Project Number Date
test_Tails_ISO_devel 3320 14 Mar 2024, 12:31

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:21:37.472 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.013
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.047
And I prepare Tails for memory erasure tests 0.571
When I start a process allocating 128 MiB of memory with a known pattern 1.252
Then patterns cover at least 128 MiB in the guest's memory 3.389 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.062
Then I find very few patterns in the guest's memory 3.689 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
After features/support/hooks.rb:291 0.933
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.597
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.229
And I prepare Tails for memory erasure tests 0.576
And I find very few patterns in the guest's memory 4.468 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.502
Then patterns cover at least 99% of the test FS size in the guest's memory 3.853 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.338
Then I find very few patterns in the guest's memory 4.627 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
After features/support/hooks.rb:291 0.996
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
56.067
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.983
And I prepare Tails for memory erasure tests 0.473
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.964
Then I find very few patterns in the guest's memory 4.699 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.590
Then patterns cover at least 86% of the test FS size in the guest's memory 11.225 
Pattern coverage: 98.981% (126 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.328
Then I find very few patterns in the guest's memory 9.117 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
# read cache
When I mount the USB drive again 0.245
And I read the content of the test FS 0.779
Then patterns cover at least 99% of the test FS size in the guest's memory 3.881 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.581
Then I find very few patterns in the guest's memory 4.195 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
After features/support/hooks.rb:291 0.751
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.753
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.188
And I prepare Tails for memory erasure tests 0.475
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.148
Then I find very few patterns in the guest's memory 4.006 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.806
Then patterns cover at least 99% of the test FS size in the guest's memory 3.391 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.658
Then I find very few patterns in the guest's memory 4.076 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
# read cache
When I mount the USB drive again 5.688
And I read the content of the test FS 0.322
Then patterns cover at least 99% of the test FS size in the guest's memory 4.482 
Pattern coverage: 106.115% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.560
Then I find very few patterns in the guest's memory 3.947 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
After features/support/hooks.rb:291 0.814
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.518
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.711
And I prepare Tails for memory erasure tests 0.455
When I fill a 128 MiB file with a known pattern on the root filesystem 14.139
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.185
Then patterns cover at least 128 MiB in the guest's memory 3.176 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.815 
Pattern coverage: 0.000% (0 MiB out of 929 MiB reference memory)
After features/support/hooks.rb:291 3.514
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:43.014
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:57.530
And I prepare Tails for memory erasure tests 0.428
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.780
When I trigger shutdown 0.011
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.244 
Pattern coverage: 0.000% (0 MiB out of 952 MiB reference memory)
After features/support/hooks.rb:291 3.544
After features/support/hooks.rb:75 0.039
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
2:46.876
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:28.753
And I update APT using apt 17.802
When I install "popularity-contest" using apt 22.369
Then I am notified I can not use Additional Software for "popularity-contest" 9.508
And I can open the Additional Software documentation from the notification 28.442
After features/support/hooks.rb:450 42.852
After features/support/hooks.rb:291 2.924
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:7.791
Before features/support/hooks.rb:245 0.009
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 55.846
And I update APT using apt 17.291
And I install "popularity-contest" using apt 19.285
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.651
When I create a persistent storage and activate the Additional Software feature 19.739
Then Additional Software is correctly configured for package "popularity-contest" 2.389
When I shutdown Tails and wait for the computer to power off 13.334
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:52.164
Then Additional Software is correctly configured for package "popularity-contest" 0.830
And the package "popularity-contest" is installed after Additional Software has been started 0.259
After features/support/hooks.rb:450 41.614
After features/support/hooks.rb:291 1.233
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:12.087
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.254
And I start Tails from USB drive "__internal" and I login with an administration password 1:29.526
And I update APT using apt 16.491
When I install "makepp" using apt 19.174
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.568
And the package "makepp" is installed 0.072
After features/support/hooks.rb:450 41.438
After features/support/hooks.rb:291 0.996
After features/support/hooks.rb:75 0.039
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:11.374
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.009
Given a computer 0.329
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:27.198
When I uninstall "popularity-contest" using apt 18.674
And I accept removing "popularity-contest" from Additional Software 0.506
Then "popularity-contest" is not in the list of Additional Software 0.736
When I start Synaptic 25.701
And I update APT using Synaptic 22.228
And I install "cowsay" using Synaptic 9.051
And I accept adding "cowsay" to Additional Software 1.163
Then Additional Software is correctly configured for package "cowsay" 0.898
When I uninstall "cowsay" using apt 3.207
And I refuse removing "cowsay" from Additional Software 0.513
Then Additional Software is correctly configured for package "cowsay" 0.827
When I start "Additional Software" via GNOME Activities Overview 10.623
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.468
Then "cowsay" is not in the list of Additional Software 0.884
When I install "cowsay" using apt 3.188
And I refuse adding "cowsay" to Additional Software 0.522
Then "cowsay" is not in the list of Additional Software 0.649
After features/support/hooks.rb:450 1.043
After features/support/hooks.rb:291 0.800
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:9.320
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.007
Given a computer 0.213
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:32.032
And I configure APT to prefer an old version of cowsay 0.028
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.182
And I accept adding "cowsay" to Additional Software 8.759
And Additional Software is correctly configured for package "cowsay" 0.918
And I shutdown Tails and wait for the computer to power off 6.121
And I start Tails from USB drive "__internal" with network unplugged 54.539
And I enable persistence 30.877
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.029
And I log in to a new session 33.388
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.760
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.072
And the network is plugged 0.043
And Tor is ready 47.955
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.864
And available upgrades have been checked 0.120
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.127
And I can open the Additional Software configuration window from the notification 3.294
And I shutdown Tails and wait for the computer to power off 2:2.386
And I start Tails from USB drive "__internal" with network unplugged 55.706
And I enable persistence 31.432
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 34.815
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.057
And I revert the APT tweaks that made it prefer an old version of cowsay 0.053
And the network is plugged 0.049
And Tor is ready 51.139
Then the Additional Software upgrade service has started 0.181
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.083
After features/support/hooks.rb:450 2.978
After features/support/hooks.rb:291 1.167
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:22.489
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.203
And I start Tails from USB drive "__internal" with network unplugged 54.505
And I enable persistence 32.573
And I remove the "cowsay" deb files from the APT cache 0.619
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.098
And I log in to a new session 35.406
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 12.974
And I can open the Additional Software log file from the notification 5.393
And the package "cowsay" is not installed 0.713
After features/support/hooks.rb:450 0.137
After features/support/hooks.rb:291 0.999
After features/support/hooks.rb:75 0.012
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:53.676
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.100
When I log in to a new session in Arabic (ar) 29.525
Then the keyboard layout is set to "us" 0.115
When the network is plugged 0.049
And Tor is ready 42.937
Then I successfully start the Unsafe Browser in "ar" 13.367
And I kill the Unsafe Browser 5.874
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 35.436
And DuckDuckGo is the default search engine 11.427
And I kill the Tor Browser 5.468
And the screen keyboard works in Thunderbird 20.693
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.311
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:3.798
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.355
When I log in to a new session in Chinese (zh_CN) 31.674
Then the keyboard layout is set to "cn" 0.314
When the network is plugged 0.047
And Tor is ready 43.255
Then I successfully start the Unsafe Browser in "zh_CN" 14.257
And I kill the Unsafe Browser 5.745
When I enable the screen keyboard 0.161
Then the screen keyboard works in Tor Browser 37.001
And DuckDuckGo is the default search engine 11.383
And I kill the Tor Browser 5.451
And the screen keyboard works in Thunderbird 25.529
And the layout of the screen keyboard is set to "us" 0.619
After features/support/hooks.rb:291 1.397
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.999
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.360
When I log in to a new session in English (en) 15.902
Then the keyboard layout is set to "us" 0.221
When the network is plugged 0.050
And Tor is ready 42.481
Then I successfully start the Unsafe Browser in "en" 14.566
And I kill the Unsafe Browser 5.840
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 34.164
And DuckDuckGo is the default search engine 5.598
And I kill the Tor Browser 5.264
And the screen keyboard works in Thunderbird 20.853
And the layout of the screen keyboard is set to "us" 0.595
After features/support/hooks.rb:291 1.857
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.160
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.296
When I log in to a new session in French (fr) 30.553
Then the keyboard layout is set to "fr" 0.204
When the network is plugged 0.053
And Tor is ready 15.772
Then I successfully start the Unsafe Browser in "fr" 14.343
And I kill the Unsafe Browser 5.826
When I enable the screen keyboard 0.418
Then the screen keyboard works in Tor Browser 35.690
And DuckDuckGo is the default search engine 10.772
And I kill the Tor Browser 5.554
And the screen keyboard works in Thunderbird 21.002
And the layout of the screen keyboard is set to "fr" 0.669
After features/support/hooks.rb:291 1.373
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.952
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.553
When I log in to a new session in German (de) 29.129
Then the keyboard layout is set to "de" 0.145
When the network is plugged 0.037
And Tor is ready 14.266
Then I successfully start the Unsafe Browser in "de" 14.245
And I kill the Unsafe Browser 5.689
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 35.353
And DuckDuckGo is the default search engine 22.954
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 21.328
And the layout of the screen keyboard is set to "de" 0.628
After features/support/hooks.rb:291 1.124
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.867
Before features/support/hooks.rb:245 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.226
When I log in to a new session in Italian (it) 29.737
Then the keyboard layout is set to "it" 0.126
When the network is plugged 0.043
And Tor is ready 13.702
Then I successfully start the Unsafe Browser in "it" 13.440
And I kill the Unsafe Browser 5.746
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 33.967
And DuckDuckGo is the default search engine 23.347
And I kill the Tor Browser 5.553
And the screen keyboard works in Thunderbird 21.285
And the layout of the screen keyboard is set to "us" 0.596
After features/support/hooks.rb:291 1.200
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.827
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.328
When I log in to a new session in Persian (fa) 31.520
Then the keyboard layout is set to "ir" 0.148
When the network is plugged 0.041
And Tor is ready 13.992
Then I successfully start the Unsafe Browser in "fa" 14.555
And I kill the Unsafe Browser 5.797
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 36.309
And DuckDuckGo is the default search engine 21.212
And I kill the Tor Browser 5.521
And the screen keyboard works in Thunderbird 21.682
And the layout of the screen keyboard is set to "ir" 0.626
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.484
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.717
When I log in to a new session in Portuguese (pt) 32.029
Then the keyboard layout is set to "pt" 0.219
When the network is plugged 0.035
And Tor is ready 43.726
Then I successfully start the Unsafe Browser in "pt" 13.281
And I kill the Unsafe Browser 5.845
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.082
And DuckDuckGo is the default search engine 11.167
And I kill the Tor Browser 5.491
And the screen keyboard works in Thunderbird 20.212
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 2.333
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.584
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.197
When I log in to a new session in Russian (ru) 29.971
Then the keyboard layout is set to "ru" 0.244
When the network is plugged 0.049
And Tor is ready 15.542
Then I successfully start the Unsafe Browser in "ru" 13.505
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 34.447
And DuckDuckGo is the default search engine 11.273
And I kill the Tor Browser 5.536
And the screen keyboard works in Thunderbird 23.214
And the layout of the screen keyboard is set to "ru" 0.665
After features/support/hooks.rb:291 2.717
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.866
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.116
When I log in to a new session in Spanish (es) 31.334
Then the keyboard layout is set to "es" 0.173
When the network is plugged 0.037
And Tor is ready 16.725
Then I successfully start the Unsafe Browser in "es" 13.689
And I kill the Unsafe Browser 5.771
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 34.686
And DuckDuckGo is the default search engine 11.563
And I kill the Tor Browser 5.502
And the screen keyboard works in Thunderbird 20.617
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 3.152
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.688
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.503
When I log in to a new session in Turkish (tr) 30.103
Then the keyboard layout is set to "tr" 0.138
When the network is plugged 0.039
And Tor is ready 19.816
Then I successfully start the Unsafe Browser in "tr" 13.880
And I kill the Unsafe Browser 5.747
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 34.512
And DuckDuckGo is the default search engine 11.697
And I kill the Tor Browser 5.484
And the screen keyboard works in Thunderbird 21.104
And the layout of the screen keyboard is set to "us" 0.563
After features/support/hooks.rb:291 1.075
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:12.660
When the network is plugged 0.038
And I wait 720 seconds 12:0.084 
Slept for 720 seconds
Then I successfully configure Tor 12.472
And the time has synced 0.065
After features/support/hooks.rb:291 1.384
After features/support/hooks.rb:75 0.000