Project Number Date
test_Tails_ISO_stable 4650 01 Feb 2024, 18:42

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:48.532 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.404
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.109
And I prepare Tails for memory erasure tests 0.644
When I start a process allocating 128 MiB of memory with a known pattern 1.212
Then patterns cover at least 128 MiB in the guest's memory 3.410 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.277
Then I find very few patterns in the guest's memory 3.749 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 0.734
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.788
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.814
And I prepare Tails for memory erasure tests 0.626
And I find very few patterns in the guest's memory 3.826 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.225
Then patterns cover at least 99% of the test FS size in the guest's memory 3.162 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.346
Then I find very few patterns in the guest's memory 3.786 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
After features/support/hooks.rb:291 2.217
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:57.178
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.361
And I prepare Tails for memory erasure tests 0.656
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.931
Then I find very few patterns in the guest's memory 3.838 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:17.400
Then patterns cover at least 86% of the test FS size in the guest's memory 3.355 
Pattern coverage: 94.014% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.478
Then I find very few patterns in the guest's memory 3.821 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
# read cache
When I mount the USB drive again 0.407
And I read the content of the test FS 0.672
Then patterns cover at least 99% of the test FS size in the guest's memory 3.422 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.362
Then I find very few patterns in the guest's memory 6.468 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
After features/support/hooks.rb:291 1.337
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:49.412
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.140
And I prepare Tails for memory erasure tests 0.683
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.714
Then I find very few patterns in the guest's memory 4.144 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:54.358
Then patterns cover at least 99% of the test FS size in the guest's memory 2.979 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.572
Then I find very few patterns in the guest's memory 3.517 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
# read cache
When I mount the USB drive again 3.026
And I read the content of the test FS 0.709
Then patterns cover at least 99% of the test FS size in the guest's memory 2.835 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.423
Then I find very few patterns in the guest's memory 3.307 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 1.181
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.732
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 7.723
And I prepare Tails for memory erasure tests 0.637
When I fill a 128 MiB file with a known pattern on the root filesystem 12.899
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.366
Then patterns cover at least 128 MiB in the guest's memory 2.350 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.895
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.839 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 3.484
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:1.317
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:17.318
And I prepare Tails for memory erasure tests 0.442
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.088
When I trigger shutdown 0.244
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.204 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 3.503
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:37.653
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.012
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.453
And I update APT using apt 17.101
And I install "popularity-contest" using apt 23.011
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.051
When I create a persistent storage and activate the Additional Software feature 17.734
Then Additional Software is correctly configured for package "popularity-contest" 1.530
When I shutdown Tails and wait for the computer to power off 11.097
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.327
Then Additional Software is correctly configured for package "popularity-contest" 1.015
And the package "popularity-contest" is installed after Additional Software has been started 0.331
After features/support/hooks.rb:450 41.053
After features/support/hooks.rb:291 1.040
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:37.290
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.210
And I start Tails from USB drive "__internal" and I login with an administration password 1:55.802
And I update APT using apt 17.070
When I install "makepp" using apt 19.986
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:4.134
And the package "makepp" is installed 0.085
After features/support/hooks.rb:450 41.552
After features/support/hooks.rb:291 0.925
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:4.499
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.006
Given a computer 0.281
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:15.611
When I uninstall "popularity-contest" using apt 19.073
And I accept removing "popularity-contest" from Additional Software 0.619
Then "popularity-contest" is not in the list of Additional Software 0.798
When I start Synaptic 24.334
And I update APT using Synaptic 22.313
And I install "cowsay" using Synaptic 9.481
And I accept adding "cowsay" to Additional Software 0.837
Then Additional Software is correctly configured for package "cowsay" 0.997
When I uninstall "cowsay" using apt 3.343
And I refuse removing "cowsay" from Additional Software 2.067
Then Additional Software is correctly configured for package "cowsay" 0.941
When I start "Additional Software" via GNOME Activities Overview 12.551
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.085
Then "cowsay" is not in the list of Additional Software 1.127
When I install "cowsay" using apt 3.357
And I refuse adding "cowsay" to Additional Software 0.841
Then "cowsay" is not in the list of Additional Software 0.833
After features/support/hooks.rb:450 1.074
After features/support/hooks.rb:291 0.864
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:19.940
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.007
Given a computer 0.235
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:6.894
And I configure APT to prefer an old version of cowsay 0.031
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.466
And I accept adding "cowsay" to Additional Software 1:8.463
And Additional Software is correctly configured for package "cowsay" 1.500
And I shutdown Tails and wait for the computer to power off 6.059
And I start Tails from USB drive "__internal" with network unplugged 1:6.232
And I enable persistence 29.701
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 23.795
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.807
And I revert the APT tweaks that made it prefer an old version of cowsay 0.067
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.101
And the network is plugged 0.054
And Tor is ready 17.468
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.212
And available upgrades have been checked 0.075
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.328
And I can open the Additional Software configuration window from the notification 2.446
And I shutdown Tails and wait for the computer to power off 2:2.517
And I start Tails from USB drive "__internal" with network unplugged 47.117
And I enable persistence 36.208
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.032
And I log in to a new session 22.514
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.167
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.049
And Tor is ready 42.026
Then the Additional Software upgrade service has started 0.169
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.114
After features/support/hooks.rb:450 2.569
After features/support/hooks.rb:291 0.731
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:51.058
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.216
And I start Tails from USB drive "__internal" with network unplugged 46.433
And I enable persistence 31.918
And I remove the "cowsay" deb files from the APT cache 0.772
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.080
And I log in to a new session 23.022
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.661
And I can open the Additional Software log file from the notification 3.774
And the package "cowsay" is not installed 0.178
After features/support/hooks.rb:450 0.146
After features/support/hooks.rb:291 1.348
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.179
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.175
When I log in to a new session in Arabic (ar) 29.201
Then the keyboard layout is set to "us" 0.158
When the network is plugged 0.041
And Tor is ready 14.024
Then I successfully start the Unsafe Browser in "ar" 27.226
And I kill the Unsafe Browser 5.739
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 34.481
And DuckDuckGo is the default search engine 9.483
And I kill the Tor Browser 5.347
And the screen keyboard works in Thunderbird 26.521
And the layout of the screen keyboard is set to "us" 0.641
After features/support/hooks.rb:291 1.998
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.654
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.946
When I log in to a new session in Chinese (zh_CN) 31.016
Then the keyboard layout is set to "cn" 0.164
When the network is plugged 0.029
And Tor is ready 16.097
Then I successfully start the Unsafe Browser in "zh_CN" 28.363
And I kill the Unsafe Browser 5.946
When I enable the screen keyboard 0.170
Then the screen keyboard works in Tor Browser 33.751
And DuckDuckGo is the default search engine 9.769
And I kill the Tor Browser 5.367
And the screen keyboard works in Thunderbird 23.399
And the layout of the screen keyboard is set to "us" 0.630
After features/support/hooks.rb:291 1.233
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.892
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.201
When I log in to a new session in English (en) 16.833
Then the keyboard layout is set to "us" 0.130
When the network is plugged 0.034
And Tor is ready 15.011
Then I successfully start the Unsafe Browser in "en" 26.740
And I kill the Unsafe Browser 5.935
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 32.154
And DuckDuckGo is the default search engine 5.404
And I kill the Tor Browser 5.297
And the screen keyboard works in Thunderbird 22.424
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 1.126
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.849
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.971
When I log in to a new session in French (fr) 29.029
Then the keyboard layout is set to "fr" 0.114
When the network is plugged 0.043
And Tor is ready 16.284
Then I successfully start the Unsafe Browser in "fr" 27.217
And I kill the Unsafe Browser 7.038
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 34.869
And DuckDuckGo is the default search engine 10.669
And I kill the Tor Browser 5.605
And the screen keyboard works in Thunderbird 22.226
And the layout of the screen keyboard is set to "fr" 0.647
After features/support/hooks.rb:291 2.307
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.368
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.194
When I log in to a new session in German (de) 29.694
Then the keyboard layout is set to "de" 0.148
When the network is plugged 0.046
And Tor is ready 15.119
Then I successfully start the Unsafe Browser in "de" 26.689
And I kill the Unsafe Browser 5.923
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 35.112
And DuckDuckGo is the default search engine 10.688
And I kill the Tor Browser 5.636
And the screen keyboard works in Thunderbird 22.400
And the layout of the screen keyboard is set to "de" 0.591
After features/support/hooks.rb:291 1.366
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.423
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.991
When I log in to a new session in Italian (it) 34.736
Then the keyboard layout is set to "it" 0.160
When the network is plugged 0.035
And Tor is ready 16.120
Then I successfully start the Unsafe Browser in "it" 26.656
And I kill the Unsafe Browser 5.939
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 35.462
And DuckDuckGo is the default search engine 10.520
And I kill the Tor Browser 5.590
And the screen keyboard works in Thunderbird 23.338
And the layout of the screen keyboard is set to "us" 0.766
After features/support/hooks.rb:291 2.089
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.842
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.117
When I log in to a new session in Persian (fa) 29.572
Then the keyboard layout is set to "ir" 0.190
When the network is plugged 0.054
And Tor is ready 14.040
Then I successfully start the Unsafe Browser in "fa" 28.049
And I kill the Unsafe Browser 5.786
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 35.331
And DuckDuckGo is the default search engine 11.411
And I kill the Tor Browser 5.691
And the screen keyboard works in Thunderbird 23.852
And the layout of the screen keyboard is set to "ir" 0.622
After features/support/hooks.rb:291 1.101
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.182
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.015
When I log in to a new session in Portuguese (pt) 32.082
Then the keyboard layout is set to "pt" 0.173
When the network is plugged 0.029
And Tor is ready 15.064
Then I successfully start the Unsafe Browser in "pt" 27.013
And I kill the Unsafe Browser 6.119
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 32.190
And DuckDuckGo is the default search engine 11.016
And I kill the Tor Browser 5.580
And the screen keyboard works in Thunderbird 23.120
And the layout of the screen keyboard is set to "us" 0.661
After features/support/hooks.rb:291 1.392
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.211
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.506
When I log in to a new session in Russian (ru) 30.970
Then the keyboard layout is set to "ru" 0.162
When the network is plugged 0.062
And Tor is ready 13.615
Then I successfully start the Unsafe Browser in "ru" 28.324
And I kill the Unsafe Browser 6.013
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 34.578
And DuckDuckGo is the default search engine 11.412
And I kill the Tor Browser 5.653
And the screen keyboard works in Thunderbird 29.153
And the layout of the screen keyboard is set to "ru" 0.613
After features/support/hooks.rb:291 1.202
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.494
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.710
When I log in to a new session in Spanish (es) 29.512
Then the keyboard layout is set to "es" 0.147
When the network is plugged 0.050
And Tor is ready 16.400
Then I successfully start the Unsafe Browser in "es" 26.138
And I kill the Unsafe Browser 6.468
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 32.440
And DuckDuckGo is the default search engine 9.981
And I kill the Tor Browser 5.272
And the screen keyboard works in Thunderbird 22.673
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 1.235
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.154
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.215
When I log in to a new session in Turkish (tr) 29.634
Then the keyboard layout is set to "tr" 0.282
When the network is plugged 0.052
And Tor is ready 15.651
Then I successfully start the Unsafe Browser in "tr" 28.219
And I kill the Unsafe Browser 5.868
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 33.984
And DuckDuckGo is the default search engine 10.255
And I kill the Tor Browser 5.593
And the screen keyboard works in Thunderbird 23.661
And the layout of the screen keyboard is set to "us" 0.600
After features/support/hooks.rb:291 1.286
After features/support/hooks.rb:75 0.000