Project Number Date
test_Tails_ISO_stable 4642 28 Jan 2024, 12:17

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:34.714 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
16.883
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.845
And I prepare Tails for memory erasure tests 0.474
When I start a process allocating 128 MiB of memory with a known pattern 1.373
Then patterns cover at least 128 MiB in the guest's memory 3.391 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.263
Then I find very few patterns in the guest's memory 3.535 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 1.132
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
56.876
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.362
And I prepare Tails for memory erasure tests 0.479
And I find very few patterns in the guest's memory 3.860 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.302
Then patterns cover at least 99% of the test FS size in the guest's memory 2.951 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.218
Then I find very few patterns in the guest's memory 3.702 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 0.743
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:51.647
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.686
And I prepare Tails for memory erasure tests 0.491
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.885
Then I find very few patterns in the guest's memory 4.383 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3:16.507
Then patterns cover at least 86% of the test FS size in the guest's memory 3.101 
Pattern coverage: 97.808% (121 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.493
Then I find very few patterns in the guest's memory 3.554 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
# read cache
When I mount the USB drive again 0.310
And I read the content of the test FS 0.515
Then patterns cover at least 99% of the test FS size in the guest's memory 2.765 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.315
Then I find very few patterns in the guest's memory 4.636 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 0.795
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:3.463
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.553
And I prepare Tails for memory erasure tests 0.442
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.492
Then I find very few patterns in the guest's memory 3.331 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:7.276
Then patterns cover at least 99% of the test FS size in the guest's memory 2.333 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.584
Then I find very few patterns in the guest's memory 3.253 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 3.583
And I read the content of the test FS 0.415
Then patterns cover at least 99% of the test FS size in the guest's memory 2.497 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.470
Then I find very few patterns in the guest's memory 3.227 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 0.847
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.863
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.342
And I prepare Tails for memory erasure tests 0.455
When I fill a 128 MiB file with a known pattern on the root filesystem 14.975
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.364
Then patterns cover at least 128 MiB in the guest's memory 2.410 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.592
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.702 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 3.456
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:44.621
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:2.563
And I prepare Tails for memory erasure tests 0.434
When I fill a 128 MiB file with a known pattern on the persistent filesystem 19.329
When I trigger shutdown 0.238
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.035 
Pattern coverage: 0.000% (0 MiB out of 1176 MiB reference memory)
After features/support/hooks.rb:291 3.451
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:14.398
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 47.770
And I update APT using apt 15.666
And I install "popularity-contest" using apt 19.843
Then I am proposed to add the "popularity-contest" package to my Additional Software 51.867
When I create a persistent storage and activate the Additional Software feature 16.044
Then Additional Software is correctly configured for package "popularity-contest" 1.348
When I shutdown Tails and wait for the computer to power off 11.138
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:29.575
Then Additional Software is correctly configured for package "popularity-contest" 0.856
And the package "popularity-contest" is installed after Additional Software has been started 0.289
After features/support/hooks.rb:450 34.496
After features/support/hooks.rb:291 1.144
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:45.040
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.142
And I start Tails from USB drive "__internal" and I login with an administration password 1:15.378
And I update APT using apt 16.638
When I install "makepp" using apt 19.707
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 53.095
And the package "makepp" is installed 0.077
After features/support/hooks.rb:450 38.822
After features/support/hooks.rb:291 1.033
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:35.564
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.147
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:57.072
When I uninstall "popularity-contest" using apt 15.862
And I accept removing "popularity-contest" from Additional Software 0.686
Then "popularity-contest" is not in the list of Additional Software 0.740
When I start Synaptic 22.632
And I update APT using Synaptic 21.827
And I install "cowsay" using Synaptic 8.433
And I accept adding "cowsay" to Additional Software 0.765
Then Additional Software is correctly configured for package "cowsay" 0.791
When I uninstall "cowsay" using apt 3.267
And I refuse removing "cowsay" from Additional Software 0.618
Then Additional Software is correctly configured for package "cowsay" 0.813
When I start "Additional Software" via GNOME Activities Overview 11.843
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.279
Then "cowsay" is not in the list of Additional Software 1.064
When I install "cowsay" using apt 3.312
And I refuse adding "cowsay" to Additional Software 0.671
Then "cowsay" is not in the list of Additional Software 0.733
After features/support/hooks.rb:450 0.889
After features/support/hooks.rb:291 0.656
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:18.162
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.143
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:55.400
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.511
And I accept adding "cowsay" to Additional Software 1:0.536
And Additional Software is correctly configured for package "cowsay" 1.257
And I shutdown Tails and wait for the computer to power off 5.077
And I start Tails from USB drive "__internal" with network unplugged 44.065
And I enable persistence 33.694
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 20.352
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.495
And I revert the APT tweaks that made it prefer an old version of cowsay 0.033
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.068
And the network is plugged 0.026
And Tor is ready 21.970
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.917
And available upgrades have been checked 0.079
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.004
And I can open the Additional Software configuration window from the notification 2.685
And I shutdown Tails and wait for the computer to power off 2:2.541
And I start Tails from USB drive "__internal" with network unplugged 44.067
And I enable persistence 30.966
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 21.687
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.725
And I revert the APT tweaks that made it prefer an old version of cowsay 0.070
And the network is plugged 0.046
And Tor is ready 39.416
Then the Additional Software upgrade service has started 0.176
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.074
After features/support/hooks.rb:450 2.414
After features/support/hooks.rb:291 0.966
After features/support/hooks.rb:75 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:40.612
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.178
And I start Tails from USB drive "__internal" with network unplugged 43.641
And I enable persistence 30.559
And I remove the "cowsay" deb files from the APT cache 0.561
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.078
And I log in to a new session 19.279
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.023
And I can open the Additional Software log file from the notification 2.117
And the package "cowsay" is not installed 0.172
After features/support/hooks.rb:450 0.119
After features/support/hooks.rb:291 0.656
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.461
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.687
When I log in to a new session in Arabic (ar) 27.978
Then the keyboard layout is set to "us" 0.202
When the network is plugged 0.033
And Tor is ready 14.770
Then I successfully start the Unsafe Browser in "ar" 29.715
And I kill the Unsafe Browser 5.875
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 31.533
And DuckDuckGo is the default search engine 9.333
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 21.318
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 0.977
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.254
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.024
When I log in to a new session in Chinese (zh_CN) 28.477
Then the keyboard layout is set to "cn" 0.166
When the network is plugged 0.025
And Tor is ready 15.922
Then I successfully start the Unsafe Browser in "zh_CN" 25.920
And I kill the Unsafe Browser 5.917
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 32.081
And DuckDuckGo is the default search engine 9.249
And I kill the Tor Browser 5.308
And the screen keyboard works in Thunderbird 23.443
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 1.094
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:13.032
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.799
When I log in to a new session in English (en) 14.903
Then the keyboard layout is set to "us" 0.142
When the network is plugged 0.030
And Tor is ready 14.994
Then I successfully start the Unsafe Browser in "en" 25.260
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 30.929
And DuckDuckGo is the default search engine 5.274
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 21.865
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 0.977
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.519
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.706
When I log in to a new session in French (fr) 33.300
Then the keyboard layout is set to "fr" 0.123
When the network is plugged 0.033
And Tor is ready 15.971
Then I successfully start the Unsafe Browser in "fr" 26.583
And I kill the Unsafe Browser 5.958
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 31.903
And DuckDuckGo is the default search engine 9.911
And I kill the Tor Browser 5.414
And the screen keyboard works in Thunderbird 23.927
And the layout of the screen keyboard is set to "fr" 0.569
After features/support/hooks.rb:291 1.186
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:59.354
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.877
When I log in to a new session in German (de) 27.632
Then the keyboard layout is set to "de" 0.271
When the network is plugged 0.099
And Tor is ready 44.257
Then I successfully start the Unsafe Browser in "de" 25.442
And I kill the Unsafe Browser 6.027
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 31.313
And DuckDuckGo is the default search engine 9.505
And I kill the Tor Browser 5.266
And the screen keyboard works in Thunderbird 20.987
And the layout of the screen keyboard is set to "de" 0.545
After features/support/hooks.rb:291 1.225
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.798
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.812
When I log in to a new session in Italian (it) 27.512
Then the keyboard layout is set to "it" 0.181
When the network is plugged 0.037
And Tor is ready 31.245
Then I successfully start the Unsafe Browser in "it" 26.252
And I kill the Unsafe Browser 7.197
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 32.446
And DuckDuckGo is the default search engine 9.554
And I kill the Tor Browser 5.334
And the screen keyboard works in Thunderbird 23.432
And the layout of the screen keyboard is set to "us" 0.647
After features/support/hooks.rb:291 1.072
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.427
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.892
When I log in to a new session in Persian (fa) 28.025
Then the keyboard layout is set to "ir" 0.213
When the network is plugged 0.032
And Tor is ready 15.026
Then I successfully start the Unsafe Browser in "fa" 30.574
And I kill the Unsafe Browser 5.771
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 33.267
And DuckDuckGo is the default search engine 10.068
And I kill the Tor Browser 5.612
And the screen keyboard works in Thunderbird 22.280
And the layout of the screen keyboard is set to "ir" 0.533
After features/support/hooks.rb:291 1.685
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.952
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.990
When I log in to a new session in Portuguese (pt) 31.743
Then the keyboard layout is set to "pt" 0.234
When the network is plugged 0.028
And Tor is ready 14.610
Then I successfully start the Unsafe Browser in "pt" 27.057
And I kill the Unsafe Browser 5.806
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 32.275
And DuckDuckGo is the default search engine 10.134
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 22.957
And the layout of the screen keyboard is set to "us" 0.614
After features/support/hooks.rb:291 1.770
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.973
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.302
When I log in to a new session in Russian (ru) 30.867
Then the keyboard layout is set to "ru" 0.157
When the network is plugged 0.022
And Tor is ready 15.401
Then I successfully start the Unsafe Browser in "ru" 27.655
And I kill the Unsafe Browser 5.796
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 33.020
And DuckDuckGo is the default search engine 9.558
And I kill the Tor Browser 5.568
And the screen keyboard works in Thunderbird 23.864
And the layout of the screen keyboard is set to "ru" 0.606
After features/support/hooks.rb:291 2.371
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.391
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.986
When I log in to a new session in Spanish (es) 28.349
Then the keyboard layout is set to "es" 0.201
When the network is plugged 0.027
And Tor is ready 14.637
Then I successfully start the Unsafe Browser in "es" 28.623
And I kill the Unsafe Browser 5.837
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 31.007
And DuckDuckGo is the default search engine 9.589
And I kill the Tor Browser 5.329
And the screen keyboard works in Thunderbird 22.036
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 3.174
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.416
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.836
When I log in to a new session in Turkish (tr) 28.044
Then the keyboard layout is set to "tr" 0.134
When the network is plugged 0.020
And Tor is ready 14.898
Then I successfully start the Unsafe Browser in "tr" 27.368
And I kill the Unsafe Browser 6.350
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 33.564
And DuckDuckGo is the default search engine 9.681
And I kill the Tor Browser 5.282
And the screen keyboard works in Thunderbird 21.535
And the layout of the screen keyboard is set to "us" 0.609
After features/support/hooks.rb:291 2.210
After features/support/hooks.rb:75 0.000