Project Number Date
test_Tails_ISO_stable 4629 22 Jan 2024, 15:45

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:46.119 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.851
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.843
And I prepare Tails for memory erasure tests 0.532
When I start a process allocating 128 MiB of memory with a known pattern 2.429
Then patterns cover at least 128 MiB in the guest's memory 3.189 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.544
Then I find very few patterns in the guest's memory 4.312 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 0.817
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.082
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.988
And I prepare Tails for memory erasure tests 0.697
And I find very few patterns in the guest's memory 4.147 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 41.669
Then patterns cover at least 99% of the test FS size in the guest's memory 3.625 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.281
Then I find very few patterns in the guest's memory 3.672 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 0.799
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:10.652
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.867
And I prepare Tails for memory erasure tests 0.469
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.970
Then I find very few patterns in the guest's memory 3.754 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:32.475
Then patterns cover at least 86% of the test FS size in the guest's memory 3.836 
Pattern coverage: 99.196% (123 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.798
Then I find very few patterns in the guest's memory 3.439 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# read cache
When I mount the USB drive again 0.241
And I read the content of the test FS 2.031
Then patterns cover at least 99% of the test FS size in the guest's memory 3.944 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.409
Then I find very few patterns in the guest's memory 4.414 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 1.056
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:48.894
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.967
And I prepare Tails for memory erasure tests 0.519
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.242
Then I find very few patterns in the guest's memory 3.667 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:53.372
Then patterns cover at least 99% of the test FS size in the guest's memory 2.666 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.643
Then I find very few patterns in the guest's memory 4.758 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
# read cache
When I mount the USB drive again 3.618
And I read the content of the test FS 0.726
Then patterns cover at least 99% of the test FS size in the guest's memory 3.378 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.398
Then I find very few patterns in the guest's memory 3.934 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 0.810
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.525
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.727
And I prepare Tails for memory erasure tests 0.498
When I fill a 128 MiB file with a known pattern on the root filesystem 14.109
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.355
Then patterns cover at least 128 MiB in the guest's memory 2.488 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.606
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.721 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
After features/support/hooks.rb:291 3.477
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:7.391
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:24.405
And I prepare Tails for memory erasure tests 0.411
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.116
When I trigger shutdown 0.325
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.116 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 3.474
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:41.611
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 58.959
And I update APT using apt 16.412
And I install "popularity-contest" using apt 19.775
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:1.932
When I create a persistent storage and activate the Additional Software feature 17.930
Then Additional Software is correctly configured for package "popularity-contest" 1.390
When I shutdown Tails and wait for the computer to power off 11.097
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:32.741
Then Additional Software is correctly configured for package "popularity-contest" 1.081
And the package "popularity-contest" is installed after Additional Software has been started 0.290
After features/support/hooks.rb:450 38.882
After features/support/hooks.rb:291 1.402
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:55.949
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.173
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.185
And I update APT using apt 16.185
When I install "makepp" using apt 21.728
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.602
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 40.158
After features/support/hooks.rb:291 0.865
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:47.755
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.009
Given a computer 0.254
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:4.644
When I uninstall "popularity-contest" using apt 15.872
And I accept removing "popularity-contest" from Additional Software 0.773
Then "popularity-contest" is not in the list of Additional Software 1.188
When I start Synaptic 23.555
And I update APT using Synaptic 22.552
And I install "cowsay" using Synaptic 9.430
And I accept adding "cowsay" to Additional Software 0.922
Then Additional Software is correctly configured for package "cowsay" 0.926
When I uninstall "cowsay" using apt 3.343
And I refuse removing "cowsay" from Additional Software 0.693
Then Additional Software is correctly configured for package "cowsay" 0.886
When I start "Additional Software" via GNOME Activities Overview 12.431
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.579
Then "cowsay" is not in the list of Additional Software 1.027
When I install "cowsay" using apt 3.251
And I refuse adding "cowsay" to Additional Software 0.681
Then "cowsay" is not in the list of Additional Software 0.740
After features/support/hooks.rb:450 0.957
After features/support/hooks.rb:291 0.805
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:5.883
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:11.978
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.354
And I accept adding "cowsay" to Additional Software 1:3.458
And Additional Software is correctly configured for package "cowsay" 1.317
And I shutdown Tails and wait for the computer to power off 6.073
And I start Tails from USB drive "__internal" with network unplugged 45.136
And I enable persistence 31.519
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 29.205
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.598
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.062
And the network is plugged 0.060
And Tor is ready 17.156
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.742
And available upgrades have been checked 0.200
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.949
And I can open the Additional Software configuration window from the notification 2.969
And I shutdown Tails and wait for the computer to power off 2:2.513
And I start Tails from USB drive "__internal" with network unplugged 45.813
And I enable persistence 33.461
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 22.854
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.565
And I revert the APT tweaks that made it prefer an old version of cowsay 0.070
And the network is plugged 0.057
And Tor is ready 47.094
Then the Additional Software upgrade service has started 0.199
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.128
After features/support/hooks.rb:450 2.344
After features/support/hooks.rb:291 0.873
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.939
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.190
And I start Tails from USB drive "__internal" with network unplugged 45.724
And I enable persistence 31.165
And I remove the "cowsay" deb files from the APT cache 0.691
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.091
And I log in to a new session 25.931
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.820
And I can open the Additional Software log file from the notification 2.083
And the package "cowsay" is not installed 0.240
After features/support/hooks.rb:450 0.119
After features/support/hooks.rb:291 1.301
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.088
Before features/support/hooks.rb:245 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.701
When I log in to a new session in Arabic (ar) 33.187
Then the keyboard layout is set to "us" 0.149
When the network is plugged 0.048
And Tor is ready 15.994
Then I successfully start the Unsafe Browser in "ar" 31.989
And I kill the Unsafe Browser 5.736
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 35.575
And DuckDuckGo is the default search engine 10.258
And I kill the Tor Browser 5.514
And the screen keyboard works in Thunderbird 23.126
And the layout of the screen keyboard is set to "us" 0.692
After features/support/hooks.rb:291 1.221
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:18.520
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.584
When I log in to a new session in Chinese (zh_CN) 30.276
Then the keyboard layout is set to "cn" 0.178
When the network is plugged 0.042
And Tor is ready 45.333
Then I successfully start the Unsafe Browser in "zh_CN" 27.427
And I kill the Unsafe Browser 5.881
When I enable the screen keyboard 0.168
Then the screen keyboard works in Tor Browser 36.146
And DuckDuckGo is the default search engine 10.005
And I kill the Tor Browser 5.388
And the screen keyboard works in Thunderbird 28.332
And the layout of the screen keyboard is set to "us" 0.752
After features/support/hooks.rb:291 1.141
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.685
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.997
When I log in to a new session in English (en) 17.896
Then the keyboard layout is set to "us" 0.132
When the network is plugged 0.050
And Tor is ready 14.659
Then I successfully start the Unsafe Browser in "en" 25.566
And I kill the Unsafe Browser 5.894
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 36.852
And DuckDuckGo is the default search engine 5.721
And I kill the Tor Browser 5.372
And the screen keyboard works in Thunderbird 22.702
And the layout of the screen keyboard is set to "us" 0.698
After features/support/hooks.rb:291 1.322
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.668
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.589
When I log in to a new session in French (fr) 31.234
Then the keyboard layout is set to "fr" 0.210
When the network is plugged 0.055
And Tor is ready 15.235
Then I successfully start the Unsafe Browser in "fr" 25.990
And I kill the Unsafe Browser 6.053
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 36.744
And DuckDuckGo is the default search engine 10.443
And I kill the Tor Browser 5.610
And the screen keyboard works in Thunderbird 22.724
And the layout of the screen keyboard is set to "fr" 0.622
After features/support/hooks.rb:291 1.052
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.275
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.250
When I log in to a new session in German (de) 30.999
Then the keyboard layout is set to "de" 0.249
When the network is plugged 0.037
And Tor is ready 14.228
Then I successfully start the Unsafe Browser in "de" 27.075
And I kill the Unsafe Browser 6.138
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 35.080
And DuckDuckGo is the default search engine 11.583
And I kill the Tor Browser 5.516
And the screen keyboard works in Thunderbird 20.411
And the layout of the screen keyboard is set to "de" 0.582
After features/support/hooks.rb:291 1.217
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.621
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.903
When I log in to a new session in Italian (it) 29.530
Then the keyboard layout is set to "it" 0.266
When the network is plugged 0.040
And Tor is ready 14.717
Then I successfully start the Unsafe Browser in "it" 28.895
And I kill the Unsafe Browser 6.184
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 35.330
And DuckDuckGo is the default search engine 9.857
And I kill the Tor Browser 5.281
And the screen keyboard works in Thunderbird 21.818
And the layout of the screen keyboard is set to "us" 0.655
After features/support/hooks.rb:291 1.147
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.625
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.447
When I log in to a new session in Persian (fa) 28.340
Then the keyboard layout is set to "ir" 0.143
When the network is plugged 0.062
And Tor is ready 15.466
Then I successfully start the Unsafe Browser in "fa" 29.131
And I kill the Unsafe Browser 5.997
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 35.799
And DuckDuckGo is the default search engine 10.490
And I kill the Tor Browser 5.679
And the screen keyboard works in Thunderbird 25.370
And the layout of the screen keyboard is set to "ir" 0.566
After features/support/hooks.rb:291 1.053
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.298
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.188
When I log in to a new session in Portuguese (pt) 29.081
Then the keyboard layout is set to "pt" 0.160
When the network is plugged 0.040
And Tor is ready 15.583
Then I successfully start the Unsafe Browser in "pt" 26.936
And I kill the Unsafe Browser 6.385
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 33.678
And DuckDuckGo is the default search engine 9.743
And I kill the Tor Browser 5.364
And the screen keyboard works in Thunderbird 22.489
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.195
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.745
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.055
When I log in to a new session in Russian (ru) 29.033
Then the keyboard layout is set to "ru" 0.173
When the network is plugged 0.039
And Tor is ready 15.025
Then I successfully start the Unsafe Browser in "ru" 28.000
And I kill the Unsafe Browser 5.859
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 34.472
And DuckDuckGo is the default search engine 9.600
And I kill the Tor Browser 5.350
And the screen keyboard works in Thunderbird 25.378
And the layout of the screen keyboard is set to "ru" 0.606
After features/support/hooks.rb:291 1.115
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.597
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.925
When I log in to a new session in Spanish (es) 29.958
Then the keyboard layout is set to "es" 0.123
When the network is plugged 0.029
And Tor is ready 14.605
Then I successfully start the Unsafe Browser in "es" 29.746
And I kill the Unsafe Browser 5.851
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 34.740
And DuckDuckGo is the default search engine 10.509
And I kill the Tor Browser 5.586
And the screen keyboard works in Thunderbird 21.784
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:291 1.156
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.455
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.861
When I log in to a new session in Turkish (tr) 28.951
Then the keyboard layout is set to "tr" 0.214
When the network is plugged 0.041
And Tor is ready 15.681
Then I successfully start the Unsafe Browser in "tr" 29.308
And I kill the Unsafe Browser 6.007
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 33.973
And DuckDuckGo is the default search engine 10.092
And I kill the Tor Browser 5.632
And the screen keyboard works in Thunderbird 22.014
And the layout of the screen keyboard is set to "us" 0.576
After features/support/hooks.rb:291 1.386
After features/support/hooks.rb:75 0.000