Project Number Date
test_Tails_ISO_stable 4656 08 Feb 2024, 13:03

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:10.343 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.165
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.218
And I prepare Tails for memory erasure tests 0.410
When I start a process allocating 128 MiB of memory with a known pattern 2.339
Then patterns cover at least 128 MiB in the guest's memory 3.409 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.227
Then I find very few patterns in the guest's memory 3.560 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 0.729
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.523
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.945
And I prepare Tails for memory erasure tests 0.550
And I find very few patterns in the guest's memory 3.762 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.853
Then patterns cover at least 99% of the test FS size in the guest's memory 3.576 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.308
Then I find very few patterns in the guest's memory 4.526 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
After features/support/hooks.rb:291 0.708
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:8.986
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.928
And I prepare Tails for memory erasure tests 0.512
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.873
Then I find very few patterns in the guest's memory 5.865 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:29.096
Then patterns cover at least 86% of the test FS size in the guest's memory 3.267 
Pattern coverage: 96.529% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.717
Then I find very few patterns in the guest's memory 3.839 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
# read cache
When I mount the USB drive again 1.219
And I read the content of the test FS 0.703
Then patterns cover at least 99% of the test FS size in the guest's memory 3.502 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.296
Then I find very few patterns in the guest's memory 4.162 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
After features/support/hooks.rb:291 1.004
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:49.300
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 9.057
And I prepare Tails for memory erasure tests 0.511
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.140
Then I find very few patterns in the guest's memory 3.668 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:47.361
Then patterns cover at least 99% of the test FS size in the guest's memory 3.742 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.722
Then I find very few patterns in the guest's memory 3.928 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 3.581
And I read the content of the test FS 2.472
Then patterns cover at least 99% of the test FS size in the guest's memory 3.396 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.729
Then I find very few patterns in the guest's memory 3.986 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.806
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.353
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.532
And I prepare Tails for memory erasure tests 0.524
When I fill a 128 MiB file with a known pattern on the root filesystem 13.760
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.428
Then patterns cover at least 128 MiB in the guest's memory 3.357 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.700
And I wait 20 seconds 20.003 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.044 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 3.457
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:1.312
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:15.755
And I prepare Tails for memory erasure tests 0.459
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.482
When I trigger shutdown 0.380
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.214 
Pattern coverage: 0.000% (0 MiB out of 1181 MiB reference memory)
After features/support/hooks.rb:291 3.456
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:34.830
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.423
And I update APT using apt 16.507
And I install "popularity-contest" using apt 19.648
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.019
When I create a persistent storage and activate the Additional Software feature 20.198
Then Additional Software is correctly configured for package "popularity-contest" 1.481
When I shutdown Tails and wait for the computer to power off 11.097
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:32.228
Then Additional Software is correctly configured for package "popularity-contest" 0.893
And the package "popularity-contest" is installed after Additional Software has been started 0.331
After features/support/hooks.rb:450 37.100
After features/support/hooks.rb:291 1.823
After features/support/hooks.rb:75 0.018
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:30.395
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.253
And I start Tails from USB drive "__internal" and I login with an administration password 1:51.758
And I update APT using apt 16.007
When I install "makepp" using apt 19.634
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:2.654
And the package "makepp" is installed 0.086
After features/support/hooks.rb:450 39.984
After features/support/hooks.rb:291 0.968
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:8.302
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.223
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:20.711
When I uninstall "popularity-contest" using apt 19.151
And I accept removing "popularity-contest" from Additional Software 0.728
Then "popularity-contest" is not in the list of Additional Software 0.907
When I start Synaptic 23.327
And I update APT using Synaptic 21.902
And I install "cowsay" using Synaptic 9.898
And I accept adding "cowsay" to Additional Software 0.934
Then Additional Software is correctly configured for package "cowsay" 0.893
When I uninstall "cowsay" using apt 3.336
And I refuse removing "cowsay" from Additional Software 0.726
Then Additional Software is correctly configured for package "cowsay" 0.969
When I start "Additional Software" via GNOME Activities Overview 13.414
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.072
Then "cowsay" is not in the list of Additional Software 1.207
When I install "cowsay" using apt 3.288
And I refuse adding "cowsay" to Additional Software 0.777
Then "cowsay" is not in the list of Additional Software 0.830
After features/support/hooks.rb:450 1.023
After features/support/hooks.rb:291 0.772
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:4.139
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.177
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:4.071
And I configure APT to prefer an old version of cowsay 0.032
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.670
And I accept adding "cowsay" to Additional Software 1:9.887
And Additional Software is correctly configured for package "cowsay" 1.416
And I shutdown Tails and wait for the computer to power off 6.121
And I start Tails from USB drive "__internal" with network unplugged 45.717
And I enable persistence 33.049
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.035
And I log in to a new session 28.387
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.416
And I revert the APT tweaks that made it prefer an old version of cowsay 0.084
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.132
And the network is plugged 0.120
And Tor is ready 17.945
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.135
And available upgrades have been checked 0.118
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.596
And I can open the Additional Software configuration window from the notification 2.692
And I shutdown Tails and wait for the computer to power off 2:2.902
And I start Tails from USB drive "__internal" with network unplugged 46.503
And I enable persistence 33.592
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 22.441
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.161
And I revert the APT tweaks that made it prefer an old version of cowsay 0.075
And the network is plugged 0.048
And Tor is ready 41.224
Then the Additional Software upgrade service has started 0.233
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.120
After features/support/hooks.rb:450 2.883
After features/support/hooks.rb:291 1.005
After features/support/hooks.rb:75 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:56.440
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.206
And I start Tails from USB drive "__internal" with network unplugged 47.435
And I enable persistence 33.033
And I remove the "cowsay" deb files from the APT cache 0.731
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.074
And I log in to a new session 23.099
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 7.301
And I can open the Additional Software log file from the notification 4.034
And the package "cowsay" is not installed 0.523
After features/support/hooks.rb:450 0.109
After features/support/hooks.rb:291 0.970
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.753
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.074
When I log in to a new session in Arabic (ar) 29.486
Then the keyboard layout is set to "us" 0.229
When the network is plugged 0.040
And Tor is ready 14.654
Then I successfully start the Unsafe Browser in "ar" 25.627
And I kill the Unsafe Browser 5.973
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 33.539
And DuckDuckGo is the default search engine 11.443
And I kill the Tor Browser 5.697
And the screen keyboard works in Thunderbird 24.243
And the layout of the screen keyboard is set to "us" 0.617
After features/support/hooks.rb:291 1.064
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.627
Before features/support/hooks.rb:245 0.015
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.945
When I log in to a new session in Chinese (zh_CN) 30.639
Then the keyboard layout is set to "cn" 0.173
When the network is plugged 0.026
And Tor is ready 16.223
Then I successfully start the Unsafe Browser in "zh_CN" 27.448
And I kill the Unsafe Browser 5.939
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 34.888
And DuckDuckGo is the default search engine 14.103
And I kill the Tor Browser 5.580
And the screen keyboard works in Thunderbird 26.700
And the layout of the screen keyboard is set to "us" 0.790
After features/support/hooks.rb:291 1.208
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.202
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.017
When I log in to a new session in English (en) 17.833
Then the keyboard layout is set to "us" 0.161
When the network is plugged 0.052
And Tor is ready 15.608
Then I successfully start the Unsafe Browser in "en" 27.805
And I kill the Unsafe Browser 5.780
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 32.804
And DuckDuckGo is the default search engine 5.710
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 23.368
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 1.137
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.479
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.524
When I log in to a new session in French (fr) 30.727
Then the keyboard layout is set to "fr" 0.167
When the network is plugged 0.074
And Tor is ready 15.750
Then I successfully start the Unsafe Browser in "fr" 26.703
And I kill the Unsafe Browser 5.997
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 33.199
And DuckDuckGo is the default search engine 11.431
And I kill the Tor Browser 5.695
And the screen keyboard works in Thunderbird 20.500
And the layout of the screen keyboard is set to "fr" 0.560
After features/support/hooks.rb:291 1.225
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.024
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.957
When I log in to a new session in German (de) 28.631
Then the keyboard layout is set to "de" 0.154
When the network is plugged 0.036
And Tor is ready 15.709
Then I successfully start the Unsafe Browser in "de" 28.819
And I kill the Unsafe Browser 6.032
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 31.462
And DuckDuckGo is the default search engine 10.195
And I kill the Tor Browser 5.576
And the screen keyboard works in Thunderbird 23.658
And the layout of the screen keyboard is set to "de" 0.615
After features/support/hooks.rb:291 3.872
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.761
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.549
When I log in to a new session in Italian (it) 30.173
Then the keyboard layout is set to "it" 0.169
When the network is plugged 0.041
And Tor is ready 17.038
Then I successfully start the Unsafe Browser in "it" 26.873
And I kill the Unsafe Browser 6.137
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 32.781
And DuckDuckGo is the default search engine 10.528
And I kill the Tor Browser 5.588
And the screen keyboard works in Thunderbird 22.088
And the layout of the screen keyboard is set to "us" 0.673
After features/support/hooks.rb:291 3.605
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:10.940
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.225
When I log in to a new session in Persian (fa) 29.035
Then the keyboard layout is set to "ir" 0.215
When the network is plugged 0.175
And Tor is ready 46.567
Then I successfully start the Unsafe Browser in "fa" 27.109
And I kill the Unsafe Browser 5.883
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 34.059
And DuckDuckGo is the default search engine 10.600
And I kill the Tor Browser 5.637
And the screen keyboard works in Thunderbird 22.729
And the layout of the screen keyboard is set to "ir" 0.581
After features/support/hooks.rb:291 2.215
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.476
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.969
When I log in to a new session in Portuguese (pt) 29.617
Then the keyboard layout is set to "pt" 0.154
When the network is plugged 0.059
And Tor is ready 14.397
Then I successfully start the Unsafe Browser in "pt" 26.725
And I kill the Unsafe Browser 6.004
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 33.338
And DuckDuckGo is the default search engine 10.933
And I kill the Tor Browser 5.677
And the screen keyboard works in Thunderbird 21.927
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 3.507
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.566
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.227
When I log in to a new session in Russian (ru) 28.855
Then the keyboard layout is set to "ru" 0.139
When the network is plugged 0.039
And Tor is ready 14.883
Then I successfully start the Unsafe Browser in "ru" 27.983
And I kill the Unsafe Browser 5.871
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 33.966
And DuckDuckGo is the default search engine 10.808
And I kill the Tor Browser 5.619
And the screen keyboard works in Thunderbird 25.475
And the layout of the screen keyboard is set to "ru" 0.556
After features/support/hooks.rb:291 1.100
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.215
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.496
When I log in to a new session in Spanish (es) 30.322
Then the keyboard layout is set to "es" 0.195
When the network is plugged 0.115
And Tor is ready 16.801
Then I successfully start the Unsafe Browser in "es" 27.435
And I kill the Unsafe Browser 5.987
When I enable the screen keyboard 0.188
Then the screen keyboard works in Tor Browser 33.010
And DuckDuckGo is the default search engine 10.918
And I kill the Tor Browser 5.627
And the screen keyboard works in Thunderbird 24.446
And the layout of the screen keyboard is set to "us" 0.666
After features/support/hooks.rb:291 2.312
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.545
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.810
When I log in to a new session in Turkish (tr) 28.580
Then the keyboard layout is set to "tr" 0.172
When the network is plugged 0.047
And Tor is ready 15.889
Then I successfully start the Unsafe Browser in "tr" 26.677
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 32.486
And DuckDuckGo is the default search engine 11.084
And I kill the Tor Browser 5.665
And the screen keyboard works in Thunderbird 21.541
And the layout of the screen keyboard is set to "us" 0.682
After features/support/hooks.rb:291 1.254
After features/support/hooks.rb:75 0.000