Project Number Date
test_Tails_ISO_stable 4606 08 Jan 2024, 16:40

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:35.365 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.068
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.520
And I prepare Tails for memory erasure tests 0.541
When I start a process allocating 128 MiB of memory with a known pattern 2.428
Then patterns cover at least 128 MiB in the guest's memory 5.310 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.842
Then I find very few patterns in the guest's memory 5.425 
Pattern coverage: 0.000% (0 MiB out of 1222 MiB reference memory)
After features/support/hooks.rb:291 1.207
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.433
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.697
And I prepare Tails for memory erasure tests 0.477
And I find very few patterns in the guest's memory 3.875 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.265
Then patterns cover at least 99% of the test FS size in the guest's memory 3.887 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.489
Then I find very few patterns in the guest's memory 7.739 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 1.062
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:20.306
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.671
And I prepare Tails for memory erasure tests 0.513
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.898
Then I find very few patterns in the guest's memory 4.157 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:39.905
Then patterns cover at least 86% of the test FS size in the guest's memory 3.174 
Pattern coverage: 94.049% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.217
Then I find very few patterns in the guest's memory 4.463 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# read cache
When I mount the USB drive again 0.249
And I read the content of the test FS 1.570
Then patterns cover at least 99% of the test FS size in the guest's memory 3.746 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.259
Then I find very few patterns in the guest's memory 4.477 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 0.791
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:58.462
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.781
And I prepare Tails for memory erasure tests 0.494
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.890
Then I find very few patterns in the guest's memory 3.979 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:50.147
Then patterns cover at least 99% of the test FS size in the guest's memory 3.406 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.590
Then I find very few patterns in the guest's memory 4.016 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# read cache
When I mount the USB drive again 15.467
And I read the content of the test FS 0.421
Then patterns cover at least 99% of the test FS size in the guest's memory 3.236 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.112
Then I find very few patterns in the guest's memory 3.917 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 0.804
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.064
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.200
And I prepare Tails for memory erasure tests 0.513
When I fill a 128 MiB file with a known pattern on the root filesystem 17.932
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.601
Then patterns cover at least 128 MiB in the guest's memory 3.198 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.726
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.871 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 3.777
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:13.989
Before features/support/hooks.rb:245 0.010
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:29.588
And I prepare Tails for memory erasure tests 0.552
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.159
When I trigger shutdown 0.351
And I wait 20 seconds 20.006 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.330 
Pattern coverage: 0.000% (0 MiB out of 1178 MiB reference memory)
After features/support/hooks.rb:291 3.493
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:44.324
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.698
And I update APT using apt 15.931
And I install "popularity-contest" using apt 19.709
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.602
When I create a persistent storage and activate the Additional Software feature 25.684
Then Additional Software is correctly configured for package "popularity-contest" 1.407
When I shutdown Tails and wait for the computer to power off 11.099
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:42.062
Then Additional Software is correctly configured for package "popularity-contest" 0.841
And the package "popularity-contest" is installed after Additional Software has been started 0.286
After features/support/hooks.rb:450 39.905
After features/support/hooks.rb:291 1.231
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:59.263
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.240
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.243
And I update APT using apt 15.987
When I install "makepp" using apt 19.624
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:0.058
And the package "makepp" is installed 0.109
After features/support/hooks.rb:450 39.967
After features/support/hooks.rb:291 0.970
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:1.033
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:13.485
When I uninstall "popularity-contest" using apt 19.072
And I accept removing "popularity-contest" from Additional Software 0.740
Then "popularity-contest" is not in the list of Additional Software 0.821
When I start Synaptic 22.878
And I update APT using Synaptic 22.144
And I install "cowsay" using Synaptic 9.756
And I accept adding "cowsay" to Additional Software 0.857
Then Additional Software is correctly configured for package "cowsay" 0.923
When I uninstall "cowsay" using apt 3.300
And I refuse removing "cowsay" from Additional Software 0.730
Then Additional Software is correctly configured for package "cowsay" 0.922
When I start "Additional Software" via GNOME Activities Overview 12.030
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.185
Then "cowsay" is not in the list of Additional Software 1.091
When I install "cowsay" using apt 3.298
And I refuse adding "cowsay" to Additional Software 1.729
Then "cowsay" is not in the list of Additional Software 0.841
After features/support/hooks.rb:450 1.272
After features/support/hooks.rb:291 0.762
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:24.982
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.190
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:11.528
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.014
And I accept adding "cowsay" to Additional Software 1:10.304
And Additional Software is correctly configured for package "cowsay" 1.343
And I shutdown Tails and wait for the computer to power off 6.091
And I start Tails from USB drive "__internal" with network unplugged 47.833
And I enable persistence 32.036
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 21.294
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 54.212
And I revert the APT tweaks that made it prefer an old version of cowsay 0.082
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.097
And the network is plugged 0.044
And Tor is ready 18.697
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.087
And available upgrades have been checked 0.170
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.036
And I can open the Additional Software configuration window from the notification 2.642
And I shutdown Tails and wait for the computer to power off 2:2.509
And I start Tails from USB drive "__internal" with network unplugged 47.607
And I enable persistence 33.916
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 30.597
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.589
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
And the network is plugged 0.038
And Tor is ready 48.604
Then the Additional Software upgrade service has started 0.166
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.102
After features/support/hooks.rb:450 2.500
After features/support/hooks.rb:291 0.871
After features/support/hooks.rb:75 0.021
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.592
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.183
And I start Tails from USB drive "__internal" with network unplugged 46.488
And I enable persistence 32.087
And I remove the "cowsay" deb files from the APT cache 0.664
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.085
And I log in to a new session 22.052
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.551
And I can open the Additional Software log file from the notification 3.298
And the package "cowsay" is not installed 0.178
After features/support/hooks.rb:450 0.122
After features/support/hooks.rb:291 1.243
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.251
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.184
When I log in to a new session in Arabic (ar) 29.235
Then the keyboard layout is set to "us" 0.154
When the network is plugged 0.038
And Tor is ready 15.573
Then I successfully start the Unsafe Browser in "ar" 26.034
And I kill the Unsafe Browser 7.195
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 36.414
And DuckDuckGo is the default search engine 10.270
And I kill the Tor Browser 5.231
And the screen keyboard works in Thunderbird 23.110
And the layout of the screen keyboard is set to "us" 0.661
After features/support/hooks.rb:291 1.198
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.591
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.408
When I log in to a new session in Chinese (zh_CN) 30.234
Then the keyboard layout is set to "cn" 0.126
When the network is plugged 0.046
And Tor is ready 15.137
Then I successfully start the Unsafe Browser in "zh_CN" 28.031
And I kill the Unsafe Browser 6.146
When I enable the screen keyboard 0.160
Then the screen keyboard works in Tor Browser 34.866
And DuckDuckGo is the default search engine 9.869
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 25.636
And the layout of the screen keyboard is set to "us" 0.637
After features/support/hooks.rb:291 1.121
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.606
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.781
When I log in to a new session in English (en) 17.314
Then the keyboard layout is set to "us" 0.124
When the network is plugged 0.051
And Tor is ready 15.836
Then I successfully start the Unsafe Browser in "en" 27.307
And I kill the Unsafe Browser 6.041
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.248
And DuckDuckGo is the default search engine 5.759
And I kill the Tor Browser 5.336
And the screen keyboard works in Thunderbird 22.049
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.071
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.699
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.831
When I log in to a new session in French (fr) 30.522
Then the keyboard layout is set to "fr" 0.147
When the network is plugged 0.048
And Tor is ready 14.320
Then I successfully start the Unsafe Browser in "fr" 29.843
And I kill the Unsafe Browser 5.892
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 33.213
And DuckDuckGo is the default search engine 9.541
And I kill the Tor Browser 5.257
And the screen keyboard works in Thunderbird 22.353
And the layout of the screen keyboard is set to "fr" 0.561
After features/support/hooks.rb:291 1.127
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.930
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.968
When I log in to a new session in German (de) 29.170
Then the keyboard layout is set to "de" 0.168
When the network is plugged 0.045
And Tor is ready 16.290
Then I successfully start the Unsafe Browser in "de" 30.636
And I kill the Unsafe Browser 5.856
When I enable the screen keyboard 0.171
Then the screen keyboard works in Tor Browser 34.201
And DuckDuckGo is the default search engine 10.500
And I kill the Tor Browser 5.747
And the screen keyboard works in Thunderbird 22.504
And the layout of the screen keyboard is set to "de" 0.669
After features/support/hooks.rb:291 1.442
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.550
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.989
When I log in to a new session in Italian (it) 29.451
Then the keyboard layout is set to "it" 0.159
When the network is plugged 0.379
And Tor is ready 14.994
Then I successfully start the Unsafe Browser in "it" 28.962
And I kill the Unsafe Browser 5.829
When I enable the screen keyboard 0.175
Then the screen keyboard works in Tor Browser 34.919
And DuckDuckGo is the default search engine 9.801
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 20.929
And the layout of the screen keyboard is set to "us" 0.669
After features/support/hooks.rb:291 3.130
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.765
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.068
When I log in to a new session in Persian (fa) 27.846
Then the keyboard layout is set to "ir" 0.151
When the network is plugged 0.045
And Tor is ready 14.743
Then I successfully start the Unsafe Browser in "fa" 29.359
And I kill the Unsafe Browser 5.878
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 36.755
And DuckDuckGo is the default search engine 10.055
And I kill the Tor Browser 5.288
And the screen keyboard works in Thunderbird 24.752
And the layout of the screen keyboard is set to "ir" 0.664
After features/support/hooks.rb:291 1.093
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.334
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.039
When I log in to a new session in Portuguese (pt) 31.829
Then the keyboard layout is set to "pt" 0.135
When the network is plugged 0.033
And Tor is ready 16.152
Then I successfully start the Unsafe Browser in "pt" 26.913
And I kill the Unsafe Browser 5.914
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 35.386
And DuckDuckGo is the default search engine 9.940
And I kill the Tor Browser 5.512
And the screen keyboard works in Thunderbird 22.689
And the layout of the screen keyboard is set to "us" 0.637
After features/support/hooks.rb:291 1.748
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.239
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.169
When I log in to a new session in Russian (ru) 31.815
Then the keyboard layout is set to "ru" 0.120
When the network is plugged 0.054
And Tor is ready 17.188
Then I successfully start the Unsafe Browser in "ru" 27.883
And I kill the Unsafe Browser 7.480
When I enable the screen keyboard 0.183
Then the screen keyboard works in Tor Browser 35.919
And DuckDuckGo is the default search engine 11.650
And I kill the Tor Browser 5.598
And the screen keyboard works in Thunderbird 25.571
And the layout of the screen keyboard is set to "ru" 0.603
After features/support/hooks.rb:291 2.663
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.982
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.518
When I log in to a new session in Spanish (es) 28.987
Then the keyboard layout is set to "es" 0.293
When the network is plugged 0.129
And Tor is ready 16.083
Then I successfully start the Unsafe Browser in "es" 25.345
And I kill the Unsafe Browser 6.268
When I enable the screen keyboard 0.170
Then the screen keyboard works in Tor Browser 36.054
And DuckDuckGo is the default search engine 9.943
And I kill the Tor Browser 5.317
And the screen keyboard works in Thunderbird 23.150
And the layout of the screen keyboard is set to "us" 0.719
After features/support/hooks.rb:291 1.479
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.892
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.660
When I log in to a new session in Turkish (tr) 28.405
Then the keyboard layout is set to "tr" 0.306
When the network is plugged 0.044
And Tor is ready 15.524
Then I successfully start the Unsafe Browser in "tr" 26.536
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 34.324
And DuckDuckGo is the default search engine 9.874
And I kill the Tor Browser 5.279
And the screen keyboard works in Thunderbird 23.329
And the layout of the screen keyboard is set to "us" 0.675
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000