Project Number Date
test_Tails_ISO_stable 4581 21 Dec 2023, 12:09

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:16.153 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.341
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.179
And I prepare Tails for memory erasure tests 0.455
When I start a process allocating 128 MiB of memory with a known pattern 1.299
Then patterns cover at least 128 MiB in the guest's memory 3.357 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.270
Then I find very few patterns in the guest's memory 3.780 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 0.705
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.965
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.232
And I prepare Tails for memory erasure tests 0.480
And I find very few patterns in the guest's memory 3.701 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.387
Then patterns cover at least 99% of the test FS size in the guest's memory 3.045 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.507
Then I find very few patterns in the guest's memory 3.610 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
After features/support/hooks.rb:291 0.709
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:33.276
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.796
And I prepare Tails for memory erasure tests 0.452
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.844
Then I find very few patterns in the guest's memory 3.793 
Pattern coverage: 0.000% (0 MiB out of 1237 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:58.406
Then patterns cover at least 86% of the test FS size in the guest's memory 3.137 
Pattern coverage: 96.014% (119 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.498
Then I find very few patterns in the guest's memory 3.595 
Pattern coverage: 0.000% (0 MiB out of 1237 MiB reference memory)
# read cache
When I mount the USB drive again 0.247
And I read the content of the test FS 0.659
Then patterns cover at least 99% of the test FS size in the guest's memory 2.913 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.325
Then I find very few patterns in the guest's memory 3.605 
Pattern coverage: 0.000% (0 MiB out of 1237 MiB reference memory)
After features/support/hooks.rb:291 0.725
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:35.349
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.982
And I prepare Tails for memory erasure tests 0.476
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 21.002
Then I find very few patterns in the guest's memory 3.277 
Pattern coverage: 0.000% (0 MiB out of 1181 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:45.380
Then patterns cover at least 99% of the test FS size in the guest's memory 2.729 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.692
Then I find very few patterns in the guest's memory 3.107 
Pattern coverage: 0.000% (0 MiB out of 1181 MiB reference memory)
# read cache
When I mount the USB drive again 3.543
And I read the content of the test FS 0.365
Then patterns cover at least 99% of the test FS size in the guest's memory 2.666 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.919
Then I find very few patterns in the guest's memory 3.206 
Pattern coverage: 0.000% (0 MiB out of 1181 MiB reference memory)
After features/support/hooks.rb:291 0.887
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
46.256
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and logged in 8.089
And I prepare Tails for memory erasure tests 0.391
When I fill a 128 MiB file with a known pattern on the root filesystem 11.581
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.528
Then patterns cover at least 128 MiB in the guest's memory 2.424 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.524
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.705 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 3.475
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:47.774
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:4.336
And I prepare Tails for memory erasure tests 0.435
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.638
When I trigger shutdown 0.280
And I wait 20 seconds 20.008 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.076 
Pattern coverage: 0.000% (0 MiB out of 1173 MiB reference memory)
After features/support/hooks.rb:291 3.507
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:40.017
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.012
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.895
And I update APT using apt 18.844
And I install "popularity-contest" using apt 19.844
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:2.134
When I create a persistent storage and activate the Additional Software feature 20.875
Then Additional Software is correctly configured for package "popularity-contest" 1.479
When I shutdown Tails and wait for the computer to power off 10.092
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:31.526
Then Additional Software is correctly configured for package "popularity-contest" 0.991
And the package "popularity-contest" is installed after Additional Software has been started 0.330
After features/support/hooks.rb:450 38.171
After features/support/hooks.rb:291 1.458
After features/support/hooks.rb:75 0.018
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:58.947
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.007
Given a computer 0.187
And I start Tails from USB drive "__internal" and I login with an administration password 1:22.076
And I update APT using apt 16.441
When I install "makepp" using apt 19.551
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:0.616
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 40.966
After features/support/hooks.rb:291 1.013
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:58.245
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.209
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:9.643
When I uninstall "popularity-contest" using apt 18.983
And I accept removing "popularity-contest" from Additional Software 0.716
Then "popularity-contest" is not in the list of Additional Software 0.822
When I start Synaptic 23.290
And I update APT using Synaptic 21.866
And I install "cowsay" using Synaptic 11.627
And I accept adding "cowsay" to Additional Software 0.874
Then Additional Software is correctly configured for package "cowsay" 0.879
When I uninstall "cowsay" using apt 3.324
And I refuse removing "cowsay" from Additional Software 0.661
Then Additional Software is correctly configured for package "cowsay" 0.901
When I start "Additional Software" via GNOME Activities Overview 12.533
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.844
Then "cowsay" is not in the list of Additional Software 0.967
When I install "cowsay" using apt 3.352
And I refuse adding "cowsay" to Additional Software 0.822
Then "cowsay" is not in the list of Additional Software 0.922
After features/support/hooks.rb:450 1.059
After features/support/hooks.rb:291 0.856
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:33.246
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.240
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:9.735
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 28.314
And I accept adding "cowsay" to Additional Software 1:4.946
And Additional Software is correctly configured for package "cowsay" 2.201
And I shutdown Tails and wait for the computer to power off 5.286
And I start Tails from USB drive "__internal" with network unplugged 46.776
And I enable persistence 33.055
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 21.035
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.990
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.115
And the network is plugged 0.037
And Tor is ready 18.604
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.850
And available upgrades have been checked 0.180
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.646
And I can open the Additional Software configuration window from the notification 2.497
And I shutdown Tails and wait for the computer to power off 2:2.594
And I start Tails from USB drive "__internal" with network unplugged 48.411
And I enable persistence 34.081
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.034
And I log in to a new session 26.555
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.922
And I revert the APT tweaks that made it prefer an old version of cowsay 0.051
And the network is plugged 0.067
And Tor is ready 53.580
Then the Additional Software upgrade service has started 0.215
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.093
After features/support/hooks.rb:450 2.496
After features/support/hooks.rb:291 0.829
After features/support/hooks.rb:75 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.610
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.211
And I start Tails from USB drive "__internal" with network unplugged 46.473
And I enable persistence 32.591
And I remove the "cowsay" deb files from the APT cache 0.653
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.083
And I log in to a new session 22.532
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.414
And I can open the Additional Software log file from the notification 2.498
And the package "cowsay" is not installed 0.151
After features/support/hooks.rb:450 0.122
After features/support/hooks.rb:291 0.792
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.589
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.142
When I log in to a new session in Arabic (ar) 31.375
Then the keyboard layout is set to "us" 0.169
When the network is plugged 0.040
And Tor is ready 15.592
Then I successfully start the Unsafe Browser in "ar" 27.298
And I kill the Unsafe Browser 5.904
When I enable the screen keyboard 0.182
Then the screen keyboard works in Tor Browser 36.340
And DuckDuckGo is the default search engine 9.572
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 23.017
And the layout of the screen keyboard is set to "us" 0.614
After features/support/hooks.rb:291 1.055
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.263
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.305
When I log in to a new session in Chinese (zh_CN) 29.401
Then the keyboard layout is set to "cn" 0.122
When the network is plugged 0.045
And Tor is ready 14.811
Then I successfully start the Unsafe Browser in "zh_CN" 27.683
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 34.390
And DuckDuckGo is the default search engine 10.110
And I kill the Tor Browser 5.650
And the screen keyboard works in Thunderbird 24.141
And the layout of the screen keyboard is set to "us" 0.600
After features/support/hooks.rb:291 1.682
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.002
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.726
When I log in to a new session in English (en) 16.286
Then the keyboard layout is set to "us" 0.221
When the network is plugged 0.053
And Tor is ready 14.335
Then I successfully start the Unsafe Browser in "en" 29.401
And I kill the Unsafe Browser 5.830
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.883
And DuckDuckGo is the default search engine 5.558
And I kill the Tor Browser 5.395
And the screen keyboard works in Thunderbird 21.631
And the layout of the screen keyboard is set to "us" 0.542
After features/support/hooks.rb:291 0.889
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.203
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.886
When I log in to a new session in French (fr) 32.120
Then the keyboard layout is set to "fr" 0.154
When the network is plugged 0.041
And Tor is ready 18.196
Then I successfully start the Unsafe Browser in "fr" 26.773
And I kill the Unsafe Browser 6.151
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 34.285
And DuckDuckGo is the default search engine 10.508
And I kill the Tor Browser 6.138
And the screen keyboard works in Thunderbird 21.226
And the layout of the screen keyboard is set to "fr" 0.565
After features/support/hooks.rb:291 1.120
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:9.668
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.402
When I log in to a new session in German (de) 28.605
Then the keyboard layout is set to "de" 0.143
When the network is plugged 0.049
And Tor is ready 44.653
Then I successfully start the Unsafe Browser in "de" 25.954
And I kill the Unsafe Browser 7.010
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 34.889
And DuckDuckGo is the default search engine 10.045
And I kill the Tor Browser 5.761
And the screen keyboard works in Thunderbird 23.397
And the layout of the screen keyboard is set to "de" 0.624
After features/support/hooks.rb:291 1.813
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.586
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.181
When I log in to a new session in Italian (it) 30.251
Then the keyboard layout is set to "it" 0.137
When the network is plugged 0.041
And Tor is ready 17.183
Then I successfully start the Unsafe Browser in "it" 28.817
And I kill the Unsafe Browser 5.951
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 36.373
And DuckDuckGo is the default search engine 10.131
And I kill the Tor Browser 5.582
And the screen keyboard works in Thunderbird 24.155
And the layout of the screen keyboard is set to "us" 0.691
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.327
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.808
When I log in to a new session in Persian (fa) 28.608
Then the keyboard layout is set to "ir" 0.272
When the network is plugged 0.048
And Tor is ready 16.370
Then I successfully start the Unsafe Browser in "fa" 29.582
And I kill the Unsafe Browser 7.035
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 36.257
And DuckDuckGo is the default search engine 9.818
And I kill the Tor Browser 5.238
And the screen keyboard works in Thunderbird 22.622
And the layout of the screen keyboard is set to "ir" 0.540
After features/support/hooks.rb:291 1.124
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.112
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.902
When I log in to a new session in Portuguese (pt) 33.650
Then the keyboard layout is set to "pt" 0.138
When the network is plugged 0.046
And Tor is ready 15.765
Then I successfully start the Unsafe Browser in "pt" 26.132
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 34.891
And DuckDuckGo is the default search engine 10.284
And I kill the Tor Browser 5.655
And the screen keyboard works in Thunderbird 25.044
And the layout of the screen keyboard is set to "us" 0.625
After features/support/hooks.rb:291 1.231
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.032
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.169
When I log in to a new session in Russian (ru) 28.123
Then the keyboard layout is set to "ru" 0.183
When the network is plugged 0.058
And Tor is ready 13.994
Then I successfully start the Unsafe Browser in "ru" 30.102
And I kill the Unsafe Browser 6.980
When I enable the screen keyboard 0.669
Then the screen keyboard works in Tor Browser 36.749
And DuckDuckGo is the default search engine 9.855
And I kill the Tor Browser 5.509
And the screen keyboard works in Thunderbird 24.982
And the layout of the screen keyboard is set to "ru" 0.654
After features/support/hooks.rb:291 1.217
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.975
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.896
When I log in to a new session in Spanish (es) 33.981
Then the keyboard layout is set to "es" 0.378
When the network is plugged 0.046
And Tor is ready 14.474
Then I successfully start the Unsafe Browser in "es" 26.349
And I kill the Unsafe Browser 5.911
When I enable the screen keyboard 0.148
Then the screen keyboard works in Tor Browser 34.954
And DuckDuckGo is the default search engine 10.093
And I kill the Tor Browser 5.590
And the screen keyboard works in Thunderbird 24.498
And the layout of the screen keyboard is set to "us" 0.650
After features/support/hooks.rb:291 1.340
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.358
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.148
When I log in to a new session in Turkish (tr) 30.222
Then the keyboard layout is set to "tr" 0.144
When the network is plugged 0.033
And Tor is ready 15.738
Then I successfully start the Unsafe Browser in "tr" 25.979
And I kill the Unsafe Browser 5.859
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 36.166
And DuckDuckGo is the default search engine 10.494
And I kill the Tor Browser 5.636
And the screen keyboard works in Thunderbird 23.141
And the layout of the screen keyboard is set to "us" 0.662
After features/support/hooks.rb:291 1.181
After features/support/hooks.rb:75 0.000