Project Number Date
test_Tails_ISO_stable 4711 12 Mar 2024, 12:15

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:4:13.437 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.153
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and logged in 8.141
And I prepare Tails for memory erasure tests 0.362
When I start a process allocating 128 MiB of memory with a known pattern 2.763
Then patterns cover at least 128 MiB in the guest's memory 3.710 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.269
Then I find very few patterns in the guest's memory 3.905 
Pattern coverage: 0.000% (0 MiB out of 937 MiB reference memory)
After features/support/hooks.rb:291 0.944
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.692
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.921
And I prepare Tails for memory erasure tests 0.382
And I find very few patterns in the guest's memory 3.720 
Pattern coverage: 0.000% (0 MiB out of 944 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.401
Then patterns cover at least 99% of the test FS size in the guest's memory 3.240 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.019
Then I find very few patterns in the guest's memory 4.006 
Pattern coverage: 0.000% (0 MiB out of 944 MiB reference memory)
After features/support/hooks.rb:291 0.788
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
42.866
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.314
And I prepare Tails for memory erasure tests 0.394
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.893
Then I find very few patterns in the guest's memory 4.692 
Pattern coverage: 0.000% (0 MiB out of 921 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.484
Then patterns cover at least 86% of the test FS size in the guest's memory 4.209 
Pattern coverage: 97.037% (123 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.395
Then I find very few patterns in the guest's memory 4.160 
Pattern coverage: 0.000% (0 MiB out of 921 MiB reference memory)
# read cache
When I mount the USB drive again 0.236
And I read the content of the test FS 1.146
Then patterns cover at least 99% of the test FS size in the guest's memory 3.506 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.469
Then I find very few patterns in the guest's memory 3.960 
Pattern coverage: 0.000% (0 MiB out of 921 MiB reference memory)
After features/support/hooks.rb:291 1.257
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.019
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.244
And I prepare Tails for memory erasure tests 0.471
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.244
Then I find very few patterns in the guest's memory 4.032 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.241
Then patterns cover at least 99% of the test FS size in the guest's memory 3.403 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.897
Then I find very few patterns in the guest's memory 3.977 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
# read cache
When I mount the USB drive again 4.614
And I read the content of the test FS 0.374
Then patterns cover at least 99% of the test FS size in the guest's memory 3.100 
Pattern coverage: 106.115% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.715
Then I find very few patterns in the guest's memory 3.703 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
After features/support/hooks.rb:291 1.732
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
53.209
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.831
And I prepare Tails for memory erasure tests 0.426
When I fill a 128 MiB file with a known pattern on the root filesystem 18.311
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.077
Then patterns cover at least 128 MiB in the guest's memory 2.627 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.015
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.901 
Pattern coverage: 0.000% (0 MiB out of 940 MiB reference memory)
After features/support/hooks.rb:291 3.550
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:44.630
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:58.673
And I prepare Tails for memory erasure tests 0.449
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.347
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.127 
Pattern coverage: 0.000% (0 MiB out of 958 MiB reference memory)
After features/support/hooks.rb:291 3.479
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:10.443
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:7.519
And I update APT using apt 20.130
And I install "popularity-contest" using apt 23.284
Then I am proposed to add the "popularity-contest" package to my Additional Software 4.203
When I create a persistent storage and activate the Additional Software feature 19.996
Then Additional Software is correctly configured for package "popularity-contest" 1.280
When I shutdown Tails and wait for the computer to power off 10.062
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:42.684
Then Additional Software is correctly configured for package "popularity-contest" 0.970
And the package "popularity-contest" is installed after Additional Software has been started 0.311
After features/support/hooks.rb:450 41.890
After features/support/hooks.rb:291 1.308
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:15.222
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.216
And I start Tails from USB drive "__internal" and I login with an administration password 1:31.628
And I update APT using apt 16.376
When I install "makepp" using apt 22.578
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.350
And the package "makepp" is installed 0.072
After features/support/hooks.rb:450 43.415
After features/support/hooks.rb:291 0.775
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:37.442
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.241
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:55.306
When I uninstall "popularity-contest" using apt 15.670
And I accept removing "popularity-contest" from Additional Software 0.598
Then "popularity-contest" is not in the list of Additional Software 0.721
When I start Synaptic 24.274
And I update APT using Synaptic 22.450
And I install "cowsay" using Synaptic 9.591
And I accept adding "cowsay" to Additional Software 1.089
Then Additional Software is correctly configured for package "cowsay" 0.883
When I uninstall "cowsay" using apt 3.270
And I refuse removing "cowsay" from Additional Software 0.495
Then Additional Software is correctly configured for package "cowsay" 0.784
When I start "Additional Software" via GNOME Activities Overview 10.643
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.861
Then "cowsay" is not in the list of Additional Software 1.116
When I install "cowsay" using apt 3.240
And I refuse adding "cowsay" to Additional Software 0.484
Then "cowsay" is not in the list of Additional Software 0.718
After features/support/hooks.rb:450 1.598
After features/support/hooks.rb:291 0.730
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:52.192
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.008
Given a computer 0.204
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:28.016
And I configure APT to prefer an old version of cowsay 0.055
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.628
And I accept adding "cowsay" to Additional Software 3.392
And Additional Software is correctly configured for package "cowsay" 0.880
And I shutdown Tails and wait for the computer to power off 6.159
And I start Tails from USB drive "__internal" with network unplugged 55.308
And I enable persistence 31.288
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 36.780
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.485
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.093
And the network is plugged 0.048
And Tor is ready 22.395
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.549
And available upgrades have been checked 0.168
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.495
And I can open the Additional Software configuration window from the notification 3.345
And I shutdown Tails and wait for the computer to power off 2:2.672
And I start Tails from USB drive "__internal" with network unplugged 55.141
And I enable persistence 29.695
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 34.483
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.760
And I revert the APT tweaks that made it prefer an old version of cowsay 0.061
And the network is plugged 0.036
And Tor is ready 50.606
Then the Additional Software upgrade service has started 0.235
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.091
After features/support/hooks.rb:450 2.573
After features/support/hooks.rb:291 1.007
After features/support/hooks.rb:75 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:20.203
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.192
And I start Tails from USB drive "__internal" with network unplugged 55.478
And I enable persistence 30.101
And I remove the "cowsay" deb files from the APT cache 0.631
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.083
And I log in to a new session 33.763
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.538
And I can open the Additional Software log file from the notification 5.755
And the package "cowsay" is not installed 0.658
After features/support/hooks.rb:450 0.122
After features/support/hooks.rb:291 0.901
After features/support/hooks.rb:75 0.019
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.398
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.946
When I log in to a new session in Arabic (ar) 30.390
Then the keyboard layout is set to "us" 0.132
When the network is plugged 0.048
And Tor is ready 14.292
Then I successfully start the Unsafe Browser in "ar" 13.438
And I kill the Unsafe Browser 5.843
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 32.522
And DuckDuckGo is the default search engine 10.311
And I kill the Tor Browser 5.512
And the screen keyboard works in Thunderbird 20.310
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.284
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:56.294
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.039
When I log in to a new session in Chinese (zh_CN) 29.218
Then the keyboard layout is set to "cn" 0.195
When the network is plugged 0.043
And Tor is ready 42.964
Then I successfully start the Unsafe Browser in "zh_CN" 13.842
And I kill the Unsafe Browser 6.034
When I enable the screen keyboard 0.160
Then the screen keyboard works in Tor Browser 33.973
And DuckDuckGo is the default search engine 10.521
And I kill the Tor Browser 5.515
And the screen keyboard works in Thunderbird 25.209
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.027
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:56.535
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.877
When I log in to a new session in English (en) 14.826
Then the keyboard layout is set to "us" 0.166
When the network is plugged 0.032
And Tor is ready 13.808
Then I successfully start the Unsafe Browser in "en" 12.425
And I kill the Unsafe Browser 5.826
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 31.386
And DuckDuckGo is the default search engine 4.926
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 19.361
And the layout of the screen keyboard is set to "us" 0.530
After features/support/hooks.rb:291 0.903
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.290
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.859
When I log in to a new session in French (fr) 28.558
Then the keyboard layout is set to "fr" 0.205
When the network is plugged 0.062
And Tor is ready 14.740
Then I successfully start the Unsafe Browser in "fr" 12.921
And I kill the Unsafe Browser 6.041
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 33.058
And DuckDuckGo is the default search engine 18.886
And I kill the Tor Browser 5.701
And the screen keyboard works in Thunderbird 20.591
And the layout of the screen keyboard is set to "fr" 0.559
After features/support/hooks.rb:291 1.698
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.284
Before features/support/hooks.rb:245 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.854
When I log in to a new session in German (de) 28.619
Then the keyboard layout is set to "de" 0.236
When the network is plugged 0.033
And Tor is ready 14.927
Then I successfully start the Unsafe Browser in "de" 13.910
And I kill the Unsafe Browser 5.894
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 32.779
And DuckDuckGo is the default search engine 22.408
And I kill the Tor Browser 5.603
And the screen keyboard works in Thunderbird 19.365
And the layout of the screen keyboard is set to "de" 0.558
After features/support/hooks.rb:291 1.491
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.022
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.918
When I log in to a new session in Italian (it) 30.321
Then the keyboard layout is set to "it" 0.158
When the network is plugged 0.053
And Tor is ready 14.378
Then I successfully start the Unsafe Browser in "it" 12.433
And I kill the Unsafe Browser 6.018
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 32.014
And DuckDuckGo is the default search engine 19.086
And I kill the Tor Browser 5.511
And the screen keyboard works in Thunderbird 19.448
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.237
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.386
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.952
When I log in to a new session in Persian (fa) 30.988
Then the keyboard layout is set to "ir" 0.123
When the network is plugged 0.048
And Tor is ready 15.899
Then I successfully start the Unsafe Browser in "fa" 13.443
And I kill the Unsafe Browser 5.960
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 32.206
And DuckDuckGo is the default search engine 18.294
And I kill the Tor Browser 5.418
And the screen keyboard works in Thunderbird 21.388
And the layout of the screen keyboard is set to "ir" 0.533
After features/support/hooks.rb:291 1.121
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.865
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.826
When I log in to a new session in Portuguese (pt) 29.722
Then the keyboard layout is set to "pt" 0.147
When the network is plugged 0.041
And Tor is ready 13.140
Then I successfully start the Unsafe Browser in "pt" 13.337
And I kill the Unsafe Browser 5.672
When I enable the screen keyboard 0.079
Then the screen keyboard works in Tor Browser 32.316
And DuckDuckGo is the default search engine 9.996
And I kill the Tor Browser 5.212
And the screen keyboard works in Thunderbird 19.839
And the layout of the screen keyboard is set to "us" 0.533
After features/support/hooks.rb:291 1.294
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.488
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.888
When I log in to a new session in Russian (ru) 28.335
Then the keyboard layout is set to "ru" 0.251
When the network is plugged 0.046
And Tor is ready 14.107
Then I successfully start the Unsafe Browser in "ru" 13.425
And I kill the Unsafe Browser 5.788
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 34.762
And DuckDuckGo is the default search engine 18.301
And I kill the Tor Browser 5.462
And the screen keyboard works in Thunderbird 21.505
And the layout of the screen keyboard is set to "ru" 0.528
After features/support/hooks.rb:291 0.944
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.338
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.851
When I log in to a new session in Spanish (es) 29.815
Then the keyboard layout is set to "es" 0.238
When the network is plugged 0.052
And Tor is ready 15.368
Then I successfully start the Unsafe Browser in "es" 14.464
And I kill the Unsafe Browser 5.638
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 32.125
And DuckDuckGo is the default search engine 10.022
And I kill the Tor Browser 5.315
And the screen keyboard works in Thunderbird 19.798
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:291 1.088
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.454
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.196
When I log in to a new session in Turkish (tr) 31.400
Then the keyboard layout is set to "tr" 0.213
When the network is plugged 0.053
And Tor is ready 17.957
Then I successfully start the Unsafe Browser in "tr" 12.909
And I kill the Unsafe Browser 5.897
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 32.438
And DuckDuckGo is the default search engine 10.364
And I kill the Tor Browser 5.506
And the screen keyboard works in Thunderbird 19.819
And the layout of the screen keyboard is set to "us" 0.579
After features/support/hooks.rb:291 4.383
After features/support/hooks.rb:75 0.000