Project Number Date
test_Tails_ISO_stable 4700 05 Mar 2024, 17:20

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:1:56.104 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.182
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.650
And I prepare Tails for memory erasure tests 0.429
When I start a process allocating 128 MiB of memory with a known pattern 1.179
Then patterns cover at least 128 MiB in the guest's memory 3.554 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.260
Then I find very few patterns in the guest's memory 4.107 
Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)
After features/support/hooks.rb:291 0.640
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.615
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.984
And I prepare Tails for memory erasure tests 0.413
And I find very few patterns in the guest's memory 4.053 
Pattern coverage: 0.000% (0 MiB out of 915 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.542
Then patterns cover at least 99% of the test FS size in the guest's memory 3.274 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.393
Then I find very few patterns in the guest's memory 3.952 
Pattern coverage: 0.000% (0 MiB out of 915 MiB reference memory)
After features/support/hooks.rb:291 1.053
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
39.686
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.071
And I prepare Tails for memory erasure tests 0.417
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.787
Then I find very few patterns in the guest's memory 3.710 
Pattern coverage: 0.000% (0 MiB out of 905 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.444
Then patterns cover at least 86% of the test FS size in the guest's memory 3.799 
Pattern coverage: 94.698% (120 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.861
Then I find very few patterns in the guest's memory 4.176 
Pattern coverage: 0.000% (0 MiB out of 905 MiB reference memory)
# read cache
When I mount the USB drive again 0.193
And I read the content of the test FS 0.528
Then patterns cover at least 99% of the test FS size in the guest's memory 3.518 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.644
Then I find very few patterns in the guest's memory 4.532 
Pattern coverage: 0.000% (0 MiB out of 905 MiB reference memory)
After features/support/hooks.rb:291 2.606
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.913
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.082
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.952
Then I find very few patterns in the guest's memory 3.763 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.509
Then patterns cover at least 99% of the test FS size in the guest's memory 3.175 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.635
Then I find very few patterns in the guest's memory 3.560 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
# read cache
When I mount the USB drive again 3.595
And I read the content of the test FS 1.334
Then patterns cover at least 99% of the test FS size in the guest's memory 3.451 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.444
Then I find very few patterns in the guest's memory 3.958 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
After features/support/hooks.rb:291 0.810
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.540
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.093
And I prepare Tails for memory erasure tests 0.426
When I fill a 128 MiB file with a known pattern on the root filesystem 13.614
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.825
Then patterns cover at least 128 MiB in the guest's memory 2.708 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.846 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
After features/support/hooks.rb:291 3.515
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:50.424
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:6.826
And I prepare Tails for memory erasure tests 0.471
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.779
When I trigger shutdown 0.014
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.313 
Pattern coverage: 0.000% (0 MiB out of 956 MiB reference memory)
After features/support/hooks.rb:291 3.642
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:50.295
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.794
And I update APT using apt 18.159
And I install "popularity-contest" using apt 19.139
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.691
When I create a persistent storage and activate the Additional Software feature 19.543
Then Additional Software is correctly configured for package "popularity-contest" 1.459
When I shutdown Tails and wait for the computer to power off 10.218
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:42.200
Then Additional Software is correctly configured for package "popularity-contest" 0.866
And the package "popularity-contest" is installed after Additional Software has been started 0.223
After features/support/hooks.rb:450 40.208
After features/support/hooks.rb:291 1.090
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:14.524
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.011
Given a computer 0.197
And I start Tails from USB drive "__internal" and I login with an administration password 1:29.197
And I update APT using apt 19.272
When I install "makepp" using apt 19.285
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.478
And the package "makepp" is installed 0.093
After features/support/hooks.rb:450 39.412
After features/support/hooks.rb:291 0.932
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:57.643
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.182
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:16.506
When I uninstall "popularity-contest" using apt 18.697
And I accept removing "popularity-contest" from Additional Software 0.569
Then "popularity-contest" is not in the list of Additional Software 0.705
When I start Synaptic 21.739
And I update APT using Synaptic 22.130
And I install "cowsay" using Synaptic 8.563
And I accept adding "cowsay" to Additional Software 1.388
Then Additional Software is correctly configured for package "cowsay" 0.835
When I uninstall "cowsay" using apt 3.220
And I refuse removing "cowsay" from Additional Software 0.572
Then Additional Software is correctly configured for package "cowsay" 0.731
When I start "Additional Software" via GNOME Activities Overview 10.616
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.773
Then "cowsay" is not in the list of Additional Software 0.957
When I install "cowsay" using apt 3.239
And I refuse adding "cowsay" to Additional Software 0.573
Then "cowsay" is not in the list of Additional Software 0.638
After features/support/hooks.rb:450 1.197
After features/support/hooks.rb:291 0.714
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:16.934
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.209
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:26.243
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 22.880
And I accept adding "cowsay" to Additional Software 5.484
And Additional Software is correctly configured for package "cowsay" 0.849
And I shutdown Tails and wait for the computer to power off 5.022
And I start Tails from USB drive "__internal" with network unplugged 53.646
And I enable persistence 29.898
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.031
And I log in to a new session 34.188
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.768
And I revert the APT tweaks that made it prefer an old version of cowsay 0.061
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.040
And Tor is ready 17.770
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.000
And available upgrades have been checked 0.395
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.438
And I can open the Additional Software configuration window from the notification 2.962
And I shutdown Tails and wait for the computer to power off 2:6.525
And I start Tails from USB drive "__internal" with network unplugged 54.023
And I enable persistence 33.512
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 34.049
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.349
And I revert the APT tweaks that made it prefer an old version of cowsay 0.067
And the network is plugged 0.035
And Tor is ready 39.077
Then the Additional Software upgrade service has started 0.188
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.086
After features/support/hooks.rb:450 2.343
After features/support/hooks.rb:291 0.904
After features/support/hooks.rb:75 0.036
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:21.597
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.185
And I start Tails from USB drive "__internal" with network unplugged 55.752
And I enable persistence 30.321
And I remove the "cowsay" deb files from the APT cache 0.558
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.066
And I log in to a new session 34.648
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.767
And I can open the Additional Software log file from the notification 5.697
And the package "cowsay" is not installed 0.600
After features/support/hooks.rb:450 0.105
After features/support/hooks.rb:291 0.627
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.168
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.899
When I log in to a new session in Arabic (ar) 28.754
Then the keyboard layout is set to "us" 0.118
When the network is plugged 0.029
And Tor is ready 13.036
Then I successfully start the Unsafe Browser in "ar" 13.224
And I kill the Unsafe Browser 5.722
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 35.145
And DuckDuckGo is the default search engine 10.731
And I kill the Tor Browser 5.527
And the screen keyboard works in Thunderbird 21.319
And the layout of the screen keyboard is set to "us" 0.544
After features/support/hooks.rb:291 0.943
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.877
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.343
When I log in to a new session in Chinese (zh_CN) 30.036
Then the keyboard layout is set to "cn" 0.138
When the network is plugged 0.034
And Tor is ready 15.495
Then I successfully start the Unsafe Browser in "zh_CN" 13.419
And I kill the Unsafe Browser 5.711
When I enable the screen keyboard 0.210
Then the screen keyboard works in Tor Browser 35.484
And DuckDuckGo is the default search engine 10.785
And I kill the Tor Browser 5.423
And the screen keyboard works in Thunderbird 25.222
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.762
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:2.391
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.014
When I log in to a new session in English (en) 15.808
Then the keyboard layout is set to "us" 0.141
When the network is plugged 0.037
And Tor is ready 14.103
Then I successfully start the Unsafe Browser in "en" 13.748
And I kill the Unsafe Browser 5.924
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 33.176
And DuckDuckGo is the default search engine 5.250
And I kill the Tor Browser 5.245
And the screen keyboard works in Thunderbird 20.264
And the layout of the screen keyboard is set to "us" 0.576
After features/support/hooks.rb:291 0.956
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.732
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.159
When I log in to a new session in French (fr) 28.601
Then the keyboard layout is set to "fr" 0.212
When the network is plugged 0.029
And Tor is ready 15.906
Then I successfully start the Unsafe Browser in "fr" 13.363
And I kill the Unsafe Browser 5.663
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 33.092
And DuckDuckGo is the default search engine 10.996
And I kill the Tor Browser 5.472
And the screen keyboard works in Thunderbird 21.535
And the layout of the screen keyboard is set to "fr" 0.584
After features/support/hooks.rb:291 1.743
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.410
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.039
When I log in to a new session in German (de) 29.186
Then the keyboard layout is set to "de" 0.239
When the network is plugged 0.033
And Tor is ready 14.191
Then I successfully start the Unsafe Browser in "de" 13.398
And I kill the Unsafe Browser 5.777
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 33.765
And DuckDuckGo is the default search engine 10.579
And I kill the Tor Browser 5.534
And the screen keyboard works in Thunderbird 20.997
And the layout of the screen keyboard is set to "de" 0.541
After features/support/hooks.rb:291 3.113
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.782
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.781
When I log in to a new session in Italian (it) 30.642
Then the keyboard layout is set to "it" 0.166
When the network is plugged 0.028
And Tor is ready 13.374
Then I successfully start the Unsafe Browser in "it" 13.813
And I kill the Unsafe Browser 5.761
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 33.758
And DuckDuckGo is the default search engine 10.685
And I kill the Tor Browser 5.476
And the screen keyboard works in Thunderbird 22.536
And the layout of the screen keyboard is set to "us" 0.664
After features/support/hooks.rb:291 1.069
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.143
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.432
When I log in to a new session in Persian (fa) 28.640
Then the keyboard layout is set to "ir" 0.101
When the network is plugged 0.039
And Tor is ready 14.510
Then I successfully start the Unsafe Browser in "fa" 12.649
And I kill the Unsafe Browser 5.852
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 34.982
And DuckDuckGo is the default search engine 11.128
And I kill the Tor Browser 5.577
And the screen keyboard works in Thunderbird 21.584
And the layout of the screen keyboard is set to "ir" 0.552
After features/support/hooks.rb:291 1.823
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.833
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.800
When I log in to a new session in Portuguese (pt) 30.633
Then the keyboard layout is set to "pt" 0.142
When the network is plugged 0.033
And Tor is ready 14.974
Then I successfully start the Unsafe Browser in "pt" 13.748
And I kill the Unsafe Browser 5.830
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 33.151
And DuckDuckGo is the default search engine 10.917
And I kill the Tor Browser 5.426
And the screen keyboard works in Thunderbird 20.536
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.098
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.968
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.031
When I log in to a new session in Russian (ru) 29.650
Then the keyboard layout is set to "ru" 0.123
When the network is plugged 0.030
And Tor is ready 15.620
Then I successfully start the Unsafe Browser in "ru" 12.768
And I kill the Unsafe Browser 5.698
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 35.207
And DuckDuckGo is the default search engine 11.019
And I kill the Tor Browser 5.415
And the screen keyboard works in Thunderbird 21.736
And the layout of the screen keyboard is set to "ru" 0.546
After features/support/hooks.rb:291 2.418
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.516
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.880
When I log in to a new session in Spanish (es) 30.763
Then the keyboard layout is set to "es" 0.183
When the network is plugged 0.024
And Tor is ready 17.186
Then I successfully start the Unsafe Browser in "es" 13.280
And I kill the Unsafe Browser 5.732
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 35.547
And DuckDuckGo is the default search engine 10.375
And I kill the Tor Browser 5.541
And the screen keyboard works in Thunderbird 22.356
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:291 2.210
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.920
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.846
When I log in to a new session in Turkish (tr) 29.936
Then the keyboard layout is set to "tr" 0.169
When the network is plugged 0.034
And Tor is ready 14.728
Then I successfully start the Unsafe Browser in "tr" 13.009
And I kill the Unsafe Browser 5.915
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 32.739
And DuckDuckGo is the default search engine 10.855
And I kill the Tor Browser 5.537
And the screen keyboard works in Thunderbird 21.433
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:291 2.141
After features/support/hooks.rb:75 0.000