Project Number Date
test_Tails_ISO_stable 4549 04 Dec 2023, 19:42

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:26.906 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.633
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.532
And I prepare Tails for memory erasure tests 0.728
When I start a process allocating 128 MiB of memory with a known pattern 2.271
Then patterns cover at least 128 MiB in the guest's memory 3.789 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.375
Then I find very few patterns in the guest's memory 3.935 
Pattern coverage: 0.000% (0 MiB out of 1225 MiB reference memory)
After features/support/hooks.rb:291 0.905
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:6.693
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.849
And I prepare Tails for memory erasure tests 0.459
And I find very few patterns in the guest's memory 3.878 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.874
Then patterns cover at least 99% of the test FS size in the guest's memory 3.194 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 2.170
Then I find very few patterns in the guest's memory 4.266 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 0.891
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:53.278
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.342
And I prepare Tails for memory erasure tests 0.703
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.955
Then I find very few patterns in the guest's memory 4.547 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:10.382
Then patterns cover at least 86% of the test FS size in the guest's memory 3.428 
Pattern coverage: 98.121% (122 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.456
Then I find very few patterns in the guest's memory 3.832 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 0.438
And I read the content of the test FS 0.904
Then patterns cover at least 99% of the test FS size in the guest's memory 3.209 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 3.950
Then I find very few patterns in the guest's memory 4.125 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 0.998
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:31.855
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.485
And I prepare Tails for memory erasure tests 0.646
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.620
Then I find very few patterns in the guest's memory 3.692 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:37.224
Then patterns cover at least 99% of the test FS size in the guest's memory 2.653 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.820
Then I find very few patterns in the guest's memory 3.416 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
# read cache
When I mount the USB drive again 3.431
And I read the content of the test FS 0.499
Then patterns cover at least 99% of the test FS size in the guest's memory 3.027 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.538
Then I find very few patterns in the guest's memory 3.799 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
After features/support/hooks.rb:291 2.859
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.524
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.171
And I prepare Tails for memory erasure tests 0.969
When I fill a 128 MiB file with a known pattern on the root filesystem 12.565
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.636
Then patterns cover at least 128 MiB in the guest's memory 2.971 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 2.409
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.779 
Pattern coverage: 0.000% (0 MiB out of 1234 MiB reference memory)
After features/support/hooks.rb:291 3.432
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:58.718
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:12.170
And I prepare Tails for memory erasure tests 0.447
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.651
When I trigger shutdown 0.220
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.210 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 3.475
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:55.723
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:17.259
And I update APT using apt 16.330
And I install "popularity-contest" using apt 20.262
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.133
When I create a persistent storage and activate the Additional Software feature 19.606
Then Additional Software is correctly configured for package "popularity-contest" 1.356
When I shutdown Tails and wait for the computer to power off 10.281
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.318
Then Additional Software is correctly configured for package "popularity-contest" 0.915
And the package "popularity-contest" is installed after Additional Software has been started 0.259
After features/support/hooks.rb:450 35.467
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:54.087
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.180
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.896
And I update APT using apt 16.175
When I install "makepp" using apt 19.595
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.154
And the package "makepp" is installed 0.084
After features/support/hooks.rb:450 36.815
After features/support/hooks.rb:291 0.927
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:11.946
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.009
Given a computer 0.218
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:34.137
When I uninstall "popularity-contest" using apt 15.698
And I accept removing "popularity-contest" from Additional Software 0.751
Then "popularity-contest" is not in the list of Additional Software 0.818
When I start Synaptic 19.545
And I update APT using Synaptic 22.158
And I install "cowsay" using Synaptic 9.250
And I accept adding "cowsay" to Additional Software 0.845
Then Additional Software is correctly configured for package "cowsay" 0.861
When I uninstall "cowsay" using apt 3.245
And I refuse removing "cowsay" from Additional Software 0.744
Then Additional Software is correctly configured for package "cowsay" 0.862
When I start "Additional Software" via GNOME Activities Overview 12.391
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.587
Then "cowsay" is not in the list of Additional Software 1.041
When I install "cowsay" using apt 3.254
And I refuse adding "cowsay" to Additional Software 0.751
Then "cowsay" is not in the list of Additional Software 0.782
After features/support/hooks.rb:450 0.957
After features/support/hooks.rb:291 0.728
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:41.566
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.292
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.885
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.625
And I accept adding "cowsay" to Additional Software 1:0.541
And Additional Software is correctly configured for package "cowsay" 1.273
And I shutdown Tails and wait for the computer to power off 5.060
And I start Tails from USB drive "__internal" with network unplugged 44.661
And I enable persistence 32.752
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 20.010
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.060
And I revert the APT tweaks that made it prefer an old version of cowsay 0.077
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.089
And the network is plugged 0.053
And Tor is ready 19.691
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.409
And available upgrades have been checked 0.123
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.625
And I can open the Additional Software configuration window from the notification 2.531
And I shutdown Tails and wait for the computer to power off 2:2.476
And I start Tails from USB drive "__internal" with network unplugged 44.078
And I enable persistence 32.182
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 23.744
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.458
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
And the network is plugged 0.055
And Tor is ready 39.355
Then the Additional Software upgrade service has started 0.209
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.123
After features/support/hooks.rb:450 2.472
After features/support/hooks.rb:291 1.151
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.792
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.189
And I start Tails from USB drive "__internal" with network unplugged 44.645
And I enable persistence 31.260
And I remove the "cowsay" deb files from the APT cache 0.658
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.075
And I log in to a new session 30.350
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.191
And I can open the Additional Software log file from the notification 2.247
And the package "cowsay" is not installed 0.171
After features/support/hooks.rb:450 0.114
After features/support/hooks.rb:291 1.309
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.847
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.661
When I log in to a new session in Arabic (ar) 28.838
Then the keyboard layout is set to "us" 0.120
When the network is plugged 0.037
And Tor is ready 13.968
Then I successfully start the Unsafe Browser in "ar" 25.529
And I kill the Unsafe Browser 6.535
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 33.854
And DuckDuckGo is the default search engine 9.339
And I kill the Tor Browser 5.263
And the screen keyboard works in Thunderbird 23.048
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:291 0.946
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.167
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.707
When I log in to a new session in Chinese (zh_CN) 28.713
Then the keyboard layout is set to "cn" 0.130
When the network is plugged 0.056
And Tor is ready 14.492
Then I successfully start the Unsafe Browser in "zh_CN" 25.832
And I kill the Unsafe Browser 5.820
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 33.359
And DuckDuckGo is the default search engine 9.609
And I kill the Tor Browser 5.314
And the screen keyboard works in Thunderbird 23.452
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.758
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.837
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.782
When I log in to a new session in English (en) 16.226
Then the keyboard layout is set to "us" 0.158
When the network is plugged 0.034
And Tor is ready 14.745
Then I successfully start the Unsafe Browser in "en" 25.837
And I kill the Unsafe Browser 5.904
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 31.353
And DuckDuckGo is the default search engine 5.247
And I kill the Tor Browser 5.299
And the screen keyboard works in Thunderbird 19.577
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 1.025
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.863
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.775
When I log in to a new session in French (fr) 30.531
Then the keyboard layout is set to "fr" 0.236
When the network is plugged 0.046
And Tor is ready 15.559
Then I successfully start the Unsafe Browser in "fr" 25.798
And I kill the Unsafe Browser 6.012
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 32.680
And DuckDuckGo is the default search engine 12.612
And I kill the Tor Browser 5.576
And the screen keyboard works in Thunderbird 20.326
And the layout of the screen keyboard is set to "fr" 0.557
After features/support/hooks.rb:291 1.297
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.083
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.894
When I log in to a new session in German (de) 29.393
Then the keyboard layout is set to "de" 0.180
When the network is plugged 0.033
And Tor is ready 15.677
Then I successfully start the Unsafe Browser in "de" 26.145
And I kill the Unsafe Browser 5.864
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 33.774
And DuckDuckGo is the default search engine 9.224
And I kill the Tor Browser 5.275
And the screen keyboard works in Thunderbird 21.955
And the layout of the screen keyboard is set to "de" 0.555
After features/support/hooks.rb:291 1.710
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.605
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.519
When I log in to a new session in Italian (it) 28.290
Then the keyboard layout is set to "it" 0.120
When the network is plugged 0.059
And Tor is ready 15.024
Then I successfully start the Unsafe Browser in "it" 24.949
And I kill the Unsafe Browser 7.724
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 33.958
And DuckDuckGo is the default search engine 9.193
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 20.802
And the layout of the screen keyboard is set to "us" 0.532
After features/support/hooks.rb:291 2.005
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.634
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.604
When I log in to a new session in Persian (fa) 28.440
Then the keyboard layout is set to "ir" 0.136
When the network is plugged 0.049
And Tor is ready 15.157
Then I successfully start the Unsafe Browser in "fa" 27.461
And I kill the Unsafe Browser 5.643
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 34.812
And DuckDuckGo is the default search engine 9.554
And I kill the Tor Browser 5.287
And the screen keyboard works in Thunderbird 25.796
And the layout of the screen keyboard is set to "ir" 0.538
After features/support/hooks.rb:291 1.038
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.146
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.662
When I log in to a new session in Portuguese (pt) 28.917
Then the keyboard layout is set to "pt" 0.132
When the network is plugged 0.046
And Tor is ready 13.991
Then I successfully start the Unsafe Browser in "pt" 25.306
And I kill the Unsafe Browser 5.889
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 32.882
And DuckDuckGo is the default search engine 9.055
And I kill the Tor Browser 5.279
And the screen keyboard works in Thunderbird 21.328
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 1.056
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.125
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.675
When I log in to a new session in Russian (ru) 27.745
Then the keyboard layout is set to "ru" 0.228
When the network is plugged 0.035
And Tor is ready 14.393
Then I successfully start the Unsafe Browser in "ru" 30.405
And I kill the Unsafe Browser 5.828
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 34.636
And DuckDuckGo is the default search engine 9.252
And I kill the Tor Browser 5.346
And the screen keyboard works in Thunderbird 22.894
And the layout of the screen keyboard is set to "ru" 0.572
After features/support/hooks.rb:291 2.413
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.567
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.580
When I log in to a new session in Spanish (es) 29.053
Then the keyboard layout is set to "es" 0.122
When the network is plugged 0.042
And Tor is ready 15.860
Then I successfully start the Unsafe Browser in "es" 26.201
And I kill the Unsafe Browser 5.718
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 32.694
And DuckDuckGo is the default search engine 9.123
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 22.102
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 1.058
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.206
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.982
When I log in to a new session in Turkish (tr) 28.523
Then the keyboard layout is set to "tr" 0.241
When the network is plugged 0.036
And Tor is ready 15.081
Then I successfully start the Unsafe Browser in "tr" 25.292
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 33.165
And DuckDuckGo is the default search engine 8.911
And I kill the Tor Browser 5.445
And the screen keyboard works in Thunderbird 23.958
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:291 2.580
After features/support/hooks.rb:75 0.000