Project Number Date
test_Tails_ISO_stable 4648 31 Jan 2024, 19:34

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:30.177 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.646
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.083
And I prepare Tails for memory erasure tests 0.567
When I start a process allocating 128 MiB of memory with a known pattern 1.289
Then patterns cover at least 128 MiB in the guest's memory 3.520 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.334
Then I find very few patterns in the guest's memory 3.851 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
After features/support/hooks.rb:291 0.846
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.855
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.037
And I prepare Tails for memory erasure tests 0.554
And I find very few patterns in the guest's memory 3.829 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.025
Then patterns cover at least 99% of the test FS size in the guest's memory 3.184 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.243
Then I find very few patterns in the guest's memory 3.980 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
After features/support/hooks.rb:291 0.867
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:45.294
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 10.064
And I prepare Tails for memory erasure tests 0.537
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.868
Then I find very few patterns in the guest's memory 4.754 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:6.002
Then patterns cover at least 86% of the test FS size in the guest's memory 3.346 
Pattern coverage: 95.591% (119 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.424
Then I find very few patterns in the guest's memory 3.880 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# read cache
When I mount the USB drive again 0.327
And I read the content of the test FS 0.782
Then patterns cover at least 99% of the test FS size in the guest's memory 3.411 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.364
Then I find very few patterns in the guest's memory 4.531 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 0.954
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:26.510
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.945
And I prepare Tails for memory erasure tests 0.438
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 25.075
Then I find very few patterns in the guest's memory 4.163 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:28.088
Then patterns cover at least 99% of the test FS size in the guest's memory 2.983 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.628
Then I find very few patterns in the guest's memory 3.461 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# read cache
When I mount the USB drive again 5.053
And I read the content of the test FS 0.445
Then patterns cover at least 99% of the test FS size in the guest's memory 3.023 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.625
Then I find very few patterns in the guest's memory 3.577 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 1.915
After features/support/hooks.rb:75 0.001
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.745
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.062
And I prepare Tails for memory erasure tests 0.569
When I fill a 128 MiB file with a known pattern on the root filesystem 12.029
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.651
Then patterns cover at least 128 MiB in the guest's memory 2.926 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.723
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.761 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 3.440
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:5.271
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:21.883
And I prepare Tails for memory erasure tests 0.496
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.328
When I trigger shutdown 0.331
And I wait 20 seconds 20.011 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.219 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
After features/support/hooks.rb:291 3.493
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:0.824
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.875
And I update APT using apt 17.221
And I install "popularity-contest" using apt 22.880
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.009
When I create a persistent storage and activate the Additional Software feature 18.497
Then Additional Software is correctly configured for package "popularity-contest" 1.377
When I shutdown Tails and wait for the computer to power off 9.080
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:59.422
Then Additional Software is correctly configured for package "popularity-contest" 1.144
And the package "popularity-contest" is installed after Additional Software has been started 0.316
After features/support/hooks.rb:450 37.524
After features/support/hooks.rb:291 0.929
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:56.461
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.175
And I start Tails from USB drive "__internal" and I login with an administration password 1:22.947
And I update APT using apt 15.630
When I install "makepp" using apt 19.621
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 57.995
And the package "makepp" is installed 0.091
After features/support/hooks.rb:450 41.626
After features/support/hooks.rb:291 0.924
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:0.196
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.202
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.628
When I uninstall "popularity-contest" using apt 19.094
And I accept removing "popularity-contest" from Additional Software 0.636
Then "popularity-contest" is not in the list of Additional Software 0.824
When I start Synaptic 23.498
And I update APT using Synaptic 21.898
And I install "cowsay" using Synaptic 9.864
And I accept adding "cowsay" to Additional Software 1.309
Then Additional Software is correctly configured for package "cowsay" 1.020
When I uninstall "cowsay" using apt 3.401
And I refuse removing "cowsay" from Additional Software 0.694
Then Additional Software is correctly configured for package "cowsay" 0.942
When I start "Additional Software" via GNOME Activities Overview 12.568
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.822
Then "cowsay" is not in the list of Additional Software 1.052
When I install "cowsay" using apt 3.284
And I refuse adding "cowsay" to Additional Software 0.708
Then "cowsay" is not in the list of Additional Software 0.743
After features/support/hooks.rb:450 1.318
After features/support/hooks.rb:291 0.715
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:22.907
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.186
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.138
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.327
And I accept adding "cowsay" to Additional Software 1:10.312
And Additional Software is correctly configured for package "cowsay" 1.337
And I shutdown Tails and wait for the computer to power off 6.059
And I start Tails from USB drive "__internal" with network unplugged 48.675
And I enable persistence 31.574
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 20.479
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.397
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.097
And the network is plugged 0.074
And Tor is ready 45.212
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.533
And available upgrades have been checked 0.650
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.030
And I can open the Additional Software configuration window from the notification 2.983
And I shutdown Tails and wait for the computer to power off 13.107
And I start Tails from USB drive "__internal" with network unplugged 45.825
And I enable persistence 31.112
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.034
And I log in to a new session 24.612
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.641
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
And the network is plugged 0.053
And Tor is ready 41.001
Then the Additional Software upgrade service has started 0.170
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.115
After features/support/hooks.rb:450 2.903
After features/support/hooks.rb:291 0.717
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:46.295
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.216
And I start Tails from USB drive "__internal" with network unplugged 46.546
And I enable persistence 30.947
And I remove the "cowsay" deb files from the APT cache 0.705
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.096
And I log in to a new session 22.734
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.099
And I can open the Additional Software log file from the notification 2.534
And the package "cowsay" is not installed 0.414
After features/support/hooks.rb:450 0.106
After features/support/hooks.rb:291 1.029
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.993
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.582
When I log in to a new session in Arabic (ar) 29.344
Then the keyboard layout is set to "us" 0.245
When the network is plugged 0.049
And Tor is ready 15.832
Then I successfully start the Unsafe Browser in "ar" 28.234
And I kill the Unsafe Browser 5.851
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 32.389
And DuckDuckGo is the default search engine 11.080
And I kill the Tor Browser 5.551
And the screen keyboard works in Thunderbird 22.118
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.276
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:20.387
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.331
When I log in to a new session in Chinese (zh_CN) 29.207
Then the keyboard layout is set to "cn" 0.207
When the network is plugged 0.055
And Tor is ready 46.457
Then I successfully start the Unsafe Browser in "zh_CN" 28.841
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 33.161
And DuckDuckGo is the default search engine 10.245
And I kill the Tor Browser 5.424
And the screen keyboard works in Thunderbird 29.794
And the layout of the screen keyboard is set to "us" 0.694
After features/support/hooks.rb:291 1.850
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.829
Before features/support/hooks.rb:245 0.020
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.244
When I log in to a new session in English (en) 18.837
Then the keyboard layout is set to "us" 0.129
When the network is plugged 0.055
And Tor is ready 14.163
Then I successfully start the Unsafe Browser in "en" 25.615
And I kill the Unsafe Browser 6.229
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 31.561
And DuckDuckGo is the default search engine 5.273
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 22.689
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 3.271
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.809
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.996
When I log in to a new session in French (fr) 30.940
Then the keyboard layout is set to "fr" 0.287
When the network is plugged 0.045
And Tor is ready 15.754
Then I successfully start the Unsafe Browser in "fr" 25.865
And I kill the Unsafe Browser 6.100
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.064
And DuckDuckGo is the default search engine 10.096
And I kill the Tor Browser 5.613
And the screen keyboard works in Thunderbird 22.364
And the layout of the screen keyboard is set to "fr" 0.571
After features/support/hooks.rb:291 2.508
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.637
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.144
When I log in to a new session in German (de) 28.774
Then the keyboard layout is set to "de" 0.147
When the network is plugged 0.055
And Tor is ready 16.108
Then I successfully start the Unsafe Browser in "de" 27.471
And I kill the Unsafe Browser 5.841
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 32.463
And DuckDuckGo is the default search engine 10.046
And I kill the Tor Browser 5.520
And the screen keyboard works in Thunderbird 21.326
And the layout of the screen keyboard is set to "de" 0.572
After features/support/hooks.rb:291 1.194
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.383
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.075
When I log in to a new session in Italian (it) 29.918
Then the keyboard layout is set to "it" 0.339
When the network is plugged 0.033
And Tor is ready 14.571
Then I successfully start the Unsafe Browser in "it" 25.608
And I kill the Unsafe Browser 6.076
When I enable the screen keyboard 0.160
Then the screen keyboard works in Tor Browser 32.902
And DuckDuckGo is the default search engine 10.456
And I kill the Tor Browser 5.751
And the screen keyboard works in Thunderbird 22.863
And the layout of the screen keyboard is set to "us" 0.625
After features/support/hooks.rb:291 1.274
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.668
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.891
When I log in to a new session in Persian (fa) 28.841
Then the keyboard layout is set to "ir" 0.204
When the network is plugged 0.028
And Tor is ready 14.824
Then I successfully start the Unsafe Browser in "fa" 28.529
And I kill the Unsafe Browser 5.845
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 33.983
And DuckDuckGo is the default search engine 10.277
And I kill the Tor Browser 5.589
And the screen keyboard works in Thunderbird 23.952
And the layout of the screen keyboard is set to "ir" 0.585
After features/support/hooks.rb:291 1.076
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.014
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.525
When I log in to a new session in Portuguese (pt) 28.430
Then the keyboard layout is set to "pt" 0.148
When the network is plugged 0.127
And Tor is ready 16.755
Then I successfully start the Unsafe Browser in "pt" 27.762
And I kill the Unsafe Browser 5.847
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 33.500
And DuckDuckGo is the default search engine 10.182
And I kill the Tor Browser 5.290
And the screen keyboard works in Thunderbird 20.675
And the layout of the screen keyboard is set to "us" 0.629
After features/support/hooks.rb:291 1.045
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.945
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.171
When I log in to a new session in Russian (ru) 28.897
Then the keyboard layout is set to "ru" 0.165
When the network is plugged 0.031
And Tor is ready 15.747
Then I successfully start the Unsafe Browser in "ru" 26.304
And I kill the Unsafe Browser 5.925
When I enable the screen keyboard 0.166
Then the screen keyboard works in Tor Browser 33.582
And DuckDuckGo is the default search engine 11.734
And I kill the Tor Browser 5.662
And the screen keyboard works in Thunderbird 24.893
And the layout of the screen keyboard is set to "ru" 0.663
After features/support/hooks.rb:291 1.202
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:6.459
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.341
When I log in to a new session in Spanish (es) 28.346
Then the keyboard layout is set to "es" 0.250
When the network is plugged 0.033
And Tor is ready 45.340
Then I successfully start the Unsafe Browser in "es" 25.703
And I kill the Unsafe Browser 6.242
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 33.211
And DuckDuckGo is the default search engine 10.287
And I kill the Tor Browser 5.735
And the screen keyboard works in Thunderbird 22.068
And the layout of the screen keyboard is set to "us" 0.773
After features/support/hooks.rb:291 2.360
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.039
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.984
When I log in to a new session in Turkish (tr) 29.233
Then the keyboard layout is set to "tr" 0.313
When the network is plugged 0.034
And Tor is ready 15.366
Then I successfully start the Unsafe Browser in "tr" 27.115
And I kill the Unsafe Browser 6.041
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 32.527
And DuckDuckGo is the default search engine 12.117
And I kill the Tor Browser 5.672
And the screen keyboard works in Thunderbird 22.854
And the layout of the screen keyboard is set to "us" 0.670
After features/support/hooks.rb:291 3.237
After features/support/hooks.rb:75 0.000