Project Number Date
test_Tails_ISO_stable 4668 16 Feb 2024, 12:22

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:52.297 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.526
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.954
And I prepare Tails for memory erasure tests 0.465
When I start a process allocating 128 MiB of memory with a known pattern 1.248
Then patterns cover at least 128 MiB in the guest's memory 4.381 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.234
Then I find very few patterns in the guest's memory 5.242 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.717
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.859
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.030
And I prepare Tails for memory erasure tests 0.503
And I find very few patterns in the guest's memory 4.973 
Pattern coverage: 0.000% (0 MiB out of 1222 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.452
Then patterns cover at least 99% of the test FS size in the guest's memory 3.345 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.252
Then I find very few patterns in the guest's memory 4.302 
Pattern coverage: 0.000% (0 MiB out of 1222 MiB reference memory)
After features/support/hooks.rb:291 0.915
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:41.517
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.866
And I prepare Tails for memory erasure tests 0.527
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.977
Then I find very few patterns in the guest's memory 4.495 
Pattern coverage: 0.000% (0 MiB out of 1225 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:57.701
Then patterns cover at least 86% of the test FS size in the guest's memory 5.234 
Pattern coverage: 97.184% (121 MiB out of 124 MiB reference memory)
When I umount the USB drive 2.992
Then I find very few patterns in the guest's memory 4.462 
Pattern coverage: 0.000% (0 MiB out of 1225 MiB reference memory)
# read cache
When I mount the USB drive again 0.413
And I read the content of the test FS 0.946
Then patterns cover at least 99% of the test FS size in the guest's memory 4.037 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.685
Then I find very few patterns in the guest's memory 4.175 
Pattern coverage: 0.000% (0 MiB out of 1225 MiB reference memory)
After features/support/hooks.rb:291 0.875
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:44.987
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.543
And I prepare Tails for memory erasure tests 0.504
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.521
Then I find very few patterns in the guest's memory 3.462 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:43.923
Then patterns cover at least 99% of the test FS size in the guest's memory 2.631 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.697
Then I find very few patterns in the guest's memory 3.392 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
# read cache
When I mount the USB drive again 8.185
And I read the content of the test FS 0.535
Then patterns cover at least 99% of the test FS size in the guest's memory 2.700 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.841
Then I find very few patterns in the guest's memory 4.047 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:291 0.846
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.828
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.915
And I prepare Tails for memory erasure tests 0.644
When I fill a 128 MiB file with a known pattern on the root filesystem 12.679
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.525
Then patterns cover at least 128 MiB in the guest's memory 2.645 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.556
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.844 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:291 3.469
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:5.867
Before features/support/hooks.rb:245 0.004
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:22.497
And I prepare Tails for memory erasure tests 0.490
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.400
When I trigger shutdown 0.209
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.249 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 3.469
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:38.177
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 57.324
And I update APT using apt 16.629
And I install "popularity-contest" using apt 19.782
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.949
When I create a persistent storage and activate the Additional Software feature 19.076
Then Additional Software is correctly configured for package "popularity-contest" 1.501
When I shutdown Tails and wait for the computer to power off 10.142
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.590
Then Additional Software is correctly configured for package "popularity-contest" 0.912
And the package "popularity-contest" is installed after Additional Software has been started 0.267
After features/support/hooks.rb:450 38.056
After features/support/hooks.rb:291 1.894
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:1.776
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.220
And I start Tails from USB drive "__internal" and I login with an administration password 1:25.683
And I update APT using apt 16.165
When I install "makepp" using apt 19.695
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.829
And the package "makepp" is installed 0.181
After features/support/hooks.rb:450 41.014
After features/support/hooks.rb:291 1.109
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:3.393
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.234
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:11.913
When I uninstall "popularity-contest" using apt 18.991
And I accept removing "popularity-contest" from Additional Software 0.652
Then "popularity-contest" is not in the list of Additional Software 0.792
When I start Synaptic 23.995
And I update APT using Synaptic 22.899
And I install "cowsay" using Synaptic 11.390
And I accept adding "cowsay" to Additional Software 0.827
Then Additional Software is correctly configured for package "cowsay" 1.149
When I uninstall "cowsay" using apt 3.387
And I refuse removing "cowsay" from Additional Software 1.947
Then Additional Software is correctly configured for package "cowsay" 1.116
When I start "Additional Software" via GNOME Activities Overview 12.886
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.071
Then "cowsay" is not in the list of Additional Software 1.099
When I install "cowsay" using apt 3.347
And I refuse adding "cowsay" to Additional Software 0.799
Then "cowsay" is not in the list of Additional Software 0.889
After features/support/hooks.rb:450 1.041
After features/support/hooks.rb:291 0.860
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
13:9.481
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.621
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:14.780
And I configure APT to prefer an old version of cowsay 0.035
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.989
And I accept adding "cowsay" to Additional Software 1:8.207
And Additional Software is correctly configured for package "cowsay" 1.606
And I shutdown Tails and wait for the computer to power off 6.117
And I start Tails from USB drive "__internal" with network unplugged 45.604
And I enable persistence 33.483
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 21.507
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.103
And I revert the APT tweaks that made it prefer an old version of cowsay 0.070
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.100
And the network is plugged 0.046
And Tor is ready 47.814
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.804
And available upgrades have been checked 0.138
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.519
And I can open the Additional Software configuration window from the notification 2.937
And I shutdown Tails and wait for the computer to power off 2:3.643
And I start Tails from USB drive "__internal" with network unplugged 50.745
And I enable persistence 35.213
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 32.802
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.835
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
And the network is plugged 0.039
And Tor is ready 41.264
Then the Additional Software upgrade service has started 0.206
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.125
After features/support/hooks.rb:450 2.462
After features/support/hooks.rb:291 0.898
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.971
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.186
And I start Tails from USB drive "__internal" with network unplugged 46.425
And I enable persistence 31.774
And I remove the "cowsay" deb files from the APT cache 0.818
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.124
And I log in to a new session 23.403
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.907
And I can open the Additional Software log file from the notification 3.113
And the package "cowsay" is not installed 0.215
After features/support/hooks.rb:450 0.142
After features/support/hooks.rb:291 0.849
After features/support/hooks.rb:75 0.013
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.807
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.084
When I log in to a new session in Arabic (ar) 28.672
Then the keyboard layout is set to "us" 0.287
When the network is plugged 0.034
And Tor is ready 15.692
Then I successfully start the Unsafe Browser in "ar" 28.451
And I kill the Unsafe Browser 6.336
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 35.734
And DuckDuckGo is the default search engine 10.120
And I kill the Tor Browser 5.384
And the screen keyboard works in Thunderbird 22.227
And the layout of the screen keyboard is set to "us" 0.608
After features/support/hooks.rb:291 0.989
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:3.176
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.180
When I log in to a new session in Chinese (zh_CN) 44.781
Then the keyboard layout is set to "cn" 0.131
When the network is plugged 0.042
And Tor is ready 16.128
Then I successfully start the Unsafe Browser in "zh_CN" 30.273
And I kill the Unsafe Browser 5.789
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 33.191
And DuckDuckGo is the default search engine 10.222
And I kill the Tor Browser 5.536
And the screen keyboard works in Thunderbird 28.173
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.822
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.804
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.834
When I log in to a new session in English (en) 14.916
Then the keyboard layout is set to "us" 0.265
When the network is plugged 0.036
And Tor is ready 15.428
Then I successfully start the Unsafe Browser in "en" 26.448
And I kill the Unsafe Browser 5.788
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 31.277
And DuckDuckGo is the default search engine 5.149
And I kill the Tor Browser 5.267
And the screen keyboard works in Thunderbird 21.705
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.158
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:15.859
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.635
When I log in to a new session in French (fr) 28.393
Then the keyboard layout is set to "fr" 0.243
When the network is plugged 0.046
And Tor is ready 44.019
Then I successfully start the Unsafe Browser in "fr" 26.238
And I kill the Unsafe Browser 5.846
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 32.662
And DuckDuckGo is the default search engine 10.197
And I kill the Tor Browser 5.297
And the screen keyboard works in Thunderbird 21.580
And the layout of the screen keyboard is set to "fr" 0.580
After features/support/hooks.rb:291 1.397
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.436
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.693
When I log in to a new session in German (de) 28.561
Then the keyboard layout is set to "de" 0.109
When the network is plugged 0.046
And Tor is ready 14.251
Then I successfully start the Unsafe Browser in "de" 29.852
And I kill the Unsafe Browser 5.616
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 31.560
And DuckDuckGo is the default search engine 10.326
And I kill the Tor Browser 5.507
And the screen keyboard works in Thunderbird 21.214
And the layout of the screen keyboard is set to "de" 0.595
After features/support/hooks.rb:291 1.145
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.715
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.813
When I log in to a new session in Italian (it) 29.031
Then the keyboard layout is set to "it" 0.290
When the network is plugged 0.041
And Tor is ready 15.200
Then I successfully start the Unsafe Browser in "it" 25.614
And I kill the Unsafe Browser 6.005
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 31.614
And DuckDuckGo is the default search engine 10.491
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 21.382
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:291 2.199
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.125
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.564
When I log in to a new session in Persian (fa) 28.346
Then the keyboard layout is set to "ir" 0.214
When the network is plugged 0.045
And Tor is ready 16.324
Then I successfully start the Unsafe Browser in "fa" 26.523
And I kill the Unsafe Browser 5.912
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 32.712
And DuckDuckGo is the default search engine 10.141
And I kill the Tor Browser 5.571
And the screen keyboard works in Thunderbird 23.099
And the layout of the screen keyboard is set to "ir" 0.532
After features/support/hooks.rb:291 1.610
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.911
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.828
When I log in to a new session in Portuguese (pt) 28.549
Then the keyboard layout is set to "pt" 0.292
When the network is plugged 0.037
And Tor is ready 15.595
Then I successfully start the Unsafe Browser in "pt" 26.494
And I kill the Unsafe Browser 6.188
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 31.461
And DuckDuckGo is the default search engine 10.446
And I kill the Tor Browser 5.534
And the screen keyboard works in Thunderbird 21.813
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.049
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.329
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.725
When I log in to a new session in Russian (ru) 28.568
Then the keyboard layout is set to "ru" 0.220
When the network is plugged 0.052
And Tor is ready 16.678
Then I successfully start the Unsafe Browser in "ru" 27.532
And I kill the Unsafe Browser 5.880
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 32.686
And DuckDuckGo is the default search engine 10.285
And I kill the Tor Browser 5.582
And the screen keyboard works in Thunderbird 21.415
And the layout of the screen keyboard is set to "ru" 0.556
After features/support/hooks.rb:291 2.053
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.459
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.710
When I log in to a new session in Spanish (es) 27.936
Then the keyboard layout is set to "es" 0.157
When the network is plugged 0.066
And Tor is ready 16.280
Then I successfully start the Unsafe Browser in "es" 27.893
And I kill the Unsafe Browser 5.950
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 31.225
And DuckDuckGo is the default search engine 10.105
And I kill the Tor Browser 5.605
And the screen keyboard works in Thunderbird 20.832
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 3.726
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.284
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.117
When I log in to a new session in Turkish (tr) 28.571
Then the keyboard layout is set to "tr" 0.150
When the network is plugged 0.047
And Tor is ready 15.617
Then I successfully start the Unsafe Browser in "tr" 24.730
And I kill the Unsafe Browser 6.202
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 31.884
And DuckDuckGo is the default search engine 10.465
And I kill the Tor Browser 5.638
And the screen keyboard works in Thunderbird 21.095
And the layout of the screen keyboard is set to "us" 0.627
After features/support/hooks.rb:291 2.740
After features/support/hooks.rb:75 0.000