Project Number Date
test_Tails_ISO_stable 4584 21 Dec 2023, 16:10

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:25:41.863 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.052
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.810
And I prepare Tails for memory erasure tests 0.542
When I start a process allocating 128 MiB of memory with a known pattern 1.250
Then patterns cover at least 128 MiB in the guest's memory 3.279 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.314
Then I find very few patterns in the guest's memory 3.855 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.844
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.258
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.835
And I prepare Tails for memory erasure tests 0.563
And I find very few patterns in the guest's memory 3.747 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.599
Then patterns cover at least 99% of the test FS size in the guest's memory 3.255 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.481
Then I find very few patterns in the guest's memory 3.776 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 0.690
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:49.327
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.152
And I prepare Tails for memory erasure tests 0.479
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.850
Then I find very few patterns in the guest's memory 3.885 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:12.372
Then patterns cover at least 86% of the test FS size in the guest's memory 2.940 
Pattern coverage: 93.685% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.136
Then I find very few patterns in the guest's memory 3.473 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# read cache
When I mount the USB drive again 0.245
And I read the content of the test FS 0.657
Then patterns cover at least 99% of the test FS size in the guest's memory 3.137 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.539
Then I find very few patterns in the guest's memory 4.456 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 0.865
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:23.375
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.636
And I prepare Tails for memory erasure tests 0.507
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 25.468
Then I find very few patterns in the guest's memory 3.445 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:28.135
Then patterns cover at least 99% of the test FS size in the guest's memory 2.769 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.616
Then I find very few patterns in the guest's memory 3.372 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# read cache
When I mount the USB drive again 3.289
And I read the content of the test FS 0.546
Then patterns cover at least 99% of the test FS size in the guest's memory 2.758 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.444
Then I find very few patterns in the guest's memory 3.384 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.015
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.412
Before features/support/hooks.rb:245 0.020
Given I have started Tails from DVD without network and logged in 9.224
And I prepare Tails for memory erasure tests 0.703
When I fill a 128 MiB file with a known pattern on the root filesystem 12.344
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.577
Then patterns cover at least 128 MiB in the guest's memory 2.811 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.935
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.797 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
After features/support/hooks.rb:291 3.449
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:11.714
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:29.636
And I prepare Tails for memory erasure tests 0.476
When I fill a 128 MiB file with a known pattern on the persistent filesystem 19.076
When I trigger shutdown 0.289
And I wait 20 seconds 20.003 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.232 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 3.479
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:37.567
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:30.345
And I update APT using apt 17.696
When I install "popularity-contest" using apt 20.035
Then I am notified I can not use Additional Software for "popularity-contest" 1:4.892
And I can open the Additional Software documentation from the notification 24.597
After features/support/hooks.rb:450 40.211
After features/support/hooks.rb:291 2.105
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:47.760
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.649
And I update APT using apt 16.202
And I install "popularity-contest" using apt 19.810
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:1.462
When I create a persistent storage and activate the Additional Software feature 20.209
Then Additional Software is correctly configured for package "popularity-contest" 1.502
When I shutdown Tails and wait for the computer to power off 11.145
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:41.495
Then Additional Software is correctly configured for package "popularity-contest" 1.028
And the package "popularity-contest" is installed after Additional Software has been started 0.253
After features/support/hooks.rb:450 35.301
After features/support/hooks.rb:291 1.397
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:4.612
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.351
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.970
And I update APT using apt 16.142
When I install "makepp" using apt 19.665
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:4.367
And the package "makepp" is installed 0.114
After features/support/hooks.rb:450 39.721
After features/support/hooks.rb:291 1.044
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:1.117
Before features/support/hooks.rb:245 0.009
Before features/support/hooks.rb:442 0.009
Given a computer 0.245
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:13.589
When I uninstall "popularity-contest" using apt 18.978
And I accept removing "popularity-contest" from Additional Software 0.748
Then "popularity-contest" is not in the list of Additional Software 1.000
When I start Synaptic 21.214
And I update APT using Synaptic 21.931
And I install "cowsay" using Synaptic 12.381
And I accept adding "cowsay" to Additional Software 0.924
Then Additional Software is correctly configured for package "cowsay" 1.122
When I uninstall "cowsay" using apt 3.483
And I refuse removing "cowsay" from Additional Software 0.590
Then Additional Software is correctly configured for package "cowsay" 1.063
When I start "Additional Software" via GNOME Activities Overview 12.828
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.836
Then "cowsay" is not in the list of Additional Software 1.147
When I install "cowsay" using apt 3.304
And I refuse adding "cowsay" to Additional Software 0.719
Then "cowsay" is not in the list of Additional Software 1.005
After features/support/hooks.rb:450 0.957
After features/support/hooks.rb:291 0.809
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:1.061
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.217
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:0.332
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.337
And I accept adding "cowsay" to Additional Software 1:6.509
And Additional Software is correctly configured for package "cowsay" 1.421
And I shutdown Tails and wait for the computer to power off 5.073
And I start Tails from USB drive "__internal" with network unplugged 47.362
And I enable persistence 30.863
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 24.239
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.041
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.099
And the network is plugged 0.040
And Tor is ready 17.966
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.420
And available upgrades have been checked 0.124
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.196
And I can open the Additional Software configuration window from the notification 2.700
And I shutdown Tails and wait for the computer to power off 2:2.577
And I start Tails from USB drive "__internal" with network unplugged 46.584
And I enable persistence 31.001
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 22.816
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.594
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
And the network is plugged 0.058
And Tor is ready 42.996
Then the Additional Software upgrade service has started 0.165
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.103
After features/support/hooks.rb:450 2.641
After features/support/hooks.rb:291 1.051
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:48.049
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.257
And I start Tails from USB drive "__internal" with network unplugged 45.396
And I enable persistence 32.510
And I remove the "cowsay" deb files from the APT cache 0.758
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.104
And I log in to a new session 21.708
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.672
And I can open the Additional Software log file from the notification 2.458
And the package "cowsay" is not installed 0.183
After features/support/hooks.rb:450 0.174
After features/support/hooks.rb:291 0.842
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.755
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.582
When I log in to a new session in Arabic (ar) 36.913
Then the keyboard layout is set to "us" 0.161
When the network is plugged 0.047
And Tor is ready 16.835
Then I successfully start the Unsafe Browser in "ar" 27.464
And I kill the Unsafe Browser 5.881
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 35.289
And DuckDuckGo is the default search engine 9.823
And I kill the Tor Browser 5.434
And the screen keyboard works in Thunderbird 22.548
And the layout of the screen keyboard is set to "us" 0.644
After features/support/hooks.rb:291 1.268
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:9.442
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.934
When I log in to a new session in Chinese (zh_CN) 30.157
Then the keyboard layout is set to "cn" 0.170
When the network is plugged 0.043
And Tor is ready 43.997
Then I successfully start the Unsafe Browser in "zh_CN" 27.178
And I kill the Unsafe Browser 5.899
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.091
And DuckDuckGo is the default search engine 9.262
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 24.722
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:291 1.203
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.771
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.684
When I log in to a new session in English (en) 13.524
Then the keyboard layout is set to "us" 0.204
When the network is plugged 0.054
And Tor is ready 14.826
Then I successfully start the Unsafe Browser in "en" 24.742
And I kill the Unsafe Browser 5.847
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 31.585
And DuckDuckGo is the default search engine 5.087
And I kill the Tor Browser 5.257
And the screen keyboard works in Thunderbird 21.289
And the layout of the screen keyboard is set to "us" 0.523
After features/support/hooks.rb:291 1.410
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.244
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.577
When I log in to a new session in French (fr) 33.480
Then the keyboard layout is set to "fr" 0.261
When the network is plugged 0.059
And Tor is ready 13.771
Then I successfully start the Unsafe Browser in "fr" 26.088
And I kill the Unsafe Browser 5.731
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 32.112
And DuckDuckGo is the default search engine 9.551
And I kill the Tor Browser 5.302
And the screen keyboard works in Thunderbird 21.656
And the layout of the screen keyboard is set to "fr" 0.536
After features/support/hooks.rb:291 1.302
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.244
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.636
When I log in to a new session in German (de) 26.829
Then the keyboard layout is set to "de" 0.394
When the network is plugged 0.051
And Tor is ready 14.701
Then I successfully start the Unsafe Browser in "de" 25.420
And I kill the Unsafe Browser 5.759
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 31.832
And DuckDuckGo is the default search engine 8.920
And I kill the Tor Browser 5.290
And the screen keyboard works in Thunderbird 21.717
And the layout of the screen keyboard is set to "de" 0.539
After features/support/hooks.rb:291 1.026
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.002
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.148
When I log in to a new session in Italian (it) 27.890
Then the keyboard layout is set to "it" 0.144
When the network is plugged 0.040
And Tor is ready 13.413
Then I successfully start the Unsafe Browser in "it" 26.677
And I kill the Unsafe Browser 5.886
When I enable the screen keyboard 0.078
Then the screen keyboard works in Tor Browser 32.456
And DuckDuckGo is the default search engine 9.108
And I kill the Tor Browser 5.267
And the screen keyboard works in Thunderbird 21.355
And the layout of the screen keyboard is set to "us" 0.534
After features/support/hooks.rb:291 1.168
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.614
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.563
When I log in to a new session in Persian (fa) 28.027
Then the keyboard layout is set to "ir" 0.106
When the network is plugged 0.038
And Tor is ready 14.998
Then I successfully start the Unsafe Browser in "fa" 29.145
And I kill the Unsafe Browser 5.780
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 33.952
And DuckDuckGo is the default search engine 9.191
And I kill the Tor Browser 5.263
And the screen keyboard works in Thunderbird 21.862
And the layout of the screen keyboard is set to "ir" 0.576
After features/support/hooks.rb:291 2.251
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.880
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.220
When I log in to a new session in Portuguese (pt) 28.913
Then the keyboard layout is set to "pt" 0.131
When the network is plugged 0.059
And Tor is ready 15.709
Then I successfully start the Unsafe Browser in "pt" 25.665
And I kill the Unsafe Browser 5.972
When I enable the screen keyboard 0.074
Then the screen keyboard works in Tor Browser 32.424
And DuckDuckGo is the default search engine 9.182
And I kill the Tor Browser 5.280
And the screen keyboard works in Thunderbird 20.722
And the layout of the screen keyboard is set to "us" 0.524
After features/support/hooks.rb:291 1.099
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.973
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.456
When I log in to a new session in Russian (ru) 27.876
Then the keyboard layout is set to "ru" 0.153
When the network is plugged 0.041
And Tor is ready 14.282
Then I successfully start the Unsafe Browser in "ru" 29.217
And I kill the Unsafe Browser 6.137
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.637
And DuckDuckGo is the default search engine 9.110
And I kill the Tor Browser 5.268
And the screen keyboard works in Thunderbird 23.093
And the layout of the screen keyboard is set to "ru" 0.567
After features/support/hooks.rb:291 1.285
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.872
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.527
When I log in to a new session in Spanish (es) 26.958
Then the keyboard layout is set to "es" 0.258
When the network is plugged 0.054
And Tor is ready 14.468
Then I successfully start the Unsafe Browser in "es" 25.001
And I kill the Unsafe Browser 5.902
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 32.057
And DuckDuckGo is the default search engine 9.345
And I kill the Tor Browser 5.235
And the screen keyboard works in Thunderbird 21.378
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:291 2.425
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.663
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.550
When I log in to a new session in Turkish (tr) 31.460
Then the keyboard layout is set to "tr" 0.216
When the network is plugged 0.060
And Tor is ready 15.088
Then I successfully start the Unsafe Browser in "tr" 26.228
And I kill the Unsafe Browser 5.843
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 32.178
And DuckDuckGo is the default search engine 9.648
And I kill the Tor Browser 5.269
And the screen keyboard works in Thunderbird 22.406
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 0.947
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:9.089
When the network is plugged 0.050
And I wait 720 seconds 12:0.090 
Slept for 720 seconds
Then I successfully configure Tor 8.888
And the time has synced 0.059
After features/support/hooks.rb:291 0.673
After features/support/hooks.rb:75 0.000