Project Number Date
test_Tails_ISO_stable 4545 01 Dec 2023, 12:32

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:52.603 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.818
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.922
And I prepare Tails for memory erasure tests 0.926
When I start a process allocating 128 MiB of memory with a known pattern 2.471
Then patterns cover at least 128 MiB in the guest's memory 3.788 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.559
Then I find very few patterns in the guest's memory 4.150 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 0.879
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.578
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.163
And I prepare Tails for memory erasure tests 0.835
And I find very few patterns in the guest's memory 3.831 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 45.192
Then patterns cover at least 99% of the test FS size in the guest's memory 3.137 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.454
Then I find very few patterns in the guest's memory 3.964 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 1.207
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:9.777
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.445
And I prepare Tails for memory erasure tests 0.749
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.036
Then I find very few patterns in the guest's memory 3.961 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:32.501
Then patterns cover at least 86% of the test FS size in the guest's memory 3.477 
Pattern coverage: 94.917% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.437
Then I find very few patterns in the guest's memory 3.942 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 0.444
And I read the content of the test FS 0.652
Then patterns cover at least 99% of the test FS size in the guest's memory 2.977 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.251
Then I find very few patterns in the guest's memory 3.900 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.866
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:34.872
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.699
And I prepare Tails for memory erasure tests 0.523
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.201
Then I find very few patterns in the guest's memory 3.490 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:37.814
Then patterns cover at least 99% of the test FS size in the guest's memory 3.115 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.662
Then I find very few patterns in the guest's memory 3.595 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
# read cache
When I mount the USB drive again 5.081
And I read the content of the test FS 0.431
Then patterns cover at least 99% of the test FS size in the guest's memory 2.840 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 2.128
Then I find very few patterns in the guest's memory 3.289 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
After features/support/hooks.rb:291 0.770
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.055
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.365
And I prepare Tails for memory erasure tests 0.764
When I fill a 128 MiB file with a known pattern on the root filesystem 13.574
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.432
Then patterns cover at least 128 MiB in the guest's memory 3.482 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.638
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.777 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 3.481
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:8.215
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:21.105
And I prepare Tails for memory erasure tests 0.475
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.990
When I trigger shutdown 0.386
And I wait 20 seconds 20.004 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.251 
Pattern coverage: 0.000% (0 MiB out of 1182 MiB reference memory)
After features/support/hooks.rb:291 3.487
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:35.059
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.219
And I update APT using apt 16.495
And I install "popularity-contest" using apt 19.621
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.560
When I create a persistent storage and activate the Additional Software feature 16.769
Then Additional Software is correctly configured for package "popularity-contest" 1.419
When I shutdown Tails and wait for the computer to power off 10.085
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:40.637
Then Additional Software is correctly configured for package "popularity-contest" 0.946
And the package "popularity-contest" is installed after Additional Software has been started 0.303
After features/support/hooks.rb:450 37.027
After features/support/hooks.rb:291 1.720
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:51.738
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.197
And I start Tails from USB drive "__internal" and I login with an administration password 1:18.644
And I update APT using apt 16.320
When I install "makepp" using apt 19.655
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.848
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 36.840
After features/support/hooks.rb:291 0.985
After features/support/hooks.rb:75 0.043
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:15.614
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.222
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:33.351
When I uninstall "popularity-contest" using apt 15.836
And I accept removing "popularity-contest" from Additional Software 2.228
Then "popularity-contest" is not in the list of Additional Software 0.858
When I start Synaptic 23.302
And I update APT using Synaptic 21.535
And I install "cowsay" using Synaptic 8.765
And I accept adding "cowsay" to Additional Software 0.775
Then Additional Software is correctly configured for package "cowsay" 0.862
When I uninstall "cowsay" using apt 3.367
And I refuse removing "cowsay" from Additional Software 0.770
Then Additional Software is correctly configured for package "cowsay" 1.050
When I start "Additional Software" via GNOME Activities Overview 12.463
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.553
Then "cowsay" is not in the list of Additional Software 0.967
When I install "cowsay" using apt 3.271
And I refuse adding "cowsay" to Additional Software 0.674
Then "cowsay" is not in the list of Additional Software 0.758
After features/support/hooks.rb:450 1.063
After features/support/hooks.rb:291 0.671
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:6.743
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:30.495
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.519
And I accept adding "cowsay" to Additional Software 1:2.563
And Additional Software is correctly configured for package "cowsay" 1.325
And I shutdown Tails and wait for the computer to power off 6.061
And I start Tails from USB drive "__internal" with network unplugged 45.086
And I enable persistence 34.717
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.058
And I log in to a new session 20.700
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.918
And I revert the APT tweaks that made it prefer an old version of cowsay 0.070
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.107
And the network is plugged 0.046
And Tor is ready 18.702
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.866
And available upgrades have been checked 0.060
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.633
And I can open the Additional Software configuration window from the notification 2.879
And I shutdown Tails and wait for the computer to power off 2:2.569
And I start Tails from USB drive "__internal" with network unplugged 44.946
And I enable persistence 32.186
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 28.091
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.518
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
And the network is plugged 0.049
And Tor is ready 38.872
Then the Additional Software upgrade service has started 0.249
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.133
After features/support/hooks.rb:450 2.320
After features/support/hooks.rb:291 0.661
After features/support/hooks.rb:75 0.044
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:46.655
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.197
And I start Tails from USB drive "__internal" with network unplugged 45.399
And I enable persistence 31.782
And I remove the "cowsay" deb files from the APT cache 0.618
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.073
And I log in to a new session 20.359
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.803
And I can open the Additional Software log file from the notification 3.306
And the package "cowsay" is not installed 0.115
After features/support/hooks.rb:450 0.107
After features/support/hooks.rb:291 0.823
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.305
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.200
When I log in to a new session in Arabic (ar) 30.540
Then the keyboard layout is set to "us" 0.176
When the network is plugged 0.047
And Tor is ready 14.838
Then I successfully start the Unsafe Browser in "ar" 27.219
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 34.226
And DuckDuckGo is the default search engine 9.671
And I kill the Tor Browser 5.358
And the screen keyboard works in Thunderbird 23.340
And the layout of the screen keyboard is set to "us" 0.647
After features/support/hooks.rb:291 1.315
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:14.050
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.709
When I log in to a new session in Chinese (zh_CN) 28.000
Then the keyboard layout is set to "cn" 0.127
When the network is plugged 0.039
And Tor is ready 45.213
Then I successfully start the Unsafe Browser in "zh_CN" 27.221
And I kill the Unsafe Browser 6.048
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 34.950
And DuckDuckGo is the default search engine 9.669
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 27.809
And the layout of the screen keyboard is set to "us" 0.756
After features/support/hooks.rb:291 1.098
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.863
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.100
When I log in to a new session in English (en) 16.434
Then the keyboard layout is set to "us" 0.262
When the network is plugged 0.062
And Tor is ready 16.380
Then I successfully start the Unsafe Browser in "en" 29.125
And I kill the Unsafe Browser 5.743
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 33.232
And DuckDuckGo is the default search engine 5.290
And I kill the Tor Browser 5.377
And the screen keyboard works in Thunderbird 22.110
And the layout of the screen keyboard is set to "us" 0.600
After features/support/hooks.rb:291 1.508
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:8.011
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.594
When I log in to a new session in French (fr) 28.615
Then the keyboard layout is set to "fr" 0.189
When the network is plugged 0.067
And Tor is ready 45.298
Then I successfully start the Unsafe Browser in "fr" 27.049
And I kill the Unsafe Browser 5.905
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 33.814
And DuckDuckGo is the default search engine 10.470
And I kill the Tor Browser 5.676
And the screen keyboard works in Thunderbird 21.554
And the layout of the screen keyboard is set to "fr" 0.628
After features/support/hooks.rb:291 2.286
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.596
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.378
When I log in to a new session in German (de) 31.560
Then the keyboard layout is set to "de" 0.209
When the network is plugged 0.048
And Tor is ready 14.779
Then I successfully start the Unsafe Browser in "de" 25.482
And I kill the Unsafe Browser 5.940
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 32.777
And DuckDuckGo is the default search engine 9.755
And I kill the Tor Browser 5.252
And the screen keyboard works in Thunderbird 22.596
And the layout of the screen keyboard is set to "de" 0.666
After features/support/hooks.rb:291 12.104
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.268
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.911
When I log in to a new session in Italian (it) 29.969
Then the keyboard layout is set to "it" 0.131
When the network is plugged 0.055
And Tor is ready 14.008
Then I successfully start the Unsafe Browser in "it" 25.910
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.148
Then the screen keyboard works in Tor Browser 34.825
And DuckDuckGo is the default search engine 9.829
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 21.652
And the layout of the screen keyboard is set to "us" 0.646
After features/support/hooks.rb:291 1.173
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.080
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.741
When I log in to a new session in Persian (fa) 30.101
Then the keyboard layout is set to "ir" 0.258
When the network is plugged 0.045
And Tor is ready 16.546
Then I successfully start the Unsafe Browser in "fa" 29.180
And I kill the Unsafe Browser 5.893
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 34.260
And DuckDuckGo is the default search engine 9.815
And I kill the Tor Browser 5.366
And the screen keyboard works in Thunderbird 22.146
And the layout of the screen keyboard is set to "ir" 0.574
After features/support/hooks.rb:291 1.047
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.651
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.294
When I log in to a new session in Portuguese (pt) 33.268
Then the keyboard layout is set to "pt" 0.274
When the network is plugged 0.049
And Tor is ready 16.631
Then I successfully start the Unsafe Browser in "pt" 26.016
And I kill the Unsafe Browser 5.949
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 33.701
And DuckDuckGo is the default search engine 9.533
And I kill the Tor Browser 5.301
And the screen keyboard works in Thunderbird 24.821
And the layout of the screen keyboard is set to "us" 0.634
After features/support/hooks.rb:291 1.025
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.674
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.072
When I log in to a new session in Russian (ru) 29.042
Then the keyboard layout is set to "ru" 0.177
When the network is plugged 0.048
And Tor is ready 15.256
Then I successfully start the Unsafe Browser in "ru" 27.816
And I kill the Unsafe Browser 5.997
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 35.931
And DuckDuckGo is the default search engine 9.473
And I kill the Tor Browser 5.282
And the screen keyboard works in Thunderbird 24.789
And the layout of the screen keyboard is set to "ru" 0.664
After features/support/hooks.rb:291 1.220
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.355
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.287
When I log in to a new session in Spanish (es) 29.508
Then the keyboard layout is set to "es" 0.220
When the network is plugged 0.035
And Tor is ready 15.096
Then I successfully start the Unsafe Browser in "es" 25.212
And I kill the Unsafe Browser 5.810
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.187
And DuckDuckGo is the default search engine 10.044
And I kill the Tor Browser 5.347
And the screen keyboard works in Thunderbird 21.905
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 1.096
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.615
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.017
When I log in to a new session in Turkish (tr) 29.267
Then the keyboard layout is set to "tr" 0.159
When the network is plugged 0.041
And Tor is ready 15.671
Then I successfully start the Unsafe Browser in "tr" 26.853
And I kill the Unsafe Browser 5.941
When I enable the screen keyboard 0.179
Then the screen keyboard works in Tor Browser 32.800
And DuckDuckGo is the default search engine 9.392
And I kill the Tor Browser 5.355
And the screen keyboard works in Thunderbird 22.400
And the layout of the screen keyboard is set to "us" 0.534
After features/support/hooks.rb:291 1.389
After features/support/hooks.rb:75 0.000