Project Number Date
test_Tails_ISO_stable 4709 11 Mar 2024, 17:29

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:15.461 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.478
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.992
And I prepare Tails for memory erasure tests 0.419
When I start a process allocating 128 MiB of memory with a known pattern 1.202
Then patterns cover at least 128 MiB in the guest's memory 4.041 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.679
Then I find very few patterns in the guest's memory 4.142 
Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)
After features/support/hooks.rb:291 0.685
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.139
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.957
And I prepare Tails for memory erasure tests 0.430
And I find very few patterns in the guest's memory 4.200 
Pattern coverage: 0.000% (0 MiB out of 934 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.880
Then patterns cover at least 99% of the test FS size in the guest's memory 4.690 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.429
Then I find very few patterns in the guest's memory 4.550 
Pattern coverage: 0.000% (0 MiB out of 934 MiB reference memory)
After features/support/hooks.rb:291 0.858
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
38.797
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.063
And I prepare Tails for memory erasure tests 0.396
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.793
Then I find very few patterns in the guest's memory 3.958 
Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.271
Then patterns cover at least 86% of the test FS size in the guest's memory 3.604 
Pattern coverage: 94.138% (120 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.854
Then I find very few patterns in the guest's memory 3.770 
Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)
# read cache
When I mount the USB drive again 0.259
And I read the content of the test FS 0.519
Then patterns cover at least 99% of the test FS size in the guest's memory 3.401 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.118
Then I find very few patterns in the guest's memory 3.787 
Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)
After features/support/hooks.rb:291 1.395
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.660
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.021
And I prepare Tails for memory erasure tests 0.359
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.766
Then I find very few patterns in the guest's memory 3.701 
Pattern coverage: 0.000% (0 MiB out of 915 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.479
Then patterns cover at least 99% of the test FS size in the guest's memory 2.849 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.772
Then I find very few patterns in the guest's memory 3.472 
Pattern coverage: 0.000% (0 MiB out of 915 MiB reference memory)
# read cache
When I mount the USB drive again 3.995
And I read the content of the test FS 0.411
Then patterns cover at least 99% of the test FS size in the guest's memory 2.881 
Pattern coverage: 106.115% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.430
Then I find very few patterns in the guest's memory 3.518 
Pattern coverage: 0.000% (0 MiB out of 915 MiB reference memory)
After features/support/hooks.rb:291 0.866
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.217
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.902
And I prepare Tails for memory erasure tests 0.405
When I fill a 128 MiB file with a known pattern on the root filesystem 13.145
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.255
Then patterns cover at least 128 MiB in the guest's memory 2.740 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.015
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.735 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
After features/support/hooks.rb:291 3.477
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:36.719
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:53.599
And I prepare Tails for memory erasure tests 0.353
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.543
When I trigger shutdown 0.011
And I wait 20 seconds 20.012 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.197 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
After features/support/hooks.rb:291 3.529
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:48.821
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.772
And I update APT using apt 17.586
And I install "popularity-contest" using apt 19.388
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.203
When I create a persistent storage and activate the Additional Software feature 21.651
Then Additional Software is correctly configured for package "popularity-contest" 1.343
When I shutdown Tails and wait for the computer to power off 9.132
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:40.668
Then Additional Software is correctly configured for package "popularity-contest" 0.839
And the package "popularity-contest" is installed after Additional Software has been started 0.235
After features/support/hooks.rb:450 39.570
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:11.865
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.206
And I start Tails from USB drive "__internal" and I login with an administration password 1:28.726
And I update APT using apt 16.643
When I install "makepp" using apt 19.801
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.414
And the package "makepp" is installed 0.074
After features/support/hooks.rb:450 39.434
After features/support/hooks.rb:291 1.581
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
14:6.687
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.174
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 12:19.056
When I uninstall "popularity-contest" using apt 15.933
And I accept removing "popularity-contest" from Additional Software 0.842
Then "popularity-contest" is not in the list of Additional Software 0.720
When I start Synaptic 29.535
And I update APT using Synaptic 22.161
And I install "cowsay" using Synaptic 9.997
And I accept adding "cowsay" to Additional Software 1.255
Then Additional Software is correctly configured for package "cowsay" 0.853
When I uninstall "cowsay" using apt 3.234
And I refuse removing "cowsay" from Additional Software 0.543
Then Additional Software is correctly configured for package "cowsay" 0.793
When I start "Additional Software" via GNOME Activities Overview 10.664
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.632
Then "cowsay" is not in the list of Additional Software 0.875
When I install "cowsay" using apt 3.234
And I refuse adding "cowsay" to Additional Software 0.483
Then "cowsay" is not in the list of Additional Software 0.693
After features/support/hooks.rb:450 1.779
After features/support/hooks.rb:291 0.720
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:32.235
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.184
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:35.340
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.046
And I accept adding "cowsay" to Additional Software 6.189
And Additional Software is correctly configured for package "cowsay" 0.858
And I shutdown Tails and wait for the computer to power off 6.063
And I start Tails from USB drive "__internal" with network unplugged 53.868
And I enable persistence 30.336
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 33.792
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.951
And I revert the APT tweaks that made it prefer an old version of cowsay 0.068
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.072
And the network is plugged 0.058
And Tor is ready 19.024
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.015
And available upgrades have been checked 0.163
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.318
And I can open the Additional Software configuration window from the notification 3.529
And I shutdown Tails and wait for the computer to power off 2:1.826
And I start Tails from USB drive "__internal" with network unplugged 57.034
And I enable persistence 32.045
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 34.105
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.052
And I revert the APT tweaks that made it prefer an old version of cowsay 0.083
And the network is plugged 0.050
And Tor is ready 41.838
Then the Additional Software upgrade service has started 0.168
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.078
After features/support/hooks.rb:450 2.174
After features/support/hooks.rb:291 0.794
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:10.412
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.229
And I start Tails from USB drive "__internal" with network unplugged 53.168
And I enable persistence 31.945
And I remove the "cowsay" deb files from the APT cache 0.604
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.087
And I log in to a new session 32.989
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.850
And I can open the Additional Software log file from the notification 4.999
And the package "cowsay" is not installed 0.537
After features/support/hooks.rb:450 0.105
After features/support/hooks.rb:291 0.780
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.609
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.077
When I log in to a new session in Arabic (ar) 29.836
Then the keyboard layout is set to "us" 0.221
When the network is plugged 0.046
And Tor is ready 14.833
Then I successfully start the Unsafe Browser in "ar" 13.853
And I kill the Unsafe Browser 5.838
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 34.816
And DuckDuckGo is the default search engine 22.487
And I kill the Tor Browser 5.483
And the screen keyboard works in Thunderbird 21.474
And the layout of the screen keyboard is set to "us" 0.552
After features/support/hooks.rb:291 0.832
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.768
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.082
When I log in to a new session in Chinese (zh_CN) 31.454
Then the keyboard layout is set to "cn" 0.255
When the network is plugged 0.034
And Tor is ready 15.281
Then I successfully start the Unsafe Browser in "zh_CN" 14.206
And I kill the Unsafe Browser 5.763
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 34.828
And DuckDuckGo is the default search engine 10.975
And I kill the Tor Browser 5.577
And the screen keyboard works in Thunderbird 25.569
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 1.120
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:6.864
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.958
When I log in to a new session in English (en) 16.041
Then the keyboard layout is set to "us" 0.169
When the network is plugged 0.036
And Tor is ready 14.736
Then I successfully start the Unsafe Browser in "en" 15.192
And I kill the Unsafe Browser 5.832
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 34.390
And DuckDuckGo is the default search engine 4.977
And I kill the Tor Browser 5.235
And the screen keyboard works in Thunderbird 21.457
And the layout of the screen keyboard is set to "us" 0.715
After features/support/hooks.rb:291 1.399
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.353
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.944
When I log in to a new session in French (fr) 30.248
Then the keyboard layout is set to "fr" 0.183
When the network is plugged 0.029
And Tor is ready 15.032
Then I successfully start the Unsafe Browser in "fr" 13.149
And I kill the Unsafe Browser 5.932
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 32.948
And DuckDuckGo is the default search engine 10.665
And I kill the Tor Browser 5.583
And the screen keyboard works in Thunderbird 21.952
And the layout of the screen keyboard is set to "fr" 0.569
After features/support/hooks.rb:291 1.947
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.950
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.991
When I log in to a new session in German (de) 29.438
Then the keyboard layout is set to "de" 0.195
When the network is plugged 0.045
And Tor is ready 43.082
Then I successfully start the Unsafe Browser in "de" 13.633
And I kill the Unsafe Browser 6.021
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 33.551
And DuckDuckGo is the default search engine 9.975
And I kill the Tor Browser 5.282
And the screen keyboard works in Thunderbird 21.089
And the layout of the screen keyboard is set to "de" 0.551
After features/support/hooks.rb:291 1.628
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.652
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.884
When I log in to a new session in Italian (it) 29.659
Then the keyboard layout is set to "it" 0.171
When the network is plugged 0.035
And Tor is ready 16.168
Then I successfully start the Unsafe Browser in "it" 13.662
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 32.811
And DuckDuckGo is the default search engine 10.183
And I kill the Tor Browser 5.613
And the screen keyboard works in Thunderbird 21.047
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:291 1.150
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:54.206
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.817
When I log in to a new session in Persian (fa) 28.945
Then the keyboard layout is set to "ir" 0.123
When the network is plugged 0.030
And Tor is ready 43.079
Then I successfully start the Unsafe Browser in "fa" 12.920
And I kill the Unsafe Browser 5.804
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 35.180
And DuckDuckGo is the default search engine 10.934
And I kill the Tor Browser 5.562
And the screen keyboard works in Thunderbird 23.146
And the layout of the screen keyboard is set to "ir" 0.543
After features/support/hooks.rb:291 1.331
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.797
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.001
When I log in to a new session in Portuguese (pt) 29.543
Then the keyboard layout is set to "pt" 0.172
When the network is plugged 0.031
And Tor is ready 14.907
Then I successfully start the Unsafe Browser in "pt" 13.814
And I kill the Unsafe Browser 5.733
When I enable the screen keyboard 0.088
Then the screen keyboard works in Tor Browser 32.953
And DuckDuckGo is the default search engine 9.834
And I kill the Tor Browser 5.255
And the screen keyboard works in Thunderbird 20.904
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.073
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.471
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.740
When I log in to a new session in Russian (ru) 29.282
Then the keyboard layout is set to "ru" 0.139
When the network is plugged 0.047
And Tor is ready 14.135
Then I successfully start the Unsafe Browser in "ru" 13.546
And I kill the Unsafe Browser 5.835
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 34.870
And DuckDuckGo is the default search engine 10.339
And I kill the Tor Browser 5.644
And the screen keyboard works in Thunderbird 23.185
And the layout of the screen keyboard is set to "ru" 0.611
After features/support/hooks.rb:291 1.209
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.546
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.227
When I log in to a new session in Spanish (es) 29.803
Then the keyboard layout is set to "es" 0.156
When the network is plugged 0.046
And Tor is ready 13.558
Then I successfully start the Unsafe Browser in "es" 14.081
And I kill the Unsafe Browser 5.758
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 33.412
And DuckDuckGo is the default search engine 22.962
And I kill the Tor Browser 5.451
And the screen keyboard works in Thunderbird 20.447
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:291 1.078
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.204
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.868
When I log in to a new session in Turkish (tr) 29.605
Then the keyboard layout is set to "tr" 0.110
When the network is plugged 0.045
And Tor is ready 17.359
Then I successfully start the Unsafe Browser in "tr" 13.602
And I kill the Unsafe Browser 5.748
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 33.666
And DuckDuckGo is the default search engine 10.333
And I kill the Tor Browser 5.646
And the screen keyboard works in Thunderbird 21.552
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.005
After features/support/hooks.rb:75 0.000