Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 7 19 Mar 2024, 17:26

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 55:52.195 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.364
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.000
And I prepare Tails for memory erasure tests 0.415
When I start a process allocating 128 MiB of memory with a known pattern 1.539
Then patterns cover at least 128 MiB in the guest's memory 4.469 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.906
Then I find very few patterns in the guest's memory 4.032 
Pattern coverage: 0.000% (0 MiB out of 905 MiB reference memory)
After features/support/hooks.rb:291 0.652
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.622
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.101
And I prepare Tails for memory erasure tests 0.383
And I find very few patterns in the guest's memory 3.962 
Pattern coverage: 0.000% (0 MiB out of 906 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.592
Then patterns cover at least 99% of the test FS size in the guest's memory 3.427 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.457
Then I find very few patterns in the guest's memory 4.697 
Pattern coverage: 0.000% (0 MiB out of 906 MiB reference memory)
After features/support/hooks.rb:291 0.845
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
43.534
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.143
And I prepare Tails for memory erasure tests 0.405
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.740
Then I find very few patterns in the guest's memory 4.417 
Pattern coverage: 0.000% (0 MiB out of 922 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.238
Then patterns cover at least 86% of the test FS size in the guest's memory 4.659 
Pattern coverage: 91.526% (116 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.928
Then I find very few patterns in the guest's memory 6.020 
Pattern coverage: 0.000% (0 MiB out of 922 MiB reference memory)
# read cache
When I mount the USB drive again 0.254
And I read the content of the test FS 0.928
Then patterns cover at least 99% of the test FS size in the guest's memory 3.626 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.409
Then I find very few patterns in the guest's memory 4.761 
Pattern coverage: 0.000% (0 MiB out of 922 MiB reference memory)
After features/support/hooks.rb:291 0.662
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.354
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.014
And I prepare Tails for memory erasure tests 0.538
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 30.473
Then I find very few patterns in the guest's memory 3.691 
Pattern coverage: 0.000% (0 MiB out of 927 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.682
Then patterns cover at least 99% of the test FS size in the guest's memory 2.724 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.714
Then I find very few patterns in the guest's memory 3.518 
Pattern coverage: 0.000% (0 MiB out of 927 MiB reference memory)
# read cache
When I mount the USB drive again 3.802
And I read the content of the test FS 0.510
Then patterns cover at least 99% of the test FS size in the guest's memory 2.807 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.433
Then I find very few patterns in the guest's memory 3.442 
Pattern coverage: 0.000% (0 MiB out of 927 MiB reference memory)
After features/support/hooks.rb:291 0.798
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.661
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.007
And I prepare Tails for memory erasure tests 0.390
When I fill a 128 MiB file with a known pattern on the root filesystem 15.167
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.173
Then patterns cover at least 128 MiB in the guest's memory 3.116 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.019
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.766 
Pattern coverage: 0.000% (0 MiB out of 928 MiB reference memory)
After features/support/hooks.rb:291 3.695
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:27.286
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:41.104
And I prepare Tails for memory erasure tests 0.428
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.631
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.091 
Pattern coverage: 0.000% (0 MiB out of 939 MiB reference memory)
After features/support/hooks.rb:291 3.515
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:38.141
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.633
And I update APT using apt 16.168
And I install "popularity-contest" using apt 19.082
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.327
When I create a persistent storage and activate the Additional Software feature 20.725
Then Additional Software is correctly configured for package "popularity-contest" 1.232
When I shutdown Tails and wait for the computer to power off 9.092
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:31.845
Then Additional Software is correctly configured for package "popularity-contest" 0.775
And the package "popularity-contest" is installed after Additional Software has been started 0.258
After features/support/hooks.rb:450 36.968
After features/support/hooks.rb:291 1.223
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:15.879
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.161
And I start Tails from USB drive "__internal" and I login with an administration password 1:32.011
And I update APT using apt 18.247
When I install "makepp" using apt 19.906
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.439
And the package "makepp" is installed 0.113
After features/support/hooks.rb:450 38.105
After features/support/hooks.rb:291 1.124
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:34.860
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.171
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:51.234
When I uninstall "popularity-contest" using apt 18.650
And I accept removing "popularity-contest" from Additional Software 0.592
Then "popularity-contest" is not in the list of Additional Software 0.649
When I start Synaptic 24.190
And I update APT using Synaptic 21.873
And I install "cowsay" using Synaptic 9.489
And I accept adding "cowsay" to Additional Software 1.198
Then Additional Software is correctly configured for package "cowsay" 0.728
When I uninstall "cowsay" using apt 3.202
And I refuse removing "cowsay" from Additional Software 0.506
Then Additional Software is correctly configured for package "cowsay" 0.737
When I start "Additional Software" via GNOME Activities Overview 10.626
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.631
Then "cowsay" is not in the list of Additional Software 0.932
When I install "cowsay" using apt 3.225
And I refuse adding "cowsay" to Additional Software 0.550
Then "cowsay" is not in the list of Additional Software 0.670
After features/support/hooks.rb:450 0.994
After features/support/hooks.rb:291 0.808
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
8:31.254
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.180
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:13.517
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.202
And I accept adding "cowsay" to Additional Software 6.400
And Additional Software is correctly configured for package "cowsay" 1.099
And I shutdown Tails and wait for the computer to power off 6.215
And I start Tails from USB drive "__internal" with network unplugged 53.949
And I enable persistence 11.063
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.031
And I log in to a new session 33.401
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.157
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.086
And the network is plugged 0.038
And Tor is ready 18.849
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.998
And available upgrades have been checked 0.053
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.030
And I can open the Additional Software configuration window from the notification 3.081
And I shutdown Tails and wait for the computer to power off 12.043
And I start Tails from USB drive "__internal" with network unplugged 53.153
And I enable persistence 11.973
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 33.070
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.158
And I revert the APT tweaks that made it prefer an old version of cowsay 0.076
And the network is plugged 0.036
And Tor is ready 40.054
Then the Additional Software upgrade service has started 0.154
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.082
After features/support/hooks.rb:450 2.334
After features/support/hooks.rb:291 1.150
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:51.454
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.189
And I start Tails from USB drive "__internal" with network unplugged 54.803
And I enable persistence 11.126
And I remove the "cowsay" deb files from the APT cache 0.616
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.073
And I log in to a new session 33.804
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.451
And I can open the Additional Software log file from the notification 4.881
And the package "cowsay" is not installed 0.506
After features/support/hooks.rb:450 0.106
After features/support/hooks.rb:291 0.684
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.633
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.183
When I log in to a new session in Arabic (ar) 29.549
Then the keyboard layout is set to "us" 0.158
When the network is plugged 0.046
And Tor is ready 15.262
Then I successfully start the Unsafe Browser in "ar" 13.775
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 26.578
And DuckDuckGo is the default search engine 17.644
And I kill the Tor Browser 5.463
And the screen keyboard works in Thunderbird 11.446
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 1.180
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.491
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.139
When I log in to a new session in Chinese (zh_CN) 31.998
Then the keyboard layout is set to "cn" 0.171
When the network is plugged 0.032
And Tor is ready 14.397
Then I successfully start the Unsafe Browser in "zh_CN" 14.951
And I kill the Unsafe Browser 5.711
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 25.171
And DuckDuckGo is the default search engine 22.289
And I kill the Tor Browser 5.512
And the screen keyboard works in Thunderbird 15.468
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:291 1.164
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:47.883
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.670
When I log in to a new session in English (en) 17.244
Then the keyboard layout is set to "us" 0.144
When the network is plugged 0.034
And Tor is ready 13.561
Then I successfully start the Unsafe Browser in "en" 15.498
And I kill the Unsafe Browser 5.654
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 24.490
And DuckDuckGo is the default search engine 5.489
And I kill the Tor Browser 5.279
And the screen keyboard works in Thunderbird 11.131
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 1.234
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:6.285
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.884
When I log in to a new session in French (fr) 30.319
Then the keyboard layout is set to "fr" 0.163
When the network is plugged 0.025
And Tor is ready 13.989
Then I successfully start the Unsafe Browser in "fr" 14.672
And I kill the Unsafe Browser 5.666
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 25.388
And DuckDuckGo is the default search engine 10.684
And I kill the Tor Browser 5.439
And the screen keyboard works in Thunderbird 11.291
And the layout of the screen keyboard is set to "fr" 0.665
After features/support/hooks.rb:291 1.103
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.116
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.993
When I log in to a new session in German (de) 29.565
Then the keyboard layout is set to "de" 0.160
When the network is plugged 0.026
And Tor is ready 15.449
Then I successfully start the Unsafe Browser in "de" 14.383
And I kill the Unsafe Browser 5.666
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 26.217
And DuckDuckGo is the default search engine 10.436
And I kill the Tor Browser 5.415
And the screen keyboard works in Thunderbird 13.074
And the layout of the screen keyboard is set to "de" 0.617
After features/support/hooks.rb:291 1.249
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:4.187
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.081
When I log in to a new session in Italian (it) 29.159
Then the keyboard layout is set to "it" 0.242
When the network is plugged 0.060
And Tor is ready 15.044
Then I successfully start the Unsafe Browser in "it" 13.947
And I kill the Unsafe Browser 5.602
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 25.503
And DuckDuckGo is the default search engine 10.189
And I kill the Tor Browser 5.402
And the screen keyboard works in Thunderbird 10.250
And the layout of the screen keyboard is set to "us" 0.619
After features/support/hooks.rb:291 1.734
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:8.940
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.083
When I log in to a new session in Persian (fa) 29.403
Then the keyboard layout is set to "ir" 0.246
When the network is plugged 0.068
And Tor is ready 15.053
Then I successfully start the Unsafe Browser in "fa" 14.228
And I kill the Unsafe Browser 5.812
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 27.390
And DuckDuckGo is the default search engine 10.800
And I kill the Tor Browser 5.575
And the screen keyboard works in Thunderbird 11.617
And the layout of the screen keyboard is set to "ir" 0.565
After features/support/hooks.rb:291 0.943
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.463
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.870
When I log in to a new session in Portuguese (pt) 29.877
Then the keyboard layout is set to "pt" 0.136
When the network is plugged 0.044
And Tor is ready 16.587
Then I successfully start the Unsafe Browser in "pt" 14.276
And I kill the Unsafe Browser 5.702
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 27.077
And DuckDuckGo is the default search engine 25.706
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 12.042
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.052
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:8.284
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.035
When I log in to a new session in Russian (ru) 29.702
Then the keyboard layout is set to "ru" 0.133
When the network is plugged 0.027
And Tor is ready 16.042
Then I successfully start the Unsafe Browser in "ru" 14.044
And I kill the Unsafe Browser 5.659
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 26.848
And DuckDuckGo is the default search engine 10.159
And I kill the Tor Browser 5.297
And the screen keyboard works in Thunderbird 11.678
And the layout of the screen keyboard is set to "ru" 0.569
After features/support/hooks.rb:291 1.150
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.666
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.870
When I log in to a new session in Spanish (es) 30.205
Then the keyboard layout is set to "es" 0.188
When the network is plugged 0.044
And Tor is ready 15.337
Then I successfully start the Unsafe Browser in "es" 14.533
And I kill the Unsafe Browser 5.597
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 26.635
And DuckDuckGo is the default search engine 10.901
And I kill the Tor Browser 5.484
And the screen keyboard works in Thunderbird 12.178
And the layout of the screen keyboard is set to "us" 0.546
After features/support/hooks.rb:291 0.992
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.827
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.886
When I log in to a new session in Turkish (tr) 29.347
Then the keyboard layout is set to "tr" 0.163
When the network is plugged 0.037
And Tor is ready 42.662
Then I successfully start the Unsafe Browser in "tr" 14.196
And I kill the Unsafe Browser 5.724
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 26.609
And DuckDuckGo is the default search engine 10.319
And I kill the Tor Browser 5.586
And the screen keyboard works in Thunderbird 12.620
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:291 0.841
After features/support/hooks.rb:75 0.000