Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 14 20 Mar 2024, 17:29

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 58:24.958 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.805
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.083
And I prepare Tails for memory erasure tests 0.467
When I start a process allocating 128 MiB of memory with a known pattern 4.341
Then patterns cover at least 128 MiB in the guest's memory 4.165 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.739
Then I find very few patterns in the guest's memory 4.008 
Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)
After features/support/hooks.rb:291 1.241
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.590
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.178
And I prepare Tails for memory erasure tests 0.444
And I find very few patterns in the guest's memory 3.935 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.727
Then patterns cover at least 99% of the test FS size in the guest's memory 3.923 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.660
Then I find very few patterns in the guest's memory 3.721 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:291 1.272
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.862
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.099
And I prepare Tails for memory erasure tests 0.421
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.102
Then I find very few patterns in the guest's memory 4.079 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 6.708
Then patterns cover at least 86% of the test FS size in the guest's memory 3.914 
Pattern coverage: 90.164% (115 MiB out of 127 MiB reference memory)
When I umount the USB drive 5.838
Then I find very few patterns in the guest's memory 4.054 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
# read cache
When I mount the USB drive again 0.301
And I read the content of the test FS 1.241
Then patterns cover at least 99% of the test FS size in the guest's memory 3.605 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.530
Then I find very few patterns in the guest's memory 4.963 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:291 0.993
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.846
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.959
And I prepare Tails for memory erasure tests 0.460
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.548
Then I find very few patterns in the guest's memory 3.634 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.577
Then patterns cover at least 99% of the test FS size in the guest's memory 3.351 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.671
Then I find very few patterns in the guest's memory 4.411 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
# read cache
When I mount the USB drive again 3.873
And I read the content of the test FS 0.555
Then patterns cover at least 99% of the test FS size in the guest's memory 3.595 
Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.564
Then I find very few patterns in the guest's memory 3.643 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
After features/support/hooks.rb:291 0.932
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
53.449
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.102
And I prepare Tails for memory erasure tests 0.446
When I fill a 128 MiB file with a known pattern on the root filesystem 17.879
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.728
Then patterns cover at least 128 MiB in the guest's memory 3.476 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.018
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.788 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:291 3.543
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:15.232
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:32.404
And I prepare Tails for memory erasure tests 0.417
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.228
When I trigger shutdown 0.011
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.151 
Pattern coverage: 0.000% (0 MiB out of 919 MiB reference memory)
After features/support/hooks.rb:291 3.491
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:35.869
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.441
And I update APT using apt 17.560
And I install "popularity-contest" using apt 19.194
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.253
When I create a persistent storage and activate the Additional Software feature 19.990
Then Additional Software is correctly configured for package "popularity-contest" 1.551
When I shutdown Tails and wait for the computer to power off 11.059
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:27.874
Then Additional Software is correctly configured for package "popularity-contest" 0.718
And the package "popularity-contest" is installed after Additional Software has been started 0.225
After features/support/hooks.rb:450 38.294
After features/support/hooks.rb:291 1.228
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:14.860
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.948
And I start Tails from USB drive "__internal" and I login with an administration password 1:33.574
And I update APT using apt 16.714
When I install "makepp" using apt 19.201
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.350
And the package "makepp" is installed 0.072
After features/support/hooks.rb:450 38.115
After features/support/hooks.rb:291 0.831
After features/support/hooks.rb:75 0.056
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:47.280
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.206
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:57.739
When I uninstall "popularity-contest" using apt 18.670
And I accept removing "popularity-contest" from Additional Software 0.645
Then "popularity-contest" is not in the list of Additional Software 0.671
When I start Synaptic 31.175
And I update APT using Synaptic 22.084
And I install "cowsay" using Synaptic 10.815
And I accept adding "cowsay" to Additional Software 0.819
Then Additional Software is correctly configured for package "cowsay" 0.719
When I uninstall "cowsay" using apt 3.195
And I refuse removing "cowsay" from Additional Software 0.538
Then Additional Software is correctly configured for package "cowsay" 0.695
When I start "Additional Software" via GNOME Activities Overview 9.768
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.240
Then "cowsay" is not in the list of Additional Software 0.850
When I install "cowsay" using apt 3.196
And I refuse adding "cowsay" to Additional Software 0.542
Then "cowsay" is not in the list of Additional Software 0.703
After features/support/hooks.rb:450 0.969
After features/support/hooks.rb:291 0.758
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:35.633
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.158
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:7.967
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.395
And I accept adding "cowsay" to Additional Software 5.960
And Additional Software is correctly configured for package "cowsay" 0.842
And I shutdown Tails and wait for the computer to power off 6.054
And I start Tails from USB drive "__internal" with network unplugged 1:1.447
And I enable persistence 11.067
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 32.360
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 32.167
And I revert the APT tweaks that made it prefer an old version of cowsay 0.049
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.066
And the network is plugged 0.023
And Tor is ready 17.500
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.357
And available upgrades have been checked 0.071
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.093
And I can open the Additional Software configuration window from the notification 2.835
And I shutdown Tails and wait for the computer to power off 2:2.512
And I start Tails from USB drive "__internal" with network unplugged 53.769
And I enable persistence 10.536
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 33.911
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.758
And I revert the APT tweaks that made it prefer an old version of cowsay 0.050
And the network is plugged 0.040
And Tor is ready 50.326
Then the Additional Software upgrade service has started 0.163
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.078
After features/support/hooks.rb:450 2.382
After features/support/hooks.rb:291 0.861
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:57.652
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.163
And I start Tails from USB drive "__internal" with network unplugged 53.565
And I enable persistence 10.221
And I remove the "cowsay" deb files from the APT cache 0.602
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.076
And I log in to a new session 31.925
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 15.171
And I can open the Additional Software log file from the notification 5.224
And the package "cowsay" is not installed 0.702
After features/support/hooks.rb:450 0.108
After features/support/hooks.rb:291 0.857
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.963
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.180
When I log in to a new session in Arabic (ar) 29.782
Then the keyboard layout is set to "us" 0.165
When the network is plugged 0.044
And Tor is ready 44.360
Then I successfully start the Unsafe Browser in "ar" 16.699
And I kill the Unsafe Browser 5.985
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 28.092
And DuckDuckGo is the default search engine 11.173
And I kill the Tor Browser 5.455
And the screen keyboard works in Thunderbird 12.393
And the layout of the screen keyboard is set to "us" 0.544
After features/support/hooks.rb:291 1.743
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.495
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.712
When I log in to a new session in Chinese (zh_CN) 30.540
Then the keyboard layout is set to "cn" 0.249
When the network is plugged 0.036
And Tor is ready 16.878
Then I successfully start the Unsafe Browser in "zh_CN" 15.128
And I kill the Unsafe Browser 5.679
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 22.101
And DuckDuckGo is the default search engine 9.712
And I kill the Tor Browser 5.308
And the screen keyboard works in Thunderbird 15.498
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 1.469
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:54.659
Before features/support/hooks.rb:245 0.023
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.575
When I log in to a new session in English (en) 14.709
Then the keyboard layout is set to "us" 0.103
When the network is plugged 0.039
And Tor is ready 16.540
Then I successfully start the Unsafe Browser in "en" 14.706
And I kill the Unsafe Browser 5.757
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 26.710
And DuckDuckGo is the default search engine 9.654
And I kill the Tor Browser 5.293
And the screen keyboard works in Thunderbird 11.946
And the layout of the screen keyboard is set to "us" 0.526
After features/support/hooks.rb:291 1.410
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.101
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.919
When I log in to a new session in French (fr) 29.540
Then the keyboard layout is set to "fr" 0.210
When the network is plugged 0.028
And Tor is ready 17.233
Then I successfully start the Unsafe Browser in "fr" 14.424
And I kill the Unsafe Browser 5.624
When I enable the screen keyboard 0.079
Then the screen keyboard works in Tor Browser 25.369
And DuckDuckGo is the default search engine 18.495
And I kill the Tor Browser 5.478
And the screen keyboard works in Thunderbird 12.119
And the layout of the screen keyboard is set to "fr" 0.577
After features/support/hooks.rb:291 1.444
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.303
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.842
When I log in to a new session in German (de) 31.136
Then the keyboard layout is set to "de" 0.180
When the network is plugged 0.034
And Tor is ready 15.190
Then I successfully start the Unsafe Browser in "de" 14.056
And I kill the Unsafe Browser 5.906
When I enable the screen keyboard 0.078
Then the screen keyboard works in Tor Browser 26.265
And DuckDuckGo is the default search engine 10.162
And I kill the Tor Browser 5.256
And the screen keyboard works in Thunderbird 11.632
And the layout of the screen keyboard is set to "de" 0.560
After features/support/hooks.rb:291 2.780
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:5.005
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.877
When I log in to a new session in Italian (it) 28.714
Then the keyboard layout is set to "it" 0.201
When the network is plugged 0.030
And Tor is ready 15.385
Then I successfully start the Unsafe Browser in "it" 14.118
And I kill the Unsafe Browser 5.662
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 24.985
And DuckDuckGo is the default search engine 9.551
And I kill the Tor Browser 5.256
And the screen keyboard works in Thunderbird 12.568
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 2.693
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.009
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.845
When I log in to a new session in Persian (fa) 30.333
Then the keyboard layout is set to "ir" 0.151
When the network is plugged 0.027
And Tor is ready 16.257
Then I successfully start the Unsafe Browser in "fa" 15.225
And I kill the Unsafe Browser 5.771
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 26.535
And DuckDuckGo is the default search engine 19.127
And I kill the Tor Browser 5.446
And the screen keyboard works in Thunderbird 12.646
And the layout of the screen keyboard is set to "ir" 0.538
After features/support/hooks.rb:291 2.957
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.612
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.718
When I log in to a new session in Portuguese (pt) 30.554
Then the keyboard layout is set to "pt" 0.176
When the network is plugged 0.031
And Tor is ready 15.212
Then I successfully start the Unsafe Browser in "pt" 14.412
And I kill the Unsafe Browser 5.728
When I enable the screen keyboard 0.076
Then the screen keyboard works in Tor Browser 27.728
And DuckDuckGo is the default search engine 10.479
And I kill the Tor Browser 5.469
And the screen keyboard works in Thunderbird 11.473
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 2.157
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.741
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.832
When I log in to a new session in Russian (ru) 28.574
Then the keyboard layout is set to "ru" 0.134
When the network is plugged 0.047
And Tor is ready 14.303
Then I successfully start the Unsafe Browser in "ru" 14.377
And I kill the Unsafe Browser 5.701
When I enable the screen keyboard 0.073
Then the screen keyboard works in Tor Browser 26.517
And DuckDuckGo is the default search engine 18.247
And I kill the Tor Browser 5.506
And the screen keyboard works in Thunderbird 13.869
And the layout of the screen keyboard is set to "ru" 0.555
After features/support/hooks.rb:291 2.766
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:3.538
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.753
When I log in to a new session in Spanish (es) 29.508
Then the keyboard layout is set to "es" 0.182
When the network is plugged 0.031
And Tor is ready 13.239
Then I successfully start the Unsafe Browser in "es" 15.424
And I kill the Unsafe Browser 5.756
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 23.758
And DuckDuckGo is the default search engine 9.486
And I kill the Tor Browser 5.243
And the screen keyboard works in Thunderbird 12.469
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:291 2.463
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.442
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.903
When I log in to a new session in Turkish (tr) 29.093
Then the keyboard layout is set to "tr" 0.136
When the network is plugged 0.057
And Tor is ready 15.511
Then I successfully start the Unsafe Browser in "tr" 14.857
And I kill the Unsafe Browser 5.716
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 25.089
And DuckDuckGo is the default search engine 18.725
And I kill the Tor Browser 5.519
And the screen keyboard works in Thunderbird 14.180
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:291 2.253
After features/support/hooks.rb:75 0.000