Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 16 22 Mar 2024, 04:42

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 57:23.211 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.201
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.517
And I prepare Tails for memory erasure tests 0.419
When I start a process allocating 128 MiB of memory with a known pattern 1.300
Then patterns cover at least 128 MiB in the guest's memory 4.237 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.707
Then I find very few patterns in the guest's memory 4.020 
Pattern coverage: 0.000% (0 MiB out of 913 MiB reference memory)
After features/support/hooks.rb:291 1.672
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.531
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.571
And I prepare Tails for memory erasure tests 0.482
And I find very few patterns in the guest's memory 4.818 
Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.073
Then patterns cover at least 99% of the test FS size in the guest's memory 3.695 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.428
Then I find very few patterns in the guest's memory 4.460 
Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)
After features/support/hooks.rb:291 0.726
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
44.954
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.122
And I prepare Tails for memory erasure tests 0.520
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.084
Then I find very few patterns in the guest's memory 4.039 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.193
Then patterns cover at least 86% of the test FS size in the guest's memory 3.829 
Pattern coverage: 86.852% (110 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.797
Then I find very few patterns in the guest's memory 4.039 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
# read cache
When I mount the USB drive again 0.243
And I read the content of the test FS 1.348
Then patterns cover at least 99% of the test FS size in the guest's memory 4.613 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.746
Then I find very few patterns in the guest's memory 4.374 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
After features/support/hooks.rb:291 0.752
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.427
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.159
And I prepare Tails for memory erasure tests 0.393
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.987
Then I find very few patterns in the guest's memory 4.527 
Pattern coverage: 0.000% (0 MiB out of 926 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.438
Then patterns cover at least 99% of the test FS size in the guest's memory 2.957 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.749
Then I find very few patterns in the guest's memory 3.569 
Pattern coverage: 0.000% (0 MiB out of 926 MiB reference memory)
# read cache
When I mount the USB drive again 3.382
And I read the content of the test FS 0.370
Then patterns cover at least 99% of the test FS size in the guest's memory 2.972 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.648
Then I find very few patterns in the guest's memory 3.270 
Pattern coverage: 0.000% (0 MiB out of 926 MiB reference memory)
After features/support/hooks.rb:291 0.713
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.267
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.247
And I prepare Tails for memory erasure tests 0.392
When I fill a 128 MiB file with a known pattern on the root filesystem 19.720
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.340
Then patterns cover at least 128 MiB in the guest's memory 2.742 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.799 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:291 3.564
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:9.226
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:25.603
And I prepare Tails for memory erasure tests 0.444
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.958
When I trigger shutdown 0.010
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.196 
Pattern coverage: 0.000% (0 MiB out of 909 MiB reference memory)
After features/support/hooks.rb:291 3.494
After features/support/hooks.rb:75 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:39.438
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.936
And I update APT using apt 17.267
And I install "popularity-contest" using apt 19.265
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.977
When I create a persistent storage and activate the Additional Software feature 18.614
Then Additional Software is correctly configured for package "popularity-contest" 1.595
When I shutdown Tails and wait for the computer to power off 11.065
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.722
Then Additional Software is correctly configured for package "popularity-contest" 0.756
And the package "popularity-contest" is installed after Additional Software has been started 0.237
After features/support/hooks.rb:450 38.423
After features/support/hooks.rb:291 1.215
After features/support/hooks.rb:75 0.059
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:41.333
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.203
And I start Tails from USB drive "__internal" and I login with an administration password 1:59.708
And I update APT using apt 16.313
When I install "makepp" using apt 19.500
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.493
And the package "makepp" is installed 0.113
After features/support/hooks.rb:450 41.026
After features/support/hooks.rb:291 1.058
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:31.694
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.188
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:51.925
When I uninstall "popularity-contest" using apt 18.735
And I accept removing "popularity-contest" from Additional Software 0.552
Then "popularity-contest" is not in the list of Additional Software 0.691
When I start Synaptic 23.101
And I update APT using Synaptic 21.998
And I install "cowsay" using Synaptic 8.788
And I accept adding "cowsay" to Additional Software 1.049
Then Additional Software is correctly configured for package "cowsay" 0.759
When I uninstall "cowsay" using apt 3.187
And I refuse removing "cowsay" from Additional Software 0.538
Then Additional Software is correctly configured for package "cowsay" 0.703
When I start "Additional Software" via GNOME Activities Overview 9.845
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.402
Then "cowsay" is not in the list of Additional Software 0.839
When I install "cowsay" using apt 3.185
And I refuse adding "cowsay" to Additional Software 0.585
Then "cowsay" is not in the list of Additional Software 0.614
After features/support/hooks.rb:450 0.971
After features/support/hooks.rb:291 0.864
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
8:29.824
Before features/support/hooks.rb:245 0.016
Before features/support/hooks.rb:442 0.011
Given a computer 0.181
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:6.160
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.387
And I accept adding "cowsay" to Additional Software 5.598
And Additional Software is correctly configured for package "cowsay" 0.925
And I shutdown Tails and wait for the computer to power off 5.079
And I start Tails from USB drive "__internal" with network unplugged 53.690
And I enable persistence 10.411
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 35.409
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.446
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.063
And the network is plugged 0.038
And Tor is ready 20.181
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.471
And available upgrades have been checked 0.064
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.994
And I can open the Additional Software configuration window from the notification 3.324
And I shutdown Tails and wait for the computer to power off 13.071
And I start Tails from USB drive "__internal" with network unplugged 54.769
And I enable persistence 10.141
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 33.376
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.652
And I revert the APT tweaks that made it prefer an old version of cowsay 0.053
And the network is plugged 0.032
And Tor is ready 40.925
Then the Additional Software upgrade service has started 0.162
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.089
After features/support/hooks.rb:450 2.213
After features/support/hooks.rb:291 0.749
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:2.579
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.171
And I start Tails from USB drive "__internal" with network unplugged 54.359
And I enable persistence 10.737
And I remove the "cowsay" deb files from the APT cache 0.583
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.086
And I log in to a new session 33.310
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 15.622
And I can open the Additional Software log file from the notification 7.000
And the package "cowsay" is not installed 0.707
After features/support/hooks.rb:450 0.126
After features/support/hooks.rb:291 1.111
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.219
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.136
When I log in to a new session in Arabic (ar) 29.459
Then the keyboard layout is set to "us" 0.182
When the network is plugged 0.027
And Tor is ready 18.950
Then I successfully start the Unsafe Browser in "ar" 14.806
And I kill the Unsafe Browser 5.817
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 25.748
And DuckDuckGo is the default search engine 19.944
And I kill the Tor Browser 5.481
And the screen keyboard works in Thunderbird 14.021
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:291 1.244
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.575
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.140
When I log in to a new session in Chinese (zh_CN) 30.763
Then the keyboard layout is set to "cn" 0.275
When the network is plugged 0.042
And Tor is ready 17.080
Then I successfully start the Unsafe Browser in "zh_CN" 15.940
And I kill the Unsafe Browser 5.708
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 24.045
And DuckDuckGo is the default search engine 22.766
And I kill the Tor Browser 5.557
And the screen keyboard works in Thunderbird 17.511
And the layout of the screen keyboard is set to "us" 0.623
After features/support/hooks.rb:291 1.771
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:57.445
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.120
When I log in to a new session in English (en) 16.839
Then the keyboard layout is set to "us" 0.153
When the network is plugged 0.039
And Tor is ready 17.436
Then I successfully start the Unsafe Browser in "en" 14.853
And I kill the Unsafe Browser 5.748
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 25.677
And DuckDuckGo is the default search engine 10.388
And I kill the Tor Browser 5.441
And the screen keyboard works in Thunderbird 12.100
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:291 1.424
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.105
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.981
When I log in to a new session in French (fr) 30.572
Then the keyboard layout is set to "fr" 0.287
When the network is plugged 0.037
And Tor is ready 14.832
Then I successfully start the Unsafe Browser in "fr" 15.308
And I kill the Unsafe Browser 5.718
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 24.091
And DuckDuckGo is the default search engine 10.693
And I kill the Tor Browser 5.407
And the screen keyboard works in Thunderbird 13.466
And the layout of the screen keyboard is set to "fr" 0.613
After features/support/hooks.rb:291 2.400
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.831
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.230
When I log in to a new session in German (de) 33.171
Then the keyboard layout is set to "de" 0.221
When the network is plugged 0.029
And Tor is ready 44.783
Then I successfully start the Unsafe Browser in "de" 13.779
And I kill the Unsafe Browser 5.658
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 24.727
And DuckDuckGo is the default search engine 9.820
And I kill the Tor Browser 5.235
And the screen keyboard works in Thunderbird 11.531
And the layout of the screen keyboard is set to "de" 0.559
After features/support/hooks.rb:291 1.476
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.160
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.970
When I log in to a new session in Italian (it) 29.910
Then the keyboard layout is set to "it" 0.129
When the network is plugged 0.030
And Tor is ready 15.896
Then I successfully start the Unsafe Browser in "it" 15.156
And I kill the Unsafe Browser 5.742
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 24.088
And DuckDuckGo is the default search engine 22.040
And I kill the Tor Browser 5.562
And the screen keyboard works in Thunderbird 12.003
And the layout of the screen keyboard is set to "us" 0.546
After features/support/hooks.rb:291 1.136
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.981
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.870
When I log in to a new session in Persian (fa) 29.857
Then the keyboard layout is set to "ir" 0.260
When the network is plugged 0.033
And Tor is ready 16.123
Then I successfully start the Unsafe Browser in "fa" 15.331
And I kill the Unsafe Browser 5.805
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 26.523
And DuckDuckGo is the default search engine 19.002
And I kill the Tor Browser 5.544
And the screen keyboard works in Thunderbird 11.992
And the layout of the screen keyboard is set to "ir" 0.542
After features/support/hooks.rb:291 1.591
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.867
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.916
When I log in to a new session in Portuguese (pt) 30.818
Then the keyboard layout is set to "pt" 0.112
When the network is plugged 0.025
And Tor is ready 15.247
Then I successfully start the Unsafe Browser in "pt" 14.263
And I kill the Unsafe Browser 5.729
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 25.327
And DuckDuckGo is the default search engine 23.571
And I kill the Tor Browser 5.597
And the screen keyboard works in Thunderbird 12.612
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.496
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.151
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.025
When I log in to a new session in Russian (ru) 29.869
Then the keyboard layout is set to "ru" 0.248
When the network is plugged 0.035
And Tor is ready 17.835
Then I successfully start the Unsafe Browser in "ru" 14.086
And I kill the Unsafe Browser 5.681
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 26.310
And DuckDuckGo is the default search engine 17.987
And I kill the Tor Browser 5.448
And the screen keyboard works in Thunderbird 12.941
And the layout of the screen keyboard is set to "ru" 0.597
After features/support/hooks.rb:291 3.698
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.980
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.888
When I log in to a new session in Spanish (es) 30.008
Then the keyboard layout is set to "es" 0.148
When the network is plugged 0.051
And Tor is ready 16.393
Then I successfully start the Unsafe Browser in "es" 13.993
And I kill the Unsafe Browser 5.792
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 26.186
And DuckDuckGo is the default search engine 10.452
And I kill the Tor Browser 5.528
And the screen keyboard works in Thunderbird 12.901
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 1.286
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.414
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.944
When I log in to a new session in Turkish (tr) 29.697
Then the keyboard layout is set to "tr" 0.257
When the network is plugged 0.029
And Tor is ready 16.680
Then I successfully start the Unsafe Browser in "tr" 15.665
And I kill the Unsafe Browser 5.702
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 23.868
And DuckDuckGo is the default search engine 19.733
And I kill the Tor Browser 5.630
And the screen keyboard works in Thunderbird 13.554
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 2.214
After features/support/hooks.rb:75 0.000