Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 25 30 Mar 2024, 06:43

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 268 1 2 0 0 271 21 1 22 1:16:29.173 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.088
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and logged in 8.480
And I prepare Tails for memory erasure tests 0.416
When I start a process allocating 128 MiB of memory with a known pattern 1.218
Then patterns cover at least 128 MiB in the guest's memory 3.835 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.032
Then I find very few patterns in the guest's memory 4.104 
Pattern coverage: 0.000% (0 MiB out of 900 MiB reference memory)
After features/support/hooks.rb:291 1.202
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.573
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.113
And I prepare Tails for memory erasure tests 0.540
And I find very few patterns in the guest's memory 3.916 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.872
Then patterns cover at least 99% of the test FS size in the guest's memory 4.025 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.595
Then I find very few patterns in the guest's memory 4.509 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
After features/support/hooks.rb:291 1.039
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
44.482
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 8.985
And I prepare Tails for memory erasure tests 0.377
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.841
Then I find very few patterns in the guest's memory 4.821 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.307
Then patterns cover at least 86% of the test FS size in the guest's memory 4.464 
Pattern coverage: 88.685% (113 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.259
Then I find very few patterns in the guest's memory 4.478 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
# read cache
When I mount the USB drive again 0.215
And I read the content of the test FS 0.778
Then patterns cover at least 99% of the test FS size in the guest's memory 4.101 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.669
Then I find very few patterns in the guest's memory 4.179 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:291 0.754
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:6.646
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.684
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 30.142
Then I find very few patterns in the guest's memory 3.778 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.822
Then patterns cover at least 99% of the test FS size in the guest's memory 2.988 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.738
Then I find very few patterns in the guest's memory 3.910 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
# read cache
When I mount the USB drive again 5.885
And I read the content of the test FS 0.402
Then patterns cover at least 99% of the test FS size in the guest's memory 3.384 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.514
Then I find very few patterns in the guest's memory 3.943 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
After features/support/hooks.rb:291 0.844
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.799
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.553
And I prepare Tails for memory erasure tests 0.393
When I fill a 128 MiB file with a known pattern on the root filesystem 19.826
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.378
Then patterns cover at least 128 MiB in the guest's memory 2.870 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.744 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
After features/support/hooks.rb:291 3.543
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:39.262
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:49.910
And I prepare Tails for memory erasure tests 0.394
When I fill a 128 MiB file with a known pattern on the persistent filesystem 26.509
When I trigger shutdown 0.016
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.411 
Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)
After features/support/hooks.rb:291 3.553
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:37.115
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.272
And I update APT using apt 18.596
And I install "popularity-contest" using apt 22.420
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.214
When I create a persistent storage and activate the Additional Software feature 20.626
Then Additional Software is correctly configured for package "popularity-contest" 1.092
When I shutdown Tails and wait for the computer to power off 11.103
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:26.711
Then Additional Software is correctly configured for package "popularity-contest" 0.827
And the package "popularity-contest" is installed after Additional Software has been started 0.250
After features/support/hooks.rb:450 39.527
After features/support/hooks.rb:291 1.174
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:15.096
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with an administration password 1:32.783
And I update APT using apt 16.179
When I install "makepp" using apt 19.304
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.556
And the package "makepp" is installed 0.071
After features/support/hooks.rb:450 41.516
After features/support/hooks.rb:291 0.919
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:31.932
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.198
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:49.588
When I uninstall "popularity-contest" using apt 18.764
And I accept removing "popularity-contest" from Additional Software 0.621
Then "popularity-contest" is not in the list of Additional Software 0.646
When I start Synaptic 23.389
And I update APT using Synaptic 22.112
And I install "cowsay" using Synaptic 9.823
And I accept adding "cowsay" to Additional Software 0.927
Then Additional Software is correctly configured for package "cowsay" 0.813
When I uninstall "cowsay" using apt 3.245
And I refuse removing "cowsay" from Additional Software 0.505
Then Additional Software is correctly configured for package "cowsay" 0.747
When I start "Additional Software" via GNOME Activities Overview 9.818
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.409
Then "cowsay" is not in the list of Additional Software 0.957
When I install "cowsay" using apt 3.211
And I refuse adding "cowsay" to Additional Software 0.522
Then "cowsay" is not in the list of Additional Software 0.628
After features/support/hooks.rb:450 0.928
After features/support/hooks.rb:291 0.630
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
8:44.193
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.195
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:7.663
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.418
And I accept adding "cowsay" to Additional Software 5.663
And Additional Software is correctly configured for package "cowsay" 0.919
And I shutdown Tails and wait for the computer to power off 6.719
And I start Tails from USB drive "__internal" with network unplugged 53.680
And I enable persistence 10.966
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 33.603
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.685
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.063
And the network is plugged 0.043
And Tor is ready 15.321
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.683
And available upgrades have been checked 0.112
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.388
And I can open the Additional Software configuration window from the notification 3.254
And I shutdown Tails and wait for the computer to power off 14.690
And I start Tails from USB drive "__internal" with network unplugged 1:1.429
And I enable persistence 10.726
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 33.003
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.611
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.309
And Tor is ready 48.596
Then the Additional Software upgrade service has started 0.159
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.109
After features/support/hooks.rb:450 2.380
After features/support/hooks.rb:291 0.668
After features/support/hooks.rb:75 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
21:37.964
Scenario I am notified when Additional Software fails to install a package
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Steps
Given a computer 0.189
And I start Tails from USB drive "__internal" with network unplugged 53.593
And I enable persistence 9.602
And I remove the "cowsay" deb files from the APT cache 0.237
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.098
And I log in to a new session 34.087
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 20:0.155
execution 
execution expired (RemoteShell::Timeout)
./features/support/helpers/remote_shell.rb:56:in `read'
./features/support/helpers/remote_shell.rb:56:in `block (3 levels) in communicate'
./features/support/helpers/remote_shell.rb:55:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/dogtail.rb:80:in `new'
./features/support/helpers/dogtail.rb:80:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/common_steps.rb:589:in `new'
./features/step_definitions/common_steps.rb:589:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:128:in `Then I see the "The installation of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software log file from the notification 0.000
And the package "cowsay" is not installed 0.000
After features/support/hooks.rb:450 0.032
After features/support/hooks.rb:291 9.870 
SCENARIO FAILED: 'I am notified when Additional Software fails to install a package' (at time 01:44:12)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/25/artifact/build-artifacts/01:44:12_I_am_notified_when_Additional_Software_fails_to_install_a_package.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/25/artifact/build-artifacts/01:44:12_I_am_notified_when_Additional_Software_fails_to_install_a_package.mkv
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:8.830
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.869
When I log in to a new session in Arabic (ar) 28.281
Then the keyboard layout is set to "us" 0.128
When the network is plugged 0.041
And Tor is ready 16.850
Then I successfully start the Unsafe Browser in "ar" 14.849
And I kill the Unsafe Browser 5.708
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 27.429
And DuckDuckGo is the default search engine 9.695
And I kill the Tor Browser 5.248
And the screen keyboard works in Thunderbird 12.084
And the layout of the screen keyboard is set to "us" 0.543
After features/support/hooks.rb:291 1.697
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.451
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.246
When I log in to a new session in Chinese (zh_CN) 30.133
Then the keyboard layout is set to "cn" 0.262
When the network is plugged 0.062
And Tor is ready 16.673
Then I successfully start the Unsafe Browser in "zh_CN" 14.799
And I kill the Unsafe Browser 5.699
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 24.701
And DuckDuckGo is the default search engine 10.391
And I kill the Tor Browser 5.416
And the screen keyboard works in Thunderbird 17.346
And the layout of the screen keyboard is set to "us" 0.620
After features/support/hooks.rb:291 1.766
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:52.403
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.034
When I log in to a new session in English (en) 14.757
Then the keyboard layout is set to "us" 0.175
When the network is plugged 0.062
And Tor is ready 13.938
Then I successfully start the Unsafe Browser in "en" 14.548
And I kill the Unsafe Browser 5.644
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 27.294
And DuckDuckGo is the default search engine 10.085
And I kill the Tor Browser 5.240
And the screen keyboard works in Thunderbird 11.904
And the layout of the screen keyboard is set to "us" 0.621
After features/support/hooks.rb:291 1.299
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.241
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.056
When I log in to a new session in French (fr) 29.987
Then the keyboard layout is set to "fr" 0.113
When the network is plugged 0.041
And Tor is ready 43.267
Then I successfully start the Unsafe Browser in "fr" 13.531
And I kill the Unsafe Browser 5.662
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 26.508
And DuckDuckGo is the default search engine 11.633
And I kill the Tor Browser 5.525
And the screen keyboard works in Thunderbird 13.218
And the layout of the screen keyboard is set to "fr" 0.590
After features/support/hooks.rb:291 1.189
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.662
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.997
When I log in to a new session in German (de) 31.011
Then the keyboard layout is set to "de" 0.275
When the network is plugged 0.056
And Tor is ready 14.371
Then I successfully start the Unsafe Browser in "de" 14.202
And I kill the Unsafe Browser 5.665
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 25.268
And DuckDuckGo is the default search engine 21.813
And I kill the Tor Browser 5.471
And the screen keyboard works in Thunderbird 11.829
And the layout of the screen keyboard is set to "de" 0.592
After features/support/hooks.rb:291 1.799
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.665
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.933
When I log in to a new session in Italian (it) 30.666
Then the keyboard layout is set to "it" 0.172
When the network is plugged 0.061
And Tor is ready 17.059
Then I successfully start the Unsafe Browser in "it" 14.345
And I kill the Unsafe Browser 5.768
When I enable the screen keyboard 0.088
Then the screen keyboard works in Tor Browser 25.920
And DuckDuckGo is the default search engine 18.484
And I kill the Tor Browser 5.453
And the screen keyboard works in Thunderbird 12.095
And the layout of the screen keyboard is set to "us" 0.618
After features/support/hooks.rb:291 3.431
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.686
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.842
When I log in to a new session in Persian (fa) 30.600
Then the keyboard layout is set to "ir" 0.207
When the network is plugged 0.045
And Tor is ready 18.647
Then I successfully start the Unsafe Browser in "fa" 13.392
And I kill the Unsafe Browser 5.624
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 25.376
And DuckDuckGo is the default search engine 10.053
And I kill the Tor Browser 5.264
And the screen keyboard works in Thunderbird 12.007
And the layout of the screen keyboard is set to "ir" 0.532
After features/support/hooks.rb:291 1.052
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.859
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.721
When I log in to a new session in Portuguese (pt) 38.393
Then the keyboard layout is set to "pt" 0.321
When the network is plugged 0.040
And Tor is ready 15.752
Then I successfully start the Unsafe Browser in "pt" 15.072
And I kill the Unsafe Browser 5.642
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 26.673
And DuckDuckGo is the default search engine 10.905
And I kill the Tor Browser 5.696
And the screen keyboard works in Thunderbird 11.960
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.209
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.682
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.113
When I log in to a new session in Russian (ru) 35.731
Then the keyboard layout is set to "ru" 0.165
When the network is plugged 0.040
And Tor is ready 14.677
Then I successfully start the Unsafe Browser in "ru" 14.685
And I kill the Unsafe Browser 5.629
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 26.239
And DuckDuckGo is the default search engine 10.882
And I kill the Tor Browser 5.513
And the screen keyboard works in Thunderbird 14.233
And the layout of the screen keyboard is set to "ru" 0.666
After features/support/hooks.rb:291 1.048
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.932
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.149
When I log in to a new session in Spanish (es) 29.402
Then the keyboard layout is set to "es" 0.202
When the network is plugged 0.068
And Tor is ready 13.363
Then I successfully start the Unsafe Browser in "es" 14.545
And I kill the Unsafe Browser 5.612
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 26.088
And DuckDuckGo is the default search engine 14.002
And I kill the Tor Browser 5.598
And the screen keyboard works in Thunderbird 12.196
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 1.132
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:8.603
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.846
When I log in to a new session in Turkish (tr) 28.599
Then the keyboard layout is set to "tr" 0.157
When the network is plugged 0.054
And Tor is ready 14.728
Then I successfully start the Unsafe Browser in "tr" 14.179
And I kill the Unsafe Browser 5.789
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 28.100
And DuckDuckGo is the default search engine 11.486
And I kill the Tor Browser 5.500
And the screen keyboard works in Thunderbird 11.459
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.154
After features/support/hooks.rb:75 0.000