Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 112 20 Jun 2024, 07:13

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 272 1 2 0 0 275 21 1 22 1:24:17.612 Failed
31.028
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.321
And I prepare Tails for memory erasure tests 0.420
When I start a process allocating 128 MiB of memory with a known pattern 5.747
Then patterns cover at least 128 MiB in the guest's memory 3.666

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 8.896
Then I find very few patterns in the guest's memory 3.976

Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)

After features/support/hooks.rb:326 0.932
After features/support/hooks.rb:100 0.000
25.343
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.545
And I prepare Tails for memory erasure tests 0.386
And I find very few patterns in the guest's memory 3.893

Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.224
Then patterns cover at least 99% of the test FS size in the guest's memory 3.897

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 1.434
Then I find very few patterns in the guest's memory 4.962

Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)

After features/support/hooks.rb:326 1.955
After features/support/hooks.rb:100 0.000
47.694
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.875
And I prepare Tails for memory erasure tests 0.471
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.343
Then I find very few patterns in the guest's memory 4.812

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.811
Then patterns cover at least 86% of the test FS size in the guest's memory 4.041

Pattern coverage: 90.485% (115 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.464
Then I find very few patterns in the guest's memory 3.705

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

# read cache
When I mount the USB drive again 0.316
And I read the content of the test FS 1.900
Then patterns cover at least 99% of the test FS size in the guest's memory 3.445

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.077
Then I find very few patterns in the guest's memory 4.428

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

After features/support/hooks.rb:326 0.830
After features/support/hooks.rb:100 0.000
1:19.433
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.260
And I prepare Tails for memory erasure tests 0.410
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 37.778
Then I find very few patterns in the guest's memory 3.528

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1.956
Then patterns cover at least 99% of the test FS size in the guest's memory 3.154

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.004
Then I find very few patterns in the guest's memory 3.687

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

# read cache
When I mount the USB drive again 11.610
And I read the content of the test FS 1.015
Then patterns cover at least 99% of the test FS size in the guest's memory 2.788

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.739
Then I find very few patterns in the guest's memory 3.496

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

After features/support/hooks.rb:326 1.206
After features/support/hooks.rb:100 0.000
54.704
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.396
And I prepare Tails for memory erasure tests 0.393
When I fill a 128 MiB file with a known pattern on the root filesystem 19.127
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.234
Then patterns cover at least 128 MiB in the guest's memory 2.725

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.012
And I wait 20 seconds 20.017

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.795

Pattern coverage: 0.000% (0 MiB out of 876 MiB reference memory)

After features/support/hooks.rb:326 3.497
After features/support/hooks.rb:100 0.000
8:15.301
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:29.346
And I prepare Tails for memory erasure tests 0.387
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.286
When I trigger shutdown 0.011
And I wait 20 seconds 20.019

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.249

Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)

After features/support/hooks.rb:326 3.485
After features/support/hooks.rb:100 0.009
4:59.644
Before features/support/hooks.rb:269 0.002
Before features/support/hooks.rb:507 0.010
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.602
And I update APT using apt 18.093
And I install "popularity-contest" using apt 22.330
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.922
When I create a persistent storage and activate the Additional Software feature 21.504
Then Additional Software is correctly configured for package "popularity-contest" 1.768
When I shutdown Tails and wait for the computer to power off 10.319
And I start Tails from USB drive "__internal" with network unplugged 57.718
And I enable persistence 18.765
And I log in to a new session 38.561
And the Additional Software installation service has started 41.354
Then I am notified that the installation succeeded 2.598
And Additional Software is correctly configured for package "popularity-contest" 0.828
And the package "popularity-contest" is installed after Additional Software has been started 0.276
After features/support/hooks.rb:515 37.579
After features/support/hooks.rb:326 1.265
After features/support/hooks.rb:100 0.012
2:26.576
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:507 0.004
Given a computer 0.234
And I start Tails from USB drive "__internal" and I login with an administration password 1:40.424
And I update APT using apt 16.824
When I install "makepp" using apt 22.410
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.588
And the package "makepp" is installed 0.094
After features/support/hooks.rb:515 37.336
After features/support/hooks.rb:326 0.937
After features/support/hooks.rb:100 0.014
5:4.651
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.007
Given a computer 0.228
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.588
When I uninstall "popularity-contest" using apt 21.822
And I accept removing "popularity-contest" from Additional Software 0.533
Then "popularity-contest" is not in the list of Additional Software 0.723
When I start Synaptic 22.540
And I update APT using Synaptic 22.680
And I install "cowsay" using Synaptic 11.874
And I accept adding "cowsay" to Additional Software 2.994
Then Additional Software is correctly configured for package "cowsay" 1.006
When I uninstall "cowsay" using apt 3.295
And I refuse removing "cowsay" from Additional Software 0.760
Then Additional Software is correctly configured for package "cowsay" 0.900
When I start "Additional Software" via GNOME Activities Overview 10.670
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.646
Then "cowsay" is not in the list of Additional Software 0.807
When I install "cowsay" using apt 3.213
And I refuse adding "cowsay" to Additional Software 0.604
Then "cowsay" is not in the list of Additional Software 0.758
After features/support/hooks.rb:515 1.014
After features/support/hooks.rb:326 0.699
After features/support/hooks.rb:100 0.008
11:37.761
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.004
Given a computer 0.232
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:19.911
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 30.132
And I accept adding "cowsay" to Additional Software 4.461
And Additional Software is correctly configured for package "cowsay" 0.850
And I shutdown Tails and wait for the computer to power off 6.529
And I start Tails from USB drive "__internal" with network unplugged 56.415
And I enable persistence 11.808
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 36.598
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.344
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.066
And the network is plugged 0.065
And Tor is ready 22.300
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.094
And available upgrades have been checked 0.176
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.778
And I can open the Additional Software configuration window from the notification 6.003
And I shutdown Tails and wait for the computer to power off 2:3.274
And I start Tails from USB drive "__internal" with network unplugged 59.288
And I enable persistence 10.555
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 40.098
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.685
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.056
And Tor is ready 54.542
Then the Additional Software upgrade service has started 0.192
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.095
After features/support/hooks.rb:515 2.728
After features/support/hooks.rb:326 0.773
After features/support/hooks.rb:100 0.025
21:49.631
Scenario I am notified when Additional Software fails to install a package
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.004
Steps
Given a computer 0.215
And I start Tails from USB drive "__internal" with network unplugged 1:0.377
And I enable persistence 10.448
And I remove the "cowsay" deb files from the APT cache 0.679
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.095
And I log in to a new session 37.633
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 20:0.182
execution expired (RemoteShell::Timeout)
./features/support/helpers/remote_shell.rb:56:in `read'
./features/support/helpers/remote_shell.rb:56:in `block (3 levels) in communicate'
./features/support/helpers/remote_shell.rb:55:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/dogtail.rb:80:in `new'
./features/support/helpers/dogtail.rb:80:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/common_steps.rb:582:in `new'
./features/step_definitions/common_steps.rb:582:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:132:in `Then I see the "The installation of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software log file from the notification 0.000
And the package "cowsay" is not installed 0.000
After features/support/hooks.rb:515 0.033
After features/support/hooks.rb:326 11.215

SCENARIO FAILED: 'I am notified when Additional Software fails to install a package' (at time 01:54:07)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/112/artifact/build-artifacts/01:54:07_I_am_notified_when_Additional_Software_fails_to_install_a_package.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/112/artifact/build-artifacts/01:54:07_I_am_notified_when_Additional_Software_fails_to_install_a_package.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/112/artifact/build-artifacts/01:54:07_I_am_notified_when_Additional_Software_fails_to_install_a_package.journal

After features/support/hooks.rb:100 0.007
Feature: Localization
2:35.907
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.425
When I log in to a new session in Arabic (ar) 38.658
Then the keyboard layout is set to "us" 0.148
When the network is plugged 0.050
And Tor is ready 17.779
Then I successfully start the Unsafe Browser in "ar" 16.361
And I kill the Unsafe Browser 5.877
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 32.561
And DuckDuckGo is the default search engine 16.402
And I kill the Tor Browser 5.476
And the screen keyboard works in Thunderbird 13.451
And the layout of the screen keyboard is set to "us" 0.589
After features/support/hooks.rb:326 1.130
After features/support/hooks.rb:100 0.000
Feature: Localization
2:28.260
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.416
When I log in to a new session in Chinese (zh_CN) 34.696
Then the keyboard layout is set to "cn" 0.419
When the network is plugged 0.085
And Tor is ready 17.544
Then I successfully start the Unsafe Browser in "zh_CN" 15.526
And I kill the Unsafe Browser 5.806
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 30.956
And DuckDuckGo is the default search engine 10.427
And I kill the Tor Browser 5.610
And the screen keyboard works in Thunderbird 17.993
And the layout of the screen keyboard is set to "us" 0.643
After features/support/hooks.rb:326 1.467
After features/support/hooks.rb:100 0.000
Feature: Localization
1:59.786
Before features/support/hooks.rb:269 0.025
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.024
When I log in to a new session in English (en) 18.124
Then the keyboard layout is set to "us" 0.149
When the network is plugged 0.043
And Tor is ready 17.186
Then I successfully start the Unsafe Browser in "en" 15.226
And I kill the Unsafe Browser 5.763
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 28.275
And DuckDuckGo is the default search engine 7.122
And I kill the Tor Browser 5.231
And the screen keyboard works in Thunderbird 12.961
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:326 1.354
After features/support/hooks.rb:100 0.000
Feature: Localization
2:23.183
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.533
When I log in to a new session in French (fr) 34.917
Then the keyboard layout is set to "fr" 0.178
When the network is plugged 0.049
And Tor is ready 17.875
Then I successfully start the Unsafe Browser in "fr" 14.588
And I kill the Unsafe Browser 5.786
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 29.767
And DuckDuckGo is the default search engine 10.666
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 14.571
And the layout of the screen keyboard is set to "fr" 0.607
After features/support/hooks.rb:326 1.208
After features/support/hooks.rb:100 0.000
Feature: Localization
2:29.165
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.713
When I log in to a new session in German (de) 33.854
Then the keyboard layout is set to "de" 0.140
When the network is plugged 0.042
And Tor is ready 16.322
Then I successfully start the Unsafe Browser in "de" 15.594
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 30.423
And DuckDuckGo is the default search engine 17.088
And I kill the Tor Browser 5.643
And the screen keyboard works in Thunderbird 14.702
And the layout of the screen keyboard is set to "de" 0.677
After features/support/hooks.rb:326 1.157
After features/support/hooks.rb:100 0.000
Feature: Localization
2:20.657
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.388
When I log in to a new session in Italian (it) 33.164
Then the keyboard layout is set to "it" 0.530
When the network is plugged 0.042
And Tor is ready 17.622
Then I successfully start the Unsafe Browser in "it" 15.473
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 30.793
And DuckDuckGo is the default search engine 10.023
And I kill the Tor Browser 5.282
And the screen keyboard works in Thunderbird 12.785
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:326 2.617
After features/support/hooks.rb:100 0.000
Feature: Localization
2:20.058
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.087
When I log in to a new session in Persian (fa) 34.973
Then the keyboard layout is set to "ir" 0.152
When the network is plugged 0.045
And Tor is ready 17.959
Then I successfully start the Unsafe Browser in "fa" 14.224
And I kill the Unsafe Browser 5.915
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 28.809
And DuckDuckGo is the default search engine 9.978
And I kill the Tor Browser 5.285
And the screen keyboard works in Thunderbird 13.935
And the layout of the screen keyboard is set to "ir" 0.545
After features/support/hooks.rb:326 1.343
After features/support/hooks.rb:100 0.000
Feature: Localization
2:19.826
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.257
When I log in to a new session in Portuguese (pt) 34.004
Then the keyboard layout is set to "pt" 0.502
When the network is plugged 0.066
And Tor is ready 16.158
Then I successfully start the Unsafe Browser in "pt" 14.950
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 29.205
And DuckDuckGo is the default search engine 10.418
And I kill the Tor Browser 5.521
And the screen keyboard works in Thunderbird 14.289
And the layout of the screen keyboard is set to "us" 0.530
After features/support/hooks.rb:326 1.070
After features/support/hooks.rb:100 0.000
Feature: Localization
2:22.549
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.646
When I log in to a new session in Russian (ru) 34.460
Then the keyboard layout is set to "ru" 0.215
When the network is plugged 0.048
And Tor is ready 17.121
Then I successfully start the Unsafe Browser in "ru" 15.090
And I kill the Unsafe Browser 5.774
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 30.224
And DuckDuckGo is the default search engine 10.387
And I kill the Tor Browser 5.572
And the screen keyboard works in Thunderbird 14.309
And the layout of the screen keyboard is set to "ru" 0.575
After features/support/hooks.rb:326 1.048
After features/support/hooks.rb:100 0.000
Feature: Localization
2:23.056
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.446
When I log in to a new session in Spanish (es) 34.713
Then the keyboard layout is set to "es" 0.143
When the network is plugged 0.045
And Tor is ready 14.386
Then I successfully start the Unsafe Browser in "es" 16.389
And I kill the Unsafe Browser 5.871
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 27.011
And DuckDuckGo is the default search engine 16.954
And I kill the Tor Browser 5.517
And the screen keyboard works in Thunderbird 12.858
And the layout of the screen keyboard is set to "us" 0.600
After features/support/hooks.rb:326 4.046
After features/support/hooks.rb:100 0.000
Feature: Localization
2:23.388
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.460
When I log in to a new session in Turkish (tr) 34.722
Then the keyboard layout is set to "tr" 0.225
When the network is plugged 0.043
And Tor is ready 16.884
Then I successfully start the Unsafe Browser in "tr" 15.210
And I kill the Unsafe Browser 5.834
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 29.663
And DuckDuckGo is the default search engine 9.826
And I kill the Tor Browser 5.256
And the screen keyboard works in Thunderbird 14.560
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:326 1.092
After features/support/hooks.rb:100 0.000