Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 34 08 Apr 2024, 06:49

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 269 1 5 0 0 275 21 1 22 1:15:1.938 Failed
19.096
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.108
And I prepare Tails for memory erasure tests 0.519
When I start a process allocating 128 MiB of memory with a known pattern 2.677
Then patterns cover at least 128 MiB in the guest's memory 3.229

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.704
Then I find very few patterns in the guest's memory 3.856

Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)

After features/support/hooks.rb:305 0.634
After features/support/hooks.rb:89 0.000
21.863
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 7.974
And I prepare Tails for memory erasure tests 0.397
And I find very few patterns in the guest's memory 3.830

Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.489
Then patterns cover at least 99% of the test FS size in the guest's memory 3.282

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 1.185
Then I find very few patterns in the guest's memory 3.703

Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)

After features/support/hooks.rb:305 0.949
After features/support/hooks.rb:89 0.000
45.017
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.225
And I prepare Tails for memory erasure tests 0.424
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.929
Then I find very few patterns in the guest's memory 4.104

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 6.233
Then patterns cover at least 86% of the test FS size in the guest's memory 3.342

Pattern coverage: 89.867% (114 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.871
Then I find very few patterns in the guest's memory 4.280

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

# read cache
When I mount the USB drive again 0.239
And I read the content of the test FS 0.425
Then patterns cover at least 99% of the test FS size in the guest's memory 4.172

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.326
Then I find very few patterns in the guest's memory 4.441

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

After features/support/hooks.rb:305 0.894
After features/support/hooks.rb:89 0.000
1:1.046
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.150
And I prepare Tails for memory erasure tests 0.440
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.806
Then I find very few patterns in the guest's memory 3.416

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1.784
Then patterns cover at least 99% of the test FS size in the guest's memory 2.775

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.631
Then I find very few patterns in the guest's memory 3.456

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

# read cache
When I mount the USB drive again 3.153
And I read the content of the test FS 0.389
Then patterns cover at least 99% of the test FS size in the guest's memory 2.695

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.488
Then I find very few patterns in the guest's memory 3.858

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

After features/support/hooks.rb:305 0.771
After features/support/hooks.rb:89 0.000
49.390
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.688
And I prepare Tails for memory erasure tests 0.649
When I fill a 128 MiB file with a known pattern on the root filesystem 14.056
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.077
Then patterns cover at least 128 MiB in the guest's memory 3.101

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.013
And I wait 20 seconds 20.016

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.786

Pattern coverage: 0.000% (0 MiB out of 886 MiB reference memory)

After features/support/hooks.rb:305 3.564
After features/support/hooks.rb:89 0.000
25:38.699
Scenario Erasure of read and write disk caches of persistent data on shutdown
Before features/support/hooks.rb:259 0.003
Steps
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 25:38.699
execution expired (RemoteShell::Timeout)
./features/support/helpers/remote_shell.rb:56:in `read'
./features/support/helpers/remote_shell.rb:56:in `block (3 levels) in communicate'
./features/support/helpers/remote_shell.rb:55:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/dogtail.rb:80:in `new'
./features/support/helpers/dogtail.rb:80:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/common_steps.rb:713:in `new'
./features/step_definitions/common_steps.rb:713:in `/^all notifications have disappeared$/'
./features/step_definitions/snapshots.rb:152:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:149:in `each'
./features/step_definitions/snapshots.rb:149:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:172:in `/^I\ have\ started\ Tails\ without\ network\ from\ a\ USB\ drive\ with\ a\ persistent\ partition\ enabled\ and\ logged\ in$/'
features/erase_memory.feature:76:in `Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in'
And I prepare Tails for memory erasure tests 0.000
When I fill a 128 MiB file with a known pattern on the persistent filesystem 0.000
When I trigger shutdown 0.000
And I wait 20 seconds 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:305 9.809

SCENARIO FAILED: 'Erasure of read and write disk caches of persistent data on shutdown' (at time 00:54:29)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/34/artifact/build-artifacts/00:54:29_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/34/artifact/build-artifacts/00:54:29_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.mkv

After features/support/hooks.rb:89 0.018
4:34.463
Before features/support/hooks.rb:259 0.003
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.495
And I update APT using apt 16.389
And I install "popularity-contest" using apt 19.260
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.847
When I create a persistent storage and activate the Additional Software feature 20.020
Then Additional Software is correctly configured for package "popularity-contest" 1.505
When I shutdown Tails and wait for the computer to power off 12.459
And I start Tails from USB drive "__internal" with network unplugged 56.688
And I enable persistence 19.657
And I log in to a new session 32.629
And the Additional Software installation service has started 31.098
Then I am notified that the installation succeeded 2.340
And Additional Software is correctly configured for package "popularity-contest" 0.829
And the package "popularity-contest" is installed after Additional Software has been started 0.241
After features/support/hooks.rb:464 40.468
After features/support/hooks.rb:305 1.457
After features/support/hooks.rb:89 0.048
2:19.678
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.008
Given a computer 0.234
And I start Tails from USB drive "__internal" and I login with an administration password 1:35.470
And I update APT using apt 16.948
When I install "makepp" using apt 22.427
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.514
And the package "makepp" is installed 0.083
After features/support/hooks.rb:464 40.713
After features/support/hooks.rb:305 1.007
After features/support/hooks.rb:89 0.014
4:37.418
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.006
Given a computer 0.216
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:52.182
When I uninstall "popularity-contest" using apt 18.770
And I accept removing "popularity-contest" from Additional Software 0.554
Then "popularity-contest" is not in the list of Additional Software 0.718
When I start Synaptic 23.966
And I update APT using Synaptic 22.401
And I install "cowsay" using Synaptic 8.967
And I accept adding "cowsay" to Additional Software 2.388
Then Additional Software is correctly configured for package "cowsay" 0.796
When I uninstall "cowsay" using apt 3.225
And I refuse removing "cowsay" from Additional Software 0.582
Then Additional Software is correctly configured for package "cowsay" 0.744
When I start "Additional Software" via GNOME Activities Overview 10.520
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.902
Then "cowsay" is not in the list of Additional Software 1.037
When I install "cowsay" using apt 3.231
And I refuse adding "cowsay" to Additional Software 0.568
Then "cowsay" is not in the list of Additional Software 0.641
After features/support/hooks.rb:464 0.992
After features/support/hooks.rb:305 0.638
After features/support/hooks.rb:89 0.010
8:57.933
Before features/support/hooks.rb:259 0.026
Before features/support/hooks.rb:456 0.027
Given a computer 0.209
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:11.239
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.721
And I accept adding "cowsay" to Additional Software 5.705
And Additional Software is correctly configured for package "cowsay" 1.109
And I shutdown Tails and wait for the computer to power off 6.496
And I start Tails from USB drive "__internal" with network unplugged 1:3.331
And I enable persistence 11.359
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 33.970
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.171
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.063
And the network is plugged 0.061
And Tor is ready 20.025
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.792
And available upgrades have been checked 0.076
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.298
And I can open the Additional Software configuration window from the notification 3.777
And I shutdown Tails and wait for the computer to power off 13.144
And I start Tails from USB drive "__internal" with network unplugged 55.894
And I enable persistence 11.005
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 35.229
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.581
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
And the network is plugged 0.034
And Tor is ready 50.201
Then the Additional Software upgrade service has started 0.166
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.092
After features/support/hooks.rb:464 2.152
After features/support/hooks.rb:305 0.671
After features/support/hooks.rb:89 0.033
2:3.058
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.008
Given a computer 0.214
And I start Tails from USB drive "__internal" with network unplugged 55.304
And I enable persistence 10.776
And I remove the "cowsay" deb files from the APT cache 0.615
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.079
And I log in to a new session 32.919
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 15.816
And I can open the Additional Software log file from the notification 6.757
And the package "cowsay" is not installed 0.577
After features/support/hooks.rb:464 0.203
After features/support/hooks.rb:305 1.009
After features/support/hooks.rb:89 0.013
Feature: Localization
2:17.160
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.534
When I log in to a new session in Arabic (ar) 28.873
Then the keyboard layout is set to "us" 0.296
When the network is plugged 0.038
And Tor is ready 16.217
Then I successfully start the Unsafe Browser in "ar" 14.356
And I kill the Unsafe Browser 5.731
When I enable the screen keyboard 0.088
Then the screen keyboard works in Tor Browser 26.787
And DuckDuckGo is the default search engine 18.432
And I kill the Tor Browser 5.564
And the screen keyboard works in Thunderbird 11.703
And the layout of the screen keyboard is set to "us" 0.535
After features/support/hooks.rb:305 1.082
After features/support/hooks.rb:89 0.000
Feature: Localization
2:19.602
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.895
When I log in to a new session in Chinese (zh_CN) 29.006
Then the keyboard layout is set to "cn" 0.235
When the network is plugged 0.048
And Tor is ready 16.489
Then I successfully start the Unsafe Browser in "zh_CN" 14.150
And I kill the Unsafe Browser 5.639
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 25.249
And DuckDuckGo is the default search engine 17.856
And I kill the Tor Browser 5.418
And the screen keyboard works in Thunderbird 16.952
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:305 1.607
After features/support/hooks.rb:89 0.000
Feature: Localization
1:49.413
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.767
When I log in to a new session in English (en) 14.876
Then the keyboard layout is set to "us" 0.156
When the network is plugged 0.035
And Tor is ready 15.782
Then I successfully start the Unsafe Browser in "en" 13.473
And I kill the Unsafe Browser 5.680
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 24.009
And DuckDuckGo is the default search engine 10.236
And I kill the Tor Browser 5.410
And the screen keyboard works in Thunderbird 11.343
And the layout of the screen keyboard is set to "us" 0.536
After features/support/hooks.rb:305 0.982
After features/support/hooks.rb:89 0.000
Feature: Localization
2:3.723
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.850
When I log in to a new session in French (fr) 28.639
Then the keyboard layout is set to "fr" 0.150
When the network is plugged 0.055
And Tor is ready 15.371
Then I successfully start the Unsafe Browser in "fr" 14.277
And I kill the Unsafe Browser 5.671
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 25.085
And DuckDuckGo is the default search engine 9.721
And I kill the Tor Browser 5.294
And the screen keyboard works in Thunderbird 10.951
And the layout of the screen keyboard is set to "fr" 0.544
After features/support/hooks.rb:305 1.132
After features/support/hooks.rb:89 0.000
Feature: Localization
2:7.196
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.827
When I log in to a new session in German (de) 29.577
Then the keyboard layout is set to "de" 0.274
When the network is plugged 0.040
And Tor is ready 17.872
Then I successfully start the Unsafe Browser in "de" 13.729
And I kill the Unsafe Browser 5.621
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 25.033
And DuckDuckGo is the default search engine 10.105
And I kill the Tor Browser 5.433
And the screen keyboard works in Thunderbird 11.015
And the layout of the screen keyboard is set to "de" 0.566
After features/support/hooks.rb:305 1.304
After features/support/hooks.rb:89 0.000
Feature: Localization
2:12.114
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.940
When I log in to a new session in Italian (it) 29.553
Then the keyboard layout is set to "it" 0.289
When the network is plugged 0.041
And Tor is ready 14.435
Then I successfully start the Unsafe Browser in "it" 13.942
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 23.271
And DuckDuckGo is the default search engine 19.006
And I kill the Tor Browser 5.479
And the screen keyboard works in Thunderbird 11.535
And the layout of the screen keyboard is set to "us" 0.684
After features/support/hooks.rb:305 1.500
After features/support/hooks.rb:89 0.000
Feature: Localization
2:4.130
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.845
When I log in to a new session in Persian (fa) 29.989
Then the keyboard layout is set to "ir" 0.336
When the network is plugged 0.039
And Tor is ready 14.400
Then I successfully start the Unsafe Browser in "fa" 14.192
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 23.491
And DuckDuckGo is the default search engine 9.890
And I kill the Tor Browser 5.388
And the screen keyboard works in Thunderbird 11.120
And the layout of the screen keyboard is set to "ir" 0.552
After features/support/hooks.rb:305 1.030
After features/support/hooks.rb:89 0.000
Feature: Localization
2:7.158
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.778
When I log in to a new session in Portuguese (pt) 30.138
Then the keyboard layout is set to "pt" 0.290
When the network is plugged 0.056
And Tor is ready 17.103
Then I successfully start the Unsafe Browser in "pt" 13.450
And I kill the Unsafe Browser 5.705
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 24.802
And DuckDuckGo is the default search engine 10.011
And I kill the Tor Browser 5.249
And the screen keyboard works in Thunderbird 11.845
And the layout of the screen keyboard is set to "us" 0.619
After features/support/hooks.rb:305 1.298
After features/support/hooks.rb:89 0.000
Feature: Localization
2:6.575
Before features/support/hooks.rb:259 0.024
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.960
When I log in to a new session in Russian (ru) 29.201
Then the keyboard layout is set to "ru" 0.236
When the network is plugged 0.052
And Tor is ready 15.018
Then I successfully start the Unsafe Browser in "ru" 13.784
And I kill the Unsafe Browser 5.708
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 25.633
And DuckDuckGo is the default search engine 10.617
And I kill the Tor Browser 5.463
And the screen keyboard works in Thunderbird 12.213
And the layout of the screen keyboard is set to "ru" 0.566
After features/support/hooks.rb:305 1.475
After features/support/hooks.rb:89 0.000
Feature: Localization
2:19.288
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.914
When I log in to a new session in Spanish (es) 29.949
Then the keyboard layout is set to "es" 0.224
When the network is plugged 0.065
And Tor is ready 15.659
Then I successfully start the Unsafe Browser in "es" 14.331
And I kill the Unsafe Browser 5.755
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 25.361
And DuckDuckGo is the default search engine 22.355
And I kill the Tor Browser 5.563
And the screen keyboard works in Thunderbird 11.420
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:305 1.392
After features/support/hooks.rb:89 0.000
Feature: Localization
2:7.908
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.888
When I log in to a new session in Turkish (tr) 29.622
Then the keyboard layout is set to "tr" 0.215
When the network is plugged 0.041
And Tor is ready 14.996
Then I successfully start the Unsafe Browser in "tr" 14.094
And I kill the Unsafe Browser 5.716
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 27.276
And DuckDuckGo is the default search engine 10.406
And I kill the Tor Browser 5.552
And the screen keyboard works in Thunderbird 11.417
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:305 1.199
After features/support/hooks.rb:89 0.000