Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 62 02 May 2024, 06:47

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 274 1 0 0 0 275 21 1 22 1:4:23.396 Failed
24.804
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:259 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.349
And I prepare Tails for memory erasure tests 0.513
When I start a process allocating 128 MiB of memory with a known pattern 7.307
Then patterns cover at least 128 MiB in the guest's memory 3.993

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.419
Then I find very few patterns in the guest's memory 4.222
9.295% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1

Pattern coverage: 9.295% (82 MiB out of 887 MiB reference memory)

After features/support/hooks.rb:305 4.518

SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:10)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/62/artifact/build-artifacts/00:29:10_Erasure_of_memory_freed_by_killed_userspace_processes.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/62/artifact/build-artifacts/00:29:10_Erasure_of_memory_freed_by_killed_userspace_processes.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/62/artifact/build-artifacts/00:29:10_Erasure_of_memory_freed_by_killed_userspace_processes.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/62/artifact/build-artifacts/00:29:10_Erasure_of_memory_freed_by_killed_userspace_processes.journal

After features/support/hooks.rb:89 0.000
31.829
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.797
And I prepare Tails for memory erasure tests 0.433
And I find very few patterns in the guest's memory 7.091

Pattern coverage: 0.000% (0 MiB out of 886 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.613
Then patterns cover at least 99% of the test FS size in the guest's memory 8.058

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 1.303
Then I find very few patterns in the guest's memory 4.529

Pattern coverage: 0.000% (0 MiB out of 886 MiB reference memory)

After features/support/hooks.rb:305 1.239
After features/support/hooks.rb:89 0.000
46.551
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.375
And I prepare Tails for memory erasure tests 0.453
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.246
Then I find very few patterns in the guest's memory 5.455

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 5.575
Then patterns cover at least 86% of the test FS size in the guest's memory 3.806

Pattern coverage: 88.428% (112 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.640
Then I find very few patterns in the guest's memory 3.584

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

# read cache
When I mount the USB drive again 0.258
And I read the content of the test FS 0.477
Then patterns cover at least 99% of the test FS size in the guest's memory 3.084

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.696
Then I find very few patterns in the guest's memory 3.897

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

After features/support/hooks.rb:305 2.081
After features/support/hooks.rb:89 0.000
1:19.186
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.493
And I prepare Tails for memory erasure tests 0.517
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 36.212
Then I find very few patterns in the guest's memory 4.220

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.114
Then patterns cover at least 99% of the test FS size in the guest's memory 3.585

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 4.981
Then I find very few patterns in the guest's memory 4.176

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

# read cache
When I mount the USB drive again 5.789
And I read the content of the test FS 0.499
Then patterns cover at least 99% of the test FS size in the guest's memory 3.697

Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.684
Then I find very few patterns in the guest's memory 4.213

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

After features/support/hooks.rb:305 0.837
After features/support/hooks.rb:89 0.000
53.089
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.215
And I prepare Tails for memory erasure tests 0.433
When I fill a 128 MiB file with a known pattern on the root filesystem 17.948
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.969
Then patterns cover at least 128 MiB in the guest's memory 2.647

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.013
And I wait 20 seconds 20.016

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.845

Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)

After features/support/hooks.rb:305 3.557
After features/support/hooks.rb:89 0.000
7:44.973
Before features/support/hooks.rb:259 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:57.943
And I prepare Tails for memory erasure tests 0.420
When I fill a 128 MiB file with a known pattern on the persistent filesystem 24.363
When I trigger shutdown 0.010
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.215

Pattern coverage: 0.000% (0 MiB out of 886 MiB reference memory)

After features/support/hooks.rb:305 3.482
After features/support/hooks.rb:89 0.011
4:56.760
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.829
And I update APT using apt 19.598
And I install "popularity-contest" using apt 22.337
Then I am proposed to add the "popularity-contest" package to my Additional Software 10.240
When I create a persistent storage and activate the Additional Software feature 21.302
Then Additional Software is correctly configured for package "popularity-contest" 1.491
When I shutdown Tails and wait for the computer to power off 12.647
And I start Tails from USB drive "__internal" with network unplugged 59.121
And I enable persistence 23.740
And I log in to a new session 36.788
And the Additional Software installation service has started 31.961
Then I am notified that the installation succeeded 2.619
And Additional Software is correctly configured for package "popularity-contest" 0.850
And the package "popularity-contest" is installed after Additional Software has been started 0.230
After features/support/hooks.rb:464 35.794
After features/support/hooks.rb:305 1.110
After features/support/hooks.rb:89 0.013
2:26.728
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.005
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with an administration password 1:40.885
And I update APT using apt 16.567
When I install "makepp" using apt 22.449
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.561
And the package "makepp" is installed 0.081
After features/support/hooks.rb:464 39.389
After features/support/hooks.rb:305 0.989
After features/support/hooks.rb:89 0.018
5:14.469
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.006
Given a computer 0.217
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:22.343
When I uninstall "popularity-contest" using apt 21.836
And I accept removing "popularity-contest" from Additional Software 0.603
Then "popularity-contest" is not in the list of Additional Software 0.711
When I start Synaptic 25.803
And I update APT using Synaptic 22.057
And I install "cowsay" using Synaptic 12.161
And I accept adding "cowsay" to Additional Software 1.396
Then Additional Software is correctly configured for package "cowsay" 0.867
When I uninstall "cowsay" using apt 3.213
And I refuse removing "cowsay" from Additional Software 0.587
Then Additional Software is correctly configured for package "cowsay" 0.848
When I start "Additional Software" via GNOME Activities Overview 10.659
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.686
Then "cowsay" is not in the list of Additional Software 0.878
When I install "cowsay" using apt 3.200
And I refuse adding "cowsay" to Additional Software 0.610
Then "cowsay" is not in the list of Additional Software 0.785
After features/support/hooks.rb:464 1.085
After features/support/hooks.rb:305 0.688
After features/support/hooks.rb:89 0.010
10:17.855
Before features/support/hooks.rb:259 0.003
Before features/support/hooks.rb:456 0.003
Given a computer 0.173
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:25.462
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.064
And I accept adding "cowsay" to Additional Software 6.769
And Additional Software is correctly configured for package "cowsay" 0.958
And I shutdown Tails and wait for the computer to power off 6.452
And I start Tails from USB drive "__internal" with network unplugged 58.102
And I enable persistence 12.706
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 35.852
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.080
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.081
And the network is plugged 0.038
And Tor is ready 48.583
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.117
And available upgrades have been checked 0.242
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.567
And I can open the Additional Software configuration window from the notification 3.935
And I shutdown Tails and wait for the computer to power off 17.419
And I start Tails from USB drive "__internal" with network unplugged 58.722
And I enable persistence 13.490
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 35.610
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.983
And I revert the APT tweaks that made it prefer an old version of cowsay 0.072
And the network is plugged 0.036
And Tor is ready 51.882
Then the Additional Software upgrade service has started 0.211
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.092
After features/support/hooks.rb:464 2.608
After features/support/hooks.rb:305 1.029
After features/support/hooks.rb:89 0.026
2:13.384
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.228
And I start Tails from USB drive "__internal" with network unplugged 1:0.569
And I enable persistence 13.011
And I remove the "cowsay" deb files from the APT cache 0.764
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.089
And I log in to a new session 35.802
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 16.492
And I can open the Additional Software log file from the notification 5.773
And the package "cowsay" is not installed 0.651
After features/support/hooks.rb:464 0.122
After features/support/hooks.rb:305 0.824
After features/support/hooks.rb:89 0.009
Feature: Localization
2:57.264
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.003
When I log in to a new session in Arabic (ar) 31.648
Then the keyboard layout is set to "us" 0.338
When the network is plugged 0.040
And Tor is ready 45.487
Then I successfully start the Unsafe Browser in "ar" 14.358
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 28.965
And DuckDuckGo is the default search engine 23.785
And I kill the Tor Browser 5.545
And the screen keyboard works in Thunderbird 12.668
And the layout of the screen keyboard is set to "us" 0.552
After features/support/hooks.rb:305 1.322
After features/support/hooks.rb:89 0.000
Feature: Localization
2:53.689
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.894
When I log in to a new session in Chinese (zh_CN) 34.341
Then the keyboard layout is set to "cn" 0.365
When the network is plugged 0.053
And Tor is ready 45.810
Then I successfully start the Unsafe Browser in "zh_CN" 15.782
And I kill the Unsafe Browser 5.771
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 26.475
And DuckDuckGo is the default search engine 10.894
And I kill the Tor Browser 5.496
And the screen keyboard works in Thunderbird 20.070
And the layout of the screen keyboard is set to "us" 0.620
After features/support/hooks.rb:305 1.640
After features/support/hooks.rb:89 0.000
Feature: Localization
2:4.333
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.201
When I log in to a new session in English (en) 24.792
Then the keyboard layout is set to "us" 0.160
When the network is plugged 0.059
And Tor is ready 15.788
Then I successfully start the Unsafe Browser in "en" 16.519
And I kill the Unsafe Browser 5.654
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 28.053
And DuckDuckGo is the default search engine 5.275
And I kill the Tor Browser 5.303
And the screen keyboard works in Thunderbird 13.847
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:305 1.158
After features/support/hooks.rb:89 0.000
Feature: Localization
2:14.889
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.045
When I log in to a new session in French (fr) 31.283
Then the keyboard layout is set to "fr" 0.266
When the network is plugged 0.120
And Tor is ready 16.043
Then I successfully start the Unsafe Browser in "fr" 16.675
And I kill the Unsafe Browser 5.776
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 26.749
And DuckDuckGo is the default search engine 10.134
And I kill the Tor Browser 5.250
And the screen keyboard works in Thunderbird 12.868
And the layout of the screen keyboard is set to "fr" 0.577
After features/support/hooks.rb:305 1.844
After features/support/hooks.rb:89 0.000
Feature: Localization
2:42.756
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.181
When I log in to a new session in German (de) 31.585
Then the keyboard layout is set to "de" 0.172
When the network is plugged 0.054
And Tor is ready 46.115
Then I successfully start the Unsafe Browser in "de" 15.330
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 27.006
And DuckDuckGo is the default search engine 9.907
And I kill the Tor Browser 5.236
And the screen keyboard works in Thunderbird 12.664
And the layout of the screen keyboard is set to "de" 0.572
After features/support/hooks.rb:305 1.087
After features/support/hooks.rb:89 0.000
Feature: Localization
2:16.789
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.145
When I log in to a new session in Italian (it) 31.454
Then the keyboard layout is set to "it" 0.202
When the network is plugged 0.042
And Tor is ready 17.194
Then I successfully start the Unsafe Browser in "it" 15.737
And I kill the Unsafe Browser 5.751
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 28.000
And DuckDuckGo is the default search engine 10.122
And I kill the Tor Browser 5.518
And the screen keyboard works in Thunderbird 13.912
And the layout of the screen keyboard is set to "us" 0.608
After features/support/hooks.rb:305 1.222
After features/support/hooks.rb:89 0.000
Feature: Localization
2:14.113
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.007
When I log in to a new session in Persian (fa) 31.023
Then the keyboard layout is set to "ir" 0.164
When the network is plugged 0.088
And Tor is ready 16.115
Then I successfully start the Unsafe Browser in "fa" 16.181
And I kill the Unsafe Browser 5.680
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 25.836
And DuckDuckGo is the default search engine 11.300
And I kill the Tor Browser 5.445
And the screen keyboard works in Thunderbird 12.564
And the layout of the screen keyboard is set to "ir" 0.561
After features/support/hooks.rb:305 1.136
After features/support/hooks.rb:89 0.000
Feature: Localization
2:44.367
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.891
When I log in to a new session in Portuguese (pt) 32.564
Then the keyboard layout is set to "pt" 0.172
When the network is plugged 0.045
And Tor is ready 44.835
Then I successfully start the Unsafe Browser in "pt" 15.430
And I kill the Unsafe Browser 5.719
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 27.941
And DuckDuckGo is the default search engine 10.734
And I kill the Tor Browser 5.516
And the screen keyboard works in Thunderbird 12.842
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:305 1.354
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.961
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.806
When I log in to a new session in Russian (ru) 34.291
Then the keyboard layout is set to "ru" 0.267
When the network is plugged 0.115
And Tor is ready 16.388
Then I successfully start the Unsafe Browser in "ru" 14.918
And I kill the Unsafe Browser 5.764
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 28.397
And DuckDuckGo is the default search engine 14.789
And I kill the Tor Browser 5.434
And the screen keyboard works in Thunderbird 13.129
And the layout of the screen keyboard is set to "ru" 0.546
After features/support/hooks.rb:305 1.116
After features/support/hooks.rb:89 0.000
Feature: Localization
2:40.278
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 22.452
When I log in to a new session in Spanish (es) 37.201
Then the keyboard layout is set to "es" 0.225
When the network is plugged 0.054
And Tor is ready 19.157
Then I successfully start the Unsafe Browser in "es" 17.036
And I kill the Unsafe Browser 5.815
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 27.440
And DuckDuckGo is the default search engine 11.702
And I kill the Tor Browser 5.496
And the screen keyboard works in Thunderbird 12.997
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:305 1.955
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.318
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.163
When I log in to a new session in Turkish (tr) 34.731
Then the keyboard layout is set to "tr" 0.156
When the network is plugged 0.047
And Tor is ready 17.119
Then I successfully start the Unsafe Browser in "tr" 15.976
And I kill the Unsafe Browser 5.753
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 27.860
And DuckDuckGo is the default search engine 10.996
And I kill the Tor Browser 5.441
And the screen keyboard works in Thunderbird 14.377
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:305 1.152
After features/support/hooks.rb:89 0.000