Project Number Date
test_Tails_ISO_15451-support-manual-fsck-on-error 3 24 Jul 2024, 19:22

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 46 2 5 0 0 53 4 2 6 11:57.645 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
22.297
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.485
And I prepare Tails for memory erasure tests 0.693
When I start a process allocating 128 MiB of memory with a known pattern 2.319
Then patterns cover at least 128 MiB in the guest's memory 5.572 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.313
Then I find very few patterns in the guest's memory 4.912
1.588% 
1.588% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 1.588% (14 MiB out of 890 MiB reference memory)
After features/support/hooks.rb:326 5.407 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:14)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
27.590
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 8.476
And I prepare Tails for memory erasure tests 0.639
And I find very few patterns in the guest's memory 5.264 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.978
Then patterns cover at least 99% of the test FS size in the guest's memory 4.522 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.767
Then I find very few patterns in the guest's memory 5.940 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
After features/support/hooks.rb:326 0.877
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
53.973
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.632
And I prepare Tails for memory erasure tests 0.601
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.384
Then I find very few patterns in the guest's memory 4.852 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.080
Then patterns cover at least 86% of the test FS size in the guest's memory 4.303 
Pattern coverage: 88.287% (112 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.472
Then I find very few patterns in the guest's memory 5.012 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
# read cache
When I mount the USB drive again 0.290
And I read the content of the test FS 4.708
Then patterns cover at least 99% of the test FS size in the guest's memory 4.606 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.626
Then I find very few patterns in the guest's memory 4.400 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
After features/support/hooks.rb:326 1.482
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
1:21.730
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.789
And I prepare Tails for memory erasure tests 0.673
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 40.693
Then I find very few patterns in the guest's memory 4.256 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.801
Then patterns cover at least 99% of the test FS size in the guest's memory 3.722 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.084
Then I find very few patterns in the guest's memory 3.946 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
# read cache
When I mount the USB drive again 5.097
And I read the content of the test FS 1.033
Then patterns cover at least 99% of the test FS size in the guest's memory 3.698 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.067
Then I find very few patterns in the guest's memory 3.865 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:326 1.989
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
1:6.306
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and logged in 22.172
And I prepare Tails for memory erasure tests 0.540
When I fill a 128 MiB file with a known pattern on the root filesystem 16.010
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.094
Then patterns cover at least 128 MiB in the guest's memory 3.523 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.015
And I wait 20 seconds 20.014 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.934 
Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)
After features/support/hooks.rb:326 3.555
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
7:45.747
Scenario Erasure of read and write disk caches of persistent data on shutdown
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:45.747
try_for() 
try_for() timeout expired
Last ignored exception was: Dogtail::Failure: The Dogtail init script raised: SearchError: descendent of [application | Welcome to Tails!]: child with name="Unlock Encryption" roleName='push button'
STDOUT:

STDERR:


./features/support/helpers/dogtail.rb:93:in `run'
./features/support/helpers/dogtail.rb:335:in `initialize'
./features/support/helpers/dogtail.rb:264:in `new'
./features/support/helpers/dogtail.rb:264:in `call_tree_api_method'
./features/support/helpers/dogtail.rb:272:in `child'
./features/step_definitions/usb.rb:685:in `block (2 levels) in <top (required)>'
./features/support/helpers/misc_helpers.rb:78:in `block (2 levels) in try_for'
./features/support/helpers/misc_helpers.rb:66:in `loop'
./features/support/helpers/misc_helpers.rb:66:in `block in try_for'
./features/support/helpers/misc_helpers.rb:65:in `try_for'
./features/step_definitions/usb.rb:684:in `block in <top (required)>'
./features/step_definitions/usb.rb:708:in `block in <top (required)>'
./features/step_definitions/snapshots.rb:153:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:150:in `each'
./features/step_definitions/snapshots.rb:150:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `block (2 levels) in <top (required)>' (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/usb.rb:684:in `/^persistence is successfully enabled$/'
./features/step_definitions/usb.rb:708:in `/^I enable persistence( with the changed passphrase)?$/'
./features/step_definitions/snapshots.rb:153:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:150:in `each'
./features/step_definitions/snapshots.rb:150:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ without\ network\ from\ a\ USB\ drive\ with\ a\ persistent\ partition\ enabled\ and\ logged\ in$/'
features/erase_memory.feature:76:in `Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in'
And I prepare Tails for memory erasure tests 0.000
When I fill a 128 MiB file with a known pattern on the persistent filesystem 0.000
When I trigger shutdown 0.000
And I wait 20 seconds 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:326 6.285 
SCENARIO FAILED: 'Erasure of read and write disk caches of persistent data on shutdown' (at time 00:41:03)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:41:03_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:41:03_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:41:03_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/3/artifact/build-artifacts/00:41:03_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.journal
After features/support/hooks.rb:100 0.014