Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 101 11 Jun 2024, 06:37

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 41 2 10 0 0 53 4 2 6 11:34.318 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
22.904
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.299
And I prepare Tails for memory erasure tests 0.446
When I start a process allocating 128 MiB of memory with a known pattern 4.933
Then patterns cover at least 128 MiB in the guest's memory 3.902 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.822
Then I find very few patterns in the guest's memory 4.500
12.040% 
12.040% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 12.040% (107 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:315 5.132 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:28:01)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:28:01_Erasure_of_memory_freed_by_killed_userspace_processes.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:28:01_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:28:01_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:28:01_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
48.919
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.122
And I prepare Tails for memory erasure tests 0.385
And I find very few patterns in the guest's memory 4.063 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 3.298
Then patterns cover at least 99% of the test FS size in the guest's memory 3.771 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 25.698
Then I find very few patterns in the guest's memory 3.580 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
After features/support/hooks.rb:315 2.359
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
49.347
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 9.217
And I prepare Tails for memory erasure tests 0.408
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.093
Then I find very few patterns in the guest's memory 3.977 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 4.081
Then patterns cover at least 86% of the test FS size in the guest's memory 3.787 
Pattern coverage: 91.168% (116 MiB out of 127 MiB reference memory)
When I umount the USB drive 4.038
Then I find very few patterns in the guest's memory 3.842 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# read cache
When I mount the USB drive again 1.131
And I read the content of the test FS 0.617
Then patterns cover at least 99% of the test FS size in the guest's memory 3.837 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.577
Then I find very few patterns in the guest's memory 3.735 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:315 1.057
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
59.022
Scenario Erasure of read and write disk caches on unmount: LUKS-encrypted ext4
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.001
And I prepare Tails for memory erasure tests 0.668
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 50.352
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:785:in `deal_with_polkit_prompt'
./features/step_definitions/common_steps.rb:1486:in `/^I plug and mount a (\d+) MiB USB drive with an? (.*)$/'
features/erase_memory.feature:50:in `When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf"'
Then I find very few patterns in the guest's memory 0.000
# write cache
When I fill the USB drive with a known pattern 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:315 5.530 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: LUKS-encrypted ext4' (at time 00:30:47)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:30:47_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:30:47_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:30:47_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/101/artifact/build-artifacts/00:30:47_Erasure_of_read_and_write_disk_caches_on_unmount:_LUKS-encrypted_ext4.journal
After features/support/hooks.rb:100 0.002
Tags: @product @slow @not_release_blocker
52.986
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.065
And I prepare Tails for memory erasure tests 0.424
When I fill a 128 MiB file with a known pattern on the root filesystem 17.553
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.301
Then patterns cover at least 128 MiB in the guest's memory 2.849 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.760 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
After features/support/hooks.rb:315 3.578
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
7:41.137
Before features/support/hooks.rb:269 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:56.302
And I prepare Tails for memory erasure tests 0.431
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.181
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.190 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:315 3.495
After features/support/hooks.rb:100 0.011