Project Number Date
test_Tails_ISO_stable 4844 16 May 2024, 13:03

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 51 2 0 0 0 53 4 2 6 11:45.394 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
21.550
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:259 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.540
And I prepare Tails for memory erasure tests 0.450
When I start a process allocating 128 MiB of memory with a known pattern 2.425
Then patterns cover at least 128 MiB in the guest's memory 4.465 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.310
Then I find very few patterns in the guest's memory 5.358
7.641% 
7.641% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 7.641% (67 MiB out of 878 MiB reference memory)
After features/support/hooks.rb:305 6.752 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:27)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4844/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4844/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4844/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4844/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
26.552
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.464
And I prepare Tails for memory erasure tests 0.478
And I find very few patterns in the guest's memory 4.435 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.561
Then patterns cover at least 99% of the test FS size in the guest's memory 4.431 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.862
Then I find very few patterns in the guest's memory 4.318 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:305 2.989
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
52.627
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.525
And I prepare Tails for memory erasure tests 0.492
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.197
Then I find very few patterns in the guest's memory 5.681 
Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 6.011
Then patterns cover at least 86% of the test FS size in the guest's memory 3.601 
Pattern coverage: 91.125% (116 MiB out of 127 MiB reference memory)
When I umount the USB drive 2.884
Then I find very few patterns in the guest's memory 4.004 
Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)
# read cache
When I mount the USB drive again 0.319
And I read the content of the test FS 0.925
Then patterns cover at least 99% of the test FS size in the guest's memory 3.890 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.850
Then I find very few patterns in the guest's memory 4.241 
Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)
After features/support/hooks.rb:305 1.488
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
1:22.178
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.343
And I prepare Tails for memory erasure tests 0.537
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 37.832
Then I find very few patterns in the guest's memory 4.443 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.363
Then patterns cover at least 99% of the test FS size in the guest's memory 7.118 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.039
Then I find very few patterns in the guest's memory 4.235 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
# read cache
When I mount the USB drive again 5.986
And I read the content of the test FS 0.554
Then patterns cover at least 99% of the test FS size in the guest's memory 3.742 
Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.979
Then I find very few patterns in the guest's memory 4.001 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
After features/support/hooks.rb:305 1.072
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
52.508
Scenario Erasure of the overlayfs read-write branch on shutdown
Before features/support/hooks.rb:259 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.744
And I prepare Tails for memory erasure tests 0.474
When I fill a 128 MiB file with a known pattern on the root filesystem 15.225
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.052
Then patterns cover at least 128 MiB in the guest's memory 3.043 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.011
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.935
6.015% 
6.015% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:73:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 6.015% (52 MiB out of 878 MiB reference memory)
After features/support/hooks.rb:305 9.559 
SCENARIO FAILED: 'Erasure of the overlayfs read-write branch on shutdown' (at time 00:33:14)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4844/artifact/build-artifacts/00:33:14_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4844/artifact/build-artifacts/00:33:14_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.mkv
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
7:49.975
Before features/support/hooks.rb:259 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:4.554
And I prepare Tails for memory erasure tests 0.472
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.032
When I trigger shutdown 0.014
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.883 
Pattern coverage: 0.000% (0 MiB out of 908 MiB reference memory)
After features/support/hooks.rb:305 3.534
After features/support/hooks.rb:89 0.014