Project Number Date
test_Tails_ISO_devel 3460 12 Jul 2024, 12:23

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 51 2 0 0 0 53 4 2 6 11:51.020 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
24.246
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.088
And I prepare Tails for memory erasure tests 0.463
When I start a process allocating 128 MiB of memory with a known pattern 2.302
Then patterns cover at least 128 MiB in the guest's memory 3.771 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 4.904
Then I find very few patterns in the guest's memory 4.716
6.432% 
6.432% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 6.432% (56 MiB out of 875 MiB reference memory)
After features/support/hooks.rb:326 5.202 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:27:09)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:27:09_Erasure_of_memory_freed_by_killed_userspace_processes.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:27:09_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:27:09_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:27:09_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
22.841
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 7.995
And I prepare Tails for memory erasure tests 0.382
And I find very few patterns in the guest's memory 3.778 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.144
Then patterns cover at least 99% of the test FS size in the guest's memory 3.834 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.790
Then I find very few patterns in the guest's memory 3.914 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:326 0.745
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
44.211
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.071
And I prepare Tails for memory erasure tests 0.451
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.241
Then I find very few patterns in the guest's memory 4.000 
Pattern coverage: 0.000% (0 MiB out of 876 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.688
Then patterns cover at least 86% of the test FS size in the guest's memory 3.921 
Pattern coverage: 87.923% (112 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.460
Then I find very few patterns in the guest's memory 4.039 
Pattern coverage: 0.000% (0 MiB out of 876 MiB reference memory)
# read cache
When I mount the USB drive again 0.242
And I read the content of the test FS 0.595
Then patterns cover at least 99% of the test FS size in the guest's memory 3.533 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.739
Then I find very few patterns in the guest's memory 4.224 
Pattern coverage: 0.000% (0 MiB out of 876 MiB reference memory)
After features/support/hooks.rb:326 0.993
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
1:35.136
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.156
And I prepare Tails for memory erasure tests 0.433
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 40.409
Then I find very few patterns in the guest's memory 3.669 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.115
Then patterns cover at least 99% of the test FS size in the guest's memory 2.985 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.065
Then I find very few patterns in the guest's memory 4.247 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
# read cache
When I mount the USB drive again 9.000
And I read the content of the test FS 0.701
Then patterns cover at least 99% of the test FS size in the guest's memory 3.078 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 15.620
Then I find very few patterns in the guest's memory 3.650 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
After features/support/hooks.rb:326 0.849
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
54.582
Scenario Erasure of the overlayfs read-write branch on shutdown
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.033
And I prepare Tails for memory erasure tests 0.388
When I fill a 128 MiB file with a known pattern on the root filesystem 18.584
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.970
Then patterns cover at least 128 MiB in the guest's memory 2.620 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.018
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.948
14.302% 
14.302% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:73:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 14.302% (128 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:326 10.605 
SCENARIO FAILED: 'Erasure of the overlayfs read-write branch on shutdown' (at time 00:30:54)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:30:54_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:30:54_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3460/artifact/build-artifacts/00:30:54_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
7:50.001
Before features/support/hooks.rb:269 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:4.236
And I prepare Tails for memory erasure tests 0.432
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.089
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.210 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
After features/support/hooks.rb:326 3.533
After features/support/hooks.rb:100 0.012