Project Number Date
test_Tails_ISO_stable 5278 19 Nov 2024, 12:27

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 50 1 0 0 0 51 5 1 6 11:23.151 Failed
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
21.261
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.149
And I prepare Tails for memory erasure tests 0.542
When I start a process allocating 128 MiB of memory with a known pattern 1.281
Then patterns cover at least 128 MiB in the guest's memory 3.972

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.246
Then I find very few patterns in the guest's memory after 3 seconds 6.069

Pattern coverage: 0.000% (0 MiB out of 873 MiB reference memory)

After features/support/hooks.rb:326 0.906
After features/support/hooks.rb:100 0.000
25.044
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.024
And I prepare Tails for memory erasure tests 1.212
And I find very few patterns in the guest's memory 3.184

Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.316
Then patterns cover at least 99% of the test FS size in the guest's memory 3.562

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.656
Then I find very few patterns in the guest's memory after 3 seconds 6.086

Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)

After features/support/hooks.rb:326 0.759
After features/support/hooks.rb:100 0.000
47.022
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.642
And I prepare Tails for memory erasure tests 0.472
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.218
Then I find very few patterns in the guest's memory 3.414

Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.516
Then patterns cover at least 75% of the test FS size in the guest's memory 3.838

Pattern coverage: 85.345% (108 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.463
Then I find very few patterns in the guest's memory after 3 seconds 6.135

Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)

# read cache
When I mount the USB drive again 0.984
And I read the content of the test FS 0.661
Then patterns cover at least 99% of the test FS size in the guest's memory 3.271

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.453
Then I find very few patterns in the guest's memory after 3 seconds 5.949

Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)

After features/support/hooks.rb:326 0.790
After features/support/hooks.rb:100 0.000
1:16.653
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 7.934
And I prepare Tails for memory erasure tests 0.431
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 33.282
Then I find very few patterns in the guest's memory 2.581

Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.790
Then patterns cover at least 99% of the test FS size in the guest's memory 3.050

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.469
Then I find very few patterns in the guest's memory after 3 seconds 5.443

Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)

# read cache
When I mount the USB drive again 6.538
And I read the content of the test FS 0.474
Then patterns cover at least 99% of the test FS size in the guest's memory 3.000

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 4.166
Then I find very few patterns in the guest's memory after 3 seconds 5.489

Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)

After features/support/hooks.rb:326 0.797
After features/support/hooks.rb:100 0.000
58.872
Scenario Erasure of the overlayfs read-write branch on shutdown
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails from DVD without network and logged in 7.947
And I prepare Tails for memory erasure tests 0.453
When I fill a 128 MiB file with a known pattern on the root filesystem 14.870
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 11.063
Then patterns cover at least 128 MiB in the guest's memory 2.650

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.012
Then I find very few patterns in the guest's memory after 20 seconds 21.873
14.286% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:222:in `/^I find very few patterns in the guest's memory(?: after (\d+) seconds)?$/'
features/erase_memory.feature:72:in `Then I find very few patterns in the guest's memory after 20 seconds'
Output 1

Pattern coverage: 14.286% (128 MiB out of 896 MiB reference memory)

After features/support/hooks.rb:326 10.561

SCENARIO FAILED: 'Erasure of the overlayfs read-write branch on shutdown' (at time 00:31:16)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5278/artifact/build-artifacts/00:31:16_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5278/artifact/build-artifacts/00:31:16_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5278/artifact/build-artifacts/00:31:16_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.journal

After features/support/hooks.rb:100 0.000
7:34.298
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:51.392
And I prepare Tails for memory erasure tests 0.396
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.368
When I trigger shutdown 0.012
Then I find very few patterns in the guest's memory after 20 seconds 21.128

Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)

After features/support/hooks.rb:326 3.497
After features/support/hooks.rb:100 0.011