Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 64 04 May 2024, 06:37

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 45 1 7 0 0 53 5 1 6 10:56.663 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
19.554
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.861
And I prepare Tails for memory erasure tests 0.606
When I start a process allocating 128 MiB of memory with a known pattern 1.213
Then patterns cover at least 128 MiB in the guest's memory 3.806 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.144
Then I find very few patterns in the guest's memory 3.921 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:305 0.846
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
24.514
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.413
And I prepare Tails for memory erasure tests 0.539
And I find very few patterns in the guest's memory 3.937 
Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 3.067
Then patterns cover at least 99% of the test FS size in the guest's memory 4.123 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.615
Then I find very few patterns in the guest's memory 3.816 
Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)
After features/support/hooks.rb:305 1.264
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
32.213
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:259 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.211
And I prepare Tails for memory erasure tests 0.594
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.040
Then I find very few patterns in the guest's memory 4.074 
Pattern coverage: 0.000% (0 MiB out of 873 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 5.281
Then patterns cover at least 86% of the test FS size in the guest's memory 4.010
85.168% 
85.168% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 85.168% (108 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:305 4.334 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:29:36)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/64/artifact/build-artifacts/00:29:36_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/64/artifact/build-artifacts/00:29:36_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/64/artifact/build-artifacts/00:29:36_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/64/artifact/build-artifacts/00:29:36_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
1:15.361
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.062
And I prepare Tails for memory erasure tests 0.503
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 37.377
Then I find very few patterns in the guest's memory 3.821 
Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.720
Then patterns cover at least 99% of the test FS size in the guest's memory 3.070 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.921
Then I find very few patterns in the guest's memory 3.247 
Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)
# read cache
When I mount the USB drive again 6.247
And I read the content of the test FS 0.503
Then patterns cover at least 99% of the test FS size in the guest's memory 2.956 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.101
Then I find very few patterns in the guest's memory 3.828 
Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)
After features/support/hooks.rb:305 0.982
After features/support/hooks.rb:89 0.001
Tags: @product @slow @not_release_blocker
51.838
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.906
And I prepare Tails for memory erasure tests 0.647
When I fill a 128 MiB file with a known pattern on the root filesystem 16.029
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.609
Then patterns cover at least 128 MiB in the guest's memory 2.917 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.694 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
After features/support/hooks.rb:305 3.521
After features/support/hooks.rb:89 0.000
Tags: @product @slow @not_release_blocker
7:33.181
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:50.440
And I prepare Tails for memory erasure tests 0.437
When I fill a 128 MiB file with a known pattern on the persistent filesystem 19.991
When I trigger shutdown 0.014
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.277 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
After features/support/hooks.rb:305 3.768
After features/support/hooks.rb:89 0.010