Project Number Date
test_Tails_ISO_stable 4957 19 Jul 2024, 12:19

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
System memory erasure on shutdown 44 2 7 0 0 53 4 2 6 11:8.169 Failed
Tags: @product @slow @not_release_blocker
Feature System memory erasure on shutdown
As a Tails user when I shutdown Tails I want the system memory to be free from sensitive data.
Tags: @product @slow @not_release_blocker
21.708
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.346
And I prepare Tails for memory erasure tests 0.473
When I start a process allocating 128 MiB of memory with a known pattern 2.567
Then patterns cover at least 128 MiB in the guest's memory 3.659 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.940
Then I find very few patterns in the guest's memory 4.721
5.130% 
5.130% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 5.130% (45 MiB out of 886 MiB reference memory)
After features/support/hooks.rb:326 5.135 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:14)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:29:14_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
24.889
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.629
And I prepare Tails for memory erasure tests 0.473
And I find very few patterns in the guest's memory 4.784 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.825
Then patterns cover at least 99% of the test FS size in the guest's memory 4.248 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.621
Then I find very few patterns in the guest's memory 4.305 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:326 0.766
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
31.719
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:269 0.007
Steps
Given I have started Tails from DVD without network and logged in 8.839
And I prepare Tails for memory erasure tests 0.451
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.128
Then I find very few patterns in the guest's memory 4.744 
Pattern coverage: 0.000% (0 MiB out of 885 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.248
Then patterns cover at least 86% of the test FS size in the guest's memory 4.305
84.644% 
84.644% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 84.644% (108 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:326 5.069 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:30:16)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:30:16_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:30:16_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:30:16_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4957/artifact/build-artifacts/00:30:16_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
1:16.620
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.282
And I prepare Tails for memory erasure tests 0.416
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 37.061
Then I find very few patterns in the guest's memory 3.517 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.903
Then patterns cover at least 99% of the test FS size in the guest's memory 3.248 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 3.444
Then I find very few patterns in the guest's memory 4.382 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
# read cache
When I mount the USB drive again 5.081
And I read the content of the test FS 0.546
Then patterns cover at least 99% of the test FS size in the guest's memory 3.660 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.103
Then I find very few patterns in the guest's memory 3.969 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:326 1.198
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
53.306
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.251
And I prepare Tails for memory erasure tests 0.424
When I fill a 128 MiB file with a known pattern on the root filesystem 17.226
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.870
Then patterns cover at least 128 MiB in the guest's memory 3.532 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.965 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:326 3.600
After features/support/hooks.rb:100 0.000
Tags: @product @slow @not_release_blocker
7:39.925
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:56.289
And I prepare Tails for memory erasure tests 0.424
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.820
When I trigger shutdown 0.012
And I wait 20 seconds 20.012 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.366 
Pattern coverage: 0.000% (0 MiB out of 860 MiB reference memory)
After features/support/hooks.rb:326 3.540
After features/support/hooks.rb:100 0.013