Project Number Date
test_Tails_ISO_15451-support-manual-fsck-on-error 22 09 Aug 2024, 16:24

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 272 1 0 0 0 273 21 1 22 1:3:13.638 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.171
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.853
And I prepare Tails for memory erasure tests 0.409
When I start a process allocating 128 MiB of memory with a known pattern 2.499
Then patterns cover at least 128 MiB in the guest's memory 3.322 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.267
Then I find very few patterns in the guest's memory after 3 seconds 5.819 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
After features/support/hooks.rb:326 0.742
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
36.448
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 20.812
And I prepare Tails for memory erasure tests 0.386
And I find very few patterns in the guest's memory 2.877 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.268
Then patterns cover at least 99% of the test FS size in the guest's memory 2.984 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.832
Then I find very few patterns in the guest's memory after 3 seconds 6.286 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
After features/support/hooks.rb:326 3.082
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.310
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.842
And I prepare Tails for memory erasure tests 0.481
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.259
Then I find very few patterns in the guest's memory 3.817 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.732
Then patterns cover at least 75% of the test FS size in the guest's memory 4.109 
Pattern coverage: 86.570% (110 MiB out of 127 MiB reference memory)
When I umount the USB drive 2.076
Then I find very few patterns in the guest's memory after 3 seconds 6.747 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# read cache
When I mount the USB drive again 0.264
And I read the content of the test FS 0.625
Then patterns cover at least 99% of the test FS size in the guest's memory 4.297 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.182
Then I find very few patterns in the guest's memory after 3 seconds 5.874 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:326 0.841
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:10.743
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.402
And I prepare Tails for memory erasure tests 0.536
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 32.736
Then I find very few patterns in the guest's memory 2.414 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.786
Then patterns cover at least 99% of the test FS size in the guest's memory 2.769 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.848
Then I find very few patterns in the guest's memory after 3 seconds 5.242 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
# read cache
When I mount the USB drive again 5.198
And I read the content of the test FS 0.463
Then patterns cover at least 99% of the test FS size in the guest's memory 2.880 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.802
Then I find very few patterns in the guest's memory after 3 seconds 5.661 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
After features/support/hooks.rb:326 3.114
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.490
Scenario Erasure of the overlayfs read-write branch on shutdown
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 9.256
And I prepare Tails for memory erasure tests 0.412
When I fill a 128 MiB file with a known pattern on the root filesystem 15.930
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.731
Then patterns cover at least 128 MiB in the guest's memory 2.589 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
Then I find very few patterns in the guest's memory after 20 seconds 22.556
14.286% 
14.286% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:222:in `/^I find very few patterns in the guest's memory(?: after (\d+) seconds)?$/'
features/erase_memory.feature:72:in `Then I find very few patterns in the guest's memory after 20 seconds'
Output 1 
Pattern coverage: 14.286% (128 MiB out of 896 MiB reference memory)
After features/support/hooks.rb:326 10.555 
SCENARIO FAILED: 'Erasure of the overlayfs read-write branch on shutdown' (at time 00:31:57)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/22/artifact/build-artifacts/00:31:57_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/22/artifact/build-artifacts/00:31:57_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_15451-support-manual-fsck-on-error/22/artifact/build-artifacts/00:31:57_Erasure_of_the_overlayfs_read-write_branch_on_shutdown.journal
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:18.882
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:35.288
And I prepare Tails for memory erasure tests 0.942
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.524
When I trigger shutdown 0.013
Then I find very few patterns in the guest's memory after 20 seconds 21.113 
Pattern coverage: 0.000% (0 MiB out of 903 MiB reference memory)
After features/support/hooks.rb:326 3.504
After features/support/hooks.rb:100 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:53.540
Before features/support/hooks.rb:269 0.003
Before features/support/hooks.rb:507 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.234
And I update APT using apt 18.617
And I install "popularity-contest" using apt 22.454
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.994
When I create a persistent storage and activate the Additional Software feature 20.396
Then Additional Software is correctly configured for package "popularity-contest" 1.519
When I shutdown Tails and wait for the computer to power off 11.045
And I start Tails from USB drive "__internal" with network unplugged 58.254
And I enable persistence 22.138
And I log in to a new session 42.751
And the Additional Software installation service has started 31.160
Then I am notified that the installation succeeded 1.870
And Additional Software is correctly configured for package "popularity-contest" 0.826
And the package "popularity-contest" is installed after Additional Software has been started 0.275
After features/support/hooks.rb:515 36.366
After features/support/hooks.rb:326 1.457
After features/support/hooks.rb:100 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:26.762
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.005
Given a computer 0.215
And I start Tails from USB drive "__internal" and I login with an administration password 1:40.802
And I update APT using apt 16.795
When I install "makepp" using apt 22.348
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.490
And the package "makepp" is installed 0.110
After features/support/hooks.rb:515 37.935
After features/support/hooks.rb:326 1.070
After features/support/hooks.rb:100 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:0.766
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:507 0.005
Given a computer 0.214
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:10.939
When I uninstall "popularity-contest" using apt 21.756
And I accept removing "popularity-contest" from Additional Software 0.533
Then "popularity-contest" is not in the list of Additional Software 0.677
When I start Synaptic 26.755
And I update APT using Synaptic 22.030
And I install "cowsay" using Synaptic 9.718
And I accept adding "cowsay" to Additional Software 1.386
Then Additional Software is correctly configured for package "cowsay" 0.791
When I uninstall "cowsay" using apt 3.203
And I refuse removing "cowsay" from Additional Software 0.613
Then Additional Software is correctly configured for package "cowsay" 0.853
When I start "Additional Software" via GNOME Activities Overview 9.799
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.186
Then "cowsay" is not in the list of Additional Software 0.916
When I install "cowsay" using apt 3.208
And I refuse adding "cowsay" to Additional Software 0.539
Then "cowsay" is not in the list of Additional Software 0.641
After features/support/hooks.rb:515 0.977
After features/support/hooks.rb:326 0.681
After features/support/hooks.rb:100 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:53.863
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.005
Given a computer 0.226
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:17.813
And I configure APT to prefer an old version of cowsay 0.031
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.344
And I accept adding "cowsay" to Additional Software 7.832
And Additional Software is correctly configured for package "cowsay" 0.894
And I shutdown Tails and wait for the computer to power off 6.327
And I start Tails from USB drive "__internal" with network unplugged 58.946
And I enable persistence 12.847
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 36.966
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.350
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.066
And the network is plugged 0.090
And Tor is ready 46.203
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.423
And available upgrades have been checked 0.183
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.153
And I can open the Additional Software configuration window from the notification 4.069
And I shutdown Tails and wait for the computer to power off 2:6.942
And I start Tails from USB drive "__internal" with network unplugged 58.744
And I enable persistence 12.705
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 37.523
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.131
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.082
And Tor is ready 45.549
Then the Additional Software upgrade service has started 0.161
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.079
After features/support/hooks.rb:515 2.636
After features/support/hooks.rb:326 1.185
After features/support/hooks.rb:100 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:8.514
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.005
Given a computer 0.221
And I start Tails from USB drive "__internal" with network unplugged 57.809
And I enable persistence 13.192
And I remove the "cowsay" deb files from the APT cache 0.056
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.102
And I log in to a new session 38.025
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.563
And I can open the Additional Software log file from the notification 4.902
And the package "cowsay" is not installed 0.640
After features/support/hooks.rb:515 0.111
After features/support/hooks.rb:326 1.259
After features/support/hooks.rb:100 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.013
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.581
When I log in to a new session in Arabic (ar) 32.272
Then the keyboard layout is set to "us" 0.110
When the network is plugged 0.085
And Tor is ready 46.078
Then I successfully start the Unsafe Browser in "ar" 14.887
And I kill the Unsafe Browser 5.768
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 29.998
And DuckDuckGo is the default search engine 9.546
And I kill the Tor Browser 5.298
And the screen keyboard works in Thunderbird 12.739
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:326 1.560
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.471
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.410
When I log in to a new session in Chinese (zh_CN) 33.458
Then the keyboard layout is set to "cn" 0.175
When the network is plugged 0.156
And Tor is ready 17.638
Then I successfully start the Unsafe Browser in "zh_CN" 17.068
And I kill the Unsafe Browser 5.950
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 30.918
And DuckDuckGo is the default search engine 9.812
And I kill the Tor Browser 5.275
And the screen keyboard works in Thunderbird 16.943
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:326 1.540
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:57.343
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.282
When I log in to a new session in English (en) 16.755
Then the keyboard layout is set to "us" 0.140
When the network is plugged 0.066
And Tor is ready 15.821
Then I successfully start the Unsafe Browser in "en" 17.158
And I kill the Unsafe Browser 5.673
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 29.243
And DuckDuckGo is the default search engine 5.093
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 13.176
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:326 1.426
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.612
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.888
When I log in to a new session in French (fr) 32.367
Then the keyboard layout is set to "fr" 0.211
When the network is plugged 0.092
And Tor is ready 17.171
Then I successfully start the Unsafe Browser in "fr" 15.434
And I kill the Unsafe Browser 5.962
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 29.003
And DuckDuckGo is the default search engine 9.687
And I kill the Tor Browser 5.334
And the screen keyboard works in Thunderbird 12.794
And the layout of the screen keyboard is set to "fr" 0.543
After features/support/hooks.rb:326 1.372
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.844
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.773
When I log in to a new session in German (de) 32.996
Then the keyboard layout is set to "de" 0.208
When the network is plugged 0.086
And Tor is ready 16.986
Then I successfully start the Unsafe Browser in "de" 15.369
And I kill the Unsafe Browser 5.876
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 28.204
And DuckDuckGo is the default search engine 9.523
And I kill the Tor Browser 5.379
And the screen keyboard works in Thunderbird 13.776
And the layout of the screen keyboard is set to "de" 0.571
After features/support/hooks.rb:326 3.492
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.696
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.163
When I log in to a new session in Italian (it) 33.321
Then the keyboard layout is set to "it" 0.130
When the network is plugged 0.076
And Tor is ready 15.821
Then I successfully start the Unsafe Browser in "it" 15.556
And I kill the Unsafe Browser 5.859
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 26.595
And DuckDuckGo is the default search engine 9.359
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 13.737
And the layout of the screen keyboard is set to "us" 0.671
After features/support/hooks.rb:326 1.775
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.423
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.318
When I log in to a new session in Persian (fa) 33.077
Then the keyboard layout is set to "ir" 0.167
When the network is plugged 0.106
And Tor is ready 18.756
Then I successfully start the Unsafe Browser in "fa" 15.382
And I kill the Unsafe Browser 5.877
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 30.407
And DuckDuckGo is the default search engine 10.258
And I kill the Tor Browser 5.629
And the screen keyboard works in Thunderbird 12.792
And the layout of the screen keyboard is set to "ir" 0.538
After features/support/hooks.rb:326 1.126
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.065
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.432
When I log in to a new session in Portuguese (pt) 33.205
Then the keyboard layout is set to "pt" 0.216
When the network is plugged 0.078
And Tor is ready 16.762
Then I successfully start the Unsafe Browser in "pt" 15.880
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 27.819
And DuckDuckGo is the default search engine 9.639
And I kill the Tor Browser 5.249
And the screen keyboard works in Thunderbird 12.237
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:326 1.130
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.646
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.081
When I log in to a new session in Russian (ru) 37.547
Then the keyboard layout is set to "ru" 0.183
When the network is plugged 0.073
And Tor is ready 16.369
Then I successfully start the Unsafe Browser in "ru" 15.374
And I kill the Unsafe Browser 5.926
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 30.536
And DuckDuckGo is the default search engine 10.342
And I kill the Tor Browser 5.638
And the screen keyboard works in Thunderbird 13.877
And the layout of the screen keyboard is set to "ru" 0.557
After features/support/hooks.rb:326 1.401
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.210
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.487
When I log in to a new session in Spanish (es) 35.755
Then the keyboard layout is set to "es" 0.182
When the network is plugged 0.128
And Tor is ready 17.998
Then I successfully start the Unsafe Browser in "es" 15.352
And I kill the Unsafe Browser 5.930
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 28.708
And DuckDuckGo is the default search engine 10.093
And I kill the Tor Browser 5.266
And the screen keyboard works in Thunderbird 12.635
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:326 3.625
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.814
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.153
When I log in to a new session in Turkish (tr) 33.840
Then the keyboard layout is set to "tr" 0.139
When the network is plugged 0.079
And Tor is ready 16.487
Then I successfully start the Unsafe Browser in "tr" 15.207
And I kill the Unsafe Browser 5.835
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 28.272
And DuckDuckGo is the default search engine 10.059
And I kill the Tor Browser 5.271
And the screen keyboard works in Thunderbird 12.804
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:326 1.290
After features/support/hooks.rb:100 0.000