Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 48 19 Apr 2024, 06:43

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 267 1 7 0 0 275 21 1 22 1:6:17.095 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.427
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.257
And I prepare Tails for memory erasure tests 0.564
When I start a process allocating 128 MiB of memory with a known pattern 1.229
Then patterns cover at least 128 MiB in the guest's memory 3.783 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.561
Then I find very few patterns in the guest's memory 4.031 
Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)
After features/support/hooks.rb:305 0.713
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.829
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.662
And I prepare Tails for memory erasure tests 0.427
And I find very few patterns in the guest's memory 3.866 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.391
Then patterns cover at least 99% of the test FS size in the guest's memory 3.871 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.801
Then I find very few patterns in the guest's memory 3.807 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
After features/support/hooks.rb:305 0.961
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.746
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:259 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.705
And I prepare Tails for memory erasure tests 0.492
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.027
Then I find very few patterns in the guest's memory 4.040 
Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.543
Then patterns cover at least 86% of the test FS size in the guest's memory 3.936
84.476% 
84.476% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 84.476% (107 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:305 4.176 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:29:00)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/48/artifact/build-artifacts/00:29:00_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/48/artifact/build-artifacts/00:29:00_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/48/artifact/build-artifacts/00:29:00_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/48/artifact/build-artifacts/00:29:00_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:6.431
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 9.375
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.232
Then I find very few patterns in the guest's memory 3.563 
Pattern coverage: 0.000% (0 MiB out of 873 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.886
Then patterns cover at least 99% of the test FS size in the guest's memory 2.939 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.774
Then I find very few patterns in the guest's memory 3.868 
Pattern coverage: 0.000% (0 MiB out of 873 MiB reference memory)
# read cache
When I mount the USB drive again 4.070
And I read the content of the test FS 1.748
Then patterns cover at least 99% of the test FS size in the guest's memory 3.590 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.150
Then I find very few patterns in the guest's memory 3.778 
Pattern coverage: 0.000% (0 MiB out of 873 MiB reference memory)
After features/support/hooks.rb:305 0.640
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.238
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.175
And I prepare Tails for memory erasure tests 0.551
When I fill a 128 MiB file with a known pattern on the root filesystem 16.234
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.648
Then patterns cover at least 128 MiB in the guest's memory 3.263 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.001 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.350 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:305 3.505
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
8:15.330
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:25.774
And I prepare Tails for memory erasure tests 0.360
When I fill a 128 MiB file with a known pattern on the persistent filesystem 26.171
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.994 
Pattern coverage: 0.000% (0 MiB out of 886 MiB reference memory)
After features/support/hooks.rb:305 3.539
After features/support/hooks.rb:89 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:12.403
Before features/support/hooks.rb:259 0.003
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 55.824
And I update APT using apt 20.425
And I install "popularity-contest" using apt 22.517
Then I am proposed to add the "popularity-contest" package to my Additional Software 9.825
When I create a persistent storage and activate the Additional Software feature 21.496
Then Additional Software is correctly configured for package "popularity-contest" 1.199
When I shutdown Tails and wait for the computer to power off 13.251
And I start Tails from USB drive "__internal" with network unplugged 1:2.875
And I enable persistence 20.644
And I log in to a new session 38.723
And the Additional Software installation service has started 41.716
Then I am notified that the installation succeeded 2.766
And Additional Software is correctly configured for package "popularity-contest" 0.848
And the package "popularity-contest" is installed after Additional Software has been started 0.288
After features/support/hooks.rb:464 39.857
After features/support/hooks.rb:305 1.128
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:2.158
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.005
Given a computer 0.196
And I start Tails from USB drive "__internal" and I login with an administration password 2:15.726
And I update APT using apt 16.240
When I install "makepp" using apt 25.626
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.282
And the package "makepp" is installed 0.085
After features/support/hooks.rb:464 41.699
After features/support/hooks.rb:305 0.982
After features/support/hooks.rb:89 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:5.058
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.006
Given a computer 0.211
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:15.104
When I uninstall "popularity-contest" using apt 21.872
And I accept removing "popularity-contest" from Additional Software 0.556
Then "popularity-contest" is not in the list of Additional Software 0.686
When I start Synaptic 26.136
And I update APT using Synaptic 22.724
And I install "cowsay" using Synaptic 10.108
And I accept adding "cowsay" to Additional Software 0.603
Then Additional Software is correctly configured for package "cowsay" 0.752
When I uninstall "cowsay" using apt 3.207
And I refuse removing "cowsay" from Additional Software 0.552
Then Additional Software is correctly configured for package "cowsay" 0.747
When I start "Additional Software" via GNOME Activities Overview 10.523
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.800
Then "cowsay" is not in the list of Additional Software 0.909
When I install "cowsay" using apt 3.200
And I refuse adding "cowsay" to Additional Software 0.605
Then "cowsay" is not in the list of Additional Software 0.754
After features/support/hooks.rb:464 0.965
After features/support/hooks.rb:305 0.824
After features/support/hooks.rb:89 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:3.444
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.005
Given a computer 0.190
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:22.863
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.051
And I accept adding "cowsay" to Additional Software 6.746
And Additional Software is correctly configured for package "cowsay" 0.921
And I shutdown Tails and wait for the computer to power off 6.507
And I start Tails from USB drive "__internal" with network unplugged 59.630
And I enable persistence 13.582
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 35.936
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.857
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.053
And Tor is ready 47.177
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.097
And available upgrades have been checked 0.061
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.050
And I can open the Additional Software configuration window from the notification 3.502
And I shutdown Tails and wait for the computer to power off 2:2.799
And I start Tails from USB drive "__internal" with network unplugged 1:0.247
And I enable persistence 13.395
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 36.096
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.571
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
And the network is plugged 0.040
And Tor is ready 54.500
Then the Additional Software upgrade service has started 0.182
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.127
After features/support/hooks.rb:464 2.430
After features/support/hooks.rb:305 0.735
After features/support/hooks.rb:89 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:18.068
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.006
Given a computer 0.265
And I start Tails from USB drive "__internal" with network unplugged 1:8.494
And I enable persistence 11.338
And I remove the "cowsay" deb files from the APT cache 0.682
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.070
And I log in to a new session 36.194
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.856
And I can open the Additional Software log file from the notification 5.505
And the package "cowsay" is not installed 0.661
After features/support/hooks.rb:464 0.115
After features/support/hooks.rb:305 0.929
After features/support/hooks.rb:89 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.640
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.091
When I log in to a new session in Arabic (ar) 32.017
Then the keyboard layout is set to "us" 0.190
When the network is plugged 0.054
And Tor is ready 19.828
Then I successfully start the Unsafe Browser in "ar" 15.249
And I kill the Unsafe Browser 5.662
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 28.649
And DuckDuckGo is the default search engine 23.003
And I kill the Tor Browser 5.469
And the screen keyboard works in Thunderbird 12.792
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:305 1.679
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.906
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.202
When I log in to a new session in Chinese (zh_CN) 30.151
Then the keyboard layout is set to "cn" 0.347
When the network is plugged 0.044
And Tor is ready 19.719
Then I successfully start the Unsafe Browser in "zh_CN" 15.359
And I kill the Unsafe Browser 5.667
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 26.616
And DuckDuckGo is the default search engine 11.127
And I kill the Tor Browser 5.476
And the screen keyboard works in Thunderbird 17.530
And the layout of the screen keyboard is set to "us" 0.552
After features/support/hooks.rb:305 2.225
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:4.055
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.391
When I log in to a new session in English (en) 17.242
Then the keyboard layout is set to "us" 0.302
When the network is plugged 0.052
And Tor is ready 19.722
Then I successfully start the Unsafe Browser in "en" 15.744
And I kill the Unsafe Browser 5.745
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 28.192
And DuckDuckGo is the default search engine 10.281
And I kill the Tor Browser 5.416
And the screen keyboard works in Thunderbird 12.328
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:305 1.051
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.307
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.322
When I log in to a new session in French (fr) 30.782
Then the keyboard layout is set to "fr" 0.157
When the network is plugged 0.038
And Tor is ready 17.030
Then I successfully start the Unsafe Browser in "fr" 14.851
And I kill the Unsafe Browser 5.703
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 26.924
And DuckDuckGo is the default search engine 21.961
And I kill the Tor Browser 5.469
And the screen keyboard works in Thunderbird 12.432
And the layout of the screen keyboard is set to "fr" 0.542
After features/support/hooks.rb:305 1.126
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.219
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.876
When I log in to a new session in German (de) 32.512
Then the keyboard layout is set to "de" 0.289
When the network is plugged 0.043
And Tor is ready 20.041
Then I successfully start the Unsafe Browser in "de" 15.123
And I kill the Unsafe Browser 5.698
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 26.840
And DuckDuckGo is the default search engine 10.931
And I kill the Tor Browser 5.444
And the screen keyboard works in Thunderbird 12.782
And the layout of the screen keyboard is set to "de" 0.544
After features/support/hooks.rb:305 1.730
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.380
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.915
When I log in to a new session in Italian (it) 32.714
Then the keyboard layout is set to "it" 0.145
When the network is plugged 0.053
And Tor is ready 46.872
Then I successfully start the Unsafe Browser in "it" 14.457
And I kill the Unsafe Browser 5.667
When I enable the screen keyboard 0.088
Then the screen keyboard works in Tor Browser 29.424
And DuckDuckGo is the default search engine 11.468
And I kill the Tor Browser 5.524
And the screen keyboard works in Thunderbird 13.468
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:305 1.557
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:54.084
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.973
When I log in to a new session in Persian (fa) 33.828
Then the keyboard layout is set to "ir" 0.214
When the network is plugged 0.042
And Tor is ready 45.598
Then I successfully start the Unsafe Browser in "fa" 14.956
And I kill the Unsafe Browser 5.729
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 27.574
And DuckDuckGo is the default search engine 19.392
And I kill the Tor Browser 5.445
And the screen keyboard works in Thunderbird 12.668
And the layout of the screen keyboard is set to "ir" 0.545
After features/support/hooks.rb:305 0.915
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.521
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.292
When I log in to a new session in Portuguese (pt) 32.547
Then the keyboard layout is set to "pt" 0.204
When the network is plugged 0.046
And Tor is ready 18.278
Then I successfully start the Unsafe Browser in "pt" 14.710
And I kill the Unsafe Browser 5.681
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 27.536
And DuckDuckGo is the default search engine 18.544
And I kill the Tor Browser 5.498
And the screen keyboard works in Thunderbird 15.546
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:305 1.125
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.282
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.047
When I log in to a new session in Russian (ru) 30.998
Then the keyboard layout is set to "ru" 0.225
When the network is plugged 0.059
And Tor is ready 19.056
Then I successfully start the Unsafe Browser in "ru" 15.392
And I kill the Unsafe Browser 5.692
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 25.862
And DuckDuckGo is the default search engine 17.934
And I kill the Tor Browser 5.462
And the screen keyboard works in Thunderbird 13.826
And the layout of the screen keyboard is set to "ru" 0.632
After features/support/hooks.rb:305 1.066
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.615
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.086
When I log in to a new session in Spanish (es) 31.222
Then the keyboard layout is set to "es" 0.308
When the network is plugged 0.034
And Tor is ready 17.192
Then I successfully start the Unsafe Browser in "es" 15.457
And I kill the Unsafe Browser 5.715
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 27.929
And DuckDuckGo is the default search engine 22.942
And I kill the Tor Browser 5.471
And the screen keyboard works in Thunderbird 14.587
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:305 1.112
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.942
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.007
When I log in to a new session in Turkish (tr) 34.761
Then the keyboard layout is set to "tr" 0.221
When the network is plugged 0.036
And Tor is ready 18.945
Then I successfully start the Unsafe Browser in "tr" 16.050
And I kill the Unsafe Browser 5.812
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 25.703
And DuckDuckGo is the default search engine 22.542
And I kill the Tor Browser 5.504
And the screen keyboard works in Thunderbird 12.681
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:305 1.147
After features/support/hooks.rb:89 0.000