Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 17 22 Mar 2024, 06:15

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 263 1 7 0 0 271 21 1 22 58:22.136 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.518
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.102
And I prepare Tails for memory erasure tests 0.630
When I start a process allocating 128 MiB of memory with a known pattern 1.174
Then patterns cover at least 128 MiB in the guest's memory 3.799 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.723
Then I find very few patterns in the guest's memory 4.088 
Pattern coverage: 0.000% (0 MiB out of 912 MiB reference memory)
After features/support/hooks.rb:291 1.303
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
25.193
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.994
And I prepare Tails for memory erasure tests 0.580
And I find very few patterns in the guest's memory 4.734 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.763
Then patterns cover at least 99% of the test FS size in the guest's memory 5.171 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.376
Then I find very few patterns in the guest's memory 4.571 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
After features/support/hooks.rb:291 2.584
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.019
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:245 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.050
And I prepare Tails for memory erasure tests 0.655
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.897
Then I find very few patterns in the guest's memory 4.671 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.271
Then patterns cover at least 86% of the test FS size in the guest's memory 3.473
85.994% 
85.994% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 85.994% (109 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:291 4.645 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:27:10)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/17/artifact/build-artifacts/00:27:10_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/17/artifact/build-artifacts/00:27:10_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/17/artifact/build-artifacts/00:27:10_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/17/artifact/build-artifacts/00:27:10_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.737
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.131
And I prepare Tails for memory erasure tests 0.403
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.000
Then I find very few patterns in the guest's memory 3.934 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.679
Then patterns cover at least 99% of the test FS size in the guest's memory 3.017 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.899
Then I find very few patterns in the guest's memory 3.672 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# read cache
When I mount the USB drive again 3.472
And I read the content of the test FS 0.627
Then patterns cover at least 99% of the test FS size in the guest's memory 3.219 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.894
Then I find very few patterns in the guest's memory 3.783 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:291 1.006
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.452
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.131
And I prepare Tails for memory erasure tests 0.599
When I fill a 128 MiB file with a known pattern on the root filesystem 16.692
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.201
Then patterns cover at least 128 MiB in the guest's memory 2.951 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.000 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.862 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:291 3.550
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:11.662
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:27.789
And I prepare Tails for memory erasure tests 0.357
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.210
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.275 
Pattern coverage: 0.000% (0 MiB out of 908 MiB reference memory)
After features/support/hooks.rb:291 3.556
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:30.676
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:32.279
And I update APT using apt 17.249
And I install "popularity-contest" using apt 19.347
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.549
When I create a persistent storage and activate the Additional Software feature 21.116
Then Additional Software is correctly configured for package "popularity-contest" 1.434
When I shutdown Tails and wait for the computer to power off 11.094
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:39.514
Then Additional Software is correctly configured for package "popularity-contest" 0.790
And the package "popularity-contest" is installed after Additional Software has been started 0.302
After features/support/hooks.rb:450 36.963
After features/support/hooks.rb:291 0.929
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:16.392
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with an administration password 1:36.093
And I update APT using apt 16.443
When I install "makepp" using apt 19.177
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.406
And the package "makepp" is installed 0.077
After features/support/hooks.rb:450 42.077
After features/support/hooks.rb:291 1.015
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:44.642
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.187
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:59.653
When I uninstall "popularity-contest" using apt 18.661
And I accept removing "popularity-contest" from Additional Software 0.547
Then "popularity-contest" is not in the list of Additional Software 0.708
When I start Synaptic 24.038
And I update APT using Synaptic 22.188
And I install "cowsay" using Synaptic 9.160
And I accept adding "cowsay" to Additional Software 2.805
Then Additional Software is correctly configured for package "cowsay" 0.758
When I uninstall "cowsay" using apt 3.250
And I refuse removing "cowsay" from Additional Software 0.540
Then Additional Software is correctly configured for package "cowsay" 0.724
When I start "Additional Software" via GNOME Activities Overview 10.738
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.372
Then "cowsay" is not in the list of Additional Software 0.864
When I install "cowsay" using apt 3.238
And I refuse adding "cowsay" to Additional Software 0.576
Then "cowsay" is not in the list of Additional Software 0.625
After features/support/hooks.rb:450 1.098
After features/support/hooks.rb:291 0.662
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
8:38.275
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.190
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:6.948
And I configure APT to prefer an old version of cowsay 0.029
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.421
And I accept adding "cowsay" to Additional Software 7.044
And Additional Software is correctly configured for package "cowsay" 0.865
And I shutdown Tails and wait for the computer to power off 6.023
And I start Tails from USB drive "__internal" with network unplugged 1:2.010
And I enable persistence 10.885
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.033
And I log in to a new session 34.302
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.516
And I revert the APT tweaks that made it prefer an old version of cowsay 0.052
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.072
And the network is plugged 0.026
And Tor is ready 17.888
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.820
And available upgrades have been checked 0.075
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.999
And I can open the Additional Software configuration window from the notification 2.821
And I shutdown Tails and wait for the computer to power off 13.070
And I start Tails from USB drive "__internal" with network unplugged 53.983
And I enable persistence 11.671
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 32.991
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.506
And I revert the APT tweaks that made it prefer an old version of cowsay 0.052
And the network is plugged 0.030
And Tor is ready 40.639
Then the Additional Software upgrade service has started 0.170
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.097
After features/support/hooks.rb:450 2.415
After features/support/hooks.rb:291 1.063
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:11.024
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.191
And I start Tails from USB drive "__internal" with network unplugged 1:1.145
And I enable persistence 12.576
And I remove the "cowsay" deb files from the APT cache 0.571
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.093
And I log in to a new session 33.320
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 17.214
And I can open the Additional Software log file from the notification 5.276
And the package "cowsay" is not installed 0.635
After features/support/hooks.rb:450 0.102
After features/support/hooks.rb:291 0.930
After features/support/hooks.rb:75 0.013
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.345
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.896
When I log in to a new session in Arabic (ar) 30.710
Then the keyboard layout is set to "us" 0.136
When the network is plugged 0.038
And Tor is ready 14.818
Then I successfully start the Unsafe Browser in "ar" 14.968
And I kill the Unsafe Browser 5.714
When I enable the screen keyboard 0.077
Then the screen keyboard works in Tor Browser 27.657
And DuckDuckGo is the default search engine 10.426
And I kill the Tor Browser 5.429
And the screen keyboard works in Thunderbird 12.900
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 0.946
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.746
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.221
When I log in to a new session in Chinese (zh_CN) 31.741
Then the keyboard layout is set to "cn" 0.290
When the network is plugged 0.064
And Tor is ready 45.737
Then I successfully start the Unsafe Browser in "zh_CN" 14.430
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 26.999
And DuckDuckGo is the default search engine 10.871
And I kill the Tor Browser 5.467
And the screen keyboard works in Thunderbird 16.453
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.241
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:49.165
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.090
When I log in to a new session in English (en) 16.172
Then the keyboard layout is set to "us" 0.152
When the network is plugged 0.037
And Tor is ready 16.354
Then I successfully start the Unsafe Browser in "en" 14.431
And I kill the Unsafe Browser 5.657
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 24.743
And DuckDuckGo is the default search engine 5.272
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 12.266
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.245
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.956
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.009
When I log in to a new session in French (fr) 29.840
Then the keyboard layout is set to "fr" 0.172
When the network is plugged 0.040
And Tor is ready 15.442
Then I successfully start the Unsafe Browser in "fr" 14.996
And I kill the Unsafe Browser 5.768
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 29.369
And DuckDuckGo is the default search engine 26.796
And I kill the Tor Browser 5.587
And the screen keyboard works in Thunderbird 14.180
And the layout of the screen keyboard is set to "fr" 0.657
After features/support/hooks.rb:291 1.436
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.702
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.486
When I log in to a new session in German (de) 30.534
Then the keyboard layout is set to "de" 0.226
When the network is plugged 0.042
And Tor is ready 45.040
Then I successfully start the Unsafe Browser in "de" 16.859
And I kill the Unsafe Browser 5.805
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 27.745
And DuckDuckGo is the default search engine 11.626
And I kill the Tor Browser 5.510
And the screen keyboard works in Thunderbird 13.105
And the layout of the screen keyboard is set to "de" 0.614
After features/support/hooks.rb:291 1.199
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.473
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.582
When I log in to a new session in Italian (it) 30.595
Then the keyboard layout is set to "it" 0.136
When the network is plugged 0.060
And Tor is ready 16.061
Then I successfully start the Unsafe Browser in "it" 14.828
And I kill the Unsafe Browser 5.922
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 27.114
And DuckDuckGo is the default search engine 40.920
And I kill the Tor Browser 5.452
And the screen keyboard works in Thunderbird 12.142
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.186
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.740
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.030
When I log in to a new session in Persian (fa) 31.057
Then the keyboard layout is set to "ir" 0.204
When the network is plugged 0.033
And Tor is ready 15.073
Then I successfully start the Unsafe Browser in "fa" 14.252
And I kill the Unsafe Browser 5.738
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 26.359
And DuckDuckGo is the default search engine 10.948
And I kill the Tor Browser 5.490
And the screen keyboard works in Thunderbird 12.823
And the layout of the screen keyboard is set to "ir" 0.635
After features/support/hooks.rb:291 1.617
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:8.329
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.119
When I log in to a new session in Portuguese (pt) 30.591
Then the keyboard layout is set to "pt" 0.247
When the network is plugged 0.026
And Tor is ready 15.739
Then I successfully start the Unsafe Browser in "pt" 14.303
And I kill the Unsafe Browser 5.824
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 25.996
And DuckDuckGo is the default search engine 9.875
And I kill the Tor Browser 5.285
And the screen keyboard works in Thunderbird 11.642
And the layout of the screen keyboard is set to "us" 0.586
After features/support/hooks.rb:291 1.138
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.987
Before features/support/hooks.rb:245 0.013
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.009
When I log in to a new session in Russian (ru) 29.265
Then the keyboard layout is set to "ru" 0.183
When the network is plugged 0.064
And Tor is ready 16.774
Then I successfully start the Unsafe Browser in "ru" 14.716
And I kill the Unsafe Browser 5.753
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 26.030
And DuckDuckGo is the default search engine 9.632
And I kill the Tor Browser 5.314
And the screen keyboard works in Thunderbird 12.546
And the layout of the screen keyboard is set to "ru" 0.602
After features/support/hooks.rb:291 1.174
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.698
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.941
When I log in to a new session in Spanish (es) 30.698
Then the keyboard layout is set to "es" 0.122
When the network is plugged 0.040
And Tor is ready 15.620
Then I successfully start the Unsafe Browser in "es" 14.134
And I kill the Unsafe Browser 5.723
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 27.497
And DuckDuckGo is the default search engine 18.541
And I kill the Tor Browser 5.465
And the screen keyboard works in Thunderbird 12.209
And the layout of the screen keyboard is set to "us" 0.598
After features/support/hooks.rb:291 3.318
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.394
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.015
When I log in to a new session in Turkish (tr) 32.975
Then the keyboard layout is set to "tr" 0.174
When the network is plugged 0.045
And Tor is ready 14.878
Then I successfully start the Unsafe Browser in "tr" 14.203
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 27.452
And DuckDuckGo is the default search engine 10.771
And I kill the Tor Browser 5.513
And the screen keyboard works in Thunderbird 11.792
And the layout of the screen keyboard is set to "us" 0.643
After features/support/hooks.rb:291 1.317
After features/support/hooks.rb:75 0.000