Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 81 23 May 2024, 07:32

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 261 2 12 0 0 275 20 2 22 1:5:38.301 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.010
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:259 0.007
Steps
Given I have started Tails from DVD without network and logged in 8.407
And I prepare Tails for memory erasure tests 0.408
When I start a process allocating 128 MiB of memory with a known pattern 2.418
Then patterns cover at least 128 MiB in the guest's memory 4.151 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.231
Then I find very few patterns in the guest's memory 5.392
8.950% 
8.950% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 8.950% (78 MiB out of 873 MiB reference memory)
After features/support/hooks.rb:305 6.202 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:11)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/81/artifact/build-artifacts/00:29:11_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/81/artifact/build-artifacts/00:29:11_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/81/artifact/build-artifacts/00:29:11_Erasure_of_memory_freed_by_killed_userspace_processes.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/81/artifact/build-artifacts/00:29:11_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.063
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.875
And I prepare Tails for memory erasure tests 0.525
And I find very few patterns in the guest's memory 4.398 
Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.037
Then patterns cover at least 99% of the test FS size in the guest's memory 4.414 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.992
Then I find very few patterns in the guest's memory 4.820 
Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)
After features/support/hooks.rb:305 2.690
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.047
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and logged in 8.606
And I prepare Tails for memory erasure tests 0.438
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.258
Then I find very few patterns in the guest's memory 4.918 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.386
Then patterns cover at least 86% of the test FS size in the guest's memory 4.653 
Pattern coverage: 93.158% (118 MiB out of 127 MiB reference memory)
When I umount the USB drive 2.538
Then I find very few patterns in the guest's memory 4.846 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
# read cache
When I mount the USB drive again 0.258
And I read the content of the test FS 0.668
Then patterns cover at least 99% of the test FS size in the guest's memory 4.119 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.712
Then I find very few patterns in the guest's memory 3.641 
Pattern coverage: 0.000% (0 MiB out of 884 MiB reference memory)
After features/support/hooks.rb:305 3.346
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:17.559
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.577
And I prepare Tails for memory erasure tests 0.460
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 36.953
Then I find very few patterns in the guest's memory 4.123 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.516
Then patterns cover at least 99% of the test FS size in the guest's memory 3.616 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.959
Then I find very few patterns in the guest's memory 3.795 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
# read cache
When I mount the USB drive again 6.152
And I read the content of the test FS 0.618
Then patterns cover at least 99% of the test FS size in the guest's memory 3.498 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.556
Then I find very few patterns in the guest's memory 3.730 
Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)
After features/support/hooks.rb:305 1.229
After features/support/hooks.rb:89 0.001
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.449
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and logged in 8.316
And I prepare Tails for memory erasure tests 0.477
When I fill a 128 MiB file with a known pattern on the root filesystem 16.517
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 3.555
Then patterns cover at least 128 MiB in the guest's memory 3.209 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.016
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.336 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:305 3.614
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:48.539
Before features/support/hooks.rb:259 0.004
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:4.761
And I prepare Tails for memory erasure tests 0.428
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.932
When I trigger shutdown 0.012
And I wait 20 seconds 20.012 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.393 
Pattern coverage: 0.000% (0 MiB out of 903 MiB reference memory)
After features/support/hooks.rb:305 3.550
After features/support/hooks.rb:89 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:17.030
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 58.482
And I update APT using apt 17.590
And I install "popularity-contest" using apt 26.112
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.535
When I create a persistent storage and activate the Additional Software feature 23.087
Then Additional Software is correctly configured for package "popularity-contest" 1.607
When I shutdown Tails and wait for the computer to power off 12.896
And I start Tails from USB drive "__internal" with network unplugged 1:0.536
And I enable persistence 26.194
And I log in to a new session 37.528
And the Additional Software installation service has started 41.760
Then I am notified that the installation succeeded 2.508
And Additional Software is correctly configured for package "popularity-contest" 0.907
And the package "popularity-contest" is installed after Additional Software has been started 0.284
After features/support/hooks.rb:464 37.947
After features/support/hooks.rb:305 1.194
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:40.372
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.209
And I start Tails from USB drive "__internal" and I login with an administration password 1:53.158
And I update APT using apt 17.960
When I install "makepp" using apt 22.515
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.444
And the package "makepp" is installed 0.083
After features/support/hooks.rb:464 39.032
After features/support/hooks.rb:305 0.959
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:11.950
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.004
Given a computer 0.235
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:18.984
When I uninstall "popularity-contest" using apt 21.991
And I accept removing "popularity-contest" from Additional Software 2.354
Then "popularity-contest" is not in the list of Additional Software 0.734
When I start Synaptic 26.108
And I update APT using Synaptic 22.601
And I install "cowsay" using Synaptic 10.799
And I accept adding "cowsay" to Additional Software 2.097
Then Additional Software is correctly configured for package "cowsay" 0.820
When I uninstall "cowsay" using apt 3.225
And I refuse removing "cowsay" from Additional Software 0.634
Then Additional Software is correctly configured for package "cowsay" 0.725
When I start "Additional Software" via GNOME Activities Overview 10.535
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.828
Then "cowsay" is not in the list of Additional Software 0.831
When I install "cowsay" using apt 3.205
And I refuse adding "cowsay" to Additional Software 0.554
Then "cowsay" is not in the list of Additional Software 0.678
After features/support/hooks.rb:464 0.985
After features/support/hooks.rb:305 0.743
After features/support/hooks.rb:89 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:32.305
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Steps
Given a computer 0.193
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:40.810
And I configure APT to prefer an old version of cowsay 0.028
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.914
And I accept adding "cowsay" to Additional Software 7.472
And Additional Software is correctly configured for package "cowsay" 0.945
And I shutdown Tails and wait for the computer to power off 6.501
And I start Tails from USB drive "__internal" with network unplugged 1:1.818
And I enable persistence 12.847
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 37.692
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.411
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.071
And the network is plugged 0.057
And Tor is ready 22.368
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 11.449
And available upgrades have been checked 0.568
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:1.064
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:146:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:52:in `try_for'
./features/step_definitions/common_steps.rb:591:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:105:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:464 0.034
After features/support/hooks.rb:305 8.656 
SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:33:34)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/81/artifact/build-artifacts/01:33:34_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/81/artifact/build-artifacts/01:33:34_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv
After features/support/hooks.rb:89 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:15.092
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.004
Given a computer 0.176
And I start Tails from USB drive "__internal" with network unplugged 1:0.760
And I enable persistence 13.895
And I remove the "cowsay" deb files from the APT cache 0.705
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.092
And I log in to a new session 37.120
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 15.927
And I can open the Additional Software log file from the notification 5.720
And the package "cowsay" is not installed 0.693
After features/support/hooks.rb:464 0.112
After features/support/hooks.rb:305 1.157
After features/support/hooks.rb:89 0.013
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.881
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.458
When I log in to a new session in Arabic (ar) 32.564
Then the keyboard layout is set to "us" 0.222
When the network is plugged 0.045
And Tor is ready 46.804
Then I successfully start the Unsafe Browser in "ar" 16.930
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 32.807
And DuckDuckGo is the default search engine 11.911
And I kill the Tor Browser 5.537
And the screen keyboard works in Thunderbird 13.972
And the layout of the screen keyboard is set to "us" 0.668
After features/support/hooks.rb:305 2.838
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.000
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 21.390
When I log in to a new session in Chinese (zh_CN) 32.627
Then the keyboard layout is set to "cn" 0.511
When the network is plugged 0.066
And Tor is ready 17.746
Then I successfully start the Unsafe Browser in "zh_CN" 19.343
And I kill the Unsafe Browser 5.804
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 30.785
And DuckDuckGo is the default search engine 11.150
And I kill the Tor Browser 5.511
And the screen keyboard works in Thunderbird 18.324
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:305 1.718
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.718
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.243
When I log in to a new session in English (en) 18.398
Then the keyboard layout is set to "us" 0.183
When the network is plugged 0.058
And Tor is ready 23.904
Then I successfully start the Unsafe Browser in "en" 16.338
And I kill the Unsafe Browser 5.611
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 29.205
And DuckDuckGo is the default search engine 7.188
And I kill the Tor Browser 5.322
And the screen keyboard works in Thunderbird 13.588
And the layout of the screen keyboard is set to "us" 0.566
After features/support/hooks.rb:305 1.163
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.193
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.658
When I log in to a new session in French (fr) 32.703
Then the keyboard layout is set to "fr" 0.367
When the network is plugged 0.042
And Tor is ready 16.639
Then I successfully start the Unsafe Browser in "fr" 17.386
And I kill the Unsafe Browser 5.776
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 29.466
And DuckDuckGo is the default search engine 10.641
And I kill the Tor Browser 5.487
And the screen keyboard works in Thunderbird 14.298
And the layout of the screen keyboard is set to "fr" 0.628
After features/support/hooks.rb:305 1.130
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.605
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.446
When I log in to a new session in German (de) 32.220
Then the keyboard layout is set to "de" 0.163
When the network is plugged 0.052
And Tor is ready 17.041
Then I successfully start the Unsafe Browser in "de" 16.653
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.160
Then the screen keyboard works in Tor Browser 29.883
And DuckDuckGo is the default search engine 11.938
And I kill the Tor Browser 5.614
And the screen keyboard works in Thunderbird 14.091
And the layout of the screen keyboard is set to "de" 0.564
After features/support/hooks.rb:305 1.334
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.631
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.572
When I log in to a new session in Italian (it) 33.209
Then the keyboard layout is set to "it" 0.156
When the network is plugged 0.098
And Tor is ready 16.787
Then I successfully start the Unsafe Browser in "it" 16.966
And I kill the Unsafe Browser 5.627
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 31.258
And DuckDuckGo is the default search engine 10.227
And I kill the Tor Browser 5.315
And the screen keyboard works in Thunderbird 14.542
And the layout of the screen keyboard is set to "us" 0.719
After features/support/hooks.rb:305 1.171
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.507
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.343
When I log in to a new session in Persian (fa) 34.143
Then the keyboard layout is set to "ir" 0.120
When the network is plugged 0.033
And Tor is ready 16.274
Then I successfully start the Unsafe Browser in "fa" 16.494
And I kill the Unsafe Browser 5.745
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 32.184
And DuckDuckGo is the default search engine 17.672
And I kill the Tor Browser 5.551
And the screen keyboard works in Thunderbird 13.277
And the layout of the screen keyboard is set to "ir" 0.515
After features/support/hooks.rb:305 3.231
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.284
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.136
When I log in to a new session in Portuguese (pt) 33.985
Then the keyboard layout is set to "pt" 0.193
When the network is plugged 0.045
And Tor is ready 17.006
Then I successfully start the Unsafe Browser in "pt" 16.475
And I kill the Unsafe Browser 5.658
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 29.820
And DuckDuckGo is the default search engine 11.019
And I kill the Tor Browser 5.472
And the screen keyboard works in Thunderbird 13.671
And the layout of the screen keyboard is set to "us" 0.664
After features/support/hooks.rb:305 1.129
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.101
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.277
When I log in to a new session in Russian (ru) 31.488
Then the keyboard layout is set to "ru" 0.240
When the network is plugged 0.039
And Tor is ready 15.233
Then I successfully start the Unsafe Browser in "ru" 17.140
And I kill the Unsafe Browser 5.687
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 27.682
And DuckDuckGo is the default search engine 10.880
And I kill the Tor Browser 5.465
And the screen keyboard works in Thunderbird 14.249
And the layout of the screen keyboard is set to "ru" 0.600
After features/support/hooks.rb:305 1.425
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.120
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.408
When I log in to a new session in Spanish (es) 36.351
Then the keyboard layout is set to "es" 0.203
When the network is plugged 0.048
And Tor is ready 19.959
Then I successfully start the Unsafe Browser in "es" 16.068
And I kill the Unsafe Browser 5.824
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 31.924
And DuckDuckGo is the default search engine 11.361
And I kill the Tor Browser 5.477
And the screen keyboard works in Thunderbird 12.777
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:305 1.413
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.837
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.217
When I log in to a new session in Turkish (tr) 35.389
Then the keyboard layout is set to "tr" 0.148
When the network is plugged 0.047
And Tor is ready 19.274
Then I successfully start the Unsafe Browser in "tr" 17.067
And I kill the Unsafe Browser 5.894
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 31.230
And DuckDuckGo is the default search engine 11.458
And I kill the Tor Browser 5.486
And the screen keyboard works in Thunderbird 12.885
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:305 3.206
After features/support/hooks.rb:89 0.000