Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 89 29 May 2024, 08:01

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 270 1 4 0 0 275 21 1 22 1:3:43.749 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.040
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.102
And I prepare Tails for memory erasure tests 0.474
When I start a process allocating 128 MiB of memory with a known pattern 2.392
Then patterns cover at least 128 MiB in the guest's memory 3.568 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.752
Then I find very few patterns in the guest's memory 3.750 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
After features/support/hooks.rb:305 2.463
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.873
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.373
And I prepare Tails for memory erasure tests 0.573
And I find very few patterns in the guest's memory 4.297 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.204
Then patterns cover at least 99% of the test FS size in the guest's memory 4.126 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.038
Then I find very few patterns in the guest's memory 4.258 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:305 0.795
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.117
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.236
And I prepare Tails for memory erasure tests 0.487
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.012
Then I find very few patterns in the guest's memory 4.595 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.091
Then patterns cover at least 86% of the test FS size in the guest's memory 3.969 
Pattern coverage: 92.148% (117 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.768
Then I find very few patterns in the guest's memory 4.659 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
# read cache
When I mount the USB drive again 0.463
And I read the content of the test FS 0.971
Then patterns cover at least 99% of the test FS size in the guest's memory 4.178 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.108
Then I find very few patterns in the guest's memory 4.574 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
After features/support/hooks.rb:305 1.654
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:21.053
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.829
And I prepare Tails for memory erasure tests 0.423
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 38.201
Then I find very few patterns in the guest's memory 3.660 
Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 6.443
Then patterns cover at least 99% of the test FS size in the guest's memory 3.058 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.508
Then I find very few patterns in the guest's memory 3.217 
Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)
# read cache
When I mount the USB drive again 7.489
And I read the content of the test FS 0.527
Then patterns cover at least 99% of the test FS size in the guest's memory 3.152 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.947
Then I find very few patterns in the guest's memory 3.593 
Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)
After features/support/hooks.rb:305 1.004
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.435
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.159
And I prepare Tails for memory erasure tests 0.514
When I fill a 128 MiB file with a known pattern on the root filesystem 15.488
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.739
Then patterns cover at least 128 MiB in the guest's memory 3.271 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.227 
Pattern coverage: 0.000% (0 MiB out of 869 MiB reference memory)
After features/support/hooks.rb:305 3.654
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:36.891
Before features/support/hooks.rb:259 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:51.826
And I prepare Tails for memory erasure tests 0.361
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.484
When I trigger shutdown 0.017
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.181 
Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)
After features/support/hooks.rb:305 3.612
After features/support/hooks.rb:89 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:14.864
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.010
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:1.251
And I update APT using apt 17.486
And I install "popularity-contest" using apt 22.497
Then I am proposed to add the "popularity-contest" package to my Additional Software 10.967
When I create a persistent storage and activate the Additional Software feature 20.124
Then Additional Software is correctly configured for package "popularity-contest" 2.538
When I shutdown Tails and wait for the computer to power off 12.517
And I start Tails from USB drive "__internal" with network unplugged 1:0.522
And I enable persistence 22.254
And I log in to a new session 40.561
And the Additional Software installation service has started 41.047
Then I am notified that the installation succeeded 2.046
And Additional Software is correctly configured for package "popularity-contest" 0.771
And the package "popularity-contest" is installed after Additional Software has been started 0.278
After features/support/hooks.rb:464 37.542
After features/support/hooks.rb:305 1.242
After features/support/hooks.rb:89 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:26.978
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.204
And I start Tails from USB drive "__internal" and I login with an administration password 1:38.623
And I update APT using apt 19.092
When I install "makepp" using apt 22.326
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.640
And the package "makepp" is installed 0.090
After features/support/hooks.rb:464 36.367
After features/support/hooks.rb:305 0.832
After features/support/hooks.rb:89 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:3.467
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.005
Given a computer 0.208
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.052
When I uninstall "popularity-contest" using apt 21.790
And I accept removing "popularity-contest" from Additional Software 0.657
Then "popularity-contest" is not in the list of Additional Software 0.712
When I start Synaptic 25.192
And I update APT using Synaptic 22.105
And I install "cowsay" using Synaptic 12.050
And I accept adding "cowsay" to Additional Software 1.430
Then Additional Software is correctly configured for package "cowsay" 0.794
When I uninstall "cowsay" using apt 3.262
And I refuse removing "cowsay" from Additional Software 0.592
Then Additional Software is correctly configured for package "cowsay" 0.762
When I start "Additional Software" via GNOME Activities Overview 9.772
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.814
Then "cowsay" is not in the list of Additional Software 0.819
When I install "cowsay" using apt 3.235
And I refuse adding "cowsay" to Additional Software 0.585
Then "cowsay" is not in the list of Additional Software 0.627
After features/support/hooks.rb:464 0.981
After features/support/hooks.rb:305 0.685
After features/support/hooks.rb:89 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:36.013
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.006
Given a computer 0.198
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:19.082
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.559
And I accept adding "cowsay" to Additional Software 6.342
And Additional Software is correctly configured for package "cowsay" 0.925
And I shutdown Tails and wait for the computer to power off 6.822
And I start Tails from USB drive "__internal" with network unplugged 58.545
And I enable persistence 9.985
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 38.775
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 40.865
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.067
And the network is plugged 0.068
And Tor is ready 18.441
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.722
And available upgrades have been checked 0.101
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.554
And I can open the Additional Software configuration window from the notification 5.561
And I shutdown Tails and wait for the computer to power off 2:7.016
And I start Tails from USB drive "__internal" with network unplugged 1:6.227
And I enable persistence 11.991
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 37.438
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.833
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
And the network is plugged 0.051
And Tor is ready 49.381
Then the Additional Software upgrade service has started 0.169
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.084
After features/support/hooks.rb:464 2.608
After features/support/hooks.rb:305 1.140
After features/support/hooks.rb:89 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:10.882
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.007
Given a computer 0.204
And I start Tails from USB drive "__internal" with network unplugged 59.300
And I enable persistence 11.460
And I remove the "cowsay" deb files from the APT cache 0.614
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.089
And I log in to a new session 40.487
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.433
And I can open the Additional Software log file from the notification 4.664
And the package "cowsay" is not installed 0.626
After features/support/hooks.rb:464 0.111
After features/support/hooks.rb:305 0.797
After features/support/hooks.rb:89 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.678
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.266
When I log in to a new session in Arabic (ar) 33.753
Then the keyboard layout is set to "us" 0.227
When the network is plugged 0.542
And Tor is ready 16.667
Then I successfully start the Unsafe Browser in "ar" 17.151
And I kill the Unsafe Browser 5.892
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 32.591
And DuckDuckGo is the default search engine 11.250
And I kill the Tor Browser 5.465
And the screen keyboard works in Thunderbird 15.193
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:305 3.106
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.481
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.405
When I log in to a new session in Chinese (zh_CN) 33.190
Then the keyboard layout is set to "cn" 0.474
When the network is plugged 0.038
And Tor is ready 18.880
Then I successfully start the Unsafe Browser in "zh_CN" 16.422
And I kill the Unsafe Browser 5.861
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 28.809
And DuckDuckGo is the default search engine 18.357
And I kill the Tor Browser 5.551
And the screen keyboard works in Thunderbird 16.744
And the layout of the screen keyboard is set to "us" 0.597
After features/support/hooks.rb:305 1.938
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:1.168
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.458
When I log in to a new session in English (en) 19.385
Then the keyboard layout is set to "us" 0.212
When the network is plugged 0.049
And Tor is ready 16.520
Then I successfully start the Unsafe Browser in "en" 16.654
And I kill the Unsafe Browser 5.771
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 29.713
And DuckDuckGo is the default search engine 5.183
And I kill the Tor Browser 5.303
And the screen keyboard works in Thunderbird 13.240
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:305 1.197
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.326
Before features/support/hooks.rb:259 0.013
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.162
When I log in to a new session in French (fr) 32.662
Then the keyboard layout is set to "fr" 0.355
When the network is plugged 0.064
And Tor is ready 19.981
Then I successfully start the Unsafe Browser in "fr" 14.880
And I kill the Unsafe Browser 5.751
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 28.885
And DuckDuckGo is the default search engine 10.834
And I kill the Tor Browser 5.513
And the screen keyboard works in Thunderbird 12.578
And the layout of the screen keyboard is set to "fr" 0.567
After features/support/hooks.rb:305 1.107
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.635
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.971
When I log in to a new session in German (de) 33.287
Then the keyboard layout is set to "de" 0.362
When the network is plugged 0.045
And Tor is ready 19.119
Then I successfully start the Unsafe Browser in "de" 15.203
And I kill the Unsafe Browser 5.877
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 29.984
And DuckDuckGo is the default search engine 10.587
And I kill the Tor Browser 5.590
And the screen keyboard works in Thunderbird 12.843
And the layout of the screen keyboard is set to "de" 0.642
After features/support/hooks.rb:305 1.436
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.177
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.999
When I log in to a new session in Italian (it) 33.352
Then the keyboard layout is set to "it" 0.174
When the network is plugged 0.051
And Tor is ready 17.517
Then I successfully start the Unsafe Browser in "it" 15.314
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 31.028
And DuckDuckGo is the default search engine 11.365
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 13.365
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:305 2.294
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.849
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.452
When I log in to a new session in Persian (fa) 35.013
Then the keyboard layout is set to "ir" 0.246
When the network is plugged 0.050
And Tor is ready 17.323
Then I successfully start the Unsafe Browser in "fa" 17.216
And I kill the Unsafe Browser 5.937
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 31.837
And DuckDuckGo is the default search engine 11.610
And I kill the Tor Browser 5.478
And the screen keyboard works in Thunderbird 13.014
And the layout of the screen keyboard is set to "ir" 0.549
After features/support/hooks.rb:305 1.199
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.670
Before features/support/hooks.rb:259 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.360
When I log in to a new session in Portuguese (pt) 32.538
Then the keyboard layout is set to "pt" 0.168
When the network is plugged 0.036
And Tor is ready 16.600
Then I successfully start the Unsafe Browser in "pt" 16.487
And I kill the Unsafe Browser 5.848
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 29.881
And DuckDuckGo is the default search engine 11.074
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 13.410
And the layout of the screen keyboard is set to "us" 0.645
After features/support/hooks.rb:305 1.420
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.828
Before features/support/hooks.rb:259 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.223
When I log in to a new session in Russian (ru) 34.039
Then the keyboard layout is set to "ru" 0.182
When the network is plugged 0.038
And Tor is ready 16.326
Then I successfully start the Unsafe Browser in "ru" 15.471
And I kill the Unsafe Browser 5.827
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 29.544
And DuckDuckGo is the default search engine 10.707
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 15.261
And the layout of the screen keyboard is set to "ru" 0.594
After features/support/hooks.rb:305 1.062
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.886
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.005
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.980
When I log in to a new session in Spanish (es) 35.025
Then the keyboard layout is set to "es" 0.204
When the network is plugged 0.047
And Tor is ready 17.223
Then I successfully start the Unsafe Browser in "es" 15.024
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 46.433
cannot 
cannot find ScreenKeyboard.png on the screen (FindFailed)
./features/support/helpers/screen.rb:173:in `rescue in wait'
./features/support/helpers/screen.rb:157:in `wait'
./features/step_definitions/browser.rb:408:in `/^the screen keyboard works in Tor Browser$/'
features/localization.feature:56:in `Then the screen keyboard works in Tor Browser'
features/localization.feature:30:in `Then the screen keyboard works in Tor Browser'
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.791 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#10)' (at time 02:47:19)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/89/artifact/build-artifacts/02:47:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/89/artifact/build-artifacts/02:47:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/89/artifact/build-artifacts/02:47:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/89/artifact/build-artifacts/02:47:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.journal
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.429
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.355
When I log in to a new session in Turkish (tr) 33.196
Then the keyboard layout is set to "tr" 0.161
When the network is plugged 0.045
And Tor is ready 17.238
Then I successfully start the Unsafe Browser in "tr" 16.284
And I kill the Unsafe Browser 5.930
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 28.253
And DuckDuckGo is the default search engine 11.091
And I kill the Tor Browser 5.493
And the screen keyboard works in Thunderbird 14.697
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:305 1.607
After features/support/hooks.rb:89 0.000