Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 57 27 Apr 2024, 06:51

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 267 2 6 0 0 275 20 2 22 1:5:43.270 Failed
21.551
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.278
And I prepare Tails for memory erasure tests 0.403
When I start a process allocating 128 MiB of memory with a known pattern 3.693
Then patterns cover at least 128 MiB in the guest's memory 3.582

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 1.709
Then I find very few patterns in the guest's memory 3.883

Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)

After features/support/hooks.rb:305 1.196
After features/support/hooks.rb:89 0.000
25.297
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.044
And I prepare Tails for memory erasure tests 0.518
And I find very few patterns in the guest's memory 3.959

Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.380
Then patterns cover at least 99% of the test FS size in the guest's memory 3.805

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 1.261
Then I find very few patterns in the guest's memory 4.328

Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)

After features/support/hooks.rb:305 5.141
After features/support/hooks.rb:89 0.000
44.455
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.037
And I prepare Tails for memory erasure tests 0.554
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.615
Then I find very few patterns in the guest's memory 4.125

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.983
Then patterns cover at least 86% of the test FS size in the guest's memory 3.385

Pattern coverage: 90.951% (116 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.652
Then I find very few patterns in the guest's memory 3.431

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

# read cache
When I mount the USB drive again 0.611
And I read the content of the test FS 0.824
Then patterns cover at least 99% of the test FS size in the guest's memory 3.257

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.616
Then I find very few patterns in the guest's memory 4.358

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

After features/support/hooks.rb:305 1.671
After features/support/hooks.rb:89 0.000
1:17.748
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.258
And I prepare Tails for memory erasure tests 0.406
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 37.592
Then I find very few patterns in the guest's memory 3.865

Pattern coverage: 0.000% (0 MiB out of 900 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.216
Then patterns cover at least 99% of the test FS size in the guest's memory 3.637

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.048
Then I find very few patterns in the guest's memory 3.945

Pattern coverage: 0.000% (0 MiB out of 900 MiB reference memory)

# read cache
When I mount the USB drive again 5.690
And I read the content of the test FS 1.910
Then patterns cover at least 99% of the test FS size in the guest's memory 2.637

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 2.009
Then I find very few patterns in the guest's memory 3.529

Pattern coverage: 0.000% (0 MiB out of 900 MiB reference memory)

After features/support/hooks.rb:305 0.909
After features/support/hooks.rb:89 0.000
51.184
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.864
And I prepare Tails for memory erasure tests 0.547
When I fill a 128 MiB file with a known pattern on the root filesystem 14.901
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.839
Then patterns cover at least 128 MiB in the guest's memory 3.183

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.012
And I wait 20 seconds 20.007

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.829

Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)

After features/support/hooks.rb:305 3.592
After features/support/hooks.rb:89 0.000
7:50.404
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:4.391
And I prepare Tails for memory erasure tests 0.435
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.305
When I trigger shutdown 0.016
And I wait 20 seconds 20.007

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.248

Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)

After features/support/hooks.rb:305 3.520
After features/support/hooks.rb:89 0.012
5:12.678
Before features/support/hooks.rb:259 0.003
Before features/support/hooks.rb:456 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 57.246
And I update APT using apt 18.250
And I install "popularity-contest" using apt 25.675
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.405
When I create a persistent storage and activate the Additional Software feature 22.625
Then Additional Software is correctly configured for package "popularity-contest" 1.800
When I shutdown Tails and wait for the computer to power off 14.991
And I start Tails from USB drive "__internal" with network unplugged 59.651
And I enable persistence 22.412
And I log in to a new session 38.803
And the Additional Software installation service has started 41.622
Then I am notified that the installation succeeded 2.148
And Additional Software is correctly configured for package "popularity-contest" 0.790
And the package "popularity-contest" is installed after Additional Software has been started 0.253
After features/support/hooks.rb:464 36.637
After features/support/hooks.rb:305 1.360
After features/support/hooks.rb:89 0.015
2:32.471
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.007
Given a computer 0.202
And I start Tails from USB drive "__internal" and I login with an administration password 1:43.964
And I update APT using apt 16.966
When I install "makepp" using apt 26.866
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.386
And the package "makepp" is installed 0.083
After features/support/hooks.rb:464 37.587
After features/support/hooks.rb:305 0.924
After features/support/hooks.rb:89 0.018
5:12.504
Before features/support/hooks.rb:259 0.010
Before features/support/hooks.rb:456 0.015
Given a computer 0.245
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:19.999
When I uninstall "popularity-contest" using apt 21.924
And I accept removing "popularity-contest" from Additional Software 0.562
Then "popularity-contest" is not in the list of Additional Software 0.712
When I start Synaptic 25.576
And I update APT using Synaptic 22.149
And I install "cowsay" using Synaptic 9.548
And I accept adding "cowsay" to Additional Software 1.502
Then Additional Software is correctly configured for package "cowsay" 0.826
When I uninstall "cowsay" using apt 3.254
And I refuse removing "cowsay" from Additional Software 0.574
Then Additional Software is correctly configured for package "cowsay" 0.905
When I start "Additional Software" via GNOME Activities Overview 10.747
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.401
Then "cowsay" is not in the list of Additional Software 1.338
When I install "cowsay" using apt 3.267
And I refuse adding "cowsay" to Additional Software 2.298
Then "cowsay" is not in the list of Additional Software 0.666
After features/support/hooks.rb:464 0.964
After features/support/hooks.rb:305 0.838
After features/support/hooks.rb:89 0.009
10:15.481
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.201
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:25.449
And I configure APT to prefer an old version of cowsay 0.027
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.043
And I accept adding "cowsay" to Additional Software 8.011
And Additional Software is correctly configured for package "cowsay" 0.931
And I shutdown Tails and wait for the computer to power off 6.218
And I start Tails from USB drive "__internal" with network unplugged 1:0.529
And I enable persistence 12.452
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 39.571
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.722
And I revert the APT tweaks that made it prefer an old version of cowsay 0.057
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.051
And Tor is ready 21.889
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.120
And available upgrades have been checked 0.207
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.654
And I can open the Additional Software configuration window from the notification 2.985
And I shutdown Tails and wait for the computer to power off 18.904
And I start Tails from USB drive "__internal" with network unplugged 1:9.215
And I enable persistence 17.780
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 38.257
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.996
And I revert the APT tweaks that made it prefer an old version of cowsay 0.042
And the network is plugged 0.037
And Tor is ready 51.723
Then the Additional Software upgrade service has started 0.166
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.104
After features/support/hooks.rb:464 2.275
After features/support/hooks.rb:305 0.960
After features/support/hooks.rb:89 0.027
2:16.264
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.007
Given a computer 0.223
And I start Tails from USB drive "__internal" with network unplugged 1:1.562
And I enable persistence 11.606
And I remove the "cowsay" deb files from the APT cache 0.657
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.094
And I log in to a new session 39.748
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.995
And I can open the Additional Software log file from the notification 6.724
And the package "cowsay" is not installed 0.651
After features/support/hooks.rb:464 0.099
After features/support/hooks.rb:305 0.966
After features/support/hooks.rb:89 0.008
Feature: Localization
2:41.876
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.275
When I log in to a new session in Arabic (ar) 32.271
Then the keyboard layout is set to "us" 0.170
When the network is plugged 0.033
And Tor is ready 17.438
Then I successfully start the Unsafe Browser in "ar" 16.801
And I kill the Unsafe Browser 5.856
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 29.400
And DuckDuckGo is the default search engine 32.118
And I kill the Tor Browser 5.502
And the screen keyboard works in Thunderbird 13.303
And the layout of the screen keyboard is set to "us" 0.552
After features/support/hooks.rb:305 1.062
After features/support/hooks.rb:89 0.000
Feature: Localization
2:29.470
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.149
When I log in to a new session in Chinese (zh_CN) 33.906
Then the keyboard layout is set to "cn" 0.262
When the network is plugged 0.054
And Tor is ready 18.422
Then I successfully start the Unsafe Browser in "zh_CN" 18.293
And I kill the Unsafe Browser 5.822
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 28.623
And DuckDuckGo is the default search engine 11.395
And I kill the Tor Browser 5.487
And the screen keyboard works in Thunderbird 18.251
And the layout of the screen keyboard is set to "us" 0.678
After features/support/hooks.rb:305 1.537
After features/support/hooks.rb:89 0.000
Feature: Localization
1:59.103
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.760
When I log in to a new session in English (en) 19.372
Then the keyboard layout is set to "us" 0.188
When the network is plugged 0.065
And Tor is ready 14.485
Then I successfully start the Unsafe Browser in "en" 17.039
And I kill the Unsafe Browser 5.661
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 27.443
And DuckDuckGo is the default search engine 7.046
And I kill the Tor Browser 5.267
And the screen keyboard works in Thunderbird 13.069
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:305 1.740
After features/support/hooks.rb:89 0.000
Feature: Localization
2:34.691
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.005
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.411
When I log in to a new session in French (fr) 33.826
Then the keyboard layout is set to "fr" 0.327
When the network is plugged 0.053
And Tor is ready 18.362
Then I successfully start the Unsafe Browser in "fr" 15.593
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.177
Then the screen keyboard works in Tor Browser 27.676
And DuckDuckGo is the default search engine 44.424
Operation failed (despite retrying 10 times) with
Timeout::Error: try_for() timeout expired (MaxRetriesFailure)
./features/support/helpers/misc_helpers.rb:227:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:394:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:47:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "fr" 0.000
After features/support/hooks.rb:305 4.747

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#4)' (at time 02:31:37)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:31:37_Tails_is_localized_for_every_tier-1_language,_Examples___4_.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:31:37_Tails_is_localized_for_every_tier-1_language,_Examples___4_.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:31:37_Tails_is_localized_for_every_tier-1_language,_Examples___4_.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:31:37_Tails_is_localized_for_every_tier-1_language,_Examples___4_.journal

After features/support/hooks.rb:89 0.000
Feature: Localization
3:5.301
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.340
When I log in to a new session in German (de) 31.552
Then the keyboard layout is set to "de" 0.345
When the network is plugged 0.049
And Tor is ready 45.967
Then I successfully start the Unsafe Browser in "de" 15.554
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 27.827
And DuckDuckGo is the default search engine 26.795
And I kill the Tor Browser 5.467
And the screen keyboard works in Thunderbird 13.866
And the layout of the screen keyboard is set to "de" 0.610
After features/support/hooks.rb:305 1.293
After features/support/hooks.rb:89 0.000
Feature: Localization
2:42.420
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.188
When I log in to a new session in Italian (it) 32.274
Then the keyboard layout is set to "it" 0.307
When the network is plugged 0.038
And Tor is ready 17.337
Then I successfully start the Unsafe Browser in "it" 15.146
And I kill the Unsafe Browser 5.980
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 27.210
And DuckDuckGo is the default search engine 35.365
And I kill the Tor Browser 5.539
And the screen keyboard works in Thunderbird 13.304
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:305 1.271
After features/support/hooks.rb:89 0.000
Feature: Localization
2:34.707
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.854
When I log in to a new session in Persian (fa) 34.788
Then the keyboard layout is set to "ir" 0.317
When the network is plugged 0.040
And Tor is ready 16.268
Then I successfully start the Unsafe Browser in "fa" 16.540
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 29.701
And DuckDuckGo is the default search engine 22.547
And I kill the Tor Browser 5.451
And the screen keyboard works in Thunderbird 13.641
And the layout of the screen keyboard is set to "ir" 0.590
After features/support/hooks.rb:305 1.261
After features/support/hooks.rb:89 0.000
Feature: Localization
2:42.413
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.510
When I log in to a new session in Portuguese (pt) 32.537
Then the keyboard layout is set to "pt" 0.231
When the network is plugged 0.044
And Tor is ready 18.629
Then I successfully start the Unsafe Browser in "pt" 16.062
And I kill the Unsafe Browser 6.117
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 30.531
And DuckDuckGo is the default search engine 29.894
And I kill the Tor Browser 5.463
And the screen keyboard works in Thunderbird 13.539
And the layout of the screen keyboard is set to "us" 0.703
After features/support/hooks.rb:305 1.711
After features/support/hooks.rb:89 0.000
Feature: Localization
2:35.800
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.005
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.040
When I log in to a new session in Russian (ru) 35.518
Then the keyboard layout is set to "ru" 0.963
When the network is plugged 0.086
And Tor is ready 17.720
Then I successfully start the Unsafe Browser in "ru" 15.707
And I kill the Unsafe Browser 5.877
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 27.665
And DuckDuckGo is the default search engine 43.094
Operation failed (despite retrying 10 times) with
Timeout::Error: try_for() timeout expired (MaxRetriesFailure)
./features/support/helpers/misc_helpers.rb:227:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:394:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:55:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "ru" 0.000
After features/support/hooks.rb:305 4.804

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#9)' (at time 02:45:28)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:45:28_Tails_is_localized_for_every_tier-1_language,_Examples___9_.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:45:28_Tails_is_localized_for_every_tier-1_language,_Examples___9_.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:45:28_Tails_is_localized_for_every_tier-1_language,_Examples___9_.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/57/artifact/build-artifacts/02:45:28_Tails_is_localized_for_every_tier-1_language,_Examples___9_.journal

After features/support/hooks.rb:89 0.000
Feature: Localization
2:25.772
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.201
When I log in to a new session in Spanish (es) 33.358
Then the keyboard layout is set to "es" 0.325
When the network is plugged 0.047
And Tor is ready 18.294
Then I successfully start the Unsafe Browser in "es" 16.306
And I kill the Unsafe Browser 5.733
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 30.710
And DuckDuckGo is the default search engine 12.501
And I kill the Tor Browser 5.497
And the screen keyboard works in Thunderbird 13.989
And the layout of the screen keyboard is set to "us" 0.651
After features/support/hooks.rb:305 1.185
After features/support/hooks.rb:89 0.000
Feature: Localization
2:51.668
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.033
When I log in to a new session in Turkish (tr) 32.479
Then the keyboard layout is set to "tr" 0.448
When the network is plugged 0.070
And Tor is ready 16.449
Then I successfully start the Unsafe Browser in "tr" 17.069
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 31.867
And DuckDuckGo is the default search engine 36.547
And I kill the Tor Browser 5.509
And the screen keyboard works in Thunderbird 14.563
And the layout of the screen keyboard is set to "us" 0.652
After features/support/hooks.rb:305 1.673
After features/support/hooks.rb:89 0.000