Project Number Date
test_Tails_ISO_devel 3353 17 Apr 2024, 12:17

Failures Overview

The following summary displays scenarios that failed.

Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
25.814
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:259 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.001
And I prepare Tails for memory erasure tests 0.400
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.918
Then I find very few patterns in the guest's memory 4.258 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.242
Then patterns cover at least 86% of the test FS size in the guest's memory 3.993
85.921% 
85.921% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 85.921% (109 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:305 4.458 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:27:18)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/00:27:18_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/00:27:18_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/00:27:18_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/00:27:18_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:89 0.000
Feature: Tails-related cryptographic keys are up-to-date
Tags: @product
20.813
Scenario The included APT repository keys are up-to-date
Before features/support/hooks.rb:259 0.006
Steps
Given I have started Tails from DVD without network and logged in 8.380
Then the keys trusted by APT are valid for the next 3 months 12.432
The 
The following APT key(s) will not be valid in 3 months: A3C4F0F979CAA22CDBA8F512EE8CBC9E886DDD89, 2265EB4CB2BF88D900AE8D1B74A941BA219EC810.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/checks.rb:29:in `assert_all_keys_are_valid_for_n_months'
./features/step_definitions/checks.rb:8:in `/^the keys trusted by APT are valid for the next (\d+) months$/'
features/keys.feature:11:in `Then the keys trusted by APT are valid for the next 3 months'
After features/support/hooks.rb:305 4.312 
SCENARIO FAILED: 'The included APT repository keys are up-to-date' (at time 02:09:39)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:09:39_The_included_APT_repository_keys_are_up-to-date.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:09:39_The_included_APT_repository_keys_are_up-to-date.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:09:39_The_included_APT_repository_keys_are_up-to-date.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:09:39_The_included_APT_repository_keys_are_up-to-date.journal
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.284
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.006
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.084
When I log in to a new session in Spanish (es) 30.091
Then the keyboard layout is set to "es" 0.287
When the network is plugged 0.055
And Tor is ready 17.516
Then I successfully start the Unsafe Browser in "es" 17.536
And I kill the Unsafe Browser 5.661
When I enable the screen keyboard 0.183
Then the screen keyboard works in Tor Browser 28.384
And DuckDuckGo is the default search engine 38.482
Operation 
Operation failed (despite retrying 10 times) with
Timeout::Error: try_for() timeout expired (MaxRetriesFailure)
./features/support/helpers/misc_helpers.rb:227:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:394:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:56:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.872 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#10)' (at time 02:36:19)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:36:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:36:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:36:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:36:19_Tails_is_localized_for_every_tier-1_language,_Examples___10_.journal
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.352
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.007
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.115
When I log in to a new session in Turkish (tr) 32.036
Then the keyboard layout is set to "tr" 0.287
When the network is plugged 0.040
And Tor is ready 44.375
Then I successfully start the Unsafe Browser in "tr" 18.061
And I kill the Unsafe Browser 5.939
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 30.376
And DuckDuckGo is the default search engine 43.977
Operation 
Operation failed (despite retrying 10 times) with
Timeout::Error: try_for() timeout expired (MaxRetriesFailure)
./features/support/helpers/misc_helpers.rb:227:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:210:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `loop'
./features/support/helpers/misc_helpers.rb:209:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:394:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:57:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.909 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#11)' (at time 02:39:29)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:39:29_Tails_is_localized_for_every_tier-1_language,_Examples___11_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:39:29_Tails_is_localized_for_every_tier-1_language,_Examples___11_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:39:29_Tails_is_localized_for_every_tier-1_language,_Examples___11_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3353/artifact/build-artifacts/02:39:29_Tails_is_localized_for_every_tier-1_language,_Examples___11_.journal
After features/support/hooks.rb:89 0.000