Project Number Date
test_Tails_ISO_stable 4850 21 May 2024, 13:13

Failures Overview

The following summary displays scenarios that failed.

Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.155
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:259 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.139
And I prepare Tails for memory erasure tests 0.434
When I start a process allocating 128 MiB of memory with a known pattern 2.506
Then patterns cover at least 128 MiB in the guest's memory 3.849 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.302
Then I find very few patterns in the guest's memory 4.923
9.617% 
9.617% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1 
Pattern coverage: 9.617% (83 MiB out of 865 MiB reference memory)
After features/support/hooks.rb:305 5.052 
SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:27:49)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/00:27:49_Erasure_of_memory_freed_by_killed_userspace_processes.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/00:27:49_Erasure_of_memory_freed_by_killed_userspace_processes.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/00:27:49_Erasure_of_memory_freed_by_killed_userspace_processes.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/00:27:49_Erasure_of_memory_freed_by_killed_userspace_processes.journal
After features/support/hooks.rb:89 0.000
Feature: Additional software
Tags: @product @check_tor_leaks @slow
26:32.266
Scenario I set up Additional Software when installing a package without persistent partition and the package is installed next time I start Tails
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Steps
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.159
And I update APT using apt 16.743
And I install "popularity-contest" using apt 23.467
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.581
When I create a persistent storage and activate the Additional Software feature 20.682
Then Additional Software is correctly configured for package "popularity-contest" 1.418
When I shutdown Tails and wait for the computer to power off 13.135
And I start Tails from USB drive "__internal" with network unplugged 57.341
And I enable persistence 23.064
And I log in to a new session 40.562
And the Additional Software installation service has started 2:12.970
Then I am notified that the installation succeeded 20:0.139
execution 
execution expired (RemoteShell::Timeout)
./features/support/helpers/remote_shell.rb:56:in `read'
./features/support/helpers/remote_shell.rb:56:in `block (3 levels) in communicate'
./features/support/helpers/remote_shell.rb:55:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/dogtail.rb:80:in `new'
./features/support/helpers/dogtail.rb:80:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/common_steps.rb:587:in `new'
./features/step_definitions/common_steps.rb:587:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
./features/step_definitions/additional_software_packages.rb:28:in `/^I am notified that the installation succeeded$/'
features/additional_software_packages.feature:39:in `Then I am notified that the installation succeeded'
And Additional Software is correctly configured for package "popularity-contest" 0.000
And the package "popularity-contest" is installed after Additional Software has been started 0.000
After features/support/hooks.rb:464 0.035
After features/support/hooks.rb:305 9.836 
SCENARIO FAILED: 'I set up Additional Software when installing a package without persistent partition and the package is installed next time I start Tails' (at time 01:30:22)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/01:30:22_I_set_up_Additional_Software_when_installing_a_package_without_persistent_partition_and_the_package_is_installed_next_time_I_start_Tails.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/01:30:22_I_set_up_Additional_Software_when_installing_a_package_without_persistent_partition_and_the_package_is_installed_next_time_I_start_Tails.mkv
After features/support/hooks.rb:89 0.010
Feature: Tails-related cryptographic keys are up-to-date
Tags: @product
20.830
Scenario The included APT repository keys are up-to-date
Before features/support/hooks.rb:259 0.005
Steps
Given I have started Tails from DVD without network and logged in 8.029
Then the keys trusted by APT are valid for the next 3 months 12.800
The 
The following APT key(s) will not be valid in 3 months: A3C4F0F979CAA22CDBA8F512EE8CBC9E886DDD89, 2265EB4CB2BF88D900AE8D1B74A941BA219EC810.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/checks.rb:29:in `assert_all_keys_are_valid_for_n_months'
./features/step_definitions/checks.rb:8:in `/^the keys trusted by APT are valid for the next (\d+) months$/'
features/keys.feature:11:in `Then the keys trusted by APT are valid for the next 3 months'
After features/support/hooks.rb:305 4.465 
SCENARIO FAILED: 'The included APT repository keys are up-to-date' (at time 02:31:15)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:31:15_The_included_APT_repository_keys_are_up-to-date.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:31:15_The_included_APT_repository_keys_are_up-to-date.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:31:15_The_included_APT_repository_keys_are_up-to-date.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:31:15_The_included_APT_repository_keys_are_up-to-date.journal
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:25.386
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.005
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.860
When I log in to a new session in Chinese (zh_CN) 3:17.525
cannot 
cannot find GnomeApplicationsMenuChinese.png on the screen (FindFailed)
./features/support/helpers/screen.rb:173:in `rescue in wait'
./features/support/helpers/screen.rb:157:in `wait'
./features/step_definitions/common_steps.rb:558:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:514:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:45:in `When I log in to a new session in Chinese (zh_CN)'
features/localization.feature:23:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "cn" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "zh_CN" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.291 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#2)' (at time 02:41:15)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:41:15_Tails_is_localized_for_every_tier-1_language,_Examples___2_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:41:15_Tails_is_localized_for_every_tier-1_language,_Examples___2_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:41:15_Tails_is_localized_for_every_tier-1_language,_Examples___2_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/02:41:15_Tails_is_localized_for_every_tier-1_language,_Examples___2_.journal
After features/support/hooks.rb:89 0.000
Feature: Thunderbird email client
Tags: @product @check_tor_leaks
52.233
Scenario I can send emails, and receive emails over IMAP
Steps
When I enter my email credentials into the autoconfiguration wizard 10.398
Then the autoconfiguration wizard's choice for the incoming server is secure IMAP 0.302
And the autoconfiguration wizard's choice for the outgoing server is secure SMTP 0.403
When I accept the autoconfiguration wizard's configuration 18.520
And I send an email to myself 22.607
The 
The Dogtail init script raised: SearchError: descendent of [application | Thunderbird]: child with name="Write: Automated test suite: OaCV44safefTYeuIHHRKVYNP3c39Nb82 - Thunderbird"
STDOUT:

STDERR:

 (Dogtail::Failure)
./features/support/helpers/dogtail.rb:93:in `run'
./features/support/helpers/dogtail.rb:335:in `initialize'
./features/support/helpers/dogtail.rb:264:in `new'
./features/support/helpers/dogtail.rb:264:in `call_tree_api_method'
./features/support/helpers/dogtail.rb:272:in `child'
./features/step_definitions/thunderbird.rb:178:in `/^I send an email to myself$/'
features/thunderbird.feature:23:in `And I send an email to myself'
And I fetch my email 0.000
Then I can find the email I sent to myself in my inbox 0.000
After features/support/hooks.rb:464 0.028
After features/support/hooks.rb:305 4.307 
SCENARIO FAILED: 'I can send emails, and receive emails over IMAP' (at time 03:56:26)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/03:56:26_I_can_send_emails,_and_receive_emails_over_IMAP.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/03:56:26_I_can_send_emails,_and_receive_emails_over_IMAP.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/03:56:26_I_can_send_emails,_and_receive_emails_over_IMAP.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4850/artifact/build-artifacts/03:56:26_I_can_send_emails,_and_receive_emails_over_IMAP.journal
After features/support/hooks.rb:89 0.000