Project Number Date
test_Tails_ISO_20263-test-suite-without-spice 16 23 Mar 2025, 03:23

Failures Overview

The following summary displays scenarios that failed.

Feature: Additional software
Tags: @product @check_tor_leaks @slow
36:37.762
Scenario The Additional Software dpkg hook notices when persistence is locked down while installing a package
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Before features/support/hooks.rb:511 0.005
Steps
Given a computer 0.196
And I start Tails from USB drive "__internal" and I login with an administration password 1:37.550
And I update APT using apt 35:0.016
execution 
execution expired (RemoteShell::Timeout)
./features/support/helpers/remote_shell.rb:56:in `read'
./features/support/helpers/remote_shell.rb:56:in `block (3 levels) in communicate'
./features/support/helpers/remote_shell.rb:55:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/misc_helpers.rb:180:in `new'
./features/support/helpers/misc_helpers.rb:180:in `force_new_tor_circuit'
./features/support/helpers/misc_helpers.rb:192:in `block in retry_tor'
./features/support/helpers/misc_helpers.rb:222:in `rescue in block in retry_action'
./features/support/helpers/misc_helpers.rb:209:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:208:in `loop'
./features/support/helpers/misc_helpers.rb:208:in `retry_action'
./features/support/helpers/misc_helpers.rb:196:in `retry_tor'
./features/step_definitions/apt.rb:59:in `/^I update APT using apt$/'
features/additional_software_packages.feature:47:in `And I update APT using apt'
When I install "makepp" using apt 0.000
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 0.000
And the package "makepp" is installed 0.000
After features/support/hooks.rb:519 0.033
After features/support/hooks.rb:330 10.782 
SCENARIO FAILED: 'The Additional Software dpkg hook notices when persistence is locked down while installing a package' (at time 01:41:06)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/01:41:06_The_Additional_Software_dpkg_hook_notices_when_persistence_is_locked_down_while_installing_a_package.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/01:41:06_The_Additional_Software_dpkg_hook_notices_when_persistence_is_locked_down_while_installing_a_package.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/01:41:06_The_Additional_Software_dpkg_hook_notices_when_persistence_is_locked_down_while_installing_a_package.journal
After features/support/hooks.rb:100 0.008
Feature: Emergency shutdown
Tags: @product @not_release_blocker
2:21.240
Scenario Tails erases memory on DVD boot medium removal: LUKS-encrypted ext4
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Steps
Given I have started Tails from DVD without network and logged in 7.825
And I prepare Tails for memory erasure tests 0.658
And I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 38.384
And I fill the USB drive with a known pattern 1.432
And I read the content of the test FS 0.059
And patterns cover at least 99% of the test FS size in the guest's memory 2.413 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I eject the boot medium 0.240
And I wait for Tails to finish wiping the memory 1:30.227
cannot 
cannot find MemoryWipeCompleted.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/erase_memory.rb:232:in `/^I wait for Tails to finish wiping the memory$/'
features/emergency_shutdown.feature:44:in `And I wait for Tails to finish wiping the memory'
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:330 10.664 
SCENARIO FAILED: 'Tails erases memory on DVD boot medium removal: LUKS-encrypted ext4' (at time 02:22:34)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/02:22:34_Tails_erases_memory_on_DVD_boot_medium_removal:_LUKS-encrypted_ext4.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/02:22:34_Tails_erases_memory_on_DVD_boot_medium_removal:_LUKS-encrypted_ext4.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/02:22:34_Tails_erases_memory_on_DVD_boot_medium_removal:_LUKS-encrypted_ext4.journal
After features/support/hooks.rb:100 0.001
Feature: Spoofing MAC addresses
Tags: @product
1:27.457
Scenario MAC address spoofing fails and macchanger returns false
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.179
And I capture all network traffic 0.005
And the network is plugged 0.120
And macchanger will fail by not spoofing and always returns false 0.274
When I log in to a new session 18.007
Then no network interfaces are enabled 0.117
And no network device leaked the real MAC address 0.012
And I see the "Wired Network Disabled" notification after at most 60 seconds 1:0.740
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:553:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/mac_spoofing.feature:43:in `And I see the "Wired Network Disabled" notification after at most 60 seconds'
After features/support/hooks.rb:330 10.550 
SCENARIO FAILED: 'MAC address spoofing fails and macchanger returns false' (at time 03:26:22)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:26:22_MAC_address_spoofing_fails_and_macchanger_returns_false.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:26:22_MAC_address_spoofing_fails_and_macchanger_returns_false.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:26:22_MAC_address_spoofing_fails_and_macchanger_returns_false.journal
After features/support/hooks.rb:100 0.054
Feature: Tails persistence
Tags: @product
3:18.896
Scenario Tails Persistent Storage behave tests
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Steps
Given I have started Tails from DVD and logged in with an administration password and the network is connected 3:18.896
cannot 
cannot find GnomeApplicationsMenu.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/common_steps.rb:520:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:476:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
./features/step_definitions/snapshots.rb:153:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:150:in `each'
./features/step_definitions/snapshots.rb:150:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:137:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ with\ an\ administration\ password\ and\ the\ network\ is\ connected$/'
features/persistence.feature:7:in `Given I have started Tails from DVD and logged in with an administration password and the network is connected'
And I update APT using apt 0.000
And I install "python3-behave" using apt 0.000
Then the Tails Persistent Storage behave tests pass 0.000
After features/support/hooks.rb:330 5.080 
SCENARIO FAILED: 'Tails Persistent Storage behave tests' (at time 03:36:01)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:36:01_Tails_Persistent_Storage_behave_tests.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:36:01_Tails_Persistent_Storage_behave_tests.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:36:01_Tails_Persistent_Storage_behave_tests.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/03:36:01_Tails_Persistent_Storage_behave_tests.journal
After features/support/hooks.rb:100 0.000
Feature: Tails persistence
Tags: @product
22:41.072
Scenario Creating and using a persistent NetworkManager connection
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Steps
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 9.255
And the network is plugged 0.146
And Tor is ready 20.857
And I add a wired DHCP NetworkManager connection called "persistent-con-current" 0.219
And I shutdown Tails and wait for the computer to power off 8.705
Given I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 22:1.888
execution 
execution expired (RemoteShell::Timeout)
./features/support/helpers/remote_shell.rb:56:in `read'
./features/support/helpers/remote_shell.rb:56:in `block (3 levels) in communicate'
./features/support/helpers/remote_shell.rb:55:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/dogtail.rb:80:in `new'
./features/support/helpers/dogtail.rb:80:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/common_steps.rb:673:in `new'
./features/step_definitions/common_steps.rb:673:in `/^all notifications have disappeared$/'
./features/step_definitions/common_steps.rb:253:in `/^I start Tails from (.+?) drive "(.+?)"( with network unplugged)?( and I login( with persistence enabled)?( with the changed persistence passphrase)?( (?:and|with) an administration password)?)?$/'
features/persistence.feature:88:in `Given I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled'
And I capture all network traffic 0.000
And the network is plugged 0.000
And Tor is ready 0.000
And I switch to the "persistent-con-current" NetworkManager connection 0.000
And the 1st network device has a spoofed MAC address configured 0.000
And no network device leaked the real MAC address 0.000
After features/support/hooks.rb:330 10.597 
SCENARIO FAILED: 'Creating and using a persistent NetworkManager connection' (at time 04:08:49)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:08:49_Creating_and_using_a_persistent_NetworkManager_connection.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:08:49_Creating_and_using_a_persistent_NetworkManager_connection.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:08:49_Creating_and_using_a_persistent_NetworkManager_connection.journal
After features/support/hooks.rb:100 0.010
Feature: Tails has a sane default configuration
Tags: @product
8.843
Scenario No unexpected error messages in the journal after booting from DVD
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Steps
Given I have started Tails from DVD without network and logged in 8.769
Then there are no unexpected messages of priority "err" or higher in the journal 0.074
Unexpected 
Unexpected error messages in the journal: [
  {
    "MESSAGE": "Failed to start tails-virt-notify-user.service - Warn the user if Tails is running inside a virtual machine.",
    "SYSLOG_IDENTIFIER": "systemd",
    "CODE_FILE": "src/core/job.c",
    "CODE_FUNC": "job_emit_done_message",
    "CODE_LINE": "767",
    "JOB_ID": "387",
    "JOB_RESULT": "failed",
    "JOB_TYPE": "start",
    "MESSAGE_ID": "be02cf6855d2428ba40df7e9d022f03d",
    "PRIORITY": "3",
    "SYSLOG_FACILITY": "3",
    "TID": "5147",
    "USER_INVOCATION_ID": "860664cf8f564396b9079457a856c979",
    "USER_UNIT": "tails-virt-notify-user.service",
    "_AUDIT_LOGINUID": "1000",
    "_AUDIT_SESSION": "5",
    "_BOOT_ID": "13553d9d664f4218b862e2e0ba4d1f1d",
    "_CAP_EFFECTIVE": "0",
    "_CMDLINE": "/lib/systemd/systemd --user",
    "_COMM": "systemd",
    "_EXE": "/usr/lib/systemd/systemd",
    "_GID": "1000",
    "_HOSTNAME": "amnesia",
    "_MACHINE_ID": "203552d5819c41f3800e2c8ef2545404",
    "_PID": "5147",
    "_RUNTIME_SCOPE": "system",
    "_SELINUX_CONTEXT": "unconfined\n",
    "_SOURCE_REALTIME_TIMESTAMP": "1742680470981706",
    "_SYSTEMD_CGROUP": "/user.slice/user-1000.slice/user@1000.service/init.scope",
    "_SYSTEMD_INVOCATION_ID": "0b3bb1f4dffa4b3d836c2f7bdb0f08af",
    "_SYSTEMD_OWNER_UID": "1000",
    "_SYSTEMD_SLICE": "user-1000.slice",
    "_SYSTEMD_UNIT": "user@1000.service",
    "_SYSTEMD_USER_SLICE": "-.slice",
    "_SYSTEMD_USER_UNIT": "init.scope",
    "_TRANSPORT": "journal",
    "_UID": "1000",
    "__CURSOR": "s=2096b122edc947d1aa53513a26642ee7;i=12a0;b=13553d9d664f4218b862e2e0ba4d1f1d;m=39ad1c4;t=630f56a6e0c4e;x=b741e80486492dc3",
    "__MONOTONIC_TIMESTAMP": "60477892",
    "__REALTIME_TIMESTAMP": "1742680470981710"
  }
].
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/checks.rb:237:in `/^there are no unexpected messages of priority "err" or higher in the journal$/'
features/sane_defaults.feature:21:in `Then there are no unexpected messages of priority "err" or higher in the journal'
After features/support/hooks.rb:330 5.055 
SCENARIO FAILED: 'No unexpected error messages in the journal after booting from DVD' (at time 04:46:06)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:46:06_No_unexpected_error_messages_in_the_journal_after_booting_from_DVD.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:46:06_No_unexpected_error_messages_in_the_journal_after_booting_from_DVD.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:46:06_No_unexpected_error_messages_in_the_journal_after_booting_from_DVD.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/16/artifact/build-artifacts/04:46:06_No_unexpected_error_messages_in_the_journal_after_booting_from_DVD.journal
After features/support/hooks.rb:100 0.000