Cucumber Reports (no 4) - Failures Overview

Project	Number	Date
test_Tails_ISO_20263-test-suite-without-spice	4	11 Mar 2025, 04:03

Feature: Additional software

5:6.418

Scenario My Additional Software list is configurable through a GUI or through notifications when I install or remove packages with APT or Synaptic

Hooks

Before features/support/hooks.rb:266 0.000

Before features/support/hooks.rb:273 0.007

Before features/support/hooks.rb:511 0.007

Steps

Given a computer 0.190

And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:17.772

When I uninstall "popularity-contest" using apt 21.814

And I accept removing "popularity-contest" from Additional Software 0.561

Then "popularity-contest" is not in the list of Additional Software 0.677

When I start Synaptic 24.622

And I update APT using Synaptic 21.923

And I install "cowsay" using Synaptic 10.892

And I accept adding "cowsay" to Additional Software 1.275

Then Additional Software is correctly configured for package "cowsay" 0.894

When I uninstall "cowsay" using apt 3.244

And I refuse removing "cowsay" from Additional Software 0.596

Then Additional Software is correctly configured for package "cowsay" 0.863

When I start "Additional Software" via GNOME Activities Overview 21.087

cannot

cannot find GnomeActivitiesOverviewSearch.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/common_steps.rb:1101:in `/^I start "([^"]+)" via GNOME Activities Overview$/'
features/additional_software_packages.feature:67:in `When I start "Additional Software" via GNOME Activities Overview'

And I remove "cowsay" from the list of Additional Software using Additional Software GUI 0.000

Then "cowsay" is not in the list of Additional Software 0.000

When I install "cowsay" using apt 0.000

And I refuse adding "cowsay" to Additional Software 0.000

Then "cowsay" is not in the list of Additional Software 0.000

Hooks

After features/support/hooks.rb:519 0.051

After features/support/hooks.rb:330 5.599

Output 1

SCENARIO FAILED: 'My Additional Software list is configurable through a GUI or through notifications when I install or remove packages with APT or Synaptic' (at time 01:10:52)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.file_content_var_log_boot.log

Content of /run/live-additional-software/log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.file_content_run_live-additional-software_log

Output of ls -la --full-time /live/persistence/tailsdata_unlocked: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_persistent_volume

Output of ls -lar --full-time /var/cache/apt: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_var_cache_apt

Output of ls -lar --full-time /var/lib/apt: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_var_lib_apt

Output of mount: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_mount

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:10:52_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.journal

After features/support/hooks.rb:100 0.009

Feature: Additional software

Tags: @product @check_tor_leaks @slow @not_release_blocker

3:17.059

Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online

Hooks

Before features/support/hooks.rb:266 0.000

Before features/support/hooks.rb:273 0.004

Before features/support/hooks.rb:511 0.005

Steps

Given a computer 0.163

And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.285

And I configure APT to prefer an old version of cowsay 0.038

When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 2.573

<"3.03+dfsg2-1">

<"3.03+dfsg2-1"> expected but was
<"3.03+dfsg2-8">.

diff:
- 3.03+dfsg2-1
?            ^
+ 3.03+dfsg2-8
?            ^ (Test::Unit::AssertionFailedError)
./features/step_definitions/apt.rb:136:in `/^the installed version of package "([^"]*)" is( newer than)? "([^"]*)"( after Additional Software has been started)?$/'
./features/step_definitions/apt.rb:119:in `/^I install an old version "([^"]*)" of the cowsay package using apt$/'
features/additional_software_packages.feature:81:in `When I install an old version "3.03+dfsg2-1" of the cowsay package using apt'

And I accept adding "cowsay" to Additional Software 0.000

And Additional Software is correctly configured for package "cowsay" 0.000

And I shutdown Tails and wait for the computer to power off 0.000

And I start Tails from USB drive "__internal" with network unplugged 0.000

And I enable persistence 0.000

# We need to add back this custom APT source for the Additional Software

# install step, as it was not saved in persistence

And I configure APT to prefer an old version of cowsay 0.000

# Prevent the "Warning: virtual machine detected!" notification from racing

# with the one we'll be interacting with below.

And I disable the tails-virt-notify-user.service user unit 0.000

And I log in to a new session 0.000

And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000

And I revert the APT tweaks that made it prefer an old version of cowsay 0.000

# We remove the newest package after it has been downloaded and before

# it is installed, so that the upgrade process fails

And I prepare the Additional Software upgrade process to fail 0.000

And the network is plugged 0.000

And Tor is ready 0.000

And available upgrades have been checked 0.000

And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.000

And I can open the Additional Software configuration window from the notification 0.000

And I shutdown Tails and wait for the computer to power off 0.000

And I start Tails from USB drive "__internal" with network unplugged 0.000

And I enable persistence 0.000

# We need to add back this custom APT source for the Additional Software

# install step, as it was not saved in persistence

And I configure APT to prefer an old version of cowsay 0.000

And I log in to a new session 0.000

And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000

And I revert the APT tweaks that made it prefer an old version of cowsay 0.000

And the network is plugged 0.000

And Tor is ready 0.000

Then the Additional Software upgrade service has started 0.000

And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000

Hooks

After features/support/hooks.rb:519 0.045

After features/support/hooks.rb:330 5.357

Output 1

SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:14:15)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.file_content_var_log_boot.log

Content of /run/live-additional-software/log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.file_content_run_live-additional-software_log

Output of ls -la --full-time /live/persistence/tailsdata_unlocked: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.cmd_output_persistent_volume

Output of ls -lar --full-time /var/cache/apt: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.cmd_output_var_cache_apt

Output of ls -lar --full-time /var/lib/apt: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.cmd_output_var_lib_apt

Output of mount: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.cmd_output_mount

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:14:15_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.journal

After features/support/hooks.rb:100 0.007

Feature: GNOME is well-integrated into Tails

Tags: @product

3:32.203

Scenario I can launch various apps via GNOME Activities Overview

Hooks

Before features/support/hooks.rb:266 0.000

Before features/support/hooks.rb:273 0.004

Steps

# Some apps (Electrum and Persistent Storage Backup) only start when

# a Persistent Storage is available.

Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 9.637

# Some apps (Tor Browser) only start when the network is plugged.

And the network is plugged 0.075

And Tor is ready 20.771

And all notifications have disappeared 4.357

When I start "Additional Software" via GNOME Activities Overview 11.294

And I close the "tails-additional-software-config" window 2.238

When I start "Disks" via GNOME Activities Overview 8.844

# The close button of GNOME Disks is not accessible

And I close the "gnome-disks" window via Alt+F4 2.827

When I start "GNOME Terminal" via GNOME Activities Overview 9.446

And I close the "gnome-terminal-server" window 1.888

When I start "Files" via GNOME Activities Overview 8.844

And I close the "org.gnome.Nautilus" window 17.509

When I start "Persistent Storage" via GNOME Activities Overview 10.791

And I close the "tps-frontend" window 4.063

When I start "Persistent Storage Backup" via GNOME Activities Overview 11.264

And I close the "zenity" window 4.384

When I start "Pidgin" via GNOME Activities Overview 8.201

And I close the "Pidgin" window via Alt+F4 3.831

When I start "Thunderbird" via GNOME Activities Overview 9.450

And I close the "Thunderbird" window 15.346

When I start "Tor Browser" via GNOME Activities Overview 9.584

And I close the "Firefox" window 16.642

When I start "Unlock VeraCrypt Volumes" via GNOME Activities Overview 20.907

cannot

cannot find GnomeActivitiesOverviewSearch.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/common_steps.rb:1101:in `/^I start "([^"]+)" via GNOME Activities Overview$/'
features/gnome.feature:46:in `When I start "Unlock VeraCrypt Volumes" via GNOME Activities Overview'

And I close the "unlock-veracrypt-volumes" window 0.000

When I start "Unsafe Browser" via GNOME Activities Overview 0.000

And I close the "Firefox" window 0.000

Hooks

After features/support/hooks.rb:330 6.081

Output 1

SCENARIO FAILED: 'I can launch various apps via GNOME Activities Overview' (at time 01:54:33)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:54:33_I_can_launch_various_apps_via_GNOME_Activities_Overview.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:54:33_I_can_launch_various_apps_via_GNOME_Activities_Overview.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:54:33_I_can_launch_various_apps_via_GNOME_Activities_Overview.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/01:54:33_I_can_launch_various_apps_via_GNOME_Activities_Overview.journal

After features/support/hooks.rb:100 0.000

Feature: Spoofing MAC addresses

Tags: @product

1:30.602

Scenario MAC address spoofing fails and macchanger returns true

Hooks

Before features/support/hooks.rb:266 0.000

Before features/support/hooks.rb:273 0.006

Steps

Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.342

And I capture all network traffic 0.005

And the network is plugged 0.100

And macchanger will fail by not spoofing and always returns true 0.345

When I log in to a new session 19.722

Then no network interfaces are enabled 0.155

And no network device leaked the real MAC address 0.014

And I see the "Wired Network Disabled" notification after at most 60 seconds 1:1.916

try_for()

try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:553:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/mac_spoofing.feature:53:in `And I see the "Wired Network Disabled" notification after at most 60 seconds'

Hooks

After features/support/hooks.rb:330 10.562

Output 1

SCENARIO FAILED: 'MAC address spoofing fails and macchanger returns true' (at time 02:47:42)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/02:47:42_MAC_address_spoofing_fails_and_macchanger_returns_true.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/02:47:42_MAC_address_spoofing_fails_and_macchanger_returns_true.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/4/artifact/build-artifacts/02:47:42_MAC_address_spoofing_fails_and_macchanger_returns_true.journal

After features/support/hooks.rb:100 0.067

Feature: Packages are up-to-date

Tags: @source

11.375

Scenario All packages are up-to-date

Hooks

Before features/support/hooks.rb:266 0.000

Before features/support/hooks.rb:536 0.000

Steps

Given I have the build manifest for the image under test 0.000

Then all packages listed in the build manifest are up-to-date 11.375

Command

Command failed (returned pid 52593 exit 1): ["/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/bin/needed-package-updates", "--config=/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/config/ci/needed-package-updates.yml", "--file=/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/tmp/tails-amd64-20263-test-suite-without-spice@a821d767f8+stable@dc23bc4f1c-20250310T2248Z.build-manifest", {:err=>[:child, :out]}]:
INFO: Check local file /var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/tmp/tails-amd64-20263-test-suite-without-spice@a821d767f8+stable@dc23bc4f1c-20250310T2248Z.build-manifest
ERROR: tor-geoipdb: the package version(0.4.8.14-1+tpo1~d12.bookworm+1) is higher than the version on experimental (0.4.8.14-1)
ERROR: tor: the package version(0.4.8.14-1+tpo1~d12.bookworm+1) is higher than the version on experimental (0.4.8.14-1)
INFO: Need to upgrade to a new APT snapshot:
  - onionshare (2.6.2-1~0.tails1) to Debian trixie (2.6.3-1)
  - thunderbird (1:128.7.0esr-1~deb12u1) to Debian bookworm-security (1:128.8.0esr-1~deb12u1)
.
<0> expected but was
<#<Process::Status: pid 52593 exit 1>>. (Test::Unit::AssertionFailedError)
/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/features/support/helpers/misc_helpers.rb:307:in `block in cmd_helper'
/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/features/support/helpers/misc_helpers.rb:303:in `popen'
/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/features/support/helpers/misc_helpers.rb:303:in `cmd_helper'
/var/lib/jenkins/workspace/test_Tails_ISO_20263-test-suite-without-spice/features/step_definitions/needed_package_updates.rb:8:in `/^all packages listed in the build manifest are up-to-date$/'
features/needed_package_updates.feature:12:in `Then all packages listed in the build manifest are up-to-date'

Hooks

After features/support/hooks.rb:543 0.000

After features/support/hooks.rb:100 0.000