Project Number Date
test_Tails_ISO_devel 3275 11 Feb 2024, 18:24

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
Browsing the web using the Unsafe Browser 7 8 37 0 0 52 1 8 9 44:2.433 Failed
Tags: @product
Feature Browsing the web using the Unsafe Browser
As a Tails user when I browse the web using the Unsafe Browser I should have direct access to the web
Tags: @product
43.281
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.879
And I disable the Unsafe Browser 4.189
And I log in to a new session 20.343
And the network is plugged 0.034
And all notifications have disappeared 4.339
When I try to start the Unsafe Browser 0.077
Then the Unsafe Browser complains that it is disabled 2.417
After features/support/hooks.rb:291 1.082
After features/support/hooks.rb:75 0.000
Tags: @product
5:26.427
Scenario The Unsafe Browser can access the LAN
Before features/support/hooks.rb:245 0.003
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:26.427
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:17:in `Given I have started Tails from DVD and logged in and the network is connected'
And a web server is running on the LAN 0.000
When I successfully start the Unsafe Browser 0.000
And I open a page on the LAN web server in the Unsafe Browser 0.000
Then the Unsafe Browser displays the LAN web server hello message 0.000
After features/support/hooks.rb:291 4.012 
SCENARIO FAILED: 'The Unsafe Browser can access the LAN' (at time 08:55:40)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/08:55:40_The_Unsafe_Browser_can_access_the_LAN.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/08:55:40_The_Unsafe_Browser_can_access_the_LAN.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/08:55:40_The_Unsafe_Browser_can_access_the_LAN.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/08:55:40_The_Unsafe_Browser_can_access_the_LAN.journal
After features/support/hooks.rb:75 0.000
Tags: @product @doc
5:25.302
Scenario Starting the Unsafe Browser works as it should
Before features/support/hooks.rb:245 0.003
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:25.302
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:25:in `Given I have started Tails from DVD and logged in and the network is connected'
When I successfully start the Unsafe Browser 0.000
Then the Unsafe Browser runs as the expected user 0.000
And the Unsafe Browser has a red theme 0.000
And the Unsafe Browser shows a warning as its start page 0.000
And the Unsafe Browser has no add-ons enabled 0.000
And the Unsafe Browser has no bookmarks 0.000
And the Unsafe Browser uses all expected TBB shared libraries 0.000
After features/support/hooks.rb:291 4.107 
SCENARIO FAILED: 'Starting the Unsafe Browser works as it should' (at time 09:01:09)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:01:09_Starting_the_Unsafe_Browser_works_as_it_should.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:01:09_Starting_the_Unsafe_Browser_works_as_it_should.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:01:09_Starting_the_Unsafe_Browser_works_as_it_should.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:01:09_Starting_the_Unsafe_Browser_works_as_it_should.journal
After features/support/hooks.rb:75 0.000
Tags: @product
5:25.689
Scenario The Unsafe Browser can load a web page from the Internet
Before features/support/hooks.rb:245 0.005
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:25.689
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:35:in `Given I have started Tails from DVD and logged in and the network is connected'
When I successfully start the Unsafe Browser 0.000
When I open the Tails homepage in the Unsafe Browser 0.000
Then the Tails homepage loads in the Unsafe Browser 0.000
And the Unsafe Browser has sent packets out to the Internet 0.000
After features/support/hooks.rb:291 4.132 
SCENARIO FAILED: 'The Unsafe Browser can load a web page from the Internet' (at time 09:06:39)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:06:39_The_Unsafe_Browser_can_load_a_web_page_from_the_Internet.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:06:39_The_Unsafe_Browser_can_load_a_web_page_from_the_Internet.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:06:39_The_Unsafe_Browser_can_load_a_web_page_from_the_Internet.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:06:39_The_Unsafe_Browser_can_load_a_web_page_from_the_Internet.journal
After features/support/hooks.rb:75 0.000
Tags: @product @not_release_blocker
5:23.508
Scenario Closing the Unsafe Browser shows a stop notification and properly tears down the chroot
Before features/support/hooks.rb:245 0.004
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:23.508
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:43:in `Given I have started Tails from DVD and logged in and the network is connected'
When I successfully start the Unsafe Browser 0.000
And I close the Unsafe Browser 0.000
Then I see the "Shutting down the Unsafe Browser..." notification after at most 60 seconds 0.000
And the Unsafe Browser chroot is torn down 0.000
After features/support/hooks.rb:291 4.029 
SCENARIO FAILED: 'Closing the Unsafe Browser shows a stop notification and properly tears down the chroot' (at time 09:12:06)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:12:06_Closing_the_Unsafe_Browser_shows_a_stop_notification_and_properly_tears_down_the_chroot.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:12:06_Closing_the_Unsafe_Browser_shows_a_stop_notification_and_properly_tears_down_the_chroot.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:12:06_Closing_the_Unsafe_Browser_shows_a_stop_notification_and_properly_tears_down_the_chroot.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:12:06_Closing_the_Unsafe_Browser_shows_a_stop_notification_and_properly_tears_down_the_chroot.journal
After features/support/hooks.rb:75 0.000
Tags: @product @not_release_blocker
5:25.682
Scenario Starting a second instance of the Unsafe Browser results in an error message being shown
Before features/support/hooks.rb:245 0.003
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:25.682
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:51:in `Given I have started Tails from DVD and logged in and the network is connected'
When I successfully start the Unsafe Browser 0.000
# Wait for whatever facility the GNOME Activities Overview uses to
# learn about which applications are running to "settle". Without
# this sleep, it is confused and it's impossible to start a new
# instance (it will just switch to the one we already started).
And I wait 10 seconds 0.000
And I try to start the Unsafe Browser 0.000
Then I see a warning about another instance already running 0.000
After features/support/hooks.rb:291 4.014 
SCENARIO FAILED: 'Starting a second instance of the Unsafe Browser results in an error message being shown' (at time 09:17:36)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:17:36_Starting_a_second_instance_of_the_Unsafe_Browser_results_in_an_error_message_being_shown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:17:36_Starting_a_second_instance_of_the_Unsafe_Browser_results_in_an_error_message_being_shown.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:17:36_Starting_a_second_instance_of_the_Unsafe_Browser_results_in_an_error_message_being_shown.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:17:36_Starting_a_second_instance_of_the_Unsafe_Browser_results_in_an_error_message_being_shown.journal
After features/support/hooks.rb:75 0.000
Tags: @product
5:22.509
Scenario The Unsafe Browser is not allowed to use a local proxy
Before features/support/hooks.rb:245 0.003
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:22.509
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:62:in `Given I have started Tails from DVD and logged in and the network is connected'
When I configure the Unsafe Browser to use a local proxy 0.000
And I successfully start the Unsafe Browser 0.000
And I open the Tails homepage in the Unsafe Browser 0.000
Then I see "BrowserProxyRefused.png" after at most 60 seconds 0.000
After features/support/hooks.rb:291 4.019 
SCENARIO FAILED: 'The Unsafe Browser is not allowed to use a local proxy' (at time 09:23:03)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:23:03_The_Unsafe_Browser_is_not_allowed_to_use_a_local_proxy.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:23:03_The_Unsafe_Browser_is_not_allowed_to_use_a_local_proxy.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:23:03_The_Unsafe_Browser_is_not_allowed_to_use_a_local_proxy.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:23:03_The_Unsafe_Browser_is_not_allowed_to_use_a_local_proxy.journal
After features/support/hooks.rb:75 0.000
Tags: @product @not_release_blocker @check_tor_leaks
5:25.528
Scenario The Unsafe Browser only makes user-initiated non-Torified connections
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.005
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:25.528
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:70:in `Given I have started Tails from DVD and logged in and the network is connected'
And I capture all network traffic 0.000
And I configure the Unsafe Browser to check for updates more frequently 0.000
But checking for updates is disabled in the Unsafe Browser's configuration 0.000
When I successfully start the Unsafe Browser 0.000
And I wait 120 seconds 0.000
Then the Unsafe Browser has not sent packets out to the Internet 0.000
After features/support/hooks.rb:450 0.036
After features/support/hooks.rb:291 4.095 
SCENARIO FAILED: 'The Unsafe Browser only makes user-initiated non-Torified connections' (at time 09:28:32)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:28:32_The_Unsafe_Browser_only_makes_user-initiated_non-Torified_connections.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:28:32_The_Unsafe_Browser_only_makes_user-initiated_non-Torified_connections.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:28:32_The_Unsafe_Browser_only_makes_user-initiated_non-Torified_connections.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:28:32_The_Unsafe_Browser_only_makes_user-initiated_non-Torified_connections.journal
After features/support/hooks.rb:75 0.000
Tags: @product @not_release_blocker
5:24.505
Scenario The Unsafe Browser cannot be started when I am offline
Before features/support/hooks.rb:245 0.004
Steps
Given I have started Tails from DVD and logged in and the network is connected 5:24.505
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:719:in `/^available upgrades have been checked$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/unsafe_browser.feature:80:in `Given I have started Tails from DVD and logged in and the network is connected'
And the network is unplugged 0.000
# NetworkManager apparently needs some time to notice that the connection is now off
And I wait 10 seconds 0.000
When I start the Unsafe Browser 0.000
Then I am told I cannot start the Unsafe Browser when I am offline 0.000
After features/support/hooks.rb:291 4.001 
SCENARIO FAILED: 'The Unsafe Browser cannot be started when I am offline' (at time 09:34:01)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:34:01_The_Unsafe_Browser_cannot_be_started_when_I_am_offline.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:34:01_The_Unsafe_Browser_cannot_be_started_when_I_am_offline.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:34:01_The_Unsafe_Browser_cannot_be_started_when_I_am_offline.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3275/artifact/build-artifacts/09:34:01_The_Unsafe_Browser_cannot_be_started_when_I_am_offline.journal
After features/support/hooks.rb:75 0.000