Project Number Date
test_Tails_ISO_20263-test-suite-without-spice 19 26 Mar 2025, 02:43

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
Browsing the web using the Tor Browser 116 5 10 0 0 131 12 5 17 32:21.548 Failed
Tags: @product
Feature Browsing the web using the Tor Browser
As a Tails user when I browse the web using the Tor Browser all Internet traffic should flow only through Tor
Tags: @product
49.538
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Given I have started Tails from DVD and logged in and the network is connected 11.974
And a web server is running on the LAN 1.038
And I capture all network traffic 0.006
When I start the Tor Browser 24.184
And the Tor Browser loads the startup page 1.041
And I open a page on the LAN web server in the Tor Browser 10.106
Then the Tor Browser shows the "Unable to connect" error 0.934
And no traffic was sent to the web server on the LAN 0.250
After features/support/hooks.rb:330 0.952
After features/support/hooks.rb:100 0.042
3:34.760
Scenario The Tor Browser directory is usable
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Before features/support/hooks.rb:511 0.005
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.964
Then the amnesiac Tor Browser directory exists 0.055
And there is a GNOME bookmark for the amnesiac Tor Browser directory 1.715
And the persistent Tor Browser directory does not exist 0.053
When I start the Tor Browser 20.862
And the Tor Browser loads the startup page 3:0.109
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/browser.rb:200:in `page_has_loaded_in_the_tor_browser'
./features/step_definitions/browser.rb:495:in `/^the Tor Browser loads the (startup page|Tails homepage|Tails GitLab)$/'
features/torified_browsing.feature:24:in `And the Tor Browser loads the startup page'
Then I can save the current page as "index.html" to the default downloads directory 0.000
And I can print the current page as "output.pdf" to the default downloads directory 0.000
After features/support/hooks.rb:519 0.036
After features/support/hooks.rb:330 5.287

SCENARIO FAILED: 'The Tor Browser directory is usable' (at time 04:07:53)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:07:53_The_Tor_Browser_directory_is_usable.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:07:53_The_Tor_Browser_directory_is_usable.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:07:53_The_Tor_Browser_directory_is_usable.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:07:53_The_Tor_Browser_directory_is_usable.journal

After features/support/hooks.rb:100 0.000
3:37.442
Scenario Downloading files with the Tor Browser
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Before features/support/hooks.rb:511 0.005
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.755
When I start the Tor Browser 25.610
Then the Tor Browser loads the startup page 3:0.076
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/browser.rb:200:in `page_has_loaded_in_the_tor_browser'
./features/step_definitions/browser.rb:495:in `/^the Tor Browser loads the (startup page|Tails homepage|Tails GitLab)$/'
features/torified_browsing.feature:32:in `Then the Tor Browser loads the startup page'
When I download some file in the Tor Browser 0.000
Then the file is saved to the default Tor Browser download directory 0.000
After features/support/hooks.rb:519 0.032
After features/support/hooks.rb:330 5.287

SCENARIO FAILED: 'Downloading files with the Tor Browser' (at time 04:11:36)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:11:36_Downloading_files_with_the_Tor_Browser.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:11:36_Downloading_files_with_the_Tor_Browser.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:11:36_Downloading_files_with_the_Tor_Browser.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:11:36_Downloading_files_with_the_Tor_Browser.journal

After features/support/hooks.rb:100 0.000
1:25.460
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Before features/support/hooks.rb:511 0.005
Given I have started Tails from DVD and logged in and the network is connected 12.243
When I start the Tor Browser 24.604
And the Tor Browser loads the startup page 0.965
Then I can listen to an Ogg audio track in Tor Browser 47.647
After features/support/hooks.rb:519 13.933
After features/support/hooks.rb:330 2.243
After features/support/hooks.rb:100 0.003
3:33.935
Scenario Watching a WebM video
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Before features/support/hooks.rb:511 0.006
Steps
Given I have started Tails from DVD and logged in and the network is connected 11.952
When I start the Tor Browser 21.941
And the Tor Browser loads the startup page 3:0.041
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/browser.rb:200:in `page_has_loaded_in_the_tor_browser'
./features/step_definitions/browser.rb:495:in `/^the Tor Browser loads the (startup page|Tails homepage|Tails GitLab)$/'
features/torified_browsing.feature:47:in `And the Tor Browser loads the startup page'
Then I can watch a WebM video in Tor Browser 0.000
After features/support/hooks.rb:519 0.041
After features/support/hooks.rb:330 5.311

SCENARIO FAILED: 'Watching a WebM video' (at time 04:16:57)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:16:57_Watching_a_WebM_video.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:16:57_Watching_a_WebM_video.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:16:57_Watching_a_WebM_video.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:16:57_Watching_a_WebM_video.journal

After features/support/hooks.rb:100 0.000
Tags: @product
1:17.125
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Given I have started Tails from DVD and logged in and the network is connected 11.741
And I copy "/usr/share/synaptic/html/index.html" to "/home/amnesia/Tor Browser/synaptic.html" as user "amnesia" 0.092
And I copy "/usr/share/synaptic/html/index.html" to "/home/amnesia/.gnupg/synaptic.html" as user "amnesia" 0.061
And I copy "/usr/share/synaptic/html/index.html" to "/tmp/synaptic.html" as user "amnesia" 0.060
Then the file "/home/amnesia/.gnupg/synaptic.html" exists 0.066
And the file "/lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" exists 0.092
And the file "/live/overlay/rw/home/amnesia/.gnupg/synaptic.html" exists 0.064
And the file "/tmp/synaptic.html" exists 0.081
Given I start monitoring the AppArmor log of "torbrowser_firefox" 0.126
When I start the Tor Browser 23.998
And the Tor Browser loads the startup page 1.062
And I open the address "file:///home/amnesia/Tor Browser/synaptic.html" in the Tor Browser 11.000
Then I see "TorBrowserSynapticManual.png" after at most 5 seconds 0.637
And AppArmor has not denied "torbrowser_firefox" from opening "/home/amnesia/Tor Browser/synaptic.html" 0.296
Given I restart monitoring the AppArmor log of "torbrowser_firefox" 0.212
When I open the address "file:///home/amnesia/.gnupg/synaptic.html" in the Tor Browser 6.086
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.561
And AppArmor has denied "torbrowser_firefox" from opening "/home/amnesia/.gnupg/synaptic.html" 0.067
Given I restart monitoring the AppArmor log of "torbrowser_firefox" 0.137
When I open the address "file:///lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" in the Tor Browser 6.109
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.562
And AppArmor has denied "torbrowser_firefox" from opening "/usr/lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" 0.079
Given I restart monitoring the AppArmor log of "torbrowser_firefox" 0.109
When I open the address "file:///live/overlay/rw/home/amnesia/.gnupg/synaptic.html" in the Tor Browser 5.984
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.530
# Due to our AppArmor aliases, /live/overlay will be treated
# as /lib/live/mount/overlay.
And AppArmor has denied "torbrowser_firefox" from opening "/usr/lib/live/mount/overlay/rw/home/amnesia/.gnupg/synaptic.html" 0.071
# We do not get any AppArmor log for when access to files in /tmp is denied
# since we explictly override (commit 51c0060) the rules (from the user-tmp
# abstraction) that would otherwise allow it, and we do so with "deny", which
# also specifies "noaudit". We could explicitly specify "audit deny" and
# then have logs, but it could be a problem when we set up desktop
# notifications for AppArmor denials (#9337).
When I open the address "file:///tmp/synaptic.html" in the Tor Browser 6.679
Then I do not see "TorBrowserSynapticManual.png" after at most 5 seconds 0.549
After features/support/hooks.rb:330 0.951
After features/support/hooks.rb:100 0.000
Tags: @product
44.209
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.006
Given I have started Tails from DVD and logged in and the network is connected 15.776
When I start the Tor Browser 26.991
Then the Tor Browser uses all expected TBB shared libraries 1.440
After features/support/hooks.rb:330 0.809
After features/support/hooks.rb:100 0.000
59.247
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.006
Before features/support/hooks.rb:511 0.007
Given I have started Tails from DVD and logged in and the network is connected 12.077
When I start the Tor Browser 24.199
And the Tor Browser loads the startup page 1.019
And I open the Tails homepage in the Tor Browser 12.122
Then the Tor Browser loads the Tails homepage 1.290
When I request a new identity in Tor Browser 3.207
Then the Tor Browser restarts into a fresh session 5.329
After features/support/hooks.rb:519 1.337
After features/support/hooks.rb:330 2.628
After features/support/hooks.rb:100 0.000
Tags: @product
3:33.503
Scenario The Tor Browser's circuit view feature works as expected
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Steps
Given I have started Tails from DVD and logged in and the network is connected 12.539
When I start the Tor Browser 20.887
And the Tor Browser loads the startup page 3:0.076
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/browser.rb:200:in `page_has_loaded_in_the_tor_browser'
./features/step_definitions/browser.rb:495:in `/^the Tor Browser loads the (startup page|Tails homepage|Tails GitLab)$/'
features/torified_browsing.feature:106:in `And the Tor Browser loads the startup page'
Then Tor Browser's circuit view is working 0.000
After features/support/hooks.rb:330 5.161

SCENARIO FAILED: 'The Tor Browser's circuit view feature works as expected' (at time 04:23:42)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:23:42_The_Tor_Browser_s_circuit_view_feature_works_as_expected.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:23:42_The_Tor_Browser_s_circuit_view_feature_works_as_expected.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:23:42_The_Tor_Browser_s_circuit_view_feature_works_as_expected.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:23:42_The_Tor_Browser_s_circuit_view_feature_works_as_expected.journal

After features/support/hooks.rb:100 0.000
Tags: @product
3:33.109
Scenario WebRTC is disabled in Tor Browser
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Steps
Given I have started Tails from DVD and logged in and the network is connected 12.093
When I start the Tor Browser 20.984
And the Tor Browser loads the startup page 3:0.030
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/browser.rb:200:in `page_has_loaded_in_the_tor_browser'
./features/step_definitions/browser.rb:495:in `/^the Tor Browser loads the (startup page|Tails homepage|Tails GitLab)$/'
features/torified_browsing.feature:112:in `And the Tor Browser loads the startup page'
When I open the address "https://net.ipcalf.com/" in the Tor Browser 0.000
Then Tor Browser displays a 'ifconfig | grep inet | grep -v inet6 | cut -d" " -f2 | tail -n1' heading on the "Network IP Address via ipcalf.com" page 0.000
When I open the address "https://mozilla.github.io/webrtc-landing/pc_test.html" in the Tor Browser 0.000
Then Tor Browser displays a "RTCPeerConnection is missing!" heading on the "Simple RTCPeerConnection Video Test" page 0.000
After features/support/hooks.rb:330 5.312

SCENARIO FAILED: 'WebRTC is disabled in Tor Browser' (at time 04:27:20)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:27:20_WebRTC_is_disabled_in_Tor_Browser.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:27:20_WebRTC_is_disabled_in_Tor_Browser.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:27:20_WebRTC_is_disabled_in_Tor_Browser.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20263-test-suite-without-spice/19/artifact/build-artifacts/04:27:20_WebRTC_is_disabled_in_Tor_Browser.journal

After features/support/hooks.rb:100 0.000
Tags: @product
1:50.522
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 11.350
And the network is plugged 0.279
And I successfully configure Tor 22.330
And available upgrades have been checked 0.054
And all notifications have disappeared 4.177
Then the persistent Tor Browser directory exists 0.060
And there is a GNOME bookmark for the persistent Tor Browser directory 1.619
When I start the Tor Browser 25.538
And I open the address "https://tails.net/about" in the Tor Browser 11.398
And "Tails - How Tails works" has loaded in the Tor Browser 1.488
Then I can save the current page as "index.html" to the persistent Tor Browser GNOME bookmark 9.479
And I open the address "file:///home/amnesia/Persistent/Tor Browser/index.html" in the Tor Browser 9.690
Then "Tails - How Tails works" has loaded in the Tor Browser 1.676
And I can print the current page as "output.pdf" to the persistent Tor Browser directory 11.377
After features/support/hooks.rb:330 1.353
After features/support/hooks.rb:100 0.000
Tags: @product
43.041
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Given I have started Tails from DVD without network and logged in 8.205
Then the amnesiac Documents directory exists 0.151
And there is a GNOME bookmark for the amnesiac Documents directory 1.722
Then I start the Tor Browser in offline mode 23.514
And I can save the current page as "index.html" to the Documents GNOME bookmark 9.447
After features/support/hooks.rb:330 1.957
After features/support/hooks.rb:100 0.000
Tags: @product
45.997
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Given I have started Tails from DVD without network and logged in 8.229
Then the amnesiac Downloads directory exists 0.196
And there is a GNOME bookmark for the amnesiac Downloads directory 2.019
Then I start the Tor Browser in offline mode 24.932
And I can save the current page as "index.html" to the Downloads GNOME bookmark 10.618
After features/support/hooks.rb:330 2.058
After features/support/hooks.rb:100 0.000
Tags: @product
46.950
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Given I have started Tails from DVD without network and logged in 8.104
Then the amnesiac Music directory exists 0.147
And there is a GNOME bookmark for the amnesiac Music directory 1.594
Then I start the Tor Browser in offline mode 25.640
And I can save the current page as "index.html" to the Music GNOME bookmark 11.463
After features/support/hooks.rb:330 1.947
After features/support/hooks.rb:100 0.000
Tags: @product
43.923
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Given I have started Tails from DVD without network and logged in 8.292
Then the amnesiac Pictures directory exists 0.163
And there is a GNOME bookmark for the amnesiac Pictures directory 1.677
Then I start the Tor Browser in offline mode 24.457
And I can save the current page as "index.html" to the Pictures GNOME bookmark 9.332
After features/support/hooks.rb:330 2.037
After features/support/hooks.rb:100 0.000
Tags: @product
48.113
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.006
Given I have started Tails from DVD without network and logged in 8.249
Then the amnesiac Videos directory exists 0.118
And there is a GNOME bookmark for the amnesiac Videos directory 1.718
Then I start the Tor Browser in offline mode 29.411
And I can save the current page as "index.html" to the Videos GNOME bookmark 8.614
After features/support/hooks.rb:330 2.049
After features/support/hooks.rb:100 0.000
Tags: @product
3:34.667
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 9.826
And all tps features are active 3.289
And all persistent filesystems have safe access rights 0.275
And all persistence configuration files have safe access rights 0.436
And all persistent directories have safe access rights 2.890
When I start the Tor Browser in offline mode 23.950
And I add a bookmark to eff.org in the Tor Browser 12.072
And I cold reboot the computer 11.739
And the computer reboots Tails 1:7.761
And I enable persistence 17.116
And I log in to a new session 35.610
And all notifications have disappeared 6.768
And I start the Tor Browser in offline mode 21.607
Then the Tor Browser has a bookmark to eff.org 1.320
After features/support/hooks.rb:330 1.439
After features/support/hooks.rb:100 0.017