Project Number Date
test_Tails_ISO_codespell 17 01 Jul 2025, 10:11

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 4:45.832 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
16.305
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.009
Given I have started Tails from DVD and logged in and the network is connected 15.467
Then the firewall's policy is to drop all IPv4 traffic 0.164
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 0.379
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.154
And the firewall is configured to block all external IPv6 traffic 0.140
After features/support/hooks.rb:330 1.355
After features/support/hooks.rb:100 0.000
Tags: @product
1:54.001
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.017
Steps
Given I have started Tails from DVD and logged in and the network is connected 12.392
And I capture all network traffic 0.302
When I successfully start the Unsafe Browser 27.849
And I open the Tails homepage in the Unsafe Browser 10.931
And the Tails homepage loads in the Unsafe Browser 1:2.525
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 6.326 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 04:48:31)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/17/artifact/build-artifacts/04:48:31_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/17/artifact/build-artifacts/04:48:31_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/17/artifact/build-artifacts/04:48:31_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/17/artifact/build-artifacts/04:48:31_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.042
Tags: @product
18.569
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.013
Given I have started Tails from DVD and logged in and the network is connected 16.585
And I capture all network traffic 0.022
And I disable Tails' firewall 0.893
When I do a TCP DNS lookup of "torproject.org" 0.899
Then the firewall leak detector has detected leaks 0.168
After features/support/hooks.rb:330 0.966
After features/support/hooks.rb:100 0.068
Tags: @product
15.768
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.058
Given I have started Tails from DVD and logged in and the network is connected 12.070
And I capture all network traffic 0.167
And I disable Tails' firewall 1.026
When I do a UDP DNS lookup of "torproject.org" 1.933
Then the firewall leak detector has detected leaks 0.570
After features/support/hooks.rb:330 1.105
After features/support/hooks.rb:100 0.039
Tags: @product
18.755
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.035
Given I have started Tails from DVD and logged in and the network is connected 12.846
And I capture all network traffic 0.026
And I disable Tails' firewall 0.877
When I send some ICMP pings 4.810
Then the firewall leak detector has detected leaks 0.194
After features/support/hooks.rb:330 0.950
After features/support/hooks.rb:100 0.052
Tags: @product @check_tor_leaks
18.052
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.022
Before features/support/hooks.rb:507 0.016
Given I have started Tails from DVD and logged in and the network is connected 15.551
When I open an untorified TCP connection to 1.2.3.4 on port 42 2.281
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.218
After features/support/hooks.rb:515 0.909
After features/support/hooks.rb:330 1.050
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
17.616
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.026
Before features/support/hooks.rb:507 0.023
Given I have started Tails from DVD and logged in and the network is connected 15.040
When I open an untorified UDP connection to 1.2.3.4 on port 42 2.232
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.344
After features/support/hooks.rb:515 1.347
After features/support/hooks.rb:330 1.133
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
40.467
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.025
Before features/support/hooks.rb:507 0.023
Given I have started Tails from DVD and logged in and the network is connected 34.167
When I open an untorified ICMP connection to 1.2.3.4 6.234
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.064
After features/support/hooks.rb:515 0.433
After features/support/hooks.rb:330 0.948
After features/support/hooks.rb:100 0.000
Tags: @product
26.295
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.006
Given I have started Tails from DVD without network and logged in 8.822
And the system DNS is using the local DNS resolver 0.029
And the network is plugged 0.087
And I successfully configure Tor 17.341
Then the system DNS is still using the local DNS resolver 0.013
After features/support/hooks.rb:330 0.724
After features/support/hooks.rb:100 0.000