Project Number Date
test_Tails_ISO_codespell 16 30 Jun 2025, 11:01

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 5:5.033 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
19.213
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Given I have started Tails from DVD and logged in and the network is connected 18.675
Then the firewall's policy is to drop all IPv4 traffic 0.121
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 0.254
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.076
And the firewall is configured to block all external IPv6 traffic 0.085
After features/support/hooks.rb:330 0.702
After features/support/hooks.rb:100 0.000
Tags: @product
2:11.412
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.020
Steps
Given I have started Tails from DVD and logged in and the network is connected 30.404
And I capture all network traffic 0.010
When I successfully start the Unsafe Browser 25.806
And I open the Tails homepage in the Unsafe Browser 15.119
And the Tails homepage loads in the Unsafe Browser 1:0.071
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 5.915 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 05:30:08)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/16/artifact/build-artifacts/05:30:08_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/16/artifact/build-artifacts/05:30:08_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/16/artifact/build-artifacts/05:30:08_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_codespell/16/artifact/build-artifacts/05:30:08_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.038
Tags: @product
17.143
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.005
Given I have started Tails from DVD and logged in and the network is connected 16.221
And I capture all network traffic 0.010
And I disable Tails' firewall 0.248
When I do a TCP DNS lookup of "torproject.org" 0.557
Then the firewall leak detector has detected leaks 0.106
After features/support/hooks.rb:330 0.914
After features/support/hooks.rb:100 0.047
Tags: @product
33.273
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.008
Given I have started Tails from DVD and logged in and the network is connected 31.051
And I capture all network traffic 0.095
And I disable Tails' firewall 0.896
When I do a UDP DNS lookup of "torproject.org" 0.940
Then the firewall leak detector has detected leaks 0.289
After features/support/hooks.rb:330 1.230
After features/support/hooks.rb:100 0.034
Tags: @product
20.042
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.010
Given I have started Tails from DVD and logged in and the network is connected 14.232
And I capture all network traffic 0.271
And I disable Tails' firewall 1.075
When I send some ICMP pings 4.328
Then the firewall leak detector has detected leaks 0.135
After features/support/hooks.rb:330 1.148
After features/support/hooks.rb:100 0.048
Tags: @product @check_tor_leaks
18.733
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Before features/support/hooks.rb:507 0.010
Given I have started Tails from DVD and logged in and the network is connected 16.687
When I open an untorified TCP connection to 1.2.3.4 on port 42 1.974
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.072
After features/support/hooks.rb:515 0.330
After features/support/hooks.rb:330 1.516
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
15.876
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Before features/support/hooks.rb:507 0.005
Given I have started Tails from DVD and logged in and the network is connected 13.742
When I open an untorified UDP connection to 1.2.3.4 on port 42 1.893
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.240
After features/support/hooks.rb:515 0.479
After features/support/hooks.rb:330 1.139
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
20.414
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Before features/support/hooks.rb:507 0.007
Given I have started Tails from DVD and logged in and the network is connected 14.113
When I open an untorified ICMP connection to 1.2.3.4 6.063
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.236
After features/support/hooks.rb:515 0.565
After features/support/hooks.rb:330 0.848
After features/support/hooks.rb:100 0.000
Tags: @product
28.923
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.019
Given I have started Tails from DVD without network and logged in 9.696
And the system DNS is using the local DNS resolver 0.026
And the network is plugged 0.076
And I successfully configure Tor 19.112
Then the system DNS is still using the local DNS resolver 0.012
After features/support/hooks.rb:330 0.925
After features/support/hooks.rb:100 0.000