Project Number Date
test_Tails_ISO_stable 5750 30 Jun 2025, 10:42

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 41 1 1 0 0 43 8 1 9 4:31.760 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
16.503
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.004
Given I have started Tails from DVD and logged in and the network is connected 15.652
Then the firewall's policy is to drop all IPv4 traffic 0.166
And the firewall is configured to only allow the clearnet and debian-tor users to connect directly to the Internet over IPv4 0.423
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.123
And the firewall is configured to block all external IPv6 traffic 0.136
After features/support/hooks.rb:330 1.275
After features/support/hooks.rb:100 0.000
Tags: @product
1:54.055
Scenario Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.015
Steps
Given I have started Tails from DVD and logged in and the network is connected 13.781
And I capture all network traffic 0.068
When I successfully start the Unsafe Browser 28.529
And I open the Tails homepage in the Unsafe Browser 10.490
And the Tails homepage loads in the Unsafe Browser 1:1.185
cannot 
cannot find TailsHomepage.png on the screen (FindFailed)
./features/support/helpers/screen.rb:181:in `rescue in wait'
./features/support/helpers/screen.rb:165:in `wait'
./features/step_definitions/browser.rb:316:in `/^the Tails homepage loads in the Unsafe Browser$/'
features/tor_enforcement.feature:20:in `And the Tails homepage loads in the Unsafe Browser'
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 7.200 
SCENARIO FAILED: 'Anti test: Detecting TCP leaks from the Unsafe Browser with the firewall leak detector' (at time 05:46:24)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5750/artifact/build-artifacts/05:46:24_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5750/artifact/build-artifacts/05:46:24_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5750/artifact/build-artifacts/05:46:24_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/5750/artifact/build-artifacts/05:46:24_Anti_test:_Detecting_TCP_leaks_from_the_Unsafe_Browser_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.038
Tags: @product
18.015
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.019
Given I have started Tails from DVD and logged in and the network is connected 16.142
And I capture all network traffic 0.149
And I disable Tails' firewall 0.702
When I do a TCP DNS lookup of "torproject.org" 0.876
Then the firewall leak detector has detected leaks 0.145
After features/support/hooks.rb:330 0.870
After features/support/hooks.rb:100 0.040
Tags: @product
17.506
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.006
Given I have started Tails from DVD and logged in and the network is connected 15.296
And I capture all network traffic 0.019
And I disable Tails' firewall 0.494
When I do a UDP DNS lookup of "torproject.org" 1.270
Then the firewall leak detector has detected leaks 0.424
After features/support/hooks.rb:330 1.468
After features/support/hooks.rb:100 0.042
Tags: @product
21.213
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.057
Given I have started Tails from DVD and logged in and the network is connected 16.300
And I capture all network traffic 0.046
And I disable Tails' firewall 0.551
When I send some ICMP pings 4.181
Then the firewall leak detector has detected leaks 0.133
After features/support/hooks.rb:330 0.967
After features/support/hooks.rb:100 0.063
Tags: @product @check_tor_leaks
16.591
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.069
Before features/support/hooks.rb:507 0.035
Given I have started Tails from DVD and logged in and the network is connected 14.033
When I open an untorified TCP connection to 1.2.3.4 on port 42 2.444
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.113
After features/support/hooks.rb:515 0.577
After features/support/hooks.rb:330 1.076
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
17.820
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.009
Before features/support/hooks.rb:507 0.011
Given I have started Tails from DVD and logged in and the network is connected 16.266
When I open an untorified UDP connection to 1.2.3.4 on port 42 1.473
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.081
After features/support/hooks.rb:515 0.391
After features/support/hooks.rb:330 1.039
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
20.196
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.017
Before features/support/hooks.rb:507 0.060
Given I have started Tails from DVD and logged in and the network is connected 14.160
When I open an untorified ICMP connection to 1.2.3.4 5.971
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.064
After features/support/hooks.rb:515 0.286
After features/support/hooks.rb:330 0.932
After features/support/hooks.rb:100 0.000
Tags: @product
29.857
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.023
Given I have started Tails from DVD without network and logged in 9.549
And the system DNS is using the local DNS resolver 0.014
And the network is plugged 0.090
And I successfully configure Tor 20.190
Then the system DNS is still using the local DNS resolver 0.012
After features/support/hooks.rb:330 1.443
After features/support/hooks.rb:100 0.000