Project Number Date
test_Tails_ISO_feature-arti 90 16 Jun 2025, 17:36

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
The Tor enforcement is effective 38 1 4 0 0 43 8 1 9 7:39.376 Failed
Tags: @product
Feature The Tor enforcement is effective
As a Tails user I want all direct Internet connections I do by mistake or applications do by misconfiguration or buggy leaks to be blocked And as a Tails developer I want to ensure that the automated test suite detects firewall leaks reliably
Tags: @product
39.029
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.060
Given I have started Tails from DVD and logged in and the network is connected 38.056
Then the firewall's policy is to drop all IPv4 traffic 0.307
And the firewall is configured to only allow the arti, clearnet and debian-tor users to connect directly to the Internet over IPv4 0.453
And the firewall's NAT rules only redirect traffic for the Unsafe Browser, Tor's TransPort, and DNSPort 0.080
And the firewall is configured to block all external IPv6 traffic 0.132
After features/support/hooks.rb:330 1.196
After features/support/hooks.rb:100 0.000
Tags: @product
1:40.982
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.015
Given I have started Tails from DVD and logged in and the network is connected 36.879
And I capture all network traffic 0.010
When I successfully start the Unsafe Browser 39.301
And I open the Tails homepage in the Unsafe Browser 22.235
And the Tails homepage loads in the Unsafe Browser 1.566
Then the firewall leak detector has detected leaks 0.989
After features/support/hooks.rb:330 1.652
After features/support/hooks.rb:100 0.033
Tags: @product
34.932
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.105
Given I have started Tails from DVD and logged in and the network is connected 33.554
And I capture all network traffic 0.007
And I disable Tails' firewall 0.259
When I do a TCP DNS lookup of "torproject.org" 0.893
Then the firewall leak detector has detected leaks 0.217
After features/support/hooks.rb:330 1.098
After features/support/hooks.rb:100 0.050
Tags: @product
1:12.639
Scenario Anti test: Detecting UDP leaks of DNS lookups with the firewall leak detector
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.007
Steps
Given I have started Tails from DVD and logged in and the network is connected 1:12.639
Failed 
Failed to restore snapshot (RuntimeError)
./features/step_definitions/common_steps.rb:91:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:74:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:97:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:74:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:97:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:74:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/common_steps.rb:97:in `rescue in post_snapshot_restore_hook'
./features/step_definitions/common_steps.rb:74:in `post_snapshot_restore_hook'
./features/step_definitions/snapshots.rb:167:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:173:in `/^I\ have\ started\ Tails\ from\ DVD\ and\ logged\ in\ and\ the\ network\ is\ connected$/'
features/tor_enforcement.feature:31:in `Given I have started Tails from DVD and logged in and the network is connected'
And I capture all network traffic 0.000
And I disable Tails' firewall 0.000
When I do a UDP DNS lookup of "torproject.org" 0.000
Then the firewall leak detector has detected leaks 0.000
After features/support/hooks.rb:330 6.585 
SCENARIO FAILED: 'Anti test: Detecting UDP leaks of DNS lookups with the firewall leak detector' (at time 07:12:03)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/90/artifact/build-artifacts/07:12:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/90/artifact/build-artifacts/07:12:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/90/artifact/build-artifacts/07:12:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/90/artifact/build-artifacts/07:12:03_Anti_test:_Detecting_UDP_leaks_of_DNS_lookups_with_the_firewall_leak_detector.journal
After features/support/hooks.rb:100 0.000
Tags: @product
55.912
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.030
Given I have started Tails from DVD and logged in and the network is connected 50.866
And I capture all network traffic 0.028
And I disable Tails' firewall 0.682
When I send some ICMP pings 4.190
Then the firewall leak detector has detected leaks 0.144
After features/support/hooks.rb:330 0.693
After features/support/hooks.rb:100 0.049
Tags: @product @check_tor_leaks
47.430
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.009
Before features/support/hooks.rb:509 0.008
Given I have started Tails from DVD and logged in and the network is connected 34.535
When I open an untorified TCP connection to 1.2.3.4 on port 42 12.260
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.635
After features/support/hooks.rb:517 8.115
After features/support/hooks.rb:330 1.228
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
33.883
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.020
Before features/support/hooks.rb:509 0.024
Given I have started Tails from DVD and logged in and the network is connected 21.021
When I open an untorified UDP connection to 1.2.3.4 on port 42 11.530
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 1.331
After features/support/hooks.rb:517 4.540
After features/support/hooks.rb:330 2.153
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
24.750
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.011
Before features/support/hooks.rb:509 0.009
Given I have started Tails from DVD and logged in and the network is connected 18.951
When I open an untorified ICMP connection to 1.2.3.4 5.671
Then the untorified connection fails 0.000
And the untorified connection is logged as dropped by the firewall 0.127
After features/support/hooks.rb:517 0.923
After features/support/hooks.rb:330 0.870
After features/support/hooks.rb:100 0.000
Tags: @product
49.815
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.017
Given I have started Tails from DVD without network and logged in 25.138
And the system DNS is using the local DNS resolver 0.712
And the network is plugged 1.128
And I successfully configure Tor 22.791
Then the system DNS is still using the local DNS resolver 0.044
After features/support/hooks.rb:330 1.462
After features/support/hooks.rb:100 0.000