Project Number Date
test_Tails_ISO_feature-arti 4 19 Nov 2024, 16:43

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
Using Tor bridges and pluggable transports 90 7 23 0 0 120 4 7 11 41:6.568 Failed
Tags: @product
Feature Using Tor bridges and pluggable transports
As a Tails user I want to circumvent censorship of Tor by using Tor bridges and pluggable transports And avoid connecting directly to the Tor Network
12.926
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.693
And I capture all network traffic 0.003
When the network is plugged 0.077
Then the Tor Connection Assistant autostarts 4.151
Tags: @product
4:45.156
Scenario Using normal bridges
Steps
When I configure some normal bridges in the Tor Connection Assistant 14.420
Then I wait until Tor is ready 4:30.736
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:15:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.288 
SCENARIO FAILED: 'Using normal bridges' (at time 00:42:49)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:42:49_Using_normal_bridges_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:42:49_Using_normal_bridges.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:42:49_Using_normal_bridges.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:42:49_Using_normal_bridges.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:42:49_Using_normal_bridges.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:42:49_Using_normal_bridges.journal
After features/support/hooks.rb:100 0.046
14.101
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.461
And I capture all network traffic 0.004
When the network is plugged 0.075
Then the Tor Connection Assistant autostarts 5.559
Tags: @product
4:42.082
Scenario Using obfs4 pluggable transports
Steps
When I configure some obfs4 bridges in the Tor Connection Assistant in hide mode 11.105
Then I wait until Tor is ready 4:30.977
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:22:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges 0.000
After features/support/hooks.rb:326 5.341 
SCENARIO FAILED: 'Using obfs4 pluggable transports' (at time 00:47:51)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:47:51_Using_obfs4_pluggable_transports_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:47:51_Using_obfs4_pluggable_transports.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:47:51_Using_obfs4_pluggable_transports.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:47:51_Using_obfs4_pluggable_transports.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:47:51_Using_obfs4_pluggable_transports.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:47:51_Using_obfs4_pluggable_transports.journal
After features/support/hooks.rb:100 0.042
13.314
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.650
And I capture all network traffic 0.003
When the network is plugged 0.085
Then the Tor Connection Assistant autostarts 4.574
Tags: @product
5:7.179
Scenario Using obfs4 pluggable transports from a QR code
Steps
When I configure some obfs4 bridges from a QR code in the Tor Connection Assistant in hide mode 36.116
Then I wait until Tor is ready 4:31.063
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:29:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges 0.000
After features/support/hooks.rb:326 5.408 
SCENARIO FAILED: 'Using obfs4 pluggable transports from a QR code' (at time 00:53:17)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:53:17_Using_obfs4_pluggable_transports_from_a_QR_code_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:53:17_Using_obfs4_pluggable_transports_from_a_QR_code.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:53:17_Using_obfs4_pluggable_transports_from_a_QR_code.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:53:17_Using_obfs4_pluggable_transports_from_a_QR_code.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:53:17_Using_obfs4_pluggable_transports_from_a_QR_code.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:53:17_Using_obfs4_pluggable_transports_from_a_QR_code.journal
After features/support/hooks.rb:100 0.039
14.485
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.493
And I capture all network traffic 0.003
When the network is plugged 0.094
Then the Tor Connection Assistant autostarts 5.893
Tags: @product
5:25.465
Scenario TCA can scan QR code after a connection failure
Steps
Given the Tor network and default bridges are blocked 1.757
When I unsuccessfully configure a direct connection in the Tor Connection Assistant 30.294
Then the Tor Connection Assistant reports that it failed to connect 0.131
And tca.conf is empty 0.225
Given I scan a QR code from the error page in Tor Connection Assistant 21.302
And I retry connecting to Tor 1.166
Then I wait until Tor is ready 4:30.587
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:41:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.245 
SCENARIO FAILED: 'TCA can scan QR code after a connection failure' (at time 00:59:02)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:59:02_TCA_can_scan_QR_code_after_a_connection_failure_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:59:02_TCA_can_scan_QR_code_after_a_connection_failure.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:59:02_TCA_can_scan_QR_code_after_a_connection_failure.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:59:02_TCA_can_scan_QR_code_after_a_connection_failure.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:59:02_TCA_can_scan_QR_code_after_a_connection_failure.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/00:59:02_TCA_can_scan_QR_code_after_a_connection_failure.journal
After features/support/hooks.rb:100 0.035
13.117
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.530
And I capture all network traffic 0.003
When the network is plugged 0.105
Then the Tor Connection Assistant autostarts 4.477
Tags: @product @supports_real_tor
4:45.035
Scenario Default Tor bridges
Steps
When I configure the default bridges in the Tor Connection Assistant 14.262
Then I wait until Tor is ready 4:30.773
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:49:in `Then I wait until Tor is ready'
And Tor is configured to use the default bridges 0.000
And tca.conf includes no bridge 0.000
And available upgrades have been checked 0.000
And Tor is configured to use the default bridges 0.000
And all Internet traffic has only flowed through the default bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.375 
SCENARIO FAILED: 'Default Tor bridges' (at time 01:04:06)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:04:06_Default_Tor_bridges_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:04:06_Default_Tor_bridges.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:04:06_Default_Tor_bridges.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:04:06_Default_Tor_bridges.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:04:06_Default_Tor_bridges.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:04:06_Default_Tor_bridges.journal
After features/support/hooks.rb:100 0.050
12.698
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.357
And I capture all network traffic 0.003
When the network is plugged 0.083
Then the Tor Connection Assistant autostarts 4.254
Tags: @product
4:53.695
Scenario Fall back to default bridges if failing to connect directly to the Tor network
Steps
Given the Tor network is blocked 1.757
When I configure a direct connection in the Tor Connection Assistant 21.310
Then I wait until Tor is ready 4:30.627
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:59:in `Then I wait until Tor is ready'
And tca.conf includes no bridge 0.000
And available upgrades have been checked 0.000
And Tor is configured to use the default bridges 0.000
And all Internet traffic has only flowed through the default bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.255 
SCENARIO FAILED: 'Fall back to default bridges if failing to connect directly to the Tor network' (at time 01:09:18)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:09:18_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:09:18_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:09:18_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:09:18_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:09:18_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:09:18_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.journal
After features/support/hooks.rb:100 0.039
13.209
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and logged in 8.808
And I capture all network traffic 0.004
When the network is plugged 0.088
Then the Tor Connection Assistant autostarts 4.307
Tags: @product
2:40.141
Given the Tor network and default bridges are blocked 1.923
When I unsuccessfully configure a direct connection in the Tor Connection Assistant 31.207
Then the Tor Connection Assistant reports that it failed to connect 0.113
And tca.conf is empty 0.215
Given the Tor network and default bridges are unblocked 1.386
And I retry connecting to Tor 1.181
Then I wait until Tor is ready 2:2.968
And tca.conf includes no bridge 0.015
And available upgrades have been checked 0.055
And all Internet traffic has only flowed through Tor or connectivity check service 1.073 
Warning: these queries were allowed but not needed: ["fedoraproject.org."]
After features/support/hooks.rb:326 1.020
After features/support/hooks.rb:100 0.072
13.479
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.921
And I capture all network traffic 0.002
When the network is plugged 0.091
Then the Tor Connection Assistant autostarts 4.464
Tags: @product
4.722
When I try to configure some normal bridges in the Tor Connection Assistant in hide mode 4.399
Then the Tor Connection Assistant complains that normal bridges are not allowed 0.135
And I cannot click the "Connect to Tor" button 0.187
After features/support/hooks.rb:326 0.675
After features/support/hooks.rb:100 0.033
13.478
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.746
And I capture all network traffic 0.002
When the network is plugged 0.153
Then the Tor Connection Assistant autostarts 4.575
Tags: @product
27.254
Given I configure a direct connection in the Tor Connection Assistant 8.332
And I wait until Tor is ready 2.890
When I disconnect the network through GNOME 2.942
And I connect the network through GNOME 2.995
Then the Tor Connection Assistant autostarts 2.810
And the Tor Connection Assistant connects to Tor 4.772
And I wait until Tor is ready 1.223
And Tor is using the same configuration as before 0.000
And available upgrades have been checked 0.064
And all Internet traffic has only flowed through Tor or connectivity check service 1.222 
Warning: these queries were allowed but not needed: ["fedoraproject.org."]
After features/support/hooks.rb:326 0.720
After features/support/hooks.rb:100 0.042
14.611
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.488
And I capture all network traffic 0.004
When the network is plugged 0.093
Then the Tor Connection Assistant autostarts 5.024
Tags: @product
47.633
Given I configure a direct connection in the Tor Connection Assistant 9.876
And I wait until Tor is ready 2.804
And I disconnect the network through GNOME 3.152
And the Tor network and default bridges are blocked 1.987
When I connect the network through GNOME 2.950
Then the Tor Connection Assistant reports that it failed to connect 26.860
After features/support/hooks.rb:326 0.860
After features/support/hooks.rb:100 0.047
13.740
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and logged in 10.179
And I capture all network traffic 0.003
When the network is plugged 0.109
Then the Tor Connection Assistant autostarts 3.448
Tags: @product
4:59.037
Scenario Tor Connection honors my choice of using default bridges on retry, too
Steps
Given the Tor network and default bridges are blocked 2.664
When I unsuccessfully configure some default bridges in the Tor Connection Assistant 23.272
Then the Tor Connection Assistant reports that it failed to connect 0.124
Given the Tor network and default bridges are unblocked 1.596
When I click "Connect to Tor" 1.174
Then I wait until Tor is ready 4:30.204
Tor 
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:108:in `Then I wait until Tor is ready'
And Tor is configured to use the default bridges 0.000
And all Internet traffic has only flowed through the default bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.428 
SCENARIO FAILED: 'Tor Connection honors my choice of using default bridges on retry, too' (at time 01:19:34)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:19:34_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:19:34_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:19:34_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:19:34_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:19:34_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/4/artifact/build-artifacts/01:19:34_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.journal
After features/support/hooks.rb:100 0.060