Project Number Date
test_Tails_ISO_feature-arti 3 18 Nov 2024, 16:51

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
Using Tor bridges and pluggable transports 90 7 23 0 0 120 4 7 11 41:0.955 Failed
Tags: @product
Feature Using Tor bridges and pluggable transports
As a Tails user I want to circumvent censorship of Tor by using Tor bridges and pluggable transports And avoid connecting directly to the Tor Network
14.609
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.983
And I capture all network traffic 0.004
When the network is plugged 0.389
Then the Tor Connection Assistant autostarts 5.233
Tags: @product
4:46.584
Scenario Using normal bridges
Steps
When I configure some normal bridges in the Tor Connection Assistant 15.554
Then I wait until Tor is ready 4:31.029
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:15:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.234

SCENARIO FAILED: 'Using normal bridges' (at time 00:42:53)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:42:53_Using_normal_bridges_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:42:53_Using_normal_bridges.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:42:53_Using_normal_bridges.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:42:53_Using_normal_bridges.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:42:53_Using_normal_bridges.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:42:53_Using_normal_bridges.journal

After features/support/hooks.rb:100 0.033
13.024
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.267
And I capture all network traffic 0.002
When the network is plugged 0.084
Then the Tor Connection Assistant autostarts 4.670
Tags: @product
4:44.223
Scenario Using obfs4 pluggable transports
Steps
When I configure some obfs4 bridges in the Tor Connection Assistant in hide mode 13.289
Then I wait until Tor is ready 4:30.934
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:22:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges 0.000
After features/support/hooks.rb:326 5.574

SCENARIO FAILED: 'Using obfs4 pluggable transports' (at time 00:47:56)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:47:56_Using_obfs4_pluggable_transports_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:47:56_Using_obfs4_pluggable_transports.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:47:56_Using_obfs4_pluggable_transports.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:47:56_Using_obfs4_pluggable_transports.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:47:56_Using_obfs4_pluggable_transports.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:47:56_Using_obfs4_pluggable_transports.journal

After features/support/hooks.rb:100 0.036
13.298
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and logged in 8.672
And I capture all network traffic 0.003
When the network is plugged 0.114
Then the Tor Connection Assistant autostarts 4.507
Tags: @product
5:4.092
Scenario Using obfs4 pluggable transports from a QR code
Steps
When I configure some obfs4 bridges from a QR code in the Tor Connection Assistant in hide mode 33.301
Then I wait until Tor is ready 4:30.790
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:29:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges 0.000
After features/support/hooks.rb:326 5.207

SCENARIO FAILED: 'Using obfs4 pluggable transports from a QR code' (at time 00:53:18)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:53:18_Using_obfs4_pluggable_transports_from_a_QR_code_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:53:18_Using_obfs4_pluggable_transports_from_a_QR_code.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:53:18_Using_obfs4_pluggable_transports_from_a_QR_code.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:53:18_Using_obfs4_pluggable_transports_from_a_QR_code.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:53:18_Using_obfs4_pluggable_transports_from_a_QR_code.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:53:18_Using_obfs4_pluggable_transports_from_a_QR_code.journal

After features/support/hooks.rb:100 0.060
12.043
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and logged in 8.250
And I capture all network traffic 0.003
When the network is plugged 0.081
Then the Tor Connection Assistant autostarts 3.708
Tags: @product
5:27.425
Scenario TCA can scan QR code after a connection failure
Steps
Given the Tor network and default bridges are blocked 2.085
When I unsuccessfully configure a direct connection in the Tor Connection Assistant 32.178
Then the Tor Connection Assistant reports that it failed to connect 0.129
And tca.conf is empty 0.216
Given I scan a QR code from the error page in Tor Connection Assistant 20.949
And I retry connecting to Tor 1.188
Then I wait until Tor is ready 4:30.677
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:41:in `Then I wait until Tor is ready'
And tca.conf includes the configured bridges 0.000
And available upgrades have been checked 0.000
And all Internet traffic has only flowed through the configured bridges or connectivity check service 0.000
After features/support/hooks.rb:326 6.338

SCENARIO FAILED: 'TCA can scan QR code after a connection failure' (at time 00:59:03)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:59:03_TCA_can_scan_QR_code_after_a_connection_failure_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:59:03_TCA_can_scan_QR_code_after_a_connection_failure.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:59:03_TCA_can_scan_QR_code_after_a_connection_failure.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:59:03_TCA_can_scan_QR_code_after_a_connection_failure.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:59:03_TCA_can_scan_QR_code_after_a_connection_failure.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/00:59:03_TCA_can_scan_QR_code_after_a_connection_failure.journal

After features/support/hooks.rb:100 0.054
13.616
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and logged in 8.198
And I capture all network traffic 0.010
When the network is plugged 0.123
Then the Tor Connection Assistant autostarts 5.284
4:43.064
Scenario Default Tor bridges
Steps
When I configure the default bridges in the Tor Connection Assistant 12.053
Then I wait until Tor is ready 4:31.011
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:49:in `Then I wait until Tor is ready'
And Tor is configured to use the default bridges 0.000
And tca.conf includes no bridge 0.000
And available upgrades have been checked 0.000
And Tor is configured to use the default bridges 0.000
And all Internet traffic has only flowed through the default bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.328

SCENARIO FAILED: 'Default Tor bridges' (at time 01:04:06)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:04:06_Default_Tor_bridges_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:04:06_Default_Tor_bridges.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:04:06_Default_Tor_bridges.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:04:06_Default_Tor_bridges.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:04:06_Default_Tor_bridges.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:04:06_Default_Tor_bridges.journal

After features/support/hooks.rb:100 0.034
12.267
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.203
And I capture all network traffic 0.003
When the network is plugged 0.089
Then the Tor Connection Assistant autostarts 3.970
Tags: @product
4:54.803
Scenario Fall back to default bridges if failing to connect directly to the Tor network
Steps
Given the Tor network is blocked 2.365
When I configure a direct connection in the Tor Connection Assistant 21.737
Then I wait until Tor is ready 4:30.700
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:59:in `Then I wait until Tor is ready'
And tca.conf includes no bridge 0.000
And available upgrades have been checked 0.000
And Tor is configured to use the default bridges 0.000
And all Internet traffic has only flowed through the default bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.288

SCENARIO FAILED: 'Fall back to default bridges if failing to connect directly to the Tor network' (at time 01:09:19)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:09:19_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:09:19_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:09:19_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:09:19_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:09:19_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:09:19_Fall_back_to_default_bridges_if_failing_to_connect_directly_to_the_Tor_network.journal

After features/support/hooks.rb:100 0.057
12.473
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.236
And I capture all network traffic 0.003
When the network is plugged 0.075
Then the Tor Connection Assistant autostarts 4.157
Tags: @product
2:44.309
Given the Tor network and default bridges are blocked 1.861
When I unsuccessfully configure a direct connection in the Tor Connection Assistant 32.255
Then the Tor Connection Assistant reports that it failed to connect 0.111
And tca.conf is empty 0.303
Given the Tor network and default bridges are unblocked 1.267
And I retry connecting to Tor 1.167
Then I wait until Tor is ready 2:6.137
And tca.conf includes no bridge 0.012
And available upgrades have been checked 0.063
And all Internet traffic has only flowed through Tor or connectivity check service 1.129

Warning: these queries were allowed but not needed: ["fedoraproject.org."]

After features/support/hooks.rb:326 0.783
After features/support/hooks.rb:100 0.052
12.923
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.615
And I capture all network traffic 0.003
When the network is plugged 0.074
Then the Tor Connection Assistant autostarts 4.230
Tags: @product
4.674
When I try to configure some normal bridges in the Tor Connection Assistant in hide mode 4.391
Then the Tor Connection Assistant complains that normal bridges are not allowed 0.151
And I cannot click the "Connect to Tor" button 0.131
After features/support/hooks.rb:326 0.628
After features/support/hooks.rb:100 0.067
11.945
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.124
And I capture all network traffic 0.002
When the network is plugged 0.089
Then the Tor Connection Assistant autostarts 3.728
Tags: @product
23.038
Given I configure a direct connection in the Tor Connection Assistant 7.203
And I wait until Tor is ready 4.063
When I disconnect the network through GNOME 2.609
And I connect the network through GNOME 2.969
Then the Tor Connection Assistant autostarts 2.393
And the Tor Connection Assistant connects to Tor 0.569
And I wait until Tor is ready 2.117
And Tor is using the same configuration as before 0.000
And available upgrades have been checked 0.084
And all Internet traffic has only flowed through Tor or connectivity check service 1.027

Warning: these queries were allowed but not needed: ["fedoraproject.org."]

After features/support/hooks.rb:326 0.644
After features/support/hooks.rb:100 0.061
13.464
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.541
And I capture all network traffic 0.004
When the network is plugged 0.084
Then the Tor Connection Assistant autostarts 4.834
Tags: @product
45.227
Given I configure a direct connection in the Tor Connection Assistant 9.419
And I wait until Tor is ready 1.762
And I disconnect the network through GNOME 2.839
And the Tor network and default bridges are blocked 1.559
When I connect the network through GNOME 2.821
Then the Tor Connection Assistant reports that it failed to connect 26.824
After features/support/hooks.rb:326 0.696
After features/support/hooks.rb:100 0.045
15.109
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.125
And I capture all network traffic 0.003
When the network is plugged 0.156
Then the Tor Connection Assistant autostarts 6.823
Tags: @product
4:58.734
Scenario Tor Connection honors my choice of using default bridges on retry, too
Steps
Given the Tor network and default bridges are blocked 2.014
When I unsuccessfully configure some default bridges in the Tor Connection Assistant 23.862
Then the Tor Connection Assistant reports that it failed to connect 0.153
Given the Tor network and default bridges are unblocked 1.407
When I click "Connect to Tor" 1.165
Then I wait until Tor is ready 4:30.131
Tor
Tor failed to bootstrap (TorBootstrapFailure)
./features/support/helpers/misc_helpers.rb:272:in `rescue in wait_until_tor_is_working'
./features/support/helpers/misc_helpers.rb:254:in `wait_until_tor_is_working'
./features/step_definitions/common_steps.rb:703:in `/^Tor has built a circuit$/'
./features/step_definitions/common_steps.rb:665:in `/^I wait until Tor is ready$/'
features/tor_bridges.feature:108:in `Then I wait until Tor is ready'
And Tor is configured to use the default bridges 0.000
And all Internet traffic has only flowed through the default bridges or connectivity check service 0.000
After features/support/hooks.rb:326 5.693

SCENARIO FAILED: 'Tor Connection honors my choice of using default bridges on retry, too' (at time 01:19:29)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:19:29_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too_chutney-data

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:19:29_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:19:29_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:19:29_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:19:29_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-arti/3/artifact/build-artifacts/01:19:29_Tor_Connection_honors_my_choice_of_using_default_bridges_on_retry,_too.journal

After features/support/hooks.rb:100 0.035