Project Number Date
test_Tails_ISO_18215-update-chutney-force-all-tests 20 31 Mar 2025, 13:16

Feature Report

Steps Scenarios Features
Feature Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
Time syncing 72 2 6 0 0 80 8 2 10 28:58.506 Failed
Tags: @product @check_tor_leaks
Feature Time syncing
As a Tails user I want Tor to work properly And for that I need a reasonably accurate system clock
Tags: @product @check_tor_leaks
10:10.579
Scenario Clock with host's time
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Before features/support/hooks.rb:505 0.003
Steps
Given I have started Tails from DVD without network and logged in 9.783
When the network is plugged 10:0.795
Command 
Command failed (pid 6667 exit 1): ["/var/lib/jenkins/workspace/test_Tails_ISO_18215-update-chutney-force-all-tests/features/scripts/chutney", "wait_for_bootstrap", "/var/lib/jenkins/workspace/test_Tails_ISO_18215-update-chutney-force-all-tests/features/chutney/test-network", {:err=>[:child, :out]}]
Bootstrap failed: 600 seconds
Node status:
test000auth  :  100, done                     , Done
test001auth  :    0, starting                 , Starting
test002auth  :    0, starting                 , Starting
test003ba    :    0, starting                 , Starting
test004relay :   95, circuit_create           , Establishing a Tor circuit
test005relay :   95, circuit_create           , Establishing a Tor circuit
test006relay :   95, circuit_create           , Establishing a Tor circuit
test007relay :   95, circuit_create           , Establishing a Tor circuit
test008relay :   95, circuit_create           , Establishing a Tor circuit
test009relay :   95, circuit_create           , Establishing a Tor circuit
test010relay :   95, circuit_create           , Establishing a Tor circuit
test011relay :   95, circuit_create           , Establishing a Tor circuit
test012relay :   95, circuit_create           , Establishing a Tor circuit
test013relay :   95, circuit_create           , Establishing a Tor circuit
test014relay :   95, circuit_create           , Establishing a Tor circuit
test015relay :   95, circuit_create           , Establishing a Tor circuit
test016relay :   95, circuit_create           , Establishing a Tor circuit
test017relay :   95, circuit_create           , Establishing a Tor circuit
test018relay :   95, circuit_create           , Establishing a Tor circuit
test019bridge:   95, circuit_create           , Establishing a Tor circuit
test020bridge:   95, circuit_create           , Establishing a Tor circuit
test021obfs4 :   95, circuit_create           , Establishing a Tor circuit
test022obfs4 :   95, circuit_create           , Establishing a Tor circuit
test023defbr :   95, circuit_create           , Establishing a Tor circuit
test024client:   95, circuit_create           , Establishing a Tor circuit
Published dir info:
test000auth  :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test001auth  :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test002auth  :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test003ba    :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test004relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test005relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test006relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test007relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test008relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test009relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test010relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test011relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test012relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test013relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test014relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test015relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test016relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test017relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test018relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test019bridge:    0, 003ba                    , desc                          , Not in dir file
test020bridge:    0, 003ba                    , desc                          , Not in dir file
test021obfs4 :    0, 003ba                    , desc                          , Not in dir file
test022obfs4 :    0, 003ba                    , desc                          , Not in dir file
test023defbr :    0, 003ba                    , desc                          , Not in dir file

 (ChutneyBootstrapFailure)
./features/step_definitions/chutney.rb:151:in `rescue in wait_until_chutney_is_working'
./features/step_definitions/chutney.rb:143:in `wait_until_chutney_is_working'
./features/step_definitions/common_steps.rb:175:in `/^the network is plugged$/'
features/time_syncing.feature:9:in `When the network is plugged'
And I successfully configure Tor 0.000
Then the system clock is less than 5 minutes incorrect 0.000
After features/support/hooks.rb:513 0.051
After features/support/hooks.rb:330 5.762 
SCENARIO FAILED: 'Clock with host's time' (at time 00:21:35)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:21:35_Clock_with_host_s_time_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:21:35_Clock_with_host_s_time.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:21:35_Clock_with_host_s_time.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:21:35_Clock_with_host_s_time.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:21:35_Clock_with_host_s_time.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:21:35_Clock_with_host_s_time.journal
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
10:8.587
Scenario Clock with host's time while using bridges
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Before features/support/hooks.rb:505 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.250
When the network is plugged 10:0.337
Command 
Command failed (pid 6825 exit 1): ["/var/lib/jenkins/workspace/test_Tails_ISO_18215-update-chutney-force-all-tests/features/scripts/chutney", "wait_for_bootstrap", "/var/lib/jenkins/workspace/test_Tails_ISO_18215-update-chutney-force-all-tests/features/chutney/test-network", {:err=>[:child, :out]}]
Bootstrap failed: 600 seconds
Node status:
test000auth  :  100, done                     , Done
test001auth  :  100, done                     , Done
test002auth  :  100, done                     , Done
test003ba    :    0, starting                 , Starting
test004relay :  100, done                     , Done
test005relay :  100, done                     , Done
test006relay :  100, done                     , Done
test007relay :  100, done                     , Done
test008relay :  100, done                     , Done
test009relay :   95, circuit_create           , Establishing a Tor circuit
test010relay :  100, done                     , Done
test011relay :   95, circuit_create           , Establishing a Tor circuit
test012relay :  100, done                     , Done
test013relay :  100, done                     , Done
test014relay :  100, done                     , Done
test015relay :   95, circuit_create           , Establishing a Tor circuit
test016relay :  100, done                     , Done
test017relay :  100, done                     , Done
test018relay :  100, done                     , Done
test019bridge:   95, circuit_create           , Establishing a Tor circuit
test020bridge:  100, done                     , Done
test021obfs4 :  100, done                     , Done
test022obfs4 :  100, done                     , Done
test023defbr :  100, done                     , Done
test024client:  100, done                     , Done
Published dir info:
test000auth  :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test001auth  :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test002auth  :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test003ba    :  100, all nodes                , desc md md_cons ns_cons       , Dir info cached
test004relay :    0, 005relay 006relay 007relay 008relay 009relay 010relay 011relay 012relay 013relay 014relay 015relay 016relay 018relay 019bridge 020bridge 021obfs4 022obfs4 023defbr 024client, desc md                       , Not in dir file
test005relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test006relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test007relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test008relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test009relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test010relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test011relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test012relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test013relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test014relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test015relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test016relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test017relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test018relay :    0, all nodes                , desc md md_cons ns_cons       , Not in dir file
test019bridge:    0, 003ba                    , desc                          , Not in dir file
test020bridge:  100, 003ba                    , desc                          , Dir info cached
test021obfs4 :    0, 003ba                    , desc                          , Not in dir file
test022obfs4 :  100, 003ba                    , desc                          , Dir info cached
test023defbr :    0, 003ba                    , desc                          , Not in dir file

 (ChutneyBootstrapFailure)
./features/step_definitions/chutney.rb:151:in `rescue in wait_until_chutney_is_working'
./features/step_definitions/chutney.rb:143:in `wait_until_chutney_is_working'
./features/step_definitions/common_steps.rb:175:in `/^the network is plugged$/'
features/time_syncing.feature:15:in `When the network is plugged'
And the Tor Connection Assistant autostarts 0.000
And I configure some normal bridges in the Tor Connection Assistant 0.000
And I wait until Tor is ready 0.000
Then the system clock is less than 5 minutes incorrect 0.000
After features/support/hooks.rb:513 0.038
After features/support/hooks.rb:330 5.798 
SCENARIO FAILED: 'Clock with host's time while using bridges' (at time 00:31:49)
Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:31:49_Clock_with_host_s_time_while_using_bridges_chutney-data
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:31:49_Clock_with_host_s_time_while_using_bridges.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:31:49_Clock_with_host_s_time_while_using_bridges.png
Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:31:49_Clock_with_host_s_time_while_using_bridges.tor
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:31:49_Clock_with_host_s_time_while_using_bridges.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_18215-update-chutney-force-all-tests/20/artifact/build-artifacts/00:31:49_Clock_with_host_s_time_while_using_bridges.journal
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
1:24.988
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Before features/support/hooks.rb:505 0.002
Given I have started Tails from DVD without network and logged in 8.546
When I bump the system time with "+1 day" 0.282
And I capture all network traffic 0.002
And the network is plugged 52.025
And the Tor Connection Assistant autostarts 6.314
And I configure some obfs4 bridges in the Tor Connection Assistant in easy mode 13.103
And I wait until Tor is ready 3.823
Then the system clock is less than 5 minutes incorrect 0.052
And all Internet traffic has only flowed through the configured bridges or connectivity check service 0.837 
Warning: these queries were allowed but not needed: ["fedoraproject.org."]
After features/support/hooks.rb:513 0.369
After features/support/hooks.rb:330 0.622
After features/support/hooks.rb:100 0.041
Tags: @product @check_tor_leaks @not_release_blocker
1:29.199
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Before features/support/hooks.rb:505 0.002
Given I have started Tails from DVD without network and logged in 8.361
When I bump the system time with "-15 days" 0.295
And I warm reboot the computer 0.016
And the computer reboots Tails 1:20.146
Then Tails' hardware clock is close to the host system's time 0.378
After features/support/hooks.rb:513 0.145
After features/support/hooks.rb:330 0.752
After features/support/hooks.rb:100 0.006
Tags: @product @check_tor_leaks @not_release_blocker
1:39.089
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Before features/support/hooks.rb:505 0.002
Given I have started Tails from DVD without network and logged in 9.143
When I bump the hardware clock's time with "-15 days" 1.928
And I warm reboot the computer 0.017
And the computer reboots Tails 1:27.418
Then the hardware clock is still off by "-15 days" 0.581
After features/support/hooks.rb:513 0.181
After features/support/hooks.rb:330 0.896
After features/support/hooks.rb:100 0.011
Tags: @product @check_tor_leaks
1:4.216
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Before features/support/hooks.rb:505 0.003
Given a computer 0.163
And the hardware clock is set to "01 Jan 2000 12:34:56" 0.025
And I start the computer 1.040
And the computer boots Tails 1:2.862
Then the system clock is just past Tails' source date 0.124
After features/support/hooks.rb:513 0.129
After features/support/hooks.rb:330 0.805
After features/support/hooks.rb:100 0.006
Tags: @product @check_tor_leaks
32.458
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Before features/support/hooks.rb:505 0.002
Given I have started Tails from DVD without network and logged in 8.333
And I make sure time sync before Tor connects times out 1.234
When the network is plugged 0.073
And I successfully configure Tor 22.726
Then the system clock is less than 5 minutes incorrect 0.089
After features/support/hooks.rb:513 0.450
After features/support/hooks.rb:330 0.826
After features/support/hooks.rb:100 0.000
Tags: @product @check_tor_leaks
1:4.451
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.002
Before features/support/hooks.rb:505 0.002
Given I have started Tails from DVD without network and logged in 8.960
When I bump the system time with "+8 hours +15 minutes" 0.219
And all notifications have disappeared 3.962
And I capture all network traffic 0.003
And I make sure time sync before Tor connects fails 0.151
And the network is plugged 0.090
And the Tor Connection Assistant autostarts 3.504
When I configure the default bridges in the Tor Connection Assistant in easy mode without connecting 5.693
And I click "Connect to Tor" 1.282
And the Tor Connection Assistant fails to connect to Tor 16.147
# The "Fix Clock" button allows users to recover from this bug
Then I set the time zone in Tor Connection to "Asia/Shanghai" 15.143
Then the system clock is less than 20 minutes incorrect 0.335
When I click "Connect to Tor" 1.167
Then I wait until Tor is ready 7.126
And all Internet traffic has only flowed through the default bridges or fake connectivity check service 0.614
# check that htpdate has done its job
And the system clock is less than 5 minutes incorrect 0.049
After features/support/hooks.rb:513 0.331
After features/support/hooks.rb:330 0.710
After features/support/hooks.rb:100 0.054
Tags: @product @check_tor_leaks
1:0.680
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.003
Before features/support/hooks.rb:505 0.002
Given I have started Tails from DVD without network and logged in 8.789
When I bump the system time with "+8 hours +15 minutes" 0.772
And all notifications have disappeared 4.246
And I capture all network traffic 0.003
And the network is plugged 0.086
And the Tor Connection Assistant autostarts 4.018
# Anti-test: Users east of UTC can't connect to obfs4 bridges
And I configure some obfs4 bridges in the Tor Connection Assistant in hide mode without connecting 4.530
And I click "Connect to Tor" 1.153
Then the Tor Connection Assistant reports that it failed to connect 11.800
# The "Fix Clock" button allows users to recover from this bug
When I set the time zone in Tor Connection to "Asia/Shanghai" 15.084
Then the system clock is less than 20 minutes incorrect 0.569
# "Asia/Shanghai" is UTC+08:00 all year long (no DST)
And the displayed clock is less than 20 minutes incorrect in "+08:00" 0.469
When I click "Connect to Tor" 1.141
Then I wait until Tor is ready 7.025
And all Internet traffic has only flowed through the configured bridges 0.508
# check that htpdate has done its job
And the system clock is less than 5 minutes incorrect 0.060
And the displayed clock is less than 5 minutes incorrect in "+08:00" 0.419
After features/support/hooks.rb:513 0.310
After features/support/hooks.rb:330 1.389
After features/support/hooks.rb:100 0.057
Tags: @product @check_tor_leaks
24.254
Before features/support/hooks.rb:266 0.000
Before features/support/hooks.rb:273 0.017
Before features/support/hooks.rb:505 0.013
Given I have started Tails from DVD without network and logged in 8.165
And I make sure time sync before Tor connects uses a fake connectivity check service 1.190
And the network is plugged 0.081
And Tor is ready 13.272
Then the fake connectivity check service has received a new HTTP request 0.000
When I make NetworkManager perform a connectivity check 1.540
Then the fake connectivity check service has received a new HTTP request 0.000
And the HTTP requests received by the fake connectivity check service are identical 0.003
After features/support/hooks.rb:513 0.495
After features/support/hooks.rb:330 0.629
After features/support/hooks.rb:100 0.000