Project Number Date
test_Tails_ISO_devel 3188 10 Dec 2023, 12:26

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 1 8 0 0 280 23 1 24 1:26:43.818 Failed
18.103
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.877
And I prepare Tails for memory erasure tests 0.592
When I start a process allocating 128 MiB of memory with a known pattern 2.343
Then patterns cover at least 128 MiB in the guest's memory 3.342

Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.257
Then I find very few patterns in the guest's memory 3.690

Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)

After features/support/hooks.rb:291 0.842
After features/support/hooks.rb:75 0.000
1:3.793
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.354
And I prepare Tails for memory erasure tests 0.551
And I find very few patterns in the guest's memory 3.720

Pattern coverage: 0.000% (0 MiB out of 1250 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.878
Then patterns cover at least 99% of the test FS size in the guest's memory 3.005

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.332
Then I find very few patterns in the guest's memory 3.950

Pattern coverage: 0.000% (0 MiB out of 1250 MiB reference memory)

After features/support/hooks.rb:291 0.966
After features/support/hooks.rb:75 0.000
3:8.428
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.763
And I prepare Tails for memory erasure tests 0.495
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.013
Then I find very few patterns in the guest's memory 3.836

Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2:32.235
Then patterns cover at least 86% of the test FS size in the guest's memory 4.676

Pattern coverage: 97.290% (121 MiB out of 124 MiB reference memory)

When I umount the USB drive 0.652
Then I find very few patterns in the guest's memory 3.723

Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)

# read cache
When I mount the USB drive again 0.219
And I read the content of the test FS 0.509
Then patterns cover at least 99% of the test FS size in the guest's memory 3.152

Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)

When I umount the USB drive 0.387
Then I find very few patterns in the guest's memory 3.761

Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)

After features/support/hooks.rb:291 1.737
After features/support/hooks.rb:75 0.000
3:2.563
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.918
And I prepare Tails for memory erasure tests 0.604
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 25.073
Then I find very few patterns in the guest's memory 5.402

Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2:3.188
Then patterns cover at least 99% of the test FS size in the guest's memory 3.560

Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)

When I umount the USB drive 0.797
Then I find very few patterns in the guest's memory 3.132

Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)

# read cache
When I mount the USB drive again 4.437
And I read the content of the test FS 0.408
Then patterns cover at least 99% of the test FS size in the guest's memory 4.096

Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)

When I umount the USB drive 0.514
Then I find very few patterns in the guest's memory 3.428

Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)

After features/support/hooks.rb:291 0.934
After features/support/hooks.rb:75 0.000
51.455
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.158
And I prepare Tails for memory erasure tests 0.575
When I fill a 128 MiB file with a known pattern on the root filesystem 15.634
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.756
Then patterns cover at least 128 MiB in the guest's memory 2.477

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 1.104
And I wait 20 seconds 20.016

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.732

Pattern coverage: 0.000% (0 MiB out of 1249 MiB reference memory)

After features/support/hooks.rb:291 3.419
After features/support/hooks.rb:75 0.000
5:56.699
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:9.533
And I prepare Tails for memory erasure tests 0.488
When I fill a 128 MiB file with a known pattern on the persistent filesystem 24.281
When I trigger shutdown 0.234
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.141

Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)

After features/support/hooks.rb:291 3.448
After features/support/hooks.rb:75 0.012
3:29.065
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:31.540
And I update APT using apt 17.571
When I install "popularity-contest" using apt 19.522
Then I am notified I can not use Additional Software for "popularity-contest" 58.507
And I can open the Additional Software documentation from the notification 21.924
After features/support/hooks.rb:450 35.899
After features/support/hooks.rb:291 2.094
After features/support/hooks.rb:75 0.005
5:47.335
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.947
And I update APT using apt 17.334
And I install "popularity-contest" using apt 19.540
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:2.516
When I create a persistent storage and activate the Additional Software feature 19.979
Then Additional Software is correctly configured for package "popularity-contest" 1.337
When I shutdown Tails and wait for the computer to power off 10.086
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:42.277
Then Additional Software is correctly configured for package "popularity-contest" 0.982
And the package "popularity-contest" is installed after Additional Software has been started 0.333
After features/support/hooks.rb:450 37.223
After features/support/hooks.rb:291 0.937
After features/support/hooks.rb:75 0.015
2:51.098
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.210
And I start Tails from USB drive "__internal" and I login with an administration password 1:15.688
And I update APT using apt 16.033
When I install "makepp" using apt 19.524
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.536
And the package "makepp" is installed 0.105
After features/support/hooks.rb:450 37.693
After features/support/hooks.rb:291 1.103
After features/support/hooks.rb:75 0.015
4:50.948
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.197
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:10.212
When I uninstall "popularity-contest" using apt 16.071
And I accept removing "popularity-contest" from Additional Software 0.679
Then "popularity-contest" is not in the list of Additional Software 0.692
When I start Synaptic 20.059
And I update APT using Synaptic 21.613
And I install "cowsay" using Synaptic 11.027
And I accept adding "cowsay" to Additional Software 0.792
Then Additional Software is correctly configured for package "cowsay" 0.946
When I uninstall "cowsay" using apt 3.532
And I refuse removing "cowsay" from Additional Software 1.271
Then Additional Software is correctly configured for package "cowsay" 0.939
When I start "Additional Software" via GNOME Activities Overview 12.408
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.577
Then "cowsay" is not in the list of Additional Software 1.016
When I install "cowsay" using apt 3.330
And I refuse adding "cowsay" to Additional Software 0.719
Then "cowsay" is not in the list of Additional Software 0.859
After features/support/hooks.rb:450 0.958
After features/support/hooks.rb:291 0.833
After features/support/hooks.rb:75 0.017
11:29.850
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.213
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:55.257
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.944
And I accept adding "cowsay" to Additional Software 1:7.139
And Additional Software is correctly configured for package "cowsay" 1.285
And I shutdown Tails and wait for the computer to power off 6.069
And I start Tails from USB drive "__internal" with network unplugged 45.934
And I enable persistence 29.508
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 24.789
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.292
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.083
And the network is plugged 0.037
And Tor is ready 19.312
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.243
And available upgrades have been checked 0.106
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.163
And I can open the Additional Software configuration window from the notification 3.105
And I shutdown Tails and wait for the computer to power off 2:2.570
And I start Tails from USB drive "__internal" with network unplugged 44.782
And I enable persistence 30.717
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.032
And I log in to a new session 21.751
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.822
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
And the network is plugged 0.036
And Tor is ready 39.208
Then the Additional Software upgrade service has started 0.179
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.118
After features/support/hooks.rb:450 4.163
After features/support/hooks.rb:291 0.818
After features/support/hooks.rb:75 0.028
1:42.753
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.223
And I start Tails from USB drive "__internal" with network unplugged 43.731
And I enable persistence 30.949
And I remove the "cowsay" deb files from the APT cache 0.594
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.070
And I log in to a new session 21.209
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.874
And I can open the Additional Software log file from the notification 1.935
And the package "cowsay" is not installed 0.164
After features/support/hooks.rb:450 0.113
After features/support/hooks.rb:291 1.045
After features/support/hooks.rb:75 0.010
Feature: Localization
2:38.998
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.656
When I log in to a new session in Arabic (ar) 29.894
Then the keyboard layout is set to "us" 0.166
When the network is plugged 0.032
And Tor is ready 14.664
Then I successfully start the Unsafe Browser in "ar" 26.421
And I kill the Unsafe Browser 5.989
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 35.240
And DuckDuckGo is the default search engine 9.324
And I kill the Tor Browser 5.263
And the screen keyboard works in Thunderbird 22.654
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.458
After features/support/hooks.rb:75 0.000
Feature: Localization
2:41.863
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.532
When I log in to a new session in Chinese (zh_CN) 28.650
Then the keyboard layout is set to "cn" 0.139
When the network is plugged 0.039
And Tor is ready 17.314
Then I successfully start the Unsafe Browser in "zh_CN" 27.088
And I kill the Unsafe Browser 5.967
When I enable the screen keyboard 0.166
Then the screen keyboard works in Tor Browser 34.176
And DuckDuckGo is the default search engine 9.733
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 24.126
And the layout of the screen keyboard is set to "us" 0.593
After features/support/hooks.rb:291 1.253
After features/support/hooks.rb:75 0.000
Feature: Localization
2:31.027
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.004
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.801
When I log in to a new session in English (en) 14.754
Then the keyboard layout is set to "us" 0.182
When the network is plugged 0.048
And Tor is ready 2:8.239
Timed out while waiting for TCA to connect to Tor
Last ignored exception was: Dogtail::Failure: The Dogtail init script raised: SearchError: child of [DEAD]: "Tor Connection" application
STDOUT:

STDERR:


./features/support/helpers/dogtail.rb:93:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/tor.rb:364:in `new'
./features/step_definitions/tor.rb:364:in `tor_connection_assistant'
./features/step_definitions/tor.rb:382:in `block (2 levels) in <top (required)>'
./features/support/helpers/misc_helpers.rb:78:in `block (2 levels) in try_for'
./features/support/helpers/misc_helpers.rb:66:in `loop'
./features/support/helpers/misc_helpers.rb:66:in `block in try_for'
./features/support/helpers/misc_helpers.rb:65:in `try_for'
./features/step_definitions/tor.rb:379:in `block in <top (required)>'
./features/step_definitions/tor.rb:469:in `tca_configure'
./features/step_definitions/tor.rb:478:in `block in <top (required)>'
./features/step_definitions/common_steps.rb:602:in `block in <top (required)>'
./features/step_definitions/common_steps.rb:556:in `block in <top (required)>' (TCAConnectionTimeout)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/tor.rb:379:in `/^the Tor Connection Assistant connects to Tor$/'
./features/step_definitions/tor.rb:469:in `tca_configure'
./features/step_definitions/tor.rb:478:in `/^I configure a direct connection in the Tor Connection Assistant$/'
./features/step_definitions/common_steps.rb:602:in `/^I successfully configure Tor$/'
./features/step_definitions/common_steps.rb:556:in `/^Tor is ready$/'
features/localization.feature:40:in `And Tor is ready'
features/localization.feature:20:in `And Tor is ready'
Then I successfully start the Unsafe Browser in "en" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:291 5.760

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#3)' (at time 02:20:33)

Chutney logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3188/artifact/build-artifacts/02:20:33_Tails_is_localized_for_every_tier-1_language,_Examples___3__chutney-data

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3188/artifact/build-artifacts/02:20:33_Tails_is_localized_for_every_tier-1_language,_Examples___3_.png

Tor logs: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3188/artifact/build-artifacts/02:20:33_Tails_is_localized_for_every_tier-1_language,_Examples___3_.tor

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3188/artifact/build-artifacts/02:20:33_Tails_is_localized_for_every_tier-1_language,_Examples___3_.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3188/artifact/build-artifacts/02:20:33_Tails_is_localized_for_every_tier-1_language,_Examples___3_.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3188/artifact/build-artifacts/02:20:33_Tails_is_localized_for_every_tier-1_language,_Examples___3_.journal

After features/support/hooks.rb:75 0.000
Feature: Localization
2:36.758
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.492
When I log in to a new session in French (fr) 30.745
Then the keyboard layout is set to "fr" 0.155
When the network is plugged 0.034
And Tor is ready 14.561
Then I successfully start the Unsafe Browser in "fr" 26.062
And I kill the Unsafe Browser 5.797
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 33.696
And DuckDuckGo is the default search engine 9.603
And I kill the Tor Browser 5.320
And the screen keyboard works in Thunderbird 21.579
And the layout of the screen keyboard is set to "fr" 0.584
After features/support/hooks.rb:291 1.070
After features/support/hooks.rb:75 0.000
Feature: Localization
2:37.879
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.990
When I log in to a new session in German (de) 30.495
Then the keyboard layout is set to "de" 0.205
When the network is plugged 0.095
And Tor is ready 14.478
Then I successfully start the Unsafe Browser in "de" 25.953
And I kill the Unsafe Browser 5.822
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 33.938
And DuckDuckGo is the default search engine 10.351
And I kill the Tor Browser 5.617
And the screen keyboard works in Thunderbird 22.181
And the layout of the screen keyboard is set to "de" 0.640
After features/support/hooks.rb:291 1.154
After features/support/hooks.rb:75 0.000
Feature: Localization
2:40.723
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.568
When I log in to a new session in Italian (it) 33.609
Then the keyboard layout is set to "it" 0.140
When the network is plugged 0.079
And Tor is ready 14.732
Then I successfully start the Unsafe Browser in "it" 24.458
And I kill the Unsafe Browser 6.018
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 33.772
And DuckDuckGo is the default search engine 9.804
And I kill the Tor Browser 5.344
And the screen keyboard works in Thunderbird 23.429
And the layout of the screen keyboard is set to "us" 0.659
After features/support/hooks.rb:291 1.180
After features/support/hooks.rb:75 0.000
Feature: Localization
3:8.739
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.796
When I log in to a new session in Persian (fa) 33.099
Then the keyboard layout is set to "ir" 0.128
When the network is plugged 0.041
And Tor is ready 43.018
Then I successfully start the Unsafe Browser in "fa" 26.376
And I kill the Unsafe Browser 5.786
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 34.320
And DuckDuckGo is the default search engine 9.299
And I kill the Tor Browser 5.422
And the screen keyboard works in Thunderbird 22.734
And the layout of the screen keyboard is set to "ir" 0.610
After features/support/hooks.rb:291 1.236
After features/support/hooks.rb:75 0.000
Feature: Localization
2:38.065
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.125
When I log in to a new session in Portuguese (pt) 29.369
Then the keyboard layout is set to "pt" 0.148
When the network is plugged 0.047
And Tor is ready 15.184
Then I successfully start the Unsafe Browser in "pt" 26.206
And I kill the Unsafe Browser 6.018
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 34.519
And DuckDuckGo is the default search engine 9.902
And I kill the Tor Browser 5.309
And the screen keyboard works in Thunderbird 22.561
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.185
After features/support/hooks.rb:75 0.000
Feature: Localization
2:40.923
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.664
When I log in to a new session in Russian (ru) 29.463
Then the keyboard layout is set to "ru" 0.137
When the network is plugged 0.042
And Tor is ready 16.223
Then I successfully start the Unsafe Browser in "ru" 26.817
And I kill the Unsafe Browser 6.024
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 34.013
And DuckDuckGo is the default search engine 9.273
And I kill the Tor Browser 5.330
And the screen keyboard works in Thunderbird 24.194
And the layout of the screen keyboard is set to "ru" 0.597
After features/support/hooks.rb:291 1.111
After features/support/hooks.rb:75 0.000
Feature: Localization
2:36.515
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.172
When I log in to a new session in Spanish (es) 30.306
Then the keyboard layout is set to "es" 0.277
When the network is plugged 0.038
And Tor is ready 16.563
Then I successfully start the Unsafe Browser in "es" 24.704
And I kill the Unsafe Browser 5.901
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 33.052
And DuckDuckGo is the default search engine 8.867
And I kill the Tor Browser 5.299
And the screen keyboard works in Thunderbird 22.617
And the layout of the screen keyboard is set to "us" 0.597
After features/support/hooks.rb:291 1.367
After features/support/hooks.rb:75 0.000
Feature: Localization
3:8.618
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.095
When I log in to a new session in Turkish (tr) 31.706
Then the keyboard layout is set to "tr" 0.145
When the network is plugged 0.040
And Tor is ready 44.465
Then I successfully start the Unsafe Browser in "tr" 26.741
And I kill the Unsafe Browser 5.943
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 33.383
And DuckDuckGo is the default search engine 9.244
And I kill the Tor Browser 5.291
And the screen keyboard works in Thunderbird 22.755
And the layout of the screen keyboard is set to "us" 0.653
After features/support/hooks.rb:291 1.241
After features/support/hooks.rb:75 0.000
12:11.608
When the network is plugged 0.048
And I wait 720 seconds 12:0.092

Slept for 720 seconds

Then I successfully configure Tor 11.399
And the time has synced 0.068
After features/support/hooks.rb:291 0.634
After features/support/hooks.rb:75 0.000