Project Number Date
test_Tails_ISO_stable 4856 28 May 2024, 14:01

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 263 1 11 0 0 275 21 1 22 1:6:7.960 Failed
21.321
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.036
And I prepare Tails for memory erasure tests 0.538
When I start a process allocating 128 MiB of memory with a known pattern 2.380
Then patterns cover at least 128 MiB in the guest's memory 4.026

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 1.529
Then I find very few patterns in the guest's memory 4.810

Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)

After features/support/hooks.rb:305 0.801
After features/support/hooks.rb:89 0.000
24.246
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.245
And I prepare Tails for memory erasure tests 0.393
And I find very few patterns in the guest's memory 4.263

Pattern coverage: 0.000% (0 MiB out of 885 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.992
Then patterns cover at least 99% of the test FS size in the guest's memory 3.945

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.916
Then I find very few patterns in the guest's memory 4.489

Pattern coverage: 0.000% (0 MiB out of 885 MiB reference memory)

After features/support/hooks.rb:305 0.763
After features/support/hooks.rb:89 0.000
49.628
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.444
And I prepare Tails for memory erasure tests 0.424
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.323
Then I find very few patterns in the guest's memory 4.571

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.036
Then patterns cover at least 86% of the test FS size in the guest's memory 3.706

Pattern coverage: 90.164% (115 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.600
Then I find very few patterns in the guest's memory 4.666

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

# read cache
When I mount the USB drive again 0.657
And I read the content of the test FS 1.311
Then patterns cover at least 99% of the test FS size in the guest's memory 4.416

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.825
Then I find very few patterns in the guest's memory 4.641

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

After features/support/hooks.rb:305 0.888
After features/support/hooks.rb:89 0.000
1:10.182
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.535
And I prepare Tails for memory erasure tests 0.373
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 34.168
Then I find very few patterns in the guest's memory 3.920

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1.938
Then patterns cover at least 99% of the test FS size in the guest's memory 3.244

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.934
Then I find very few patterns in the guest's memory 3.653

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

# read cache
When I mount the USB drive again 4.651
And I read the content of the test FS 0.468
Then patterns cover at least 99% of the test FS size in the guest's memory 3.778

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.656
Then I find very few patterns in the guest's memory 3.860

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

After features/support/hooks.rb:305 0.902
After features/support/hooks.rb:89 0.000
50.319
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.039
And I prepare Tails for memory erasure tests 0.410
When I fill a 128 MiB file with a known pattern on the root filesystem 15.215
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.867
Then patterns cover at least 128 MiB in the guest's memory 2.937

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.017
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.812

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

After features/support/hooks.rb:305 3.508
After features/support/hooks.rb:89 0.000
8:1.547
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:16.317
And I prepare Tails for memory erasure tests 0.395
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.597
When I trigger shutdown 0.011
And I wait 20 seconds 20.007

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.217

Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)

After features/support/hooks.rb:305 3.481
After features/support/hooks.rb:89 0.010
4:47.687
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.422
And I update APT using apt 18.213
And I install "popularity-contest" using apt 22.241
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.240
When I create a persistent storage and activate the Additional Software feature 20.922
Then Additional Software is correctly configured for package "popularity-contest" 1.146
When I shutdown Tails and wait for the computer to power off 10.702
And I start Tails from USB drive "__internal" with network unplugged 59.578
And I enable persistence 22.375
And I log in to a new session 38.211
And the Additional Software installation service has started 30.997
Then I am notified that the installation succeeded 1.584
And Additional Software is correctly configured for package "popularity-contest" 0.806
And the package "popularity-contest" is installed after Additional Software has been started 0.243
After features/support/hooks.rb:464 38.012
After features/support/hooks.rb:305 1.191
After features/support/hooks.rb:89 0.014
2:29.458
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.197
And I start Tails from USB drive "__internal" and I login with an administration password 1:43.463
And I update APT using apt 16.815
When I install "makepp" using apt 22.423
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.470
And the package "makepp" is installed 0.086
After features/support/hooks.rb:464 39.536
After features/support/hooks.rb:305 0.990
After features/support/hooks.rb:89 0.015
5:37.940
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.007
Given a computer 0.197
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:42.621
When I uninstall "popularity-contest" using apt 21.864
And I accept removing "popularity-contest" from Additional Software 0.643
Then "popularity-contest" is not in the list of Additional Software 0.796
When I start Synaptic 28.640
And I update APT using Synaptic 22.686
And I install "cowsay" using Synaptic 11.509
And I accept adding "cowsay" to Additional Software 0.948
Then Additional Software is correctly configured for package "cowsay" 0.945
When I uninstall "cowsay" using apt 3.336
And I refuse removing "cowsay" from Additional Software 0.673
Then Additional Software is correctly configured for package "cowsay" 0.864
When I start "Additional Software" via GNOME Activities Overview 10.816
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.765
Then "cowsay" is not in the list of Additional Software 0.949
When I install "cowsay" using apt 3.198
And I refuse adding "cowsay" to Additional Software 0.745
Then "cowsay" is not in the list of Additional Software 0.736
After features/support/hooks.rb:464 1.103
After features/support/hooks.rb:305 0.694
After features/support/hooks.rb:89 0.010
11:51.397
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.007
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:27.649
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.598
And I accept adding "cowsay" to Additional Software 7.530
And Additional Software is correctly configured for package "cowsay" 0.800
And I shutdown Tails and wait for the computer to power off 6.302
And I start Tails from USB drive "__internal" with network unplugged 1:6.337
And I enable persistence 13.568
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 35.782
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.886
And I revert the APT tweaks that made it prefer an old version of cowsay 0.046
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.063
And the network is plugged 0.045
And Tor is ready 20.401
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.145
And available upgrades have been checked 0.056
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.147
And I can open the Additional Software configuration window from the notification 2.843
And I shutdown Tails and wait for the computer to power off 2:7.665
And I start Tails from USB drive "__internal" with network unplugged 1:0.322
And I enable persistence 13.166
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 36.936
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.592
And I revert the APT tweaks that made it prefer an old version of cowsay 0.079
And the network is plugged 0.036
And Tor is ready 50.873
Then the Additional Software upgrade service has started 0.171
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.091
After features/support/hooks.rb:464 2.370
After features/support/hooks.rb:305 1.256
After features/support/hooks.rb:89 0.025
2:10.981
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.187
And I start Tails from USB drive "__internal" with network unplugged 59.419
And I enable persistence 12.736
And I remove the "cowsay" deb files from the APT cache 0.639
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.074
And I log in to a new session 37.011
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.932
And I can open the Additional Software log file from the notification 5.321
And the package "cowsay" is not installed 0.659
After features/support/hooks.rb:464 0.124
After features/support/hooks.rb:305 0.959
After features/support/hooks.rb:89 0.010
Feature: Localization
3:25.520
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.008
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.037
When I log in to a new session in Arabic (ar) 3:17.482
cannot find GnomeApplicationsMenuArabic.png on the screen (FindFailed)
./features/support/helpers/screen.rb:173:in `rescue in wait'
./features/support/helpers/screen.rb:157:in `wait'
./features/step_definitions/common_steps.rb:558:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:514:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:44:in `When I log in to a new session in Arabic (ar)'
features/localization.feature:23:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "us" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "ar" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.612

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#1)' (at time 02:23:23)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4856/artifact/build-artifacts/02:23:23_Tails_is_localized_for_every_tier-1_language,_Examples___1_.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4856/artifact/build-artifacts/02:23:23_Tails_is_localized_for_every_tier-1_language,_Examples___1_.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4856/artifact/build-artifacts/02:23:23_Tails_is_localized_for_every_tier-1_language,_Examples___1_.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4856/artifact/build-artifacts/02:23:23_Tails_is_localized_for_every_tier-1_language,_Examples___1_.journal

After features/support/hooks.rb:89 0.000
Feature: Localization
2:39.028
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.976
When I log in to a new session in Chinese (zh_CN) 37.968
Then the keyboard layout is set to "cn" 0.334
When the network is plugged 0.034
And Tor is ready 17.611
Then I successfully start the Unsafe Browser in "zh_CN" 18.352
And I kill the Unsafe Browser 5.758
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 28.300
And DuckDuckGo is the default search engine 18.618
And I kill the Tor Browser 5.500
And the screen keyboard works in Thunderbird 17.789
And the layout of the screen keyboard is set to "us" 0.653
After features/support/hooks.rb:305 1.346
After features/support/hooks.rb:89 0.000
Feature: Localization
2:2.142
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.762
When I log in to a new session in English (en) 18.730
Then the keyboard layout is set to "us" 0.333
When the network is plugged 0.114
And Tor is ready 16.333
Then I successfully start the Unsafe Browser in "en" 15.341
And I kill the Unsafe Browser 5.804
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 30.027
And DuckDuckGo is the default search engine 7.591
And I kill the Tor Browser 5.290
And the screen keyboard works in Thunderbird 13.100
And the layout of the screen keyboard is set to "us" 0.589
After features/support/hooks.rb:305 1.443
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.330
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.118
When I log in to a new session in French (fr) 33.375
Then the keyboard layout is set to "fr" 0.359
When the network is plugged 0.189
And Tor is ready 19.384
Then I successfully start the Unsafe Browser in "fr" 15.040
And I kill the Unsafe Browser 5.954
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 30.268
And DuckDuckGo is the default search engine 10.776
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 12.695
And the layout of the screen keyboard is set to "fr" 0.553
After features/support/hooks.rb:305 1.187
After features/support/hooks.rb:89 0.000
Feature: Localization
2:31.428
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.105
When I log in to a new session in German (de) 32.716
Then the keyboard layout is set to "de" 0.201
When the network is plugged 0.039
And Tor is ready 19.124
Then I successfully start the Unsafe Browser in "de" 16.481
And I kill the Unsafe Browser 5.957
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 31.051
And DuckDuckGo is the default search engine 18.109
And I kill the Tor Browser 5.527
And the screen keyboard works in Thunderbird 13.391
And the layout of the screen keyboard is set to "de" 0.600
After features/support/hooks.rb:305 1.143
After features/support/hooks.rb:89 0.000
Feature: Localization
2:24.432
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.051
When I log in to a new session in Italian (it) 33.875
Then the keyboard layout is set to "it" 0.404
When the network is plugged 0.032
And Tor is ready 18.091
Then I successfully start the Unsafe Browser in "it" 15.626
And I kill the Unsafe Browser 5.845
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 30.355
And DuckDuckGo is the default search engine 11.057
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 14.912
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:305 1.059
After features/support/hooks.rb:89 0.000
Feature: Localization
2:21.438
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.033
When I log in to a new session in Persian (fa) 32.230
Then the keyboard layout is set to "ir" 0.178
When the network is plugged 0.031
And Tor is ready 16.647
Then I successfully start the Unsafe Browser in "fa" 17.000
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 31.285
And DuckDuckGo is the default search engine 11.118
And I kill the Tor Browser 5.420
And the screen keyboard works in Thunderbird 12.947
And the layout of the screen keyboard is set to "ir" 0.533
After features/support/hooks.rb:305 2.704
After features/support/hooks.rb:89 0.000
Feature: Localization
2:24.456
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.148
When I log in to a new session in Portuguese (pt) 32.123
Then the keyboard layout is set to "pt" 0.126
When the network is plugged 0.035
And Tor is ready 23.343
Then I successfully start the Unsafe Browser in "pt" 16.917
And I kill the Unsafe Browser 5.777
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 27.007
And DuckDuckGo is the default search engine 11.517
And I kill the Tor Browser 5.514
And the screen keyboard works in Thunderbird 13.243
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:305 1.084
After features/support/hooks.rb:89 0.000
Feature: Localization
2:25.293
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.183
When I log in to a new session in Russian (ru) 32.364
Then the keyboard layout is set to "ru" 0.346
When the network is plugged 0.400
And Tor is ready 21.165
Then I successfully start the Unsafe Browser in "ru" 15.439
And I kill the Unsafe Browser 5.899
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 30.162
And DuckDuckGo is the default search engine 11.068
And I kill the Tor Browser 5.538
And the screen keyboard works in Thunderbird 14.006
And the layout of the screen keyboard is set to "ru" 0.587
After features/support/hooks.rb:305 1.018
After features/support/hooks.rb:89 0.000
Feature: Localization
2:28.922
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.023
When I log in to a new session in Spanish (es) 33.019
Then the keyboard layout is set to "es" 0.214
When the network is plugged 0.048
And Tor is ready 17.434
Then I successfully start the Unsafe Browser in "es" 16.695
And I kill the Unsafe Browser 5.913
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 30.056
And DuckDuckGo is the default search engine 18.499
And I kill the Tor Browser 5.476
And the screen keyboard works in Thunderbird 12.848
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:305 1.288
After features/support/hooks.rb:89 0.000
Feature: Localization
2:28.254
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.173
When I log in to a new session in Turkish (tr) 33.318
Then the keyboard layout is set to "tr" 0.156
When the network is plugged 0.046
And Tor is ready 24.934
Then I successfully start the Unsafe Browser in "tr" 15.615
And I kill the Unsafe Browser 5.948
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 30.196
And DuckDuckGo is the default search engine 10.508
And I kill the Tor Browser 5.499
And the screen keyboard works in Thunderbird 13.102
And the layout of the screen keyboard is set to "us" 0.638
After features/support/hooks.rb:305 2.394
After features/support/hooks.rb:89 0.000