Project Number Date
test_Tails_ISO_stable 4578 20 Dec 2023, 12:14

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 266 1 4 0 0 271 21 1 22 1:11:17.673 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.040
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.633
And I prepare Tails for memory erasure tests 0.613
When I start a process allocating 128 MiB of memory with a known pattern 2.292
Then patterns cover at least 128 MiB in the guest's memory 3.406 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.470
Then I find very few patterns in the guest's memory 3.624 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
After features/support/hooks.rb:291 0.810
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.411
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.299
And I prepare Tails for memory erasure tests 0.435
And I find very few patterns in the guest's memory 3.408 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.903
Then patterns cover at least 99% of the test FS size in the guest's memory 3.239 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.607
Then I find very few patterns in the guest's memory 4.517 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 1.037
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:21.372
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.071
And I prepare Tails for memory erasure tests 0.467
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.000
Then I find very few patterns in the guest's memory 4.248 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:44.944
Then patterns cover at least 86% of the test FS size in the guest's memory 2.716 
Pattern coverage: 94.507% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.797
Then I find very few patterns in the guest's memory 3.652 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
# read cache
When I mount the USB drive again 0.179
And I read the content of the test FS 0.553
Then patterns cover at least 99% of the test FS size in the guest's memory 2.912 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.311
Then I find very few patterns in the guest's memory 4.517 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 0.711
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:0.786
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.984
And I prepare Tails for memory erasure tests 0.557
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 21.451
Then I find very few patterns in the guest's memory 4.164 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:7.087
Then patterns cover at least 99% of the test FS size in the guest's memory 2.787 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 2.945
Then I find very few patterns in the guest's memory 3.313 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
# read cache
When I mount the USB drive again 3.264
And I read the content of the test FS 0.431
Then patterns cover at least 99% of the test FS size in the guest's memory 3.095 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.438
Then I find very few patterns in the guest's memory 3.265 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
After features/support/hooks.rb:291 0.766
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.664
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.945
And I prepare Tails for memory erasure tests 0.542
When I fill a 128 MiB file with a known pattern on the root filesystem 15.053
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.094
Then patterns cover at least 128 MiB in the guest's memory 2.750 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.510
And I wait 20 seconds 20.014 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.753 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
After features/support/hooks.rb:291 3.440
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:50.433
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:4.658
And I prepare Tails for memory erasure tests 0.450
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.846
When I trigger shutdown 0.373
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.084 
Pattern coverage: 0.000% (0 MiB out of 1180 MiB reference memory)
After features/support/hooks.rb:291 3.464
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:33.663
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.944
And I update APT using apt 16.139
And I install "popularity-contest" using apt 19.869
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.731
When I create a persistent storage and activate the Additional Software feature 17.219
Then Additional Software is correctly configured for package "popularity-contest" 1.332
When I shutdown Tails and wait for the computer to power off 10.073
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:34.177
Then Additional Software is correctly configured for package "popularity-contest" 0.896
And the package "popularity-contest" is installed after Additional Software has been started 0.278
After features/support/hooks.rb:450 36.333
After features/support/hooks.rb:291 1.402
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:8.166
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.247
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.510
And I update APT using apt 16.669
When I install "makepp" using apt 23.178
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:6.471
And the package "makepp" is installed 0.088
After features/support/hooks.rb:450 40.422
After features/support/hooks.rb:291 0.930
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:54.481
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.009
Given a computer 0.243
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.247
When I uninstall "popularity-contest" using apt 15.872
And I accept removing "popularity-contest" from Additional Software 1.928
Then "popularity-contest" is not in the list of Additional Software 0.845
When I start Synaptic 23.392
And I update APT using Synaptic 21.809
And I install "cowsay" using Synaptic 7.917
And I accept adding "cowsay" to Additional Software 0.932
Then Additional Software is correctly configured for package "cowsay" 1.019
When I uninstall "cowsay" using apt 3.314
And I refuse removing "cowsay" from Additional Software 0.738
Then Additional Software is correctly configured for package "cowsay" 0.991
When I start "Additional Software" via GNOME Activities Overview 12.612
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.580
Then "cowsay" is not in the list of Additional Software 1.199
When I install "cowsay" using apt 3.342
And I refuse adding "cowsay" to Additional Software 0.709
Then "cowsay" is not in the list of Additional Software 0.784
After features/support/hooks.rb:450 1.038
After features/support/hooks.rb:291 0.725
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:10.052
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.005
Given a computer 0.174
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:6.238
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.482
And I accept adding "cowsay" to Additional Software 1:9.112
And Additional Software is correctly configured for package "cowsay" 1.761
And I shutdown Tails and wait for the computer to power off 8.126
And I start Tails from USB drive "__internal" with network unplugged 47.086
And I enable persistence 32.664
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 29.215
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.775
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.112
And the network is plugged 0.045
And Tor is ready 20.906
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.818
And available upgrades have been checked 0.172
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.580
And I can open the Additional Software configuration window from the notification 3.119
And I shutdown Tails and wait for the computer to power off 2:3.687
And I start Tails from USB drive "__internal" with network unplugged 47.544
And I enable persistence 31.741
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 21.826
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.720
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.043
And Tor is ready 49.551
Then the Additional Software upgrade service has started 0.235
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.091
After features/support/hooks.rb:450 2.443
After features/support/hooks.rb:291 0.803
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:52.070
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.203
And I start Tails from USB drive "__internal" with network unplugged 48.743
And I enable persistence 32.136
And I remove the "cowsay" deb files from the APT cache 0.628
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.101
And I log in to a new session 22.291
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.258
And I can open the Additional Software log file from the notification 2.575
And the package "cowsay" is not installed 0.132
After features/support/hooks.rb:450 0.134
After features/support/hooks.rb:291 0.745
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:13.376
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.699
When I log in to a new session in Arabic (ar) 32.152
Then the keyboard layout is set to "us" 0.398
When the network is plugged 0.051
And Tor is ready 45.038
Then I successfully start the Unsafe Browser in "ar" 29.097
And I kill the Unsafe Browser 6.129
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.202
And DuckDuckGo is the default search engine 9.675
And I kill the Tor Browser 5.359
And the screen keyboard works in Thunderbird 21.829
And the layout of the screen keyboard is set to "us" 0.610
After features/support/hooks.rb:291 1.300
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.654
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.000
When I log in to a new session in Chinese (zh_CN) 29.142
Then the keyboard layout is set to "cn" 0.231
When the network is plugged 0.043
And Tor is ready 14.199
Then I successfully start the Unsafe Browser in "zh_CN" 27.896
And I kill the Unsafe Browser 6.501
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 34.088
And DuckDuckGo is the default search engine 9.088
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 23.260
And the layout of the screen keyboard is set to "us" 0.712
After features/support/hooks.rb:291 1.636
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.633
Before features/support/hooks.rb:245 0.016
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.013
When I log in to a new session in English (en) 17.146
Then the keyboard layout is set to "us" 0.115
When the network is plugged 0.047
And Tor is ready 15.358
Then I successfully start the Unsafe Browser in "en" 26.858
And I kill the Unsafe Browser 5.990
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.507
And DuckDuckGo is the default search engine 5.520
And I kill the Tor Browser 5.375
And the screen keyboard works in Thunderbird 22.005
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 1.971
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.801
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.759
When I log in to a new session in French (fr) 30.792
Then the keyboard layout is set to "fr" 0.283
When the network is plugged 0.052
And Tor is ready 14.777
Then I successfully start the Unsafe Browser in "fr" 27.269
And I kill the Unsafe Browser 6.370
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 33.817
And DuckDuckGo is the default search engine 9.421
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 22.077
And the layout of the screen keyboard is set to "fr" 0.706
After features/support/hooks.rb:291 2.470
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.579
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.463
When I log in to a new session in German (de) 29.579
Then the keyboard layout is set to "de" 0.238
When the network is plugged 0.041
And Tor is ready 14.884
Then I successfully start the Unsafe Browser in "de" 26.471
And I kill the Unsafe Browser 6.320
When I enable the screen keyboard 0.408
Then the screen keyboard works in Tor Browser 34.304
And DuckDuckGo is the default search engine 9.893
And I kill the Tor Browser 5.325
And the screen keyboard works in Thunderbird 21.016
And the layout of the screen keyboard is set to "de" 0.630
After features/support/hooks.rb:291 2.538
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.991
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.741
When I log in to a new session in Italian (it) 29.149
Then the keyboard layout is set to "it" 0.236
When the network is plugged 0.183
And Tor is ready 15.391
Then I successfully start the Unsafe Browser in "it" 28.847
And I kill the Unsafe Browser 5.883
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 35.171
And DuckDuckGo is the default search engine 9.938
And I kill the Tor Browser 5.401
And the screen keyboard works in Thunderbird 22.328
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.480
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:44.807
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.008
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.441
When I log in to a new session in Persian (fa) 33.252
Then the keyboard layout is set to "ir" 0.192
When the network is plugged 0.042
And Tor is ready 16.401
Then I successfully start the Unsafe Browser in "fa" 28.831
And I kill the Unsafe Browser 6.389
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 10.105
cannot 
cannot find GnomeApplicationsMenuPersian.png on the screen (FindFailed)
./features/support/helpers/screen.rb:166:in `rescue in wait'
./features/support/helpers/screen.rb:159:in `wait'
./features/step_definitions/common_steps.rb:926:in `/^I start "([^"]+)" via GNOME Activities Overview$/'
./features/step_definitions/browser.rb:447:in `/^I start the Tor Browser( in offline mode)?$/'
./features/step_definitions/browser.rb:413:in `/^the screen keyboard works in Tor Browser$/'
features/localization.feature:47:in `Then the screen keyboard works in Tor Browser'
features/localization.feature:24:in `Then the screen keyboard works in Tor Browser'
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "ir" 0.000
After features/support/hooks.rb:291 4.141 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#7)' (at time 02:28:04)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4578/artifact/build-artifacts/02:28:04_Tails_is_localized_for_every_tier-1_language,_Examples___7_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4578/artifact/build-artifacts/02:28:04_Tails_is_localized_for_every_tier-1_language,_Examples___7_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4578/artifact/build-artifacts/02:28:04_Tails_is_localized_for_every_tier-1_language,_Examples___7_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4578/artifact/build-artifacts/02:28:04_Tails_is_localized_for_every_tier-1_language,_Examples___7_.journal
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.025
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.637
When I log in to a new session in Portuguese (pt) 32.190
Then the keyboard layout is set to "pt" 0.282
When the network is plugged 0.051
And Tor is ready 15.544
Then I successfully start the Unsafe Browser in "pt" 26.631
And I kill the Unsafe Browser 6.086
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 33.698
And DuckDuckGo is the default search engine 9.437
And I kill the Tor Browser 5.389
And the screen keyboard works in Thunderbird 22.177
And the layout of the screen keyboard is set to "us" 0.746
After features/support/hooks.rb:291 2.022
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:17.222
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.396
When I log in to a new session in Russian (ru) 32.429
Then the keyboard layout is set to "ru" 0.220
When the network is plugged 0.064
And Tor is ready 44.348
Then I successfully start the Unsafe Browser in "ru" 29.972
And I kill the Unsafe Browser 6.472
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 33.926
And DuckDuckGo is the default search engine 9.879
And I kill the Tor Browser 5.325
And the screen keyboard works in Thunderbird 24.389
And the layout of the screen keyboard is set to "ru" 0.660
After features/support/hooks.rb:291 1.022
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.216
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.746
When I log in to a new session in Spanish (es) 31.967
Then the keyboard layout is set to "es" 0.167
When the network is plugged 0.034
And Tor is ready 17.235
Then I successfully start the Unsafe Browser in "es" 26.995
And I kill the Unsafe Browser 6.180
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 32.719
And DuckDuckGo is the default search engine 9.018
And I kill the Tor Browser 5.296
And the screen keyboard works in Thunderbird 23.099
And the layout of the screen keyboard is set to "us" 0.640
After features/support/hooks.rb:291 1.134
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.221
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.346
When I log in to a new session in Turkish (tr) 32.353
Then the keyboard layout is set to "tr" 0.233
When the network is plugged 0.034
And Tor is ready 15.942
Then I successfully start the Unsafe Browser in "tr" 28.111
And I kill the Unsafe Browser 5.936
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.526
And DuckDuckGo is the default search engine 9.243
And I kill the Tor Browser 5.280
And the screen keyboard works in Thunderbird 20.488
And the layout of the screen keyboard is set to "us" 0.594
After features/support/hooks.rb:291 1.156
After features/support/hooks.rb:75 0.000