Project Number Date
test_Tails_ISO_stable 4520 21 Nov 2023, 20:05

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 267 1 3 0 0 271 21 1 22 1:13:15.348 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.467
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.276
And I prepare Tails for memory erasure tests 0.656
When I start a process allocating 128 MiB of memory with a known pattern 2.341
Then patterns cover at least 128 MiB in the guest's memory 3.649 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.267
Then I find very few patterns in the guest's memory 4.275 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:290 0.962
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:9.892
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.530
And I prepare Tails for memory erasure tests 0.720
And I find very few patterns in the guest's memory 4.984 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 46.472
Then patterns cover at least 99% of the test FS size in the guest's memory 4.174 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.236
Then I find very few patterns in the guest's memory 4.773 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:290 1.079
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:16.977
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.252
And I prepare Tails for memory erasure tests 0.497
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.026
Then I find very few patterns in the guest's memory 4.102 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:34.923
Then patterns cover at least 86% of the test FS size in the guest's memory 3.538 
Pattern coverage: 94.500% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.579
Then I find very few patterns in the guest's memory 4.127 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
# read cache
When I mount the USB drive again 0.294
And I read the content of the test FS 0.695
Then patterns cover at least 99% of the test FS size in the guest's memory 4.784 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.291
Then I find very few patterns in the guest's memory 5.864 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
After features/support/hooks.rb:290 1.131
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:41.905
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.030
And I prepare Tails for memory erasure tests 0.529
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.488
Then I find very few patterns in the guest's memory 4.111 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:46.608
Then patterns cover at least 99% of the test FS size in the guest's memory 2.580 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.939
Then I find very few patterns in the guest's memory 3.655 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# read cache
When I mount the USB drive again 3.728
And I read the content of the test FS 0.453
Then patterns cover at least 99% of the test FS size in the guest's memory 2.693 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.560
Then I find very few patterns in the guest's memory 3.522 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:290 0.705
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.909
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.176
And I prepare Tails for memory erasure tests 0.667
When I fill a 128 MiB file with a known pattern on the root filesystem 13.317
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.594
Then patterns cover at least 128 MiB in the guest's memory 2.749 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.463
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.920 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:290 3.525
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:15.075
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:28.350
And I prepare Tails for memory erasure tests 0.495
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.494
When I trigger shutdown 0.396
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.319 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
After features/support/hooks.rb:290 3.503
After features/support/hooks.rb:75 0.042
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:44.744
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:438 0.010
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 47.183
And I update APT using apt 17.837
And I install "popularity-contest" using apt 19.737
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.274
When I create a persistent storage and activate the Additional Software feature 16.709
Then Additional Software is correctly configured for package "popularity-contest" 1.764
When I shutdown Tails and wait for the computer to power off 10.099
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:50.944
Then Additional Software is correctly configured for package "popularity-contest" 0.909
And the package "popularity-contest" is installed after Additional Software has been started 0.283
After features/support/hooks.rb:446 36.356
After features/support/hooks.rb:290 1.511
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:0.189
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.006
Given a computer 0.216
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.913
And I update APT using apt 16.479
When I install "makepp" using apt 19.828
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:3.661
And the package "makepp" is installed 0.089
After features/support/hooks.rb:446 35.483
After features/support/hooks.rb:290 0.899
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:3.345
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.007
Given a computer 0.203
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:17.628
When I uninstall "popularity-contest" using apt 19.074
And I accept removing "popularity-contest" from Additional Software 0.781
Then "popularity-contest" is not in the list of Additional Software 1.026
When I start Synaptic 21.455
And I update APT using Synaptic 21.894
And I install "cowsay" using Synaptic 9.314
And I accept adding "cowsay" to Additional Software 0.922
Then Additional Software is correctly configured for package "cowsay" 0.844
When I uninstall "cowsay" using apt 3.426
And I refuse removing "cowsay" from Additional Software 0.693
Then Additional Software is correctly configured for package "cowsay" 1.060
When I start "Additional Software" via GNOME Activities Overview 12.597
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.151
Then "cowsay" is not in the list of Additional Software 1.214
When I install "cowsay" using apt 3.276
And I refuse adding "cowsay" to Additional Software 0.735
Then "cowsay" is not in the list of Additional Software 1.043
After features/support/hooks.rb:446 1.137
After features/support/hooks.rb:290 0.879
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:37.592
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.006
Given a computer 0.232
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:4.057
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.644
And I accept adding "cowsay" to Additional Software 1:6.537
And Additional Software is correctly configured for package "cowsay" 1.373
And I shutdown Tails and wait for the computer to power off 5.074
And I start Tails from USB drive "__internal" with network unplugged 46.700
And I enable persistence 34.061
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 30.706
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.628
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.112
And the network is plugged 0.055
And Tor is ready 19.705
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.611
And available upgrades have been checked 0.176
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.927
And I can open the Additional Software configuration window from the notification 3.021
And I shutdown Tails and wait for the computer to power off 2:3.752
And I start Tails from USB drive "__internal" with network unplugged 53.609
And I enable persistence 32.223
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 30.138
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.788
And I revert the APT tweaks that made it prefer an old version of cowsay 0.050
And the network is plugged 0.049
And Tor is ready 48.927
Then the Additional Software upgrade service has started 0.193
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.100
After features/support/hooks.rb:446 2.373
After features/support/hooks.rb:290 0.879
After features/support/hooks.rb:75 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.575
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:438 0.005
Given a computer 0.206
And I start Tails from USB drive "__internal" with network unplugged 45.518
And I enable persistence 35.123
And I remove the "cowsay" deb files from the APT cache 0.659
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.078
And I log in to a new session 28.241
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.296
And I can open the Additional Software log file from the notification 2.287
And the package "cowsay" is not installed 0.162
After features/support/hooks.rb:446 0.111
After features/support/hooks.rb:290 1.245
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.479
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.135
When I log in to a new session in Arabic (ar) 29.177
Then the keyboard layout is set to "us" 0.175
When the network is plugged 0.040
And Tor is ready 18.111
Then I successfully start the Unsafe Browser in "ar" 28.997
And I kill the Unsafe Browser 6.028
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 34.491
And DuckDuckGo is the default search engine 5.020
And I kill the Tor Browser 5.311
And the screen keyboard works in Thunderbird 22.223
And the layout of the screen keyboard is set to "us" 0.594
After features/support/hooks.rb:290 1.119
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:59.678
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 26.435
When I log in to a new session in Chinese (zh_CN) 30.327
Then the keyboard layout is set to "cn" 0.128
When the network is plugged 0.047
And Tor is ready 15.539
Then I successfully start the Unsafe Browser in "zh_CN" 27.985
And I kill the Unsafe Browser 5.955
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 33.853
And DuckDuckGo is the default search engine 4.983
And I kill the Tor Browser 5.393
And the screen keyboard works in Thunderbird 28.280
And the layout of the screen keyboard is set to "us" 0.598
After features/support/hooks.rb:290 1.407
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.815
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.017
When I log in to a new session in English (en) 16.799
Then the keyboard layout is set to "us" 0.172
When the network is plugged 0.037
And Tor is ready 16.688
Then I successfully start the Unsafe Browser in "en" 26.452
And I kill the Unsafe Browser 6.903
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 32.451
And DuckDuckGo is the default search engine 4.907
And I kill the Tor Browser 5.389
And the screen keyboard works in Thunderbird 23.304
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:290 2.372
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.865
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.515
When I log in to a new session in French (fr) 28.860
Then the keyboard layout is set to "fr" 0.207
When the network is plugged 0.051
And Tor is ready 15.327
Then I successfully start the Unsafe Browser in "fr" 27.823
And I kill the Unsafe Browser 6.017
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 34.558
And DuckDuckGo is the default search engine 5.061
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 24.388
And the layout of the screen keyboard is set to "fr" 0.606
After features/support/hooks.rb:290 1.142
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.853
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.005
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.237
When I log in to a new session in German (de) 29.129
Then the keyboard layout is set to "de" 0.180
When the network is plugged 0.042
And Tor is ready 14.525
Then I successfully start the Unsafe Browser in "de" 29.136
And I kill the Unsafe Browser 6.706
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 33.272
And DuckDuckGo is the default search engine 24.475
cannot 
cannot find DuckDuckGoSearchPrompt.png on the screen (FindFailed)
./features/support/helpers/screen.rb:165:in `rescue in wait'
./features/support/helpers/screen.rb:158:in `wait'
./features/step_definitions/browser.rb:362:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:42:in `And DuckDuckGo is the default search engine'
features/localization.feature:25:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "de" 0.000
After features/support/hooks.rb:290 4.829 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#5)' (at time 02:25:18)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4520/artifact/build-artifacts/02:25:18_Tails_is_localized_for_every_tier-1_language,_Examples___5_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4520/artifact/build-artifacts/02:25:18_Tails_is_localized_for_every_tier-1_language,_Examples___5_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4520/artifact/build-artifacts/02:25:18_Tails_is_localized_for_every_tier-1_language,_Examples___5_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4520/artifact/build-artifacts/02:25:18_Tails_is_localized_for_every_tier-1_language,_Examples___5_.journal
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.517
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.576
When I log in to a new session in Italian (it) 29.149
Then the keyboard layout is set to "it" 0.287
When the network is plugged 0.105
And Tor is ready 17.451
Then I successfully start the Unsafe Browser in "it" 27.478
And I kill the Unsafe Browser 5.919
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 33.031
And DuckDuckGo is the default search engine 4.939
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 24.515
And the layout of the screen keyboard is set to "us" 0.596
After features/support/hooks.rb:290 3.223
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:9.215
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.819
When I log in to a new session in Persian (fa) 30.475
Then the keyboard layout is set to "ir" 0.155
When the network is plugged 0.058
And Tor is ready 15.300
Then I successfully start the Unsafe Browser in "fa" 27.757
And I kill the Unsafe Browser 6.379
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 1:4.526
And DuckDuckGo is the default search engine 5.105
And I kill the Tor Browser 5.374
And the screen keyboard works in Thunderbird 24.527
And the layout of the screen keyboard is set to "ir" 0.592
After features/support/hooks.rb:290 1.352
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.187
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.904
When I log in to a new session in Portuguese (pt) 29.215
Then the keyboard layout is set to "pt" 0.222
When the network is plugged 0.037
And Tor is ready 16.717
Then I successfully start the Unsafe Browser in "pt" 27.547
And I kill the Unsafe Browser 5.934
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 34.151
And DuckDuckGo is the default search engine 4.896
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 22.506
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:290 1.437
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.813
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.236
When I log in to a new session in Russian (ru) 32.111
Then the keyboard layout is set to "ru" 0.140
When the network is plugged 0.048
And Tor is ready 15.206
Then I successfully start the Unsafe Browser in "ru" 27.998
And I kill the Unsafe Browser 5.901
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.586
And DuckDuckGo is the default search engine 4.775
And I kill the Tor Browser 5.321
And the screen keyboard works in Thunderbird 25.787
And the layout of the screen keyboard is set to "ru" 0.581
After features/support/hooks.rb:290 1.031
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.247
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.918
When I log in to a new session in Spanish (es) 31.011
Then the keyboard layout is set to "es" 0.204
When the network is plugged 0.098
And Tor is ready 45.612
Then I successfully start the Unsafe Browser in "es" 28.732
And I kill the Unsafe Browser 6.001
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 33.587
And DuckDuckGo is the default search engine 4.773
And I kill the Tor Browser 5.306
And the screen keyboard works in Thunderbird 20.236
And the layout of the screen keyboard is set to "us" 0.608
After features/support/hooks.rb:290 1.356
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.998
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.884
When I log in to a new session in Turkish (tr) 29.712
Then the keyboard layout is set to "tr" 0.156
When the network is plugged 0.036
And Tor is ready 45.131
Then I successfully start the Unsafe Browser in "tr" 28.289
And I kill the Unsafe Browser 6.019
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 34.456
And DuckDuckGo is the default search engine 5.217
And I kill the Tor Browser 5.376
And the screen keyboard works in Thunderbird 22.040
And the layout of the screen keyboard is set to "us" 0.566
After features/support/hooks.rb:290 3.920
After features/support/hooks.rb:75 0.000