Project Number Date
test_Tails_ISO_stable 4731 20 Mar 2024, 14:02

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 259 1 11 0 0 271 21 1 22 57:8.944 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.077
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.298
And I prepare Tails for memory erasure tests 0.515
When I start a process allocating 128 MiB of memory with a known pattern 1.215
Then patterns cover at least 128 MiB in the guest's memory 3.715 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.121
Then I find very few patterns in the guest's memory 4.211 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:291 1.622
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.789
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.365
And I prepare Tails for memory erasure tests 0.567
And I find very few patterns in the guest's memory 4.090 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.861
Then patterns cover at least 99% of the test FS size in the guest's memory 3.963 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.542
Then I find very few patterns in the guest's memory 4.397 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
After features/support/hooks.rb:291 1.333
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.507
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.651
And I prepare Tails for memory erasure tests 0.372
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.924
Then I find very few patterns in the guest's memory 3.865 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 5.687
Then patterns cover at least 86% of the test FS size in the guest's memory 3.942 
Pattern coverage: 89.285% (113 MiB out of 127 MiB reference memory)
When I umount the USB drive 2.353
Then I find very few patterns in the guest's memory 4.631 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# read cache
When I mount the USB drive again 0.205
And I read the content of the test FS 0.538
Then patterns cover at least 99% of the test FS size in the guest's memory 4.113 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.689
Then I find very few patterns in the guest's memory 4.531 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:291 1.309
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:10.187
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.314
And I prepare Tails for memory erasure tests 0.576
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.953
Then I find very few patterns in the guest's memory 4.128 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.449
Then patterns cover at least 99% of the test FS size in the guest's memory 3.379 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.677
Then I find very few patterns in the guest's memory 4.000 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# read cache
When I mount the USB drive again 6.874
And I read the content of the test FS 0.468
Then patterns cover at least 99% of the test FS size in the guest's memory 3.719 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.514
Then I find very few patterns in the guest's memory 4.128 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
After features/support/hooks.rb:291 0.771
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.206
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.495
And I prepare Tails for memory erasure tests 0.388
When I fill a 128 MiB file with a known pattern on the root filesystem 18.901
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.163
Then patterns cover at least 128 MiB in the guest's memory 3.338 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.886 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:291 3.558
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:36.344
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:51.285
And I prepare Tails for memory erasure tests 0.430
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.281
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.317 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:291 3.549
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:26.592
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:13.030
And I update APT using apt 16.992
And I install "popularity-contest" using apt 19.339
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.983
When I create a persistent storage and activate the Additional Software feature 35.667
Then Additional Software is correctly configured for package "popularity-contest" 2.008
When I shutdown Tails and wait for the computer to power off 11.052
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:38.446
Then Additional Software is correctly configured for package "popularity-contest" 0.820
And the package "popularity-contest" is installed after Additional Software has been started 0.250
After features/support/hooks.rb:450 41.038
After features/support/hooks.rb:291 1.106
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:53.826
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.311
And I start Tails from USB drive "__internal" and I login with an administration password 2:10.944
And I update APT using apt 16.506
When I install "makepp" using apt 19.448
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.532
And the package "makepp" is installed 0.082
After features/support/hooks.rb:450 40.574
After features/support/hooks.rb:291 0.950
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:56.327
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.203
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:8.750
When I uninstall "popularity-contest" using apt 18.721
And I accept removing "popularity-contest" from Additional Software 0.571
Then "popularity-contest" is not in the list of Additional Software 0.661
When I start Synaptic 23.561
And I update APT using Synaptic 23.037
And I install "cowsay" using Synaptic 11.460
And I accept adding "cowsay" to Additional Software 1.279
Then Additional Software is correctly configured for package "cowsay" 0.878
When I uninstall "cowsay" using apt 3.231
And I refuse removing "cowsay" from Additional Software 0.869
Then Additional Software is correctly configured for package "cowsay" 0.925
When I start "Additional Software" via GNOME Activities Overview 10.871
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.965
Then "cowsay" is not in the list of Additional Software 0.878
When I install "cowsay" using apt 3.205
And I refuse adding "cowsay" to Additional Software 0.562
Then "cowsay" is not in the list of Additional Software 0.692
After features/support/hooks.rb:450 1.110
After features/support/hooks.rb:291 0.693
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
8:55.199
Before features/support/hooks.rb:245 0.011
Before features/support/hooks.rb:442 0.005
Given a computer 0.197
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:12.027
And I configure APT to prefer an old version of cowsay 0.036
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 28.789
And I accept adding "cowsay" to Additional Software 4.476
And Additional Software is correctly configured for package "cowsay" 0.939
And I shutdown Tails and wait for the computer to power off 6.100
And I start Tails from USB drive "__internal" with network unplugged 56.389
And I enable persistence 10.294
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 33.530
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.197
And I revert the APT tweaks that made it prefer an old version of cowsay 0.048
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.053
And the network is plugged 0.047
And Tor is ready 19.196
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.538
And available upgrades have been checked 0.052
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.115
And I can open the Additional Software configuration window from the notification 3.259
And I shutdown Tails and wait for the computer to power off 18.058
And I start Tails from USB drive "__internal" with network unplugged 54.067
And I enable persistence 10.851
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 34.212
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.627
And I revert the APT tweaks that made it prefer an old version of cowsay 0.053
And the network is plugged 0.172
And Tor is ready 50.525
Then the Additional Software upgrade service has started 0.190
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.102
After features/support/hooks.rb:450 2.328
After features/support/hooks.rb:291 0.749
After features/support/hooks.rb:75 0.062
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:5.684
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.325
And I start Tails from USB drive "__internal" with network unplugged 55.292
And I enable persistence 14.648
And I remove the "cowsay" deb files from the APT cache 0.634
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.085
And I log in to a new session 34.930
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.499
And I can open the Additional Software log file from the notification 5.699
And the package "cowsay" is not installed 0.568
After features/support/hooks.rb:450 0.111
After features/support/hooks.rb:291 0.979
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:13.908
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.032
When I log in to a new session in Arabic (ar) 32.709
Then the keyboard layout is set to "us" 0.182
When the network is plugged 0.110
And Tor is ready 14.834
Then I successfully start the Unsafe Browser in "ar" 14.725
And I kill the Unsafe Browser 5.769
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 27.675
And DuckDuckGo is the default search engine 10.650
And I kill the Tor Browser 5.444
And the screen keyboard works in Thunderbird 13.098
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.102
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.797
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.065
When I log in to a new session in Chinese (zh_CN) 31.651
Then the keyboard layout is set to "cn" 0.245
When the network is plugged 0.040
And Tor is ready 43.958
Then I successfully start the Unsafe Browser in "zh_CN" 14.773
And I kill the Unsafe Browser 5.730
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 25.778
And DuckDuckGo is the default search engine 11.044
And I kill the Tor Browser 5.436
And the screen keyboard works in Thunderbird 17.374
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:291 2.002
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:50.230
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.988
When I log in to a new session in English (en) 15.314
Then the keyboard layout is set to "us" 0.198
When the network is plugged 0.050
And Tor is ready 15.697
Then I successfully start the Unsafe Browser in "en" 14.576
And I kill the Unsafe Browser 5.584
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 26.227
And DuckDuckGo is the default search engine 5.704
And I kill the Tor Browser 5.288
And the screen keyboard works in Thunderbird 12.901
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.159
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.181
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.095
When I log in to a new session in French (fr) 29.934
Then the keyboard layout is set to "fr" 0.225
When the network is plugged 0.034
And Tor is ready 16.608
Then I successfully start the Unsafe Browser in "fr" 13.968
And I kill the Unsafe Browser 5.646
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 26.829
And DuckDuckGo is the default search engine 11.138
And I kill the Tor Browser 5.556
And the screen keyboard works in Thunderbird 13.420
And the layout of the screen keyboard is set to "fr" 0.605
After features/support/hooks.rb:291 1.249
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.106
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.308
When I log in to a new session in German (de) 33.423
Then the keyboard layout is set to "de" 0.321
When the network is plugged 0.037
And Tor is ready 15.276
Then I successfully start the Unsafe Browser in "de" 14.901
And I kill the Unsafe Browser 5.718
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 29.049
And DuckDuckGo is the default search engine 11.083
And I kill the Tor Browser 5.582
And the screen keyboard works in Thunderbird 11.711
And the layout of the screen keyboard is set to "de" 0.588
After features/support/hooks.rb:291 2.000
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.584
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.148
When I log in to a new session in Italian (it) 30.655
Then the keyboard layout is set to "it" 0.153
When the network is plugged 0.099
And Tor is ready 15.442
Then I successfully start the Unsafe Browser in "it" 14.702
And I kill the Unsafe Browser 5.740
When I enable the screen keyboard 0.080
Then the screen keyboard works in Tor Browser 26.301
And DuckDuckGo is the default search engine 10.782
And I kill the Tor Browser 5.497
And the screen keyboard works in Thunderbird 11.403
And the layout of the screen keyboard is set to "us" 0.576
After features/support/hooks.rb:291 1.242
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.887
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.002
When I log in to a new session in Persian (fa) 30.251
Then the keyboard layout is set to "ir" 0.121
When the network is plugged 0.043
And Tor is ready 14.207
Then I successfully start the Unsafe Browser in "fa" 15.336
And I kill the Unsafe Browser 5.664
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 27.207
And DuckDuckGo is the default search engine 19.065
And I kill the Tor Browser 5.612
And the screen keyboard works in Thunderbird 12.740
And the layout of the screen keyboard is set to "ir" 0.537
After features/support/hooks.rb:291 1.007
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.884
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.982
When I log in to a new session in Portuguese (pt) 30.539
Then the keyboard layout is set to "pt" 0.245
When the network is plugged 0.035
And Tor is ready 17.923
Then I successfully start the Unsafe Browser in "pt" 15.017
And I kill the Unsafe Browser 5.821
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 26.133
And DuckDuckGo is the default search engine 10.128
And I kill the Tor Browser 5.577
And the screen keyboard works in Thunderbird 10.806
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 4.058
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.276
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.064
When I log in to a new session in Russian (ru) 33.009
Then the keyboard layout is set to "ru" 0.136
When the network is plugged 0.045
And Tor is ready 13.321
Then I successfully start the Unsafe Browser in "ru" 14.604
And I kill the Unsafe Browser 5.600
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 27.216
And DuckDuckGo is the default search engine 9.580
And I kill the Tor Browser 5.237
And the screen keyboard works in Thunderbird 12.777
And the layout of the screen keyboard is set to "ru" 0.589
After features/support/hooks.rb:291 1.361
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.255
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.176
When I log in to a new session in Spanish (es) 30.285
Then the keyboard layout is set to "es" 0.198
When the network is plugged 0.061
And Tor is ready 17.703
Then I successfully start the Unsafe Browser in "es" 14.481
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 26.295
And DuckDuckGo is the default search engine 9.597
And I kill the Tor Browser 5.299
And the screen keyboard works in Thunderbird 13.633
And the layout of the screen keyboard is set to "us" 0.628
After features/support/hooks.rb:291 1.293
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
19.090
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.006
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.259
When I log in to a new session in Turkish (tr) 10.830
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:469:in `/^I set the language to (.*) \((.*)\)$/'
./features/step_definitions/common_steps.rb:493:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:57:in `When I log in to a new session in Turkish (tr)'
features/localization.feature:23:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "tr" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "tr" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:291 5.254 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#11)' (at time 02:33:19)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4731/artifact/build-artifacts/02:33:19_Tails_is_localized_for_every_tier-1_language,_Examples___11_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4731/artifact/build-artifacts/02:33:19_Tails_is_localized_for_every_tier-1_language,_Examples___11_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4731/artifact/build-artifacts/02:33:19_Tails_is_localized_for_every_tier-1_language,_Examples___11_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4731/artifact/build-artifacts/02:33:19_Tails_is_localized_for_every_tier-1_language,_Examples___11_.journal
After features/support/hooks.rb:75 0.000