Project Number Date
test_Tails_ISO_devel 3225 07 Jan 2024, 12:34

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 268 1 11 0 0 280 23 1 24 1:29:15.403 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.509
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.181
And I prepare Tails for memory erasure tests 0.426
When I start a process allocating 128 MiB of memory with a known pattern 1.207
Then patterns cover at least 128 MiB in the guest's memory 3.726 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.246
Then I find very few patterns in the guest's memory 3.720 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 0.659
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.235
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.458
And I prepare Tails for memory erasure tests 0.398
And I find very few patterns in the guest's memory 3.803 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.743
Then patterns cover at least 99% of the test FS size in the guest's memory 4.012 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.247
Then I find very few patterns in the guest's memory 4.571 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 0.793
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:38.606
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.383
And I prepare Tails for memory erasure tests 0.430
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.998
Then I find very few patterns in the guest's memory 4.564 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:59.786
Then patterns cover at least 86% of the test FS size in the guest's memory 3.126 
Pattern coverage: 94.250% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.071
Then I find very few patterns in the guest's memory 3.633 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
# read cache
When I mount the USB drive again 0.259
And I read the content of the test FS 1.031
Then patterns cover at least 99% of the test FS size in the guest's memory 3.212 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.571
Then I find very few patterns in the guest's memory 5.536 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 0.811
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:32.713
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.243
And I prepare Tails for memory erasure tests 0.472
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.265
Then I find very few patterns in the guest's memory 4.082 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:36.889
Then patterns cover at least 99% of the test FS size in the guest's memory 3.052 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.764
Then I find very few patterns in the guest's memory 4.234 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# read cache
When I mount the USB drive again 3.659
And I read the content of the test FS 0.393
Then patterns cover at least 99% of the test FS size in the guest's memory 2.695 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.650
Then I find very few patterns in the guest's memory 3.308 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 1.319
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
53.719
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 8.614
And I prepare Tails for memory erasure tests 0.488
When I fill a 128 MiB file with a known pattern on the root filesystem 17.687
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.544
Then patterns cover at least 128 MiB in the guest's memory 2.730 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.615
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.029 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 3.437
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:10.909
Before features/support/hooks.rb:245 0.004
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:25.569
And I prepare Tails for memory erasure tests 0.472
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.190
When I trigger shutdown 0.377
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.278 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 3.529
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:30.115
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:29.626
And I update APT using apt 18.589
When I install "popularity-contest" using apt 19.748
Then I am notified I can not use Additional Software for "popularity-contest" 58.820
And I can open the Additional Software documentation from the notification 23.330
After features/support/hooks.rb:450 36.986
After features/support/hooks.rb:291 2.038
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:36.442
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.128
And I update APT using apt 16.578
And I install "popularity-contest" using apt 19.713
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.229
When I create a persistent storage and activate the Additional Software feature 20.182
Then Additional Software is correctly configured for package "popularity-contest" 1.648
When I shutdown Tails and wait for the computer to power off 12.087
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:36.584
Then Additional Software is correctly configured for package "popularity-contest" 0.946
And the package "popularity-contest" is installed after Additional Software has been started 0.342
After features/support/hooks.rb:450 37.350
After features/support/hooks.rb:291 0.969
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:59.401
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.009
Given a computer 0.208
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.360
And I update APT using apt 16.545
When I install "makepp" using apt 19.686
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:3.517
And the package "makepp" is installed 0.082
After features/support/hooks.rb:450 37.515
After features/support/hooks.rb:291 0.829
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:29.401
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.217
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:43.908
When I uninstall "popularity-contest" using apt 15.858
And I accept removing "popularity-contest" from Additional Software 1.870
Then "popularity-contest" is not in the list of Additional Software 0.763
When I start Synaptic 23.630
And I update APT using Synaptic 22.246
And I install "cowsay" using Synaptic 10.149
And I accept adding "cowsay" to Additional Software 1.125
Then Additional Software is correctly configured for package "cowsay" 0.885
When I uninstall "cowsay" using apt 3.365
And I refuse removing "cowsay" from Additional Software 0.735
Then Additional Software is correctly configured for package "cowsay" 0.954
When I start "Additional Software" via GNOME Activities Overview 12.588
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.999
Then "cowsay" is not in the list of Additional Software 1.221
When I install "cowsay" using apt 3.312
And I refuse adding "cowsay" to Additional Software 0.756
Then "cowsay" is not in the list of Additional Software 0.810
After features/support/hooks.rb:450 1.185
After features/support/hooks.rb:291 0.952
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:6.565
Before features/support/hooks.rb:245 0.009
Before features/support/hooks.rb:442 0.008
Given a computer 0.248
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:2.857
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.835
And I accept adding "cowsay" to Additional Software 1:5.535
And Additional Software is correctly configured for package "cowsay" 1.262
And I shutdown Tails and wait for the computer to power off 6.057
And I start Tails from USB drive "__internal" with network unplugged 47.037
And I enable persistence 34.211
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 33.174
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.456
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.066
And the network is plugged 0.537
And Tor is ready 19.739
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 4.963
And available upgrades have been checked 0.124
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.474
And I can open the Additional Software configuration window from the notification 2.298
And I shutdown Tails and wait for the computer to power off 2:2.665
And I start Tails from USB drive "__internal" with network unplugged 49.417
And I enable persistence 33.440
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 32.785
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.741
And I revert the APT tweaks that made it prefer an old version of cowsay 0.091
And the network is plugged 0.041
And Tor is ready 41.049
Then the Additional Software upgrade service has started 0.205
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.110
After features/support/hooks.rb:450 2.438
After features/support/hooks.rb:291 0.814
After features/support/hooks.rb:75 0.034
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:52.356
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.011
Given a computer 0.207
And I start Tails from USB drive "__internal" with network unplugged 45.901
And I enable persistence 32.149
And I remove the "cowsay" deb files from the APT cache 0.594
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.099
And I log in to a new session 24.020
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.646
And I can open the Additional Software log file from the notification 3.469
And the package "cowsay" is not installed 0.268
After features/support/hooks.rb:450 0.126
After features/support/hooks.rb:291 0.669
After features/support/hooks.rb:75 0.026
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.380
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.942
When I log in to a new session in Arabic (ar) 29.127
Then the keyboard layout is set to "us" 0.168
When the network is plugged 0.036
And Tor is ready 15.209
Then I successfully start the Unsafe Browser in "ar" 29.686
And I kill the Unsafe Browser 6.890
When I enable the screen keyboard 0.159
Then the screen keyboard works in Tor Browser 35.832
And DuckDuckGo is the default search engine 9.951
And I kill the Tor Browser 5.299
And the screen keyboard works in Thunderbird 22.512
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.330
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.794
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.231
When I log in to a new session in Chinese (zh_CN) 29.220
Then the keyboard layout is set to "cn" 0.326
When the network is plugged 0.048
And Tor is ready 15.675
Then I successfully start the Unsafe Browser in "zh_CN" 27.349
And I kill the Unsafe Browser 6.402
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 37.109
And DuckDuckGo is the default search engine 10.219
And I kill the Tor Browser 5.621
And the screen keyboard works in Thunderbird 26.767
And the layout of the screen keyboard is set to "us" 0.679
After features/support/hooks.rb:291 1.191
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.817
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.712
When I log in to a new session in English (en) 16.060
Then the keyboard layout is set to "us" 0.293
When the network is plugged 0.043
And Tor is ready 14.838
Then I successfully start the Unsafe Browser in "en" 29.542
And I kill the Unsafe Browser 5.991
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 33.466
And DuckDuckGo is the default search engine 9.388
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 22.427
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.415
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:25.443
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.030
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.254
When I log in to a new session in French (fr) 3:17.188
cannot 
cannot find GnomeApplicationsMenuFrench.png on the screen (FindFailed)
./features/support/helpers/screen.rb:166:in `rescue in wait'
./features/support/helpers/screen.rb:159:in `wait'
./features/step_definitions/common_steps.rb:499:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:454:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:41:in `When I log in to a new session in French (fr)'
features/localization.feature:17:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "fr" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "fr" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "fr" 0.000
After features/support/hooks.rb:291 3.921 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#4)' (at time 02:39:55)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3225/artifact/build-artifacts/02:39:55_Tails_is_localized_for_every_tier-1_language,_Examples___4_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3225/artifact/build-artifacts/02:39:55_Tails_is_localized_for_every_tier-1_language,_Examples___4_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3225/artifact/build-artifacts/02:39:55_Tails_is_localized_for_every_tier-1_language,_Examples___4_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3225/artifact/build-artifacts/02:39:55_Tails_is_localized_for_every_tier-1_language,_Examples___4_.journal
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.353
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.076
When I log in to a new session in German (de) 28.994
Then the keyboard layout is set to "de" 0.308
When the network is plugged 0.055
And Tor is ready 15.447
Then I successfully start the Unsafe Browser in "de" 25.045
And I kill the Unsafe Browser 5.968
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 34.560
And DuckDuckGo is the default search engine 10.448
And I kill the Tor Browser 5.716
And the screen keyboard works in Thunderbird 21.990
And the layout of the screen keyboard is set to "de" 0.623
After features/support/hooks.rb:291 2.312
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:9.282
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.246
When I log in to a new session in Italian (it) 30.497
Then the keyboard layout is set to "it" 0.257
When the network is plugged 0.043
And Tor is ready 44.454
Then I successfully start the Unsafe Browser in "it" 25.440
And I kill the Unsafe Browser 6.090
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 35.794
And DuckDuckGo is the default search engine 9.909
And I kill the Tor Browser 5.348
And the screen keyboard works in Thunderbird 22.498
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.206
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.538
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.317
When I log in to a new session in Persian (fa) 31.147
Then the keyboard layout is set to "ir" 0.157
When the network is plugged 0.039
And Tor is ready 14.973
Then I successfully start the Unsafe Browser in "fa" 27.681
And I kill the Unsafe Browser 5.918
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 36.743
And DuckDuckGo is the default search engine 18.282
And I kill the Tor Browser 5.672
And the screen keyboard works in Thunderbird 22.889
And the layout of the screen keyboard is set to "ir" 0.583
After features/support/hooks.rb:291 1.612
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.173
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.192
When I log in to a new session in Portuguese (pt) 30.254
Then the keyboard layout is set to "pt" 0.249
When the network is plugged 0.041
And Tor is ready 15.644
Then I successfully start the Unsafe Browser in "pt" 29.769
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.171
Then the screen keyboard works in Tor Browser 35.248
And DuckDuckGo is the default search engine 10.859
And I kill the Tor Browser 5.531
And the screen keyboard works in Thunderbird 22.749
And the layout of the screen keyboard is set to "us" 0.622
After features/support/hooks.rb:291 1.266
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.186
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.205
When I log in to a new session in Russian (ru) 28.284
Then the keyboard layout is set to "ru" 0.320
When the network is plugged 0.064
And Tor is ready 15.307
Then I successfully start the Unsafe Browser in "ru" 28.448
And I kill the Unsafe Browser 5.909
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 35.516
And DuckDuckGo is the default search engine 9.945
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 26.094
And the layout of the screen keyboard is set to "ru" 0.634
After features/support/hooks.rb:291 1.345
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.191
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.847
When I log in to a new session in Spanish (es) 29.308
Then the keyboard layout is set to "es" 0.228
When the network is plugged 0.035
And Tor is ready 15.262
Then I successfully start the Unsafe Browser in "es" 26.455
And I kill the Unsafe Browser 5.954
When I enable the screen keyboard 0.177
Then the screen keyboard works in Tor Browser 35.385
And DuckDuckGo is the default search engine 9.892
And I kill the Tor Browser 5.366
And the screen keyboard works in Thunderbird 22.604
And the layout of the screen keyboard is set to "us" 0.672
After features/support/hooks.rb:291 1.207
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.060
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.014
When I log in to a new session in Turkish (tr) 28.879
Then the keyboard layout is set to "tr" 0.213
When the network is plugged 0.048
And Tor is ready 17.589
Then I successfully start the Unsafe Browser in "tr" 28.859
And I kill the Unsafe Browser 5.880
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 34.833
And DuckDuckGo is the default search engine 9.559
And I kill the Tor Browser 5.318
And the screen keyboard works in Thunderbird 22.117
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 1.126
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.202
When the network is plugged 0.048
And I wait 720 seconds 12:0.082 
Slept for 720 seconds
Then I successfully configure Tor 9.983
And the time has synced 0.087
After features/support/hooks.rb:291 0.723
After features/support/hooks.rb:75 0.000