Project Number Date
test_Tails_ISO_devel 3190 12 Dec 2023, 12:15

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 268 1 11 0 0 280 23 1 24 1:26:12.672 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.702
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.327
And I prepare Tails for memory erasure tests 0.735
When I start a process allocating 128 MiB of memory with a known pattern 2.335
Then patterns cover at least 128 MiB in the guest's memory 3.386 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.206
Then I find very few patterns in the guest's memory 3.711 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.831
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:6.480
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.178
And I prepare Tails for memory erasure tests 0.681
And I find very few patterns in the guest's memory 3.728 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 45.668
Then patterns cover at least 99% of the test FS size in the guest's memory 3.035 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.363
Then I find very few patterns in the guest's memory 4.825 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 0.797
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:55.288
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.832
And I prepare Tails for memory erasure tests 0.641
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.012
Then I find very few patterns in the guest's memory 3.753 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:13.913
Then patterns cover at least 86% of the test FS size in the guest's memory 3.389 
Pattern coverage: 95.162% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.670
Then I find very few patterns in the guest's memory 4.502 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# read cache
When I mount the USB drive again 1.015
And I read the content of the test FS 0.694
Then patterns cover at least 99% of the test FS size in the guest's memory 3.830 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.020
Then I find very few patterns in the guest's memory 6.010 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 1.487
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:31.270
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.035
And I prepare Tails for memory erasure tests 0.655
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.224
Then I find very few patterns in the guest's memory 3.978 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:34.520
Then patterns cover at least 99% of the test FS size in the guest's memory 2.395 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.652
Then I find very few patterns in the guest's memory 3.436 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
# read cache
When I mount the USB drive again 3.578
And I read the content of the test FS 0.428
Then patterns cover at least 99% of the test FS size in the guest's memory 2.635 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.386
Then I find very few patterns in the guest's memory 3.342 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 1.260
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.315
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.065
And I prepare Tails for memory erasure tests 0.696
When I fill a 128 MiB file with a known pattern on the root filesystem 12.732
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.975
Then patterns cover at least 128 MiB in the guest's memory 2.201 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.937
And I wait 20 seconds 20.010 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.695 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 3.490
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:57.668
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:8.377
And I prepare Tails for memory erasure tests 0.462
When I fill a 128 MiB file with a known pattern on the persistent filesystem 26.296
When I trigger shutdown 0.383
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.128 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 3.463
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:33.962
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:29.977
And I update APT using apt 17.187
When I install "popularity-contest" using apt 19.669
Then I am notified I can not use Additional Software for "popularity-contest" 1:3.472
And I can open the Additional Software documentation from the notification 23.656
After features/support/hooks.rb:450 38.176
After features/support/hooks.rb:291 2.371
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:40.023
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.249
And I update APT using apt 15.603
And I install "popularity-contest" using apt 19.521
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:1.667
When I create a persistent storage and activate the Additional Software feature 19.726
Then Additional Software is correctly configured for package "popularity-contest" 1.532
When I shutdown Tails and wait for the computer to power off 10.073
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:37.502
Then Additional Software is correctly configured for package "popularity-contest" 0.827
And the package "popularity-contest" is installed after Additional Software has been started 0.320
After features/support/hooks.rb:450 38.141
After features/support/hooks.rb:291 0.976
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:53.564
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.207
And I start Tails from USB drive "__internal" and I login with an administration password 1:18.616
And I update APT using apt 15.768
When I install "makepp" using apt 19.530
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.345
And the package "makepp" is installed 0.097
After features/support/hooks.rb:450 38.598
After features/support/hooks.rb:291 0.861
After features/support/hooks.rb:75 0.045
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:25.457
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.196
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:41.371
When I uninstall "popularity-contest" using apt 15.922
And I accept removing "popularity-contest" from Additional Software 2.033
Then "popularity-contest" is not in the list of Additional Software 0.828
When I start Synaptic 23.398
And I update APT using Synaptic 22.054
And I install "cowsay" using Synaptic 9.515
And I accept adding "cowsay" to Additional Software 0.919
Then Additional Software is correctly configured for package "cowsay" 0.922
When I uninstall "cowsay" using apt 3.388
And I refuse removing "cowsay" from Additional Software 0.715
Then Additional Software is correctly configured for package "cowsay" 1.013
When I start "Additional Software" via GNOME Activities Overview 12.593
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.610
Then "cowsay" is not in the list of Additional Software 0.980
When I install "cowsay" using apt 3.284
And I refuse adding "cowsay" to Additional Software 0.840
Then "cowsay" is not in the list of Additional Software 0.866
After features/support/hooks.rb:450 1.574
After features/support/hooks.rb:291 0.865
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:5.166
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.010
Given a computer 0.222
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:55.202
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.696
And I accept adding "cowsay" to Additional Software 1:6.651
And Additional Software is correctly configured for package "cowsay" 1.430
And I shutdown Tails and wait for the computer to power off 5.078
And I start Tails from USB drive "__internal" with network unplugged 44.705
And I enable persistence 30.478
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 20.309
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.346
And I revert the APT tweaks that made it prefer an old version of cowsay 0.044
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.112
And the network is plugged 0.060
And Tor is ready 44.723
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.641
And available upgrades have been checked 0.129
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.573
And I can open the Additional Software configuration window from the notification 2.520
And I shutdown Tails and wait for the computer to power off 2:2.665
And I start Tails from USB drive "__internal" with network unplugged 44.250
And I enable persistence 31.736
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 19.702
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.012
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
And the network is plugged 0.051
And Tor is ready 39.365
Then the Additional Software upgrade service has started 0.213
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.114
After features/support/hooks.rb:450 2.626
After features/support/hooks.rb:291 1.068
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:39.802
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.212
And I start Tails from USB drive "__internal" with network unplugged 43.895
And I enable persistence 30.931
And I remove the "cowsay" deb files from the APT cache 0.523
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.084
And I log in to a new session 20.728
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.293
And I can open the Additional Software log file from the notification 1.924
And the package "cowsay" is not installed 0.207
After features/support/hooks.rb:450 0.118
After features/support/hooks.rb:291 0.690
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.368
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.970
When I log in to a new session in Arabic (ar) 28.287
Then the keyboard layout is set to "us" 0.165
When the network is plugged 0.039
And Tor is ready 14.920
Then I successfully start the Unsafe Browser in "ar" 24.938
And I kill the Unsafe Browser 5.867
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 34.182
And DuckDuckGo is the default search engine 9.874
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 23.086
And the layout of the screen keyboard is set to "us" 0.621
After features/support/hooks.rb:291 1.762
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.549
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.962
When I log in to a new session in Chinese (zh_CN) 27.530
Then the keyboard layout is set to "cn" 0.230
When the network is plugged 0.060
And Tor is ready 14.989
Then I successfully start the Unsafe Browser in "zh_CN" 25.909
And I kill the Unsafe Browser 5.973
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 34.132
And DuckDuckGo is the default search engine 9.649
And I kill the Tor Browser 5.391
And the screen keyboard works in Thunderbird 23.039
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 1.443
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.938
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.147
When I log in to a new session in English (en) 18.442
Then the keyboard layout is set to "us" 0.181
When the network is plugged 0.044
And Tor is ready 14.567
Then I successfully start the Unsafe Browser in "en" 26.026
And I kill the Unsafe Browser 5.735
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 33.664
And DuckDuckGo is the default search engine 5.083
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 19.982
And the layout of the screen keyboard is set to "us" 0.644
After features/support/hooks.rb:291 0.997
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.810
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.653
When I log in to a new session in French (fr) 29.158
Then the keyboard layout is set to "fr" 0.151
When the network is plugged 0.044
And Tor is ready 14.614
Then I successfully start the Unsafe Browser in "fr" 24.623
And I kill the Unsafe Browser 6.262
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 32.552
And DuckDuckGo is the default search engine 8.626
And I kill the Tor Browser 5.298
And the screen keyboard works in Thunderbird 21.168
And the layout of the screen keyboard is set to "fr" 0.567
After features/support/hooks.rb:291 1.059
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.211
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.326
When I log in to a new session in German (de) 28.191
Then the keyboard layout is set to "de" 0.188
When the network is plugged 0.045
And Tor is ready 15.752
Then I successfully start the Unsafe Browser in "de" 25.789
And I kill the Unsafe Browser 5.971
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 33.240
And DuckDuckGo is the default search engine 9.037
And I kill the Tor Browser 5.286
And the screen keyboard works in Thunderbird 24.690
And the layout of the screen keyboard is set to "de" 0.564
After features/support/hooks.rb:291 1.190
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.009
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.909
When I log in to a new session in Italian (it) 30.969
Then the keyboard layout is set to "it" 0.135
When the network is plugged 0.056
And Tor is ready 15.571
Then I successfully start the Unsafe Browser in "it" 26.647
And I kill the Unsafe Browser 5.949
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 32.850
And DuckDuckGo is the default search engine 9.296
And I kill the Tor Browser 5.306
And the screen keyboard works in Thunderbird 19.646
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:291 1.141
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.288
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.516
When I log in to a new session in Persian (fa) 29.875
Then the keyboard layout is set to "ir" 0.139
When the network is plugged 0.038
And Tor is ready 14.756
Then I successfully start the Unsafe Browser in "fa" 25.334
And I kill the Unsafe Browser 5.936
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 34.759
And DuckDuckGo is the default search engine 9.449
And I kill the Tor Browser 5.342
And the screen keyboard works in Thunderbird 22.476
And the layout of the screen keyboard is set to "ir" 0.566
After features/support/hooks.rb:291 1.027
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.930
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.908
When I log in to a new session in Portuguese (pt) 29.223
Then the keyboard layout is set to "pt" 0.153
When the network is plugged 0.033
And Tor is ready 15.862
Then I successfully start the Unsafe Browser in "pt" 26.063
And I kill the Unsafe Browser 5.987
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.091
And DuckDuckGo is the default search engine 9.312
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 21.250
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:291 1.129
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.006
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.001
When I log in to a new session in Russian (ru) 29.439
Then the keyboard layout is set to "ru" 0.352
When the network is plugged 0.037
And Tor is ready 16.806
Then I successfully start the Unsafe Browser in "ru" 26.849
And I kill the Unsafe Browser 5.909
When I enable the screen keyboard 0.072
Then the screen keyboard works in Tor Browser 34.439
And DuckDuckGo is the default search engine 9.361
And I kill the Tor Browser 5.359
And the screen keyboard works in Thunderbird 22.735
And the layout of the screen keyboard is set to "ru" 0.642
After features/support/hooks.rb:291 1.866
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:26.063
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.007
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.037
When I log in to a new session in Spanish (es) 3:18.025
cannot 
cannot find GnomeApplicationsMenuSpanish.png on the screen (FindFailed)
./features/support/helpers/screen.rb:166:in `rescue in wait'
./features/support/helpers/screen.rb:159:in `wait'
./features/step_definitions/common_steps.rb:499:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:454:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:50:in `When I log in to a new session in Spanish (es)'
features/localization.feature:17:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "es" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "es" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:291 4.145 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#10)' (at time 02:40:00)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3190/artifact/build-artifacts/02:40:00_Tails_is_localized_for_every_tier-1_language,_Examples___10_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3190/artifact/build-artifacts/02:40:00_Tails_is_localized_for_every_tier-1_language,_Examples___10_.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3190/artifact/build-artifacts/02:40:00_Tails_is_localized_for_every_tier-1_language,_Examples___10_.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3190/artifact/build-artifacts/02:40:00_Tails_is_localized_for_every_tier-1_language,_Examples___10_.journal
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.627
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.814
When I log in to a new session in Turkish (tr) 29.556
Then the keyboard layout is set to "tr" 0.135
When the network is plugged 0.042
And Tor is ready 14.165
Then I successfully start the Unsafe Browser in "tr" 28.027
And I kill the Unsafe Browser 5.874
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 32.511
And DuckDuckGo is the default search engine 9.620
And I kill the Tor Browser 5.295
And the screen keyboard works in Thunderbird 19.930
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.568
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.164
When the network is plugged 0.042
And I wait 720 seconds 12:0.000 
Slept for 720 seconds
Then I successfully configure Tor 10.064
And the time has synced 0.057
After features/support/hooks.rb:291 0.673
After features/support/hooks.rb:75 0.000