Project Number Date
test_Tails_ISO_devel 3219 01 Jan 2024, 12:16

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 268 1 11 0 0 280 23 1 24 1:24:32.835 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.512
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.240
And I prepare Tails for memory erasure tests 0.610
When I start a process allocating 128 MiB of memory with a known pattern 1.387
Then patterns cover at least 128 MiB in the guest's memory 3.267 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.268
Then I find very few patterns in the guest's memory 4.739 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 0.976
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.323
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.820
And I prepare Tails for memory erasure tests 0.519
And I find very few patterns in the guest's memory 3.887 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.822
Then patterns cover at least 99% of the test FS size in the guest's memory 3.231 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.268
Then I find very few patterns in the guest's memory 3.774 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 1.313
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:38.885
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.873
And I prepare Tails for memory erasure tests 0.497
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.062
Then I find very few patterns in the guest's memory 3.612 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:3.410
Then patterns cover at least 86% of the test FS size in the guest's memory 3.204 
Pattern coverage: 92.224% (114 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.564
Then I find very few patterns in the guest's memory 3.744 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# read cache
When I mount the USB drive again 0.235
And I read the content of the test FS 0.612
Then patterns cover at least 99% of the test FS size in the guest's memory 2.906 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.377
Then I find very few patterns in the guest's memory 3.784 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 2.188
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:47.807
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.335
And I prepare Tails for memory erasure tests 0.449
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.675
Then I find very few patterns in the guest's memory 3.728 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:42.877
Then patterns cover at least 99% of the test FS size in the guest's memory 2.862 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.811
Then I find very few patterns in the guest's memory 3.336 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# read cache
When I mount the USB drive again 8.621
And I read the content of the test FS 0.438
Then patterns cover at least 99% of the test FS size in the guest's memory 2.712 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.995
Then I find very few patterns in the guest's memory 4.963 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
After features/support/hooks.rb:291 1.719
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
55.099
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.515
And I prepare Tails for memory erasure tests 0.500
When I fill a 128 MiB file with a known pattern on the root filesystem 18.649
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.672
Then patterns cover at least 128 MiB in the guest's memory 3.165 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.753
And I wait 20 seconds 20.002 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.839 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
After features/support/hooks.rb:291 3.453
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:0.848
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:18.682
And I prepare Tails for memory erasure tests 0.559
When I fill a 128 MiB file with a known pattern on the persistent filesystem 18.995
When I trigger shutdown 0.258
And I wait 20 seconds 20.005 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.345 
Pattern coverage: 0.000% (0 MiB out of 1172 MiB reference memory)
After features/support/hooks.rb:291 3.508
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:41.357
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:30.896
And I update APT using apt 18.950
When I install "popularity-contest" using apt 24.205
Then I am notified I can not use Additional Software for "popularity-contest" 1:2.749
And I can open the Additional Software documentation from the notification 24.555
After features/support/hooks.rb:450 39.201
After features/support/hooks.rb:291 2.096
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:38.385
Before features/support/hooks.rb:245 0.009
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 57.005
And I update APT using apt 16.204
And I install "popularity-contest" using apt 19.711
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.219
When I create a persistent storage and activate the Additional Software feature 18.722
Then Additional Software is correctly configured for package "popularity-contest" 1.371
When I shutdown Tails and wait for the computer to power off 10.077
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.863
Then Additional Software is correctly configured for package "popularity-contest" 0.873
And the package "popularity-contest" is installed after Additional Software has been started 0.335
After features/support/hooks.rb:450 41.906
After features/support/hooks.rb:291 0.979
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:55.560
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 1.074
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.217
And I update APT using apt 16.294
When I install "makepp" using apt 19.506
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.360
And the package "makepp" is installed 0.107
After features/support/hooks.rb:450 42.616
After features/support/hooks.rb:291 0.996
After features/support/hooks.rb:75 0.018
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:47.151
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.009
Given a computer 0.249
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:1.422
When I uninstall "popularity-contest" using apt 19.197
And I accept removing "popularity-contest" from Additional Software 0.673
Then "popularity-contest" is not in the list of Additional Software 0.789
When I start Synaptic 22.742
And I update APT using Synaptic 22.136
And I install "cowsay" using Synaptic 8.936
And I accept adding "cowsay" to Additional Software 0.854
Then Additional Software is correctly configured for package "cowsay" 0.958
When I uninstall "cowsay" using apt 3.380
And I refuse removing "cowsay" from Additional Software 0.658
Then Additional Software is correctly configured for package "cowsay" 0.937
When I start "Additional Software" via GNOME Activities Overview 12.471
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.765
Then "cowsay" is not in the list of Additional Software 1.157
When I install "cowsay" using apt 3.295
And I refuse adding "cowsay" to Additional Software 0.729
Then "cowsay" is not in the list of Additional Software 0.796
After features/support/hooks.rb:450 1.412
After features/support/hooks.rb:291 0.733
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:13.951
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.218
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:4.415
And I configure APT to prefer an old version of cowsay 0.028
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.228
And I accept adding "cowsay" to Additional Software 1:7.761
And Additional Software is correctly configured for package "cowsay" 1.294
And I shutdown Tails and wait for the computer to power off 6.228
And I start Tails from USB drive "__internal" with network unplugged 45.236
And I enable persistence 30.968
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 23.698
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.831
And I revert the APT tweaks that made it prefer an old version of cowsay 0.049
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.106
And the network is plugged 0.046
And Tor is ready 18.358
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.969
And available upgrades have been checked 0.236
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.314
And I can open the Additional Software configuration window from the notification 3.493
And I shutdown Tails and wait for the computer to power off 2:2.497
And I start Tails from USB drive "__internal" with network unplugged 46.288
And I enable persistence 34.091
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 25.206
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.568
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
And the network is plugged 0.062
And Tor is ready 1:5.335
Then the Additional Software upgrade service has started 0.169
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.131
After features/support/hooks.rb:450 2.427
After features/support/hooks.rb:291 0.899
After features/support/hooks.rb:75 0.066
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.229
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.205
And I start Tails from USB drive "__internal" with network unplugged 48.146
And I enable persistence 32.811
And I remove the "cowsay" deb files from the APT cache 0.632
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.089
And I log in to a new session 22.065
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.917
And I can open the Additional Software log file from the notification 2.926
And the package "cowsay" is not installed 0.433
After features/support/hooks.rb:450 0.108
After features/support/hooks.rb:291 0.712
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
21.625
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:245 0.009
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.702
When I log in to a new session in Arabic (ar) 11.923
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:407:in `/^I set the language to (.*) \((.*)\)$/'
./features/step_definitions/common_steps.rb:431:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:38:in `When I log in to a new session in Arabic (ar)'
features/localization.feature:17:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "us" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "ar" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:291 8.070 
SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#1)' (at time 02:15:47)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3219/artifact/build-artifacts/02:15:47_Tails_is_localized_for_every_tier-1_language,_Examples___1_.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3219/artifact/build-artifacts/02:15:47_Tails_is_localized_for_every_tier-1_language,_Examples___1_.mkv
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.415
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.116
When I log in to a new session in Chinese (zh_CN) 36.857
Then the keyboard layout is set to "cn" 0.131
When the network is plugged 0.826
And Tor is ready 14.888
Then I successfully start the Unsafe Browser in "zh_CN" 27.324
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.424
And DuckDuckGo is the default search engine 10.703
And I kill the Tor Browser 5.538
And the screen keyboard works in Thunderbird 26.998
And the layout of the screen keyboard is set to "us" 0.581
After features/support/hooks.rb:291 3.726
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.835
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.599
When I log in to a new session in English (en) 16.558
Then the keyboard layout is set to "us" 0.155
When the network is plugged 0.035
And Tor is ready 17.342
Then I successfully start the Unsafe Browser in "en" 26.057
And I kill the Unsafe Browser 6.285
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 36.040
And DuckDuckGo is the default search engine 5.837
And I kill the Tor Browser 5.352
And the screen keyboard works in Thunderbird 23.841
And the layout of the screen keyboard is set to "us" 0.595
After features/support/hooks.rb:291 1.497
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.206
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.969
When I log in to a new session in French (fr) 30.972
Then the keyboard layout is set to "fr" 0.159
When the network is plugged 0.045
And Tor is ready 17.143
Then I successfully start the Unsafe Browser in "fr" 28.970
And I kill the Unsafe Browser 5.777
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 32.693
And DuckDuckGo is the default search engine 9.770
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 21.704
And the layout of the screen keyboard is set to "fr" 0.540
After features/support/hooks.rb:291 1.098
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.514
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.023
When I log in to a new session in German (de) 34.458
Then the keyboard layout is set to "de" 0.189
When the network is plugged 0.034
And Tor is ready 15.501
Then I successfully start the Unsafe Browser in "de" 26.862
And I kill the Unsafe Browser 6.279
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 34.282
And DuckDuckGo is the default search engine 10.340
And I kill the Tor Browser 5.534
And the screen keyboard works in Thunderbird 21.260
And the layout of the screen keyboard is set to "de" 0.593
After features/support/hooks.rb:291 1.231
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.680
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.915
When I log in to a new session in Italian (it) 30.701
Then the keyboard layout is set to "it" 0.135
When the network is plugged 0.048
And Tor is ready 15.088
Then I successfully start the Unsafe Browser in "it" 30.006
And I kill the Unsafe Browser 5.726
When I enable the screen keyboard 0.167
Then the screen keyboard works in Tor Browser 35.045
And DuckDuckGo is the default search engine 9.512
And I kill the Tor Browser 5.272
And the screen keyboard works in Thunderbird 24.448
And the layout of the screen keyboard is set to "us" 0.610
After features/support/hooks.rb:291 1.320
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.388
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.206
When I log in to a new session in Persian (fa) 32.944
Then the keyboard layout is set to "ir" 0.126
When the network is plugged 0.041
And Tor is ready 16.041
Then I successfully start the Unsafe Browser in "fa" 30.705
And I kill the Unsafe Browser 5.851
When I enable the screen keyboard 0.185
Then the screen keyboard works in Tor Browser 35.282
And DuckDuckGo is the default search engine 10.123
And I kill the Tor Browser 5.368
And the screen keyboard works in Thunderbird 23.818
And the layout of the screen keyboard is set to "ir" 0.693
After features/support/hooks.rb:291 1.038
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.982
Before features/support/hooks.rb:245 0.015
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.043
When I log in to a new session in Portuguese (pt) 31.430
Then the keyboard layout is set to "pt" 0.152
When the network is plugged 0.042
And Tor is ready 16.473
Then I successfully start the Unsafe Browser in "pt" 29.383
And I kill the Unsafe Browser 6.092
When I enable the screen keyboard 0.173
Then the screen keyboard works in Tor Browser 34.287
And DuckDuckGo is the default search engine 10.663
And I kill the Tor Browser 5.682
And the screen keyboard works in Thunderbird 20.950
And the layout of the screen keyboard is set to "us" 0.603
After features/support/hooks.rb:291 1.198
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.903
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.227
When I log in to a new session in Russian (ru) 34.879
Then the keyboard layout is set to "ru" 0.173
When the network is plugged 0.034
And Tor is ready 16.544
Then I successfully start the Unsafe Browser in "ru" 29.056
And I kill the Unsafe Browser 6.107
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.226
And DuckDuckGo is the default search engine 9.767
And I kill the Tor Browser 5.349
And the screen keyboard works in Thunderbird 23.803
And the layout of the screen keyboard is set to "ru" 0.579
After features/support/hooks.rb:291 0.990
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.584
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.322
When I log in to a new session in Spanish (es) 31.949
Then the keyboard layout is set to "es" 0.255
When the network is plugged 0.046
And Tor is ready 16.715
Then I successfully start the Unsafe Browser in "es" 27.350
And I kill the Unsafe Browser 6.612
When I enable the screen keyboard 0.177
Then the screen keyboard works in Tor Browser 33.580
And DuckDuckGo is the default search engine 10.282
And I kill the Tor Browser 5.494
And the screen keyboard works in Thunderbird 22.127
And the layout of the screen keyboard is set to "us" 0.669
After features/support/hooks.rb:291 1.147
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.112
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.993
When I log in to a new session in Turkish (tr) 30.426
Then the keyboard layout is set to "tr" 0.270
When the network is plugged 0.043
And Tor is ready 15.132
Then I successfully start the Unsafe Browser in "tr" 26.598
And I kill the Unsafe Browser 5.861
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 33.543
And DuckDuckGo is the default search engine 9.880
And I kill the Tor Browser 5.328
And the screen keyboard works in Thunderbird 21.279
And the layout of the screen keyboard is set to "us" 0.639
After features/support/hooks.rb:291 1.427
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.472
When the network is plugged 0.046
And I wait 720 seconds 12:0.087 
Slept for 720 seconds
Then I successfully configure Tor 10.263
And the time has synced 0.075
After features/support/hooks.rb:291 0.649
After features/support/hooks.rb:75 0.000