Project Number Date
test_Tails_ISO_stable 4633 24 Jan 2024, 16:22

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 258 1 12 0 0 271 21 1 22 1:12:36.357 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.959
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.974
And I prepare Tails for memory erasure tests 0.459
When I start a process allocating 128 MiB of memory with a known pattern 2.299
Then patterns cover at least 128 MiB in the guest's memory 3.323 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.279
Then I find very few patterns in the guest's memory 3.623 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 1.027
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.104
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.203
And I prepare Tails for memory erasure tests 0.540
And I find very few patterns in the guest's memory 3.752 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.994
Then patterns cover at least 99% of the test FS size in the guest's memory 5.179 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.332
Then I find very few patterns in the guest's memory 5.103 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 0.847
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:13.259
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.237
And I prepare Tails for memory erasure tests 0.559
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.216
Then I find very few patterns in the guest's memory 4.654 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:30.966
Then patterns cover at least 86% of the test FS size in the guest's memory 3.291 
Pattern coverage: 97.077% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.537
Then I find very few patterns in the guest's memory 3.615 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
# read cache
When I mount the USB drive again 0.230
And I read the content of the test FS 1.178
Then patterns cover at least 99% of the test FS size in the guest's memory 6.630 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.581
Then I find very few patterns in the guest's memory 3.559 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 0.982
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:55.678
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.667
And I prepare Tails for memory erasure tests 0.475
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.111
Then I find very few patterns in the guest's memory 4.032 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:1.534
Then patterns cover at least 99% of the test FS size in the guest's memory 3.022 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.827
Then I find very few patterns in the guest's memory 3.408 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
# read cache
When I mount the USB drive again 4.281
And I read the content of the test FS 0.504
Then patterns cover at least 99% of the test FS size in the guest's memory 2.507 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.566
Then I find very few patterns in the guest's memory 3.736 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 0.925
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.276
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 8.258
And I prepare Tails for memory erasure tests 0.541
When I fill a 128 MiB file with a known pattern on the root filesystem 11.269
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.618
Then patterns cover at least 128 MiB in the guest's memory 2.557 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.199
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.811 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 3.495
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:6.836
Before features/support/hooks.rb:245 0.004
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:20.794
And I prepare Tails for memory erasure tests 0.477
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.045
When I trigger shutdown 0.317
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.180 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 3.469
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:9.724
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:20.825
And I update APT using apt 16.953
And I install "popularity-contest" using apt 19.809
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.692
When I create a persistent storage and activate the Additional Software feature 22.788
Then Additional Software is correctly configured for package "popularity-contest" 2.050
When I shutdown Tails and wait for the computer to power off 10.088
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:36.956
Then Additional Software is correctly configured for package "popularity-contest" 1.193
And the package "popularity-contest" is installed after Additional Software has been started 0.367
After features/support/hooks.rb:450 39.300
After features/support/hooks.rb:291 1.076
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:0.030
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.225
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.190
And I update APT using apt 16.784
When I install "makepp" using apt 23.525
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.197
And the package "makepp" is installed 0.108
After features/support/hooks.rb:450 38.798
After features/support/hooks.rb:291 0.842
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:3.313
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.211
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:17.223
When I uninstall "popularity-contest" using apt 19.016
And I accept removing "popularity-contest" from Additional Software 0.595
Then "popularity-contest" is not in the list of Additional Software 0.775
When I start Synaptic 23.873
And I update APT using Synaptic 21.845
And I install "cowsay" using Synaptic 10.062
And I accept adding "cowsay" to Additional Software 0.746
Then Additional Software is correctly configured for package "cowsay" 0.815
When I uninstall "cowsay" using apt 3.325
And I refuse removing "cowsay" from Additional Software 0.623
Then Additional Software is correctly configured for package "cowsay" 0.896
When I start "Additional Software" via GNOME Activities Overview 12.540
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.857
Then "cowsay" is not in the list of Additional Software 1.134
When I install "cowsay" using apt 3.257
And I refuse adding "cowsay" to Additional Software 0.700
Then "cowsay" is not in the list of Additional Software 0.811
After features/support/hooks.rb:450 1.051
After features/support/hooks.rb:291 0.747
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:58.727
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Steps
Given a computer 0.165
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:9.432
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.151
And I accept adding "cowsay" to Additional Software 1:10.878
And Additional Software is correctly configured for package "cowsay" 1.466
And I shutdown Tails and wait for the computer to power off 6.153
And I start Tails from USB drive "__internal" with network unplugged 47.052
And I enable persistence 32.891
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.032
And I log in to a new session 23.783
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.189
And I revert the APT tweaks that made it prefer an old version of cowsay 0.044
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.088
And the network is plugged 0.043
And Tor is ready 20.023
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.142
And available upgrades have been checked 0.188
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:0.974
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:595:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:101:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:450 0.031
After features/support/hooks.rb:291 8.512 
SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:32:24)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4633/artifact/build-artifacts/01:32:24_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4633/artifact/build-artifacts/01:32:24_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv
After features/support/hooks.rb:75 0.018
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:52.133
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.190
And I start Tails from USB drive "__internal" with network unplugged 47.193
And I enable persistence 32.233
And I remove the "cowsay" deb files from the APT cache 0.541
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.084
And I log in to a new session 23.260
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.712
And I can open the Additional Software log file from the notification 2.706
And the package "cowsay" is not installed 0.209
After features/support/hooks.rb:450 0.136
After features/support/hooks.rb:291 1.234
After features/support/hooks.rb:75 0.015
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.112
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.889
When I log in to a new session in Arabic (ar) 28.541
Then the keyboard layout is set to "us" 0.261
When the network is plugged 0.110
And Tor is ready 15.514
Then I successfully start the Unsafe Browser in "ar" 29.260
And I kill the Unsafe Browser 5.950
When I enable the screen keyboard 0.192
Then the screen keyboard works in Tor Browser 35.518
And DuckDuckGo is the default search engine 9.875
And I kill the Tor Browser 5.416
And the screen keyboard works in Thunderbird 21.998
And the layout of the screen keyboard is set to "us" 0.584
After features/support/hooks.rb:291 1.010
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.334
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.288
When I log in to a new session in Chinese (zh_CN) 31.880
Then the keyboard layout is set to "cn" 0.159
When the network is plugged 0.042
And Tor is ready 14.754
Then I successfully start the Unsafe Browser in "zh_CN" 27.472
And I kill the Unsafe Browser 5.772
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 34.137
And DuckDuckGo is the default search engine 9.210
And I kill the Tor Browser 5.328
And the screen keyboard works in Thunderbird 24.580
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 1.181
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.454
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.149
When I log in to a new session in English (en) 15.374
Then the keyboard layout is set to "us" 0.211
When the network is plugged 0.039
And Tor is ready 16.111
Then I successfully start the Unsafe Browser in "en" 26.986
And I kill the Unsafe Browser 5.912
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 36.911
And DuckDuckGo is the default search engine 5.310
And I kill the Tor Browser 5.342
And the screen keyboard works in Thunderbird 21.262
And the layout of the screen keyboard is set to "us" 0.683
After features/support/hooks.rb:291 1.385
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:11.356
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.610
When I log in to a new session in French (fr) 30.542
Then the keyboard layout is set to "fr" 0.208
When the network is plugged 0.038
And Tor is ready 43.937
Then I successfully start the Unsafe Browser in "fr" 27.675
And I kill the Unsafe Browser 6.278
When I enable the screen keyboard 0.182
Then the screen keyboard works in Tor Browser 35.558
And DuckDuckGo is the default search engine 10.061
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 22.324
And the layout of the screen keyboard is set to "fr" 0.613
After features/support/hooks.rb:291 2.151
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.695
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.229
When I log in to a new session in German (de) 29.837
Then the keyboard layout is set to "de" 0.131
When the network is plugged 0.028
And Tor is ready 16.104
Then I successfully start the Unsafe Browser in "de" 30.703
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.173
Then the screen keyboard works in Tor Browser 36.541
And DuckDuckGo is the default search engine 10.332
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 22.515
And the layout of the screen keyboard is set to "de" 0.756
After features/support/hooks.rb:291 1.438
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.998
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.209
When I log in to a new session in Italian (it) 28.900
Then the keyboard layout is set to "it" 0.191
When the network is plugged 0.062
And Tor is ready 15.743
Then I successfully start the Unsafe Browser in "it" 30.496
And I kill the Unsafe Browser 5.820
When I enable the screen keyboard 0.316
Then the screen keyboard works in Tor Browser 35.345
And DuckDuckGo is the default search engine 10.935
And I kill the Tor Browser 5.662
And the screen keyboard works in Thunderbird 24.692
And the layout of the screen keyboard is set to "us" 0.620
After features/support/hooks.rb:291 2.145
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.080
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.386
When I log in to a new session in Persian (fa) 30.284
Then the keyboard layout is set to "ir" 0.144
When the network is plugged 0.054
And Tor is ready 15.112
Then I successfully start the Unsafe Browser in "fa" 28.928
And I kill the Unsafe Browser 5.678
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 36.117
And DuckDuckGo is the default search engine 9.938
And I kill the Tor Browser 5.312
And the screen keyboard works in Thunderbird 23.301
And the layout of the screen keyboard is set to "ir" 0.670
After features/support/hooks.rb:291 1.380
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.875
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.406
When I log in to a new session in Portuguese (pt) 28.030
Then the keyboard layout is set to "pt" 0.247
When the network is plugged 0.056
And Tor is ready 14.899
Then I successfully start the Unsafe Browser in "pt" 29.709
And I kill the Unsafe Browser 5.817
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 34.889
And DuckDuckGo is the default search engine 10.314
And I kill the Tor Browser 5.564
And the screen keyboard works in Thunderbird 22.225
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 3.752
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.006
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.029
When I log in to a new session in Russian (ru) 29.048
Then the keyboard layout is set to "ru" 0.155
When the network is plugged 0.043
And Tor is ready 15.826
Then I successfully start the Unsafe Browser in "ru" 27.502
And I kill the Unsafe Browser 5.856
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 36.610
And DuckDuckGo is the default search engine 9.738
And I kill the Tor Browser 5.346
And the screen keyboard works in Thunderbird 25.098
And the layout of the screen keyboard is set to "ru" 0.587
After features/support/hooks.rb:291 1.446
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.812
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.988
When I log in to a new session in Spanish (es) 28.375
Then the keyboard layout is set to "es" 0.269
When the network is plugged 0.056
And Tor is ready 16.245
Then I successfully start the Unsafe Browser in "es" 30.599
And I kill the Unsafe Browser 5.828
When I enable the screen keyboard 0.181
Then the screen keyboard works in Tor Browser 35.367
And DuckDuckGo is the default search engine 9.847
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 25.011
And the layout of the screen keyboard is set to "us" 0.727
After features/support/hooks.rb:291 2.043
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.585
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.048
When I log in to a new session in Turkish (tr) 28.910
Then the keyboard layout is set to "tr" 0.156
When the network is plugged 0.049
And Tor is ready 15.721
Then I successfully start the Unsafe Browser in "tr" 28.521
And I kill the Unsafe Browser 6.525
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 35.900
And DuckDuckGo is the default search engine 10.028
And I kill the Tor Browser 5.232
And the screen keyboard works in Thunderbird 24.847
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:291 1.130
After features/support/hooks.rb:75 0.000