Project Number Date
test_Tails_ISO_stable 4685 28 Feb 2024, 12:18

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 265 1 5 0 0 271 21 1 22 1:3:37.430 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.086
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.956
And I prepare Tails for memory erasure tests 0.396
When I start a process allocating 128 MiB of memory with a known pattern 1.214
Then patterns cover at least 128 MiB in the guest's memory 4.660 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.711
Then I find very few patterns in the guest's memory 4.147 
Pattern coverage: 0.000% (0 MiB out of 939 MiB reference memory)
After features/support/hooks.rb:291 0.716
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.240
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.186
And I prepare Tails for memory erasure tests 0.427
And I find very few patterns in the guest's memory 3.914 
Pattern coverage: 0.000% (0 MiB out of 936 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.464
Then patterns cover at least 99% of the test FS size in the guest's memory 3.738 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.335
Then I find very few patterns in the guest's memory 4.173 
Pattern coverage: 0.000% (0 MiB out of 936 MiB reference memory)
After features/support/hooks.rb:291 1.021
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.011
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.095
And I prepare Tails for memory erasure tests 0.378
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.915
Then I find very few patterns in the guest's memory 4.528 
Pattern coverage: 0.000% (0 MiB out of 944 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.871
Then patterns cover at least 86% of the test FS size in the guest's memory 3.735 
Pattern coverage: 97.698% (124 MiB out of 127 MiB reference memory)
When I umount the USB drive 8.028
Then I find very few patterns in the guest's memory 3.823 
Pattern coverage: 0.000% (0 MiB out of 944 MiB reference memory)
# read cache
When I mount the USB drive again 0.204
And I read the content of the test FS 0.629
Then patterns cover at least 99% of the test FS size in the guest's memory 3.239 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.416
Then I find very few patterns in the guest's memory 4.144 
Pattern coverage: 0.000% (0 MiB out of 944 MiB reference memory)
After features/support/hooks.rb:291 0.689
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.672
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.443
And I prepare Tails for memory erasure tests 0.462
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.001
Then I find very few patterns in the guest's memory 3.373 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.589
Then patterns cover at least 99% of the test FS size in the guest's memory 3.522 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.645
Then I find very few patterns in the guest's memory 3.679 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
# read cache
When I mount the USB drive again 3.729
And I read the content of the test FS 0.453
Then patterns cover at least 99% of the test FS size in the guest's memory 2.846 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.456
Then I find very few patterns in the guest's memory 3.468 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
After features/support/hooks.rb:291 0.760
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.451
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.025
And I prepare Tails for memory erasure tests 0.370
When I fill a 128 MiB file with a known pattern on the root filesystem 16.565
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.099
Then patterns cover at least 128 MiB in the guest's memory 2.568 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.788 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
After features/support/hooks.rb:291 3.541
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
8:6.564
Scenario Erasure of read and write disk caches of persistent data on shutdown
Before features/support/hooks.rb:245 0.003
Steps
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 8:6.564
cannot 
cannot find GnomeApplicationsMenu.png on the screen (FindFailed)
./features/support/helpers/screen.rb:166:in `rescue in wait'
./features/support/helpers/screen.rb:159:in `wait'
./features/step_definitions/common_steps.rb:561:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:516:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ without\ network\ from\ a\ USB\ drive\ with\ a\ persistent\ partition\ enabled\ and\ logged\ in$/'
features/erase_memory.feature:76:in `Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in'
And I prepare Tails for memory erasure tests 0.000
When I fill a 128 MiB file with a known pattern on the persistent filesystem 0.000
When I trigger shutdown 0.000
And I wait 20 seconds 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:291 4.655 
SCENARIO FAILED: 'Erasure of read and write disk caches of persistent data on shutdown' (at time 00:36:34)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4685/artifact/build-artifacts/00:36:34_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4685/artifact/build-artifacts/00:36:34_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4685/artifact/build-artifacts/00:36:34_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4685/artifact/build-artifacts/00:36:34_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.journal
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:41.615
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.467
And I update APT using apt 16.558
And I install "popularity-contest" using apt 19.426
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.244
When I create a persistent storage and activate the Additional Software feature 19.136
Then Additional Software is correctly configured for package "popularity-contest" 1.334
When I shutdown Tails and wait for the computer to power off 10.158
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:37.320
Then Additional Software is correctly configured for package "popularity-contest" 0.702
And the package "popularity-contest" is installed after Additional Software has been started 0.265
After features/support/hooks.rb:450 39.214
After features/support/hooks.rb:291 0.943
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:11.649
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.184
And I start Tails from USB drive "__internal" and I login with an administration password 1:31.243
And I update APT using apt 15.416
When I install "makepp" using apt 19.279
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.435
And the package "makepp" is installed 0.090
After features/support/hooks.rb:450 40.893
After features/support/hooks.rb:291 0.776
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.660
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.161
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:9.994
When I uninstall "popularity-contest" using apt 18.631
And I accept removing "popularity-contest" from Additional Software 0.587
Then "popularity-contest" is not in the list of Additional Software 0.621
When I start Synaptic 22.231
And I update APT using Synaptic 22.098
And I install "cowsay" using Synaptic 11.695
And I accept adding "cowsay" to Additional Software 0.671
Then Additional Software is correctly configured for package "cowsay" 0.773
When I uninstall "cowsay" using apt 3.225
And I refuse removing "cowsay" from Additional Software 0.524
Then Additional Software is correctly configured for package "cowsay" 0.756
When I start "Additional Software" via GNOME Activities Overview 9.776
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.606
Then "cowsay" is not in the list of Additional Software 0.904
When I install "cowsay" using apt 3.213
And I refuse adding "cowsay" to Additional Software 0.527
Then "cowsay" is not in the list of Additional Software 0.657
After features/support/hooks.rb:450 0.973
After features/support/hooks.rb:291 0.693
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:51.961
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.157
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:53.097
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.024
And I accept adding "cowsay" to Additional Software 5.689
And Additional Software is correctly configured for package "cowsay" 0.932
And I shutdown Tails and wait for the computer to power off 7.093
And I start Tails from USB drive "__internal" with network unplugged 53.008
And I enable persistence 29.789
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 33.548
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.010
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.064
And the network is plugged 0.029
And Tor is ready 18.403
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.680
And available upgrades have been checked 0.051
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.160
And I can open the Additional Software configuration window from the notification 2.833
And I shutdown Tails and wait for the computer to power off 2:6.623
And I start Tails from USB drive "__internal" with network unplugged 1:1.058
And I enable persistence 32.015
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 33.271
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.860
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
And the network is plugged 0.048
And Tor is ready 41.044
Then the Additional Software upgrade service has started 0.177
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.093
After features/support/hooks.rb:450 2.650
After features/support/hooks.rb:291 1.140
After features/support/hooks.rb:75 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:17.135
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.187
And I start Tails from USB drive "__internal" with network unplugged 53.682
And I enable persistence 30.441
And I remove the "cowsay" deb files from the APT cache 0.658
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.082
And I log in to a new session 33.685
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 12.634
And I can open the Additional Software log file from the notification 4.996
And the package "cowsay" is not installed 0.766
After features/support/hooks.rb:450 0.107
After features/support/hooks.rb:291 1.033
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.936
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.752
When I log in to a new session in Arabic (ar) 27.885
Then the keyboard layout is set to "us" 0.166
When the network is plugged 0.037
And Tor is ready 13.980
Then I successfully start the Unsafe Browser in "ar" 13.167
And I kill the Unsafe Browser 5.897
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 34.773
And DuckDuckGo is the default search engine 10.164
And I kill the Tor Browser 5.712
And the screen keyboard works in Thunderbird 21.755
And the layout of the screen keyboard is set to "us" 0.539
After features/support/hooks.rb:291 0.777
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:57.245
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.063
When I log in to a new session in Chinese (zh_CN) 28.842
Then the keyboard layout is set to "cn" 0.174
When the network is plugged 0.030
And Tor is ready 42.857
Then I successfully start the Unsafe Browser in "zh_CN" 13.996
And I kill the Unsafe Browser 5.651
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 35.422
And DuckDuckGo is the default search engine 10.472
And I kill the Tor Browser 5.756
And the screen keyboard works in Thunderbird 25.282
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:291 1.105
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:0.047
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.998
When I log in to a new session in English (en) 14.289
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.028
And Tor is ready 13.290
Then I successfully start the Unsafe Browser in "en" 13.533
And I kill the Unsafe Browser 5.704
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 33.129
And DuckDuckGo is the default search engine 5.108
And I kill the Tor Browser 5.271
And the screen keyboard works in Thunderbird 20.836
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.285
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.120
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.920
When I log in to a new session in French (fr) 29.173
Then the keyboard layout is set to "fr" 0.110
When the network is plugged 0.037
And Tor is ready 13.166
Then I successfully start the Unsafe Browser in "fr" 14.026
And I kill the Unsafe Browser 5.727
When I enable the screen keyboard 0.079
Then the screen keyboard works in Tor Browser 34.310
And DuckDuckGo is the default search engine 18.507
And I kill the Tor Browser 5.580
And the screen keyboard works in Thunderbird 20.942
And the layout of the screen keyboard is set to "fr" 0.536
After features/support/hooks.rb:291 0.987
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.986
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.939
When I log in to a new session in German (de) 28.268
Then the keyboard layout is set to "de" 0.144
When the network is plugged 0.025
And Tor is ready 14.826
Then I successfully start the Unsafe Browser in "de" 13.388
And I kill the Unsafe Browser 5.919
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 32.090
And DuckDuckGo is the default search engine 10.410
And I kill the Tor Browser 5.458
And the screen keyboard works in Thunderbird 19.827
And the layout of the screen keyboard is set to "de" 0.572
After features/support/hooks.rb:291 0.976
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.573
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.926
When I log in to a new session in Italian (it) 28.052
Then the keyboard layout is set to "it" 0.163
When the network is plugged 0.028
And Tor is ready 12.938
Then I successfully start the Unsafe Browser in "it" 13.656
And I kill the Unsafe Browser 5.646
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 34.487
And DuckDuckGo is the default search engine 10.830
And I kill the Tor Browser 5.472
And the screen keyboard works in Thunderbird 20.721
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:291 1.098
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.500
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.553
When I log in to a new session in Persian (fa) 28.888
Then the keyboard layout is set to "ir" 0.138
When the network is plugged 0.030
And Tor is ready 14.922
Then I successfully start the Unsafe Browser in "fa" 13.478
And I kill the Unsafe Browser 5.941
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.950
And DuckDuckGo is the default search engine 11.047
And I kill the Tor Browser 5.456
And the screen keyboard works in Thunderbird 21.447
And the layout of the screen keyboard is set to "ir" 0.537
After features/support/hooks.rb:291 1.456
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.222
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.781
When I log in to a new session in Portuguese (pt) 27.981
Then the keyboard layout is set to "pt" 0.194
When the network is plugged 0.041
And Tor is ready 13.076
Then I successfully start the Unsafe Browser in "pt" 13.449
And I kill the Unsafe Browser 5.652
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 32.427
And DuckDuckGo is the default search engine 10.343
And I kill the Tor Browser 5.476
And the screen keyboard works in Thunderbird 21.130
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.232
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.759
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.100
When I log in to a new session in Russian (ru) 28.483
Then the keyboard layout is set to "ru" 0.126
When the network is plugged 0.027
And Tor is ready 13.402
Then I successfully start the Unsafe Browser in "ru" 13.132
And I kill the Unsafe Browser 5.727
When I enable the screen keyboard 0.074
Then the screen keyboard works in Tor Browser 34.923
And DuckDuckGo is the default search engine 10.139
And I kill the Tor Browser 5.461
And the screen keyboard works in Thunderbird 22.535
And the layout of the screen keyboard is set to "ru" 0.624
After features/support/hooks.rb:291 0.929
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.187
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.849
When I log in to a new session in Spanish (es) 28.587
Then the keyboard layout is set to "es" 0.126
When the network is plugged 0.039
And Tor is ready 13.972
Then I successfully start the Unsafe Browser in "es" 13.653
And I kill the Unsafe Browser 5.651
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 32.405
And DuckDuckGo is the default search engine 10.577
And I kill the Tor Browser 5.550
And the screen keyboard works in Thunderbird 21.077
And the layout of the screen keyboard is set to "us" 0.586
After features/support/hooks.rb:291 1.049
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.800
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.825
When I log in to a new session in Turkish (tr) 28.397
Then the keyboard layout is set to "tr" 0.204
When the network is plugged 0.035
And Tor is ready 12.920
Then I successfully start the Unsafe Browser in "tr" 13.564
And I kill the Unsafe Browser 5.974
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 32.141
And DuckDuckGo is the default search engine 10.359
And I kill the Tor Browser 5.475
And the screen keyboard works in Thunderbird 21.177
And the layout of the screen keyboard is set to "us" 0.594
After features/support/hooks.rb:291 1.175
After features/support/hooks.rb:75 0.000