Project Number Date
test_Tails_ISO_stable 4701 06 Mar 2024, 12:14

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 253 1 17 0 0 271 21 1 22 1:1:36.719 Failed
18.523
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.584
And I prepare Tails for memory erasure tests 0.443
When I start a process allocating 128 MiB of memory with a known pattern 1.175
Then patterns cover at least 128 MiB in the guest's memory 3.797

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.835
Then I find very few patterns in the guest's memory 3.687

Pattern coverage: 0.000% (0 MiB out of 929 MiB reference memory)

After features/support/hooks.rb:291 1.233
After features/support/hooks.rb:75 0.000
21.672
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.112
And I prepare Tails for memory erasure tests 0.364
And I find very few patterns in the guest's memory 3.975

Pattern coverage: 0.000% (0 MiB out of 912 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.517
Then patterns cover at least 99% of the test FS size in the guest's memory 3.351

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.312
Then I find very few patterns in the guest's memory 4.039

Pattern coverage: 0.000% (0 MiB out of 912 MiB reference memory)

After features/support/hooks.rb:291 1.221
After features/support/hooks.rb:75 0.000
39.014
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.978
And I prepare Tails for memory erasure tests 0.382
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.943
Then I find very few patterns in the guest's memory 4.053

Pattern coverage: 0.000% (0 MiB out of 912 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.487
Then patterns cover at least 86% of the test FS size in the guest's memory 3.723

Pattern coverage: 94.808% (120 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.165
Then I find very few patterns in the guest's memory 3.649

Pattern coverage: 0.000% (0 MiB out of 912 MiB reference memory)

# read cache
When I mount the USB drive again 0.219
And I read the content of the test FS 0.535
Then patterns cover at least 99% of the test FS size in the guest's memory 3.416

Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.616
Then I find very few patterns in the guest's memory 3.842

Pattern coverage: 0.000% (0 MiB out of 912 MiB reference memory)

After features/support/hooks.rb:291 1.163
After features/support/hooks.rb:75 0.000
1:2.626
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.994
And I prepare Tails for memory erasure tests 0.373
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.760
Then I find very few patterns in the guest's memory 3.593

Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.199
Then patterns cover at least 99% of the test FS size in the guest's memory 2.559

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.862
Then I find very few patterns in the guest's memory 3.402

Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)

# read cache
When I mount the USB drive again 4.309
And I read the content of the test FS 0.640
Then patterns cover at least 99% of the test FS size in the guest's memory 3.276

Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.487
Then I find very few patterns in the guest's memory 3.166

Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)

After features/support/hooks.rb:291 0.962
After features/support/hooks.rb:75 0.000
49.779
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.952
And I prepare Tails for memory erasure tests 0.380
When I fill a 128 MiB file with a known pattern on the root filesystem 15.673
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.393
Then patterns cover at least 128 MiB in the guest's memory 2.586

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.011
And I wait 20 seconds 20.004

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.775

Pattern coverage: 0.000% (0 MiB out of 934 MiB reference memory)

After features/support/hooks.rb:291 3.507
After features/support/hooks.rb:75 0.000
6:26.580
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:42.387
And I prepare Tails for memory erasure tests 0.411
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.608
When I trigger shutdown 0.010
And I wait 20 seconds 20.016

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.145

Pattern coverage: 0.000% (0 MiB out of 955 MiB reference memory)

After features/support/hooks.rb:291 3.490
After features/support/hooks.rb:75 0.012
4:50.484
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 48.767
And I update APT using apt 17.500
And I install "popularity-contest" using apt 19.405
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.054
When I create a persistent storage and activate the Additional Software feature 19.553
Then Additional Software is correctly configured for package "popularity-contest" 1.348
When I shutdown Tails and wait for the computer to power off 10.182
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:46.484
Then Additional Software is correctly configured for package "popularity-contest" 0.921
And the package "popularity-contest" is installed after Additional Software has been started 0.266
After features/support/hooks.rb:450 39.150
After features/support/hooks.rb:291 1.055
After features/support/hooks.rb:75 0.013
2:15.147
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.185
And I start Tails from USB drive "__internal" and I login with an administration password 1:31.000
And I update APT using apt 17.955
When I install "makepp" using apt 19.445
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.485
And the package "makepp" is installed 0.074
After features/support/hooks.rb:450 38.941
After features/support/hooks.rb:291 0.859
After features/support/hooks.rb:75 0.014
4:35.826
Scenario My Additional Software list is configurable through a GUI or through notifications when I install or remove packages with APT or Synaptic
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Steps
Given a computer 0.171
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 4:35.654
cannot find GnomeApplicationsMenu.png on the screen (FindFailed)
./features/support/helpers/screen.rb:166:in `rescue in wait'
./features/support/helpers/screen.rb:159:in `wait'
./features/step_definitions/common_steps.rb:561:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:516:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
./features/step_definitions/common_steps.rb:294:in `/^I start Tails from (.+?) drive "(.+?)"( with network unplugged)?( and I login( with persistence enabled)?( with the changed persistence passphrase)?( (?:and|with) an administration password)?)?$/'
features/additional_software_packages.feature:51:in `And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password'
When I uninstall "popularity-contest" using apt 0.000
And I accept removing "popularity-contest" from Additional Software 0.000
Then "popularity-contest" is not in the list of Additional Software 0.000
When I start Synaptic 0.000
And I update APT using Synaptic 0.000
And I install "cowsay" using Synaptic 0.000
And I accept adding "cowsay" to Additional Software 0.000
Then Additional Software is correctly configured for package "cowsay" 0.000
When I uninstall "cowsay" using apt 0.000
And I refuse removing "cowsay" from Additional Software 0.000
Then Additional Software is correctly configured for package "cowsay" 0.000
When I start "Additional Software" via GNOME Activities Overview 0.000
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 0.000
Then "cowsay" is not in the list of Additional Software 0.000
When I install "cowsay" using apt 0.000
And I refuse adding "cowsay" to Additional Software 0.000
Then "cowsay" is not in the list of Additional Software 0.000
After features/support/hooks.rb:450 0.045
After features/support/hooks.rb:291 4.434

SCENARIO FAILED: 'My Additional Software list is configurable through a GUI or through notifications when I install or remove packages with APT or Synaptic' (at time 01:16:10)

Exception thrown while trying to save /tmp/TailsToaster/artifact.file_content_run_live-additional-software_log: RemoteShell::ServerFailure: FileNotFoundError: [Errno 2] No such file or directory: '/run/live-additional-software/log'

Output of ls -la --full-time /live/persistence/tailsdata_unlocked: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_persistent_volume

Output of ls -lar --full-time /var/cache/apt: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_var_cache_apt

Output of ls -lar --full-time /var/lib/apt: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_var_lib_apt

Output of mount: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.cmd_output_mount

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4701/artifact/build-artifacts/01:16:10_My_Additional_Software_list_is_configurable_through_a_GUI_or_through_notifications_when_I_install_or_remove_packages_with_APT_or_Synaptic.journal

After features/support/hooks.rb:75 0.010
10:26.044
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.168
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.080
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 21.634
And I accept adding "cowsay" to Additional Software 0.565
And Additional Software is correctly configured for package "cowsay" 0.740
And I shutdown Tails and wait for the computer to power off 11.027
And I start Tails from USB drive "__internal" with network unplugged 53.495
And I enable persistence 31.549
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 33.597
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.092
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.072
And the network is plugged 0.028
And Tor is ready 16.910
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.378
And available upgrades have been checked 0.112
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 4.015
And I can open the Additional Software configuration window from the notification 4.273
And I shutdown Tails and wait for the computer to power off 18.056
And I start Tails from USB drive "__internal" with network unplugged 54.959
And I enable persistence 30.002
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 33.688
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.786
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.039
And Tor is ready 50.288
Then the Additional Software upgrade service has started 0.179
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.104
After features/support/hooks.rb:450 2.287
After features/support/hooks.rb:291 0.656
After features/support/hooks.rb:75 0.072
2:19.167
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.180
And I start Tails from USB drive "__internal" with network unplugged 53.924
And I enable persistence 30.225
And I remove the "cowsay" deb files from the APT cache 0.602
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.079
And I log in to a new session 34.296
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.813
And I can open the Additional Software log file from the notification 5.401
And the package "cowsay" is not installed 0.643
After features/support/hooks.rb:450 0.106
After features/support/hooks.rb:291 0.712
After features/support/hooks.rb:75 0.010
Feature: Localization
2:35.108
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.963
When I log in to a new session in Arabic (ar) 29.510
Then the keyboard layout is set to "us" 0.154
When the network is plugged 0.028
And Tor is ready 13.649
Then I successfully start the Unsafe Browser in "ar" 14.462
And I kill the Unsafe Browser 5.723
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 34.798
And DuckDuckGo is the default search engine 21.695
And I kill the Tor Browser 5.618
And the screen keyboard works in Thunderbird 20.853
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 2.664
After features/support/hooks.rb:75 0.000
Feature: Localization
2:57.922
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.991
When I log in to a new session in Chinese (zh_CN) 29.872
Then the keyboard layout is set to "cn" 0.276
When the network is plugged 0.042
And Tor is ready 42.719
Then I successfully start the Unsafe Browser in "zh_CN" 14.634
And I kill the Unsafe Browser 5.729
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 34.938
And DuckDuckGo is the default search engine 10.595
And I kill the Tor Browser 5.505
And the screen keyboard works in Thunderbird 24.872
And the layout of the screen keyboard is set to "us" 0.593
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000
Feature: Localization
2:7.642
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.104
When I log in to a new session in English (en) 15.482
Then the keyboard layout is set to "us" 0.134
When the network is plugged 0.028
And Tor is ready 17.328
Then I successfully start the Unsafe Browser in "en" 14.367
And I kill the Unsafe Browser 5.723
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 33.559
And DuckDuckGo is the default search engine 5.383
And I kill the Tor Browser 5.285
And the screen keyboard works in Thunderbird 21.534
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.160
After features/support/hooks.rb:75 0.000
Feature: Localization
2:21.437
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.924
When I log in to a new session in French (fr) 29.334
Then the keyboard layout is set to "fr" 0.143
When the network is plugged 0.040
And Tor is ready 14.499
Then I successfully start the Unsafe Browser in "fr" 13.689
And I kill the Unsafe Browser 5.752
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 31.981
And DuckDuckGo is the default search engine 10.629
And I kill the Tor Browser 5.558
And the screen keyboard works in Thunderbird 21.216
And the layout of the screen keyboard is set to "fr" 0.575
After features/support/hooks.rb:291 1.316
After features/support/hooks.rb:75 0.000
Feature: Localization
2:23.517
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.225
When I log in to a new session in German (de) 30.112
Then the keyboard layout is set to "de" 0.168
When the network is plugged 0.042
And Tor is ready 15.090
Then I successfully start the Unsafe Browser in "de" 13.563
And I kill the Unsafe Browser 5.707
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 32.866
And DuckDuckGo is the default search engine 10.637
And I kill the Tor Browser 5.481
And the screen keyboard works in Thunderbird 20.953
And the layout of the screen keyboard is set to "de" 0.575
After features/support/hooks.rb:291 0.870
After features/support/hooks.rb:75 0.000
Feature: Localization
2:21.631
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.941
When I log in to a new session in Italian (it) 29.005
Then the keyboard layout is set to "it" 0.189
When the network is plugged 0.068
And Tor is ready 13.473
Then I successfully start the Unsafe Browser in "it" 13.647
And I kill the Unsafe Browser 5.748
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 33.894
And DuckDuckGo is the default search engine 11.143
And I kill the Tor Browser 5.462
And the screen keyboard works in Thunderbird 20.429
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:291 0.847
After features/support/hooks.rb:75 0.000
Feature: Localization
2:38.176
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.792
When I log in to a new session in Persian (fa) 30.039
Then the keyboard layout is set to "ir" 0.144
When the network is plugged 0.030
And Tor is ready 14.391
Then I successfully start the Unsafe Browser in "fa" 13.555
And I kill the Unsafe Browser 5.782
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 34.298
And DuckDuckGo is the default search engine 23.016
And I kill the Tor Browser 5.520
And the screen keyboard works in Thunderbird 22.896
And the layout of the screen keyboard is set to "ir" 0.597
After features/support/hooks.rb:291 2.425
After features/support/hooks.rb:75 0.000
Feature: Localization
2:29.579
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.081
When I log in to a new session in Portuguese (pt) 30.158
Then the keyboard layout is set to "pt" 0.190
When the network is plugged 0.034
And Tor is ready 14.329
Then I successfully start the Unsafe Browser in "pt" 17.441
And I kill the Unsafe Browser 5.712
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 33.998
And DuckDuckGo is the default search engine 10.765
And I kill the Tor Browser 5.433
And the screen keyboard works in Thunderbird 22.640
And the layout of the screen keyboard is set to "us" 0.687
After features/support/hooks.rb:291 1.284
After features/support/hooks.rb:75 0.000
Feature: Localization
2:39.775
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.335
When I log in to a new session in Russian (ru) 30.037
Then the keyboard layout is set to "ru" 0.174
When the network is plugged 0.049
And Tor is ready 14.462
Then I successfully start the Unsafe Browser in "ru" 15.815
And I kill the Unsafe Browser 5.869
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 33.721
And DuckDuckGo is the default search engine 19.311
And I kill the Tor Browser 5.525
And the screen keyboard works in Thunderbird 25.813
And the layout of the screen keyboard is set to "ru" 0.572
After features/support/hooks.rb:291 1.183
After features/support/hooks.rb:75 0.000
Feature: Localization
2:31.106
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.161
When I log in to a new session in Spanish (es) 30.317
Then the keyboard layout is set to "es" 0.189
When the network is plugged 0.035
And Tor is ready 15.701
Then I successfully start the Unsafe Browser in "es" 16.613
And I kill the Unsafe Browser 5.838
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 33.444
And DuckDuckGo is the default search engine 11.533
And I kill the Tor Browser 5.500
And the screen keyboard works in Thunderbird 23.080
And the layout of the screen keyboard is set to "us" 0.596
After features/support/hooks.rb:291 2.332
After features/support/hooks.rb:75 0.000
Feature: Localization
2:25.956
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.240
When I log in to a new session in Turkish (tr) 29.701
Then the keyboard layout is set to "tr" 0.218
When the network is plugged 0.246
And Tor is ready 14.644
Then I successfully start the Unsafe Browser in "tr" 16.764
And I kill the Unsafe Browser 5.789
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 33.434
And DuckDuckGo is the default search engine 10.463
And I kill the Tor Browser 5.525
And the screen keyboard works in Thunderbird 20.198
And the layout of the screen keyboard is set to "us" 0.617
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000