Project Number Date
test_Tails_ISO_stable 4752 27 Mar 2024, 16:17

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 265 1 5 0 0 271 21 1 22 52:52.828 Failed
17.485
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.043
And I prepare Tails for memory erasure tests 0.465
When I start a process allocating 128 MiB of memory with a known pattern 1.361
Then patterns cover at least 128 MiB in the guest's memory 3.656

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.191
Then I find very few patterns in the guest's memory 3.767

Pattern coverage: 0.000% (0 MiB out of 922 MiB reference memory)

After features/support/hooks.rb:291 0.663
After features/support/hooks.rb:75 0.000
21.854
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.035
And I prepare Tails for memory erasure tests 0.380
And I find very few patterns in the guest's memory 3.724

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.568
Then patterns cover at least 99% of the test FS size in the guest's memory 3.233

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.475
Then I find very few patterns in the guest's memory 4.437

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

After features/support/hooks.rb:291 0.995
After features/support/hooks.rb:75 0.000
40.605
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.941
And I prepare Tails for memory erasure tests 0.400
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.837
Then I find very few patterns in the guest's memory 3.847

Pattern coverage: 0.000% (0 MiB out of 927 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.152
Then patterns cover at least 86% of the test FS size in the guest's memory 3.950

Pattern coverage: 89.200% (113 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.026
Then I find very few patterns in the guest's memory 4.319

Pattern coverage: 0.000% (0 MiB out of 927 MiB reference memory)

# read cache
When I mount the USB drive again 0.462
And I read the content of the test FS 0.418
Then patterns cover at least 99% of the test FS size in the guest's memory 4.003

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.445
Then I find very few patterns in the guest's memory 3.800

Pattern coverage: 0.000% (0 MiB out of 927 MiB reference memory)

After features/support/hooks.rb:291 1.142
After features/support/hooks.rb:75 0.000
1:1.946
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.982
And I prepare Tails for memory erasure tests 0.413
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.381
Then I find very few patterns in the guest's memory 3.374

Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1.728
Then patterns cover at least 99% of the test FS size in the guest's memory 2.975

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.780
Then I find very few patterns in the guest's memory 3.539

Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)

# read cache
When I mount the USB drive again 3.844
And I read the content of the test FS 0.317
Then patterns cover at least 99% of the test FS size in the guest's memory 3.227

Pattern coverage: 106.115% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.487
Then I find very few patterns in the guest's memory 3.893

Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)

After features/support/hooks.rb:291 0.781
After features/support/hooks.rb:75 0.000
48.469
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.343
And I prepare Tails for memory erasure tests 0.412
When I fill a 128 MiB file with a known pattern on the root filesystem 13.412
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.565
Then patterns cover at least 128 MiB in the guest's memory 2.898

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.015
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.802

Pattern coverage: 0.000% (0 MiB out of 902 MiB reference memory)

After features/support/hooks.rb:291 3.518
After features/support/hooks.rb:75 0.000
2:9.372
Scenario Erasure of read and write disk caches of persistent data on shutdown
Before features/support/hooks.rb:245 0.003
Steps
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 2:9.372
try_for() timeout expired
Last ignored exception was: RemoteShell::ServerFailure: FileNotFoundError: [Errno 2] No such file or directory: '/tmp/gdm-env'
./features/support/helpers/remote_shell.rb:71:in `block (2 levels) in communicate'
./features/support/helpers/remote_shell.rb:42:in `loop'
./features/support/helpers/remote_shell.rb:42:in `block in communicate'
./features/support/helpers/remote_shell.rb:37:in `communicate'
./features/support/helpers/remote_shell.rb:174:in `execute'
./features/support/helpers/remote_shell.rb:185:in `initialize'
./features/support/helpers/dogtail.rb:80:in `new'
./features/support/helpers/dogtail.rb:80:in `run'
./features/support/helpers/dogtail.rb:70:in `initialize'
./features/step_definitions/usb.rb:108:in `new'
./features/step_definitions/usb.rb:108:in `greeter'
./features/step_definitions/common_steps.rb:450:in `block (2 levels) in <top (required)>'
./features/support/helpers/misc_helpers.rb:78:in `block (2 levels) in try_for'
./features/support/helpers/misc_helpers.rb:66:in `loop'
./features/support/helpers/misc_helpers.rb:66:in `block in try_for'
./features/support/helpers/misc_helpers.rb:65:in `try_for'
./features/step_definitions/common_steps.rb:449:in `block in <top (required)>'
./features/step_definitions/common_steps.rb:288:in `block in <top (required)>'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:133:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:133:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:133:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `block (2 levels) in <top (required)>' (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:449:in `/^the computer (?:re)?boots Tails( with genuine APT sources)?$/'
./features/step_definitions/common_steps.rb:288:in `/^I start Tails from (.+?) drive "(.+?)"( with network unplugged)?( and I login( with persistence enabled)?( with the changed persistence passphrase)?( (?:and|with) an administration password)?)?$/'
./features/step_definitions/snapshots.rb:148:in `block in reach_checkpoint'
./features/step_definitions/snapshots.rb:145:in `each'
./features/step_definitions/snapshots.rb:145:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:133:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:133:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:133:in `reach_checkpoint'
./features/step_definitions/snapshots.rb:168:in `/^I\ have\ started\ Tails\ without\ network\ from\ a\ USB\ drive\ with\ a\ persistent\ partition\ enabled\ and\ logged\ in$/'
features/erase_memory.feature:76:in `Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in'
And I prepare Tails for memory erasure tests 0.000
When I fill a 128 MiB file with a known pattern on the persistent filesystem 0.000
When I trigger shutdown 0.000
And I wait 20 seconds 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:291 4.009

SCENARIO FAILED: 'Erasure of read and write disk caches of persistent data on shutdown' (at time 00:33:00)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4752/artifact/build-artifacts/00:33:00_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4752/artifact/build-artifacts/00:33:00_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4752/artifact/build-artifacts/00:33:00_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4752/artifact/build-artifacts/00:33:00_Erasure_of_read_and_write_disk_caches_of_persistent_data_on_shutdown.journal

After features/support/hooks.rb:75 0.006
4:44.351
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.815
And I update APT using apt 18.282
And I install "popularity-contest" using apt 19.393
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.225
When I create a persistent storage and activate the Additional Software feature 20.845
Then Additional Software is correctly configured for package "popularity-contest" 1.230
When I shutdown Tails and wait for the computer to power off 12.917
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:28.605
Then Additional Software is correctly configured for package "popularity-contest" 0.776
And the package "popularity-contest" is installed after Additional Software has been started 0.258
After features/support/hooks.rb:450 40.353
After features/support/hooks.rb:291 0.995
After features/support/hooks.rb:75 0.014
2:12.662
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.194
And I start Tails from USB drive "__internal" and I login with an administration password 1:31.320
And I update APT using apt 15.859
When I install "makepp" using apt 19.642
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.579
And the package "makepp" is installed 0.066
After features/support/hooks.rb:450 39.829
After features/support/hooks.rb:291 0.770
After features/support/hooks.rb:75 0.015
5:13.095
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.244
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:26.998
When I uninstall "popularity-contest" using apt 18.709
And I accept removing "popularity-contest" from Additional Software 0.530
Then "popularity-contest" is not in the list of Additional Software 0.690
When I start Synaptic 25.689
And I update APT using Synaptic 22.580
And I install "cowsay" using Synaptic 10.837
And I accept adding "cowsay" to Additional Software 1.043
Then Additional Software is correctly configured for package "cowsay" 0.800
When I uninstall "cowsay" using apt 3.222
And I refuse removing "cowsay" from Additional Software 0.565
Then Additional Software is correctly configured for package "cowsay" 0.781
When I start "Additional Software" via GNOME Activities Overview 10.540
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.611
Then "cowsay" is not in the list of Additional Software 0.806
When I install "cowsay" using apt 3.204
And I refuse adding "cowsay" to Additional Software 0.567
Then "cowsay" is not in the list of Additional Software 0.671
After features/support/hooks.rb:450 1.080
After features/support/hooks.rb:291 0.671
After features/support/hooks.rb:75 0.027
8:45.627
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.212
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.811
And I configure APT to prefer an old version of cowsay 0.027
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.222
And I accept adding "cowsay" to Additional Software 7.036
And Additional Software is correctly configured for package "cowsay" 0.945
And I shutdown Tails and wait for the computer to power off 6.661
And I start Tails from USB drive "__internal" with network unplugged 1:3.166
And I enable persistence 12.660
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.033
And I log in to a new session 33.949
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.155
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.100
And the network is plugged 0.047
And Tor is ready 20.919
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.961
And available upgrades have been checked 0.085
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.067
And I can open the Additional Software configuration window from the notification 3.420
And I shutdown Tails and wait for the computer to power off 13.015
And I start Tails from USB drive "__internal" with network unplugged 54.207
And I enable persistence 10.446
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 33.045
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.595
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
And the network is plugged 0.045
And Tor is ready 41.347
Then the Additional Software upgrade service has started 0.208
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.106
After features/support/hooks.rb:450 2.402
After features/support/hooks.rb:291 0.994
After features/support/hooks.rb:75 0.032
1:50.901
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.005
Given a computer 0.232
And I start Tails from USB drive "__internal" with network unplugged 55.501
And I enable persistence 10.756
And I remove the "cowsay" deb files from the APT cache 0.583
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.093
And I log in to a new session 31.816
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 6.285
And I can open the Additional Software log file from the notification 5.073
And the package "cowsay" is not installed 0.558
After features/support/hooks.rb:450 0.106
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.008
Feature: Localization
2:19.459
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.957
When I log in to a new session in Arabic (ar) 28.950
Then the keyboard layout is set to "us" 0.190
When the network is plugged 0.037
And Tor is ready 16.832
Then I successfully start the Unsafe Browser in "ar" 14.921
And I kill the Unsafe Browser 5.743
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 26.536
And DuckDuckGo is the default search engine 19.255
And I kill the Tor Browser 5.490
And the screen keyboard works in Thunderbird 12.819
And the layout of the screen keyboard is set to "us" 0.622
After features/support/hooks.rb:291 1.378
After features/support/hooks.rb:75 0.000
Feature: Localization
2:18.786
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.066
When I log in to a new session in Chinese (zh_CN) 31.941
Then the keyboard layout is set to "cn" 0.252
When the network is plugged 0.040
And Tor is ready 15.202
Then I successfully start the Unsafe Browser in "zh_CN" 14.871
And I kill the Unsafe Browser 5.707
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 25.845
And DuckDuckGo is the default search engine 10.645
And I kill the Tor Browser 5.584
And the screen keyboard works in Thunderbird 19.989
And the layout of the screen keyboard is set to "us" 0.542
After features/support/hooks.rb:291 1.533
After features/support/hooks.rb:75 0.000
Feature: Localization
1:48.545
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.711
When I log in to a new session in English (en) 13.444
Then the keyboard layout is set to "us" 0.211
When the network is plugged 0.043
And Tor is ready 14.556
Then I successfully start the Unsafe Browser in "en" 14.854
And I kill the Unsafe Browser 5.702
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 28.081
And DuckDuckGo is the default search engine 5.552
And I kill the Tor Browser 5.286
And the screen keyboard works in Thunderbird 11.358
And the layout of the screen keyboard is set to "us" 0.637
After features/support/hooks.rb:291 1.170
After features/support/hooks.rb:75 0.000
Feature: Localization
2:18.549
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.981
When I log in to a new session in French (fr) 28.098
Then the keyboard layout is set to "fr" 0.148
When the network is plugged 0.039
And Tor is ready 15.593
Then I successfully start the Unsafe Browser in "fr" 13.895
And I kill the Unsafe Browser 5.701
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 25.615
And DuckDuckGo is the default search engine 22.929
And I kill the Tor Browser 5.520
And the screen keyboard works in Thunderbird 12.358
And the layout of the screen keyboard is set to "fr" 0.561
After features/support/hooks.rb:291 1.148
After features/support/hooks.rb:75 0.000
Feature: Localization
2:20.169
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.608
When I log in to a new session in German (de) 28.860
Then the keyboard layout is set to "de" 0.191
When the network is plugged 0.038
And Tor is ready 18.854
Then I successfully start the Unsafe Browser in "de" 13.662
And I kill the Unsafe Browser 5.673
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 27.799
And DuckDuckGo is the default search engine 18.811
And I kill the Tor Browser 5.561
And the screen keyboard works in Thunderbird 11.456
And the layout of the screen keyboard is set to "de" 0.556
After features/support/hooks.rb:291 5.656
After features/support/hooks.rb:75 0.000
Feature: Localization
2:8.367
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.031
When I log in to a new session in Italian (it) 27.539
Then the keyboard layout is set to "it" 0.163
When the network is plugged 0.044
And Tor is ready 15.513
Then I successfully start the Unsafe Browser in "it" 14.427
And I kill the Unsafe Browser 5.735
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 25.549
And DuckDuckGo is the default search engine 10.706
And I kill the Tor Browser 5.454
And the screen keyboard works in Thunderbird 14.481
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:291 1.059
After features/support/hooks.rb:75 0.000
Feature: Localization
2:21.332
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.321
When I log in to a new session in Persian (fa) 31.041
Then the keyboard layout is set to "ir" 0.163
When the network is plugged 0.066
And Tor is ready 17.777
Then I successfully start the Unsafe Browser in "fa" 14.514
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 26.947
And DuckDuckGo is the default search engine 18.942
And I kill the Tor Browser 5.521
And the screen keyboard works in Thunderbird 11.591
And the layout of the screen keyboard is set to "ir" 0.537
After features/support/hooks.rb:291 2.288
After features/support/hooks.rb:75 0.000
Feature: Localization
2:21.972
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.995
When I log in to a new session in Portuguese (pt) 36.043
Then the keyboard layout is set to "pt" 0.152
When the network is plugged 0.080
And Tor is ready 13.660
Then I successfully start the Unsafe Browser in "pt" 14.348
And I kill the Unsafe Browser 5.779
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 25.725
And DuckDuckGo is the default search engine 19.323
And I kill the Tor Browser 5.569
And the screen keyboard works in Thunderbird 11.548
And the layout of the screen keyboard is set to "us" 0.640
After features/support/hooks.rb:291 1.280
After features/support/hooks.rb:75 0.000
Feature: Localization
2:9.358
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.262
When I log in to a new session in Russian (ru) 28.953
Then the keyboard layout is set to "ru" 0.116
When the network is plugged 0.037
And Tor is ready 15.447
Then I successfully start the Unsafe Browser in "ru" 14.304
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 25.755
And DuckDuckGo is the default search engine 10.207
And I kill the Tor Browser 5.493
And the screen keyboard works in Thunderbird 14.185
And the layout of the screen keyboard is set to "ru" 0.640
After features/support/hooks.rb:291 1.839
After features/support/hooks.rb:75 0.000
Feature: Localization
2:21.799
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.028
When I log in to a new session in Spanish (es) 28.783
Then the keyboard layout is set to "es" 0.153
When the network is plugged 0.040
And Tor is ready 16.182
Then I successfully start the Unsafe Browser in "es" 13.582
And I kill the Unsafe Browser 5.735
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 27.327
And DuckDuckGo is the default search engine 22.105
And I kill the Tor Browser 5.575
And the screen keyboard works in Thunderbird 13.625
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:291 1.053
After features/support/hooks.rb:75 0.000
Feature: Localization
2:18.114
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.866
When I log in to a new session in Turkish (tr) 28.776
Then the keyboard layout is set to "tr" 0.268
When the network is plugged 0.046
And Tor is ready 15.642
Then I successfully start the Unsafe Browser in "tr" 15.273
And I kill the Unsafe Browser 5.685
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 25.375
And DuckDuckGo is the default search engine 21.374
And I kill the Tor Browser 5.461
And the screen keyboard works in Thunderbird 11.670
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 1.365
After features/support/hooks.rb:75 0.000