Project Number Date
test_Tails_ISO_stable 4813 27 Apr 2024, 12:29

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 261 2 12 0 0 275 20 2 22 1:5:46.447 Failed
22.122
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:259 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.637
And I prepare Tails for memory erasure tests 0.518
When I start a process allocating 128 MiB of memory with a known pattern 3.912
Then patterns cover at least 128 MiB in the guest's memory 3.846

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.250
Then I find very few patterns in the guest's memory 4.957
4.696% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1

Pattern coverage: 4.696% (40 MiB out of 873 MiB reference memory)

After features/support/hooks.rb:305 4.603

SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:28:50)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4813/artifact/build-artifacts/00:28:50_Erasure_of_memory_freed_by_killed_userspace_processes.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4813/artifact/build-artifacts/00:28:50_Erasure_of_memory_freed_by_killed_userspace_processes.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4813/artifact/build-artifacts/00:28:50_Erasure_of_memory_freed_by_killed_userspace_processes.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4813/artifact/build-artifacts/00:28:50_Erasure_of_memory_freed_by_killed_userspace_processes.journal

After features/support/hooks.rb:89 0.000
25.791
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.149
And I prepare Tails for memory erasure tests 0.413
And I find very few patterns in the guest's memory 4.637

Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 3.130
Then patterns cover at least 99% of the test FS size in the guest's memory 4.062

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 1.174
Then I find very few patterns in the guest's memory 4.224

Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)

After features/support/hooks.rb:305 1.102
After features/support/hooks.rb:89 0.000
45.603
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.471
And I prepare Tails for memory erasure tests 0.407
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.165
Then I find very few patterns in the guest's memory 4.093

Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.697
Then patterns cover at least 86% of the test FS size in the guest's memory 3.306

Pattern coverage: 90.048% (114 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.321
Then I find very few patterns in the guest's memory 3.586

Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)

# read cache
When I mount the USB drive again 0.341
And I read the content of the test FS 0.953
Then patterns cover at least 99% of the test FS size in the guest's memory 4.153

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 2.521
Then I find very few patterns in the guest's memory 4.582

Pattern coverage: 0.000% (0 MiB out of 875 MiB reference memory)

After features/support/hooks.rb:305 1.498
After features/support/hooks.rb:89 0.000
1:15.793
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 7.960
And I prepare Tails for memory erasure tests 0.417
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 38.036
Then I find very few patterns in the guest's memory 4.772

Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.797
Then patterns cover at least 99% of the test FS size in the guest's memory 3.041

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.994
Then I find very few patterns in the guest's memory 3.453

Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)

# read cache
When I mount the USB drive again 6.230
And I read the content of the test FS 0.978
Then patterns cover at least 99% of the test FS size in the guest's memory 2.963

Pattern coverage: 106.115% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.758
Then I find very few patterns in the guest's memory 3.387

Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)

After features/support/hooks.rb:305 1.152
After features/support/hooks.rb:89 0.000
55.557
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.278
And I prepare Tails for memory erasure tests 0.483
When I fill a 128 MiB file with a known pattern on the root filesystem 19.259
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.610
Then patterns cover at least 128 MiB in the guest's memory 3.067

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.018
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.820

Pattern coverage: 0.000% (0 MiB out of 873 MiB reference memory)

After features/support/hooks.rb:305 3.567
After features/support/hooks.rb:89 0.000
7:41.436
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:55.889
And I prepare Tails for memory erasure tests 0.438
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.821
When I trigger shutdown 0.012
And I wait 20 seconds 20.017

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.257

Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)

After features/support/hooks.rb:305 3.507
After features/support/hooks.rb:89 0.015
5:41.349
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:27.521
And I update APT using apt 16.944
And I install "popularity-contest" using apt 25.783
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.302
When I create a persistent storage and activate the Additional Software feature 22.323
Then Additional Software is correctly configured for package "popularity-contest" 1.438
When I shutdown Tails and wait for the computer to power off 12.709
And I start Tails from USB drive "__internal" with network unplugged 1:2.427
And I enable persistence 25.177
And I log in to a new session 36.468
And the Additional Software installation service has started 41.361
Then I am notified that the installation succeeded 2.663
And Additional Software is correctly configured for package "popularity-contest" 0.906
And the package "popularity-contest" is installed after Additional Software has been started 0.318
After features/support/hooks.rb:464 39.911
After features/support/hooks.rb:305 1.198
After features/support/hooks.rb:89 0.014
2:31.235
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.009
Given a computer 0.221
And I start Tails from USB drive "__internal" and I login with an administration password 1:42.903
And I update APT using apt 17.995
When I install "makepp" using apt 25.659
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.376
And the package "makepp" is installed 0.079
After features/support/hooks.rb:464 41.112
After features/support/hooks.rb:305 0.855
After features/support/hooks.rb:89 0.014
5:9.396
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.009
Given a computer 0.225
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:13.133
When I uninstall "popularity-contest" using apt 21.887
And I accept removing "popularity-contest" from Additional Software 0.811
Then "popularity-contest" is not in the list of Additional Software 0.751
When I start Synaptic 28.597
And I update APT using Synaptic 22.111
And I install "cowsay" using Synaptic 12.280
And I accept adding "cowsay" to Additional Software 2.267
Then Additional Software is correctly configured for package "cowsay" 0.816
When I uninstall "cowsay" using apt 3.194
And I refuse removing "cowsay" from Additional Software 0.566
Then Additional Software is correctly configured for package "cowsay" 0.887
When I start "Additional Software" via GNOME Activities Overview 10.651
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.685
Then "cowsay" is not in the list of Additional Software 0.936
When I install "cowsay" using apt 3.222
And I refuse adding "cowsay" to Additional Software 0.639
Then "cowsay" is not in the list of Additional Software 0.729
After features/support/hooks.rb:464 1.139
After features/support/hooks.rb:305 1.164
After features/support/hooks.rb:89 0.018
11:38.224
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.008
Steps
Given a computer 0.235
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:33.778
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 31.163
And I accept adding "cowsay" to Additional Software 5.670
And Additional Software is correctly configured for package "cowsay" 1.086
And I shutdown Tails and wait for the computer to power off 7.109
And I start Tails from USB drive "__internal" with network unplugged 1:5.492
And I enable persistence 14.619
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 37.912
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.861
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.090
And the network is plugged 1.898
And Tor is ready 23.123
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 12.287
And available upgrades have been checked 0.516
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:1.259
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:146:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:52:in `try_for'
./features/step_definitions/common_steps.rb:591:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:105:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:464 0.030
After features/support/hooks.rb:305 9.688

SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:33:59)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4813/artifact/build-artifacts/01:33:59_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4813/artifact/build-artifacts/01:33:59_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv

After features/support/hooks.rb:89 0.022
2:18.321
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.007
Given a computer 0.226
And I start Tails from USB drive "__internal" with network unplugged 1:1.108
And I enable persistence 14.721
And I remove the "cowsay" deb files from the APT cache 0.683
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.090
And I log in to a new session 37.209
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 16.647
And I can open the Additional Software log file from the notification 6.958
And the package "cowsay" is not installed 0.676
After features/support/hooks.rb:464 0.135
After features/support/hooks.rb:305 1.055
After features/support/hooks.rb:89 0.012
Feature: Localization
2:29.476
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.006
When I log in to a new session in Arabic (ar) 33.234
Then the keyboard layout is set to "us" 0.182
When the network is plugged 0.048
And Tor is ready 15.959
Then I successfully start the Unsafe Browser in "ar" 15.546
And I kill the Unsafe Browser 5.958
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 28.433
And DuckDuckGo is the default search engine 23.039
And I kill the Tor Browser 5.465
And the screen keyboard works in Thunderbird 12.916
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:305 1.702
After features/support/hooks.rb:89 0.000
Feature: Localization
2:40.917
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.083
When I log in to a new session in Chinese (zh_CN) 32.518
Then the keyboard layout is set to "cn" 0.400
When the network is plugged 0.034
And Tor is ready 18.459
Then I successfully start the Unsafe Browser in "zh_CN" 15.389
And I kill the Unsafe Browser 5.800
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 29.066
And DuckDuckGo is the default search engine 29.160
And I kill the Tor Browser 5.515
And the screen keyboard works in Thunderbird 15.800
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:305 1.075
After features/support/hooks.rb:89 0.000
Feature: Localization
2:2.875
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.027
When I log in to a new session in English (en) 17.438
Then the keyboard layout is set to "us" 0.305
When the network is plugged 0.047
And Tor is ready 16.557
Then I successfully start the Unsafe Browser in "en" 16.474
And I kill the Unsafe Browser 5.696
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 28.988
And DuckDuckGo is the default search engine 10.534
And I kill the Tor Browser 5.449
And the screen keyboard works in Thunderbird 12.667
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:305 2.530
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.995
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.158
When I log in to a new session in French (fr) 33.721
Then the keyboard layout is set to "fr" 0.384
When the network is plugged 0.056
And Tor is ready 14.680
Then I successfully start the Unsafe Browser in "fr" 16.383
And I kill the Unsafe Browser 5.938
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 29.351
And DuckDuckGo is the default search engine 14.517
And I kill the Tor Browser 5.465
And the screen keyboard works in Thunderbird 13.595
And the layout of the screen keyboard is set to "fr" 0.623
After features/support/hooks.rb:305 8.549
After features/support/hooks.rb:89 0.000
Feature: Localization
2:29.675
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.252
When I log in to a new session in German (de) 32.024
Then the keyboard layout is set to "de" 0.221
When the network is plugged 0.068
And Tor is ready 17.683
Then I successfully start the Unsafe Browser in "de" 14.922
And I kill the Unsafe Browser 5.858
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 27.769
And DuckDuckGo is the default search engine 23.701
And I kill the Tor Browser 5.530
And the screen keyboard works in Thunderbird 12.937
And the layout of the screen keyboard is set to "de" 0.601
After features/support/hooks.rb:305 1.110
After features/support/hooks.rb:89 0.000
Feature: Localization
2:25.173
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.453
When I log in to a new session in Italian (it) 32.539
Then the keyboard layout is set to "it" 0.239
When the network is plugged 0.058
And Tor is ready 14.772
Then I successfully start the Unsafe Browser in "it" 15.617
And I kill the Unsafe Browser 5.713
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 27.119
And DuckDuckGo is the default search engine 21.816
And I kill the Tor Browser 5.493
And the screen keyboard works in Thunderbird 12.662
And the layout of the screen keyboard is set to "us" 0.546
After features/support/hooks.rb:305 1.043
After features/support/hooks.rb:89 0.000
Feature: Localization
2:29.236
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.207
When I log in to a new session in Persian (fa) 32.081
Then the keyboard layout is set to "ir" 0.258
When the network is plugged 0.038
And Tor is ready 16.628
Then I successfully start the Unsafe Browser in "fa" 15.111
And I kill the Unsafe Browser 5.754
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 29.191
And DuckDuckGo is the default search engine 22.930
And I kill the Tor Browser 5.599
And the screen keyboard works in Thunderbird 12.715
And the layout of the screen keyboard is set to "ir" 0.595
After features/support/hooks.rb:305 1.412
After features/support/hooks.rb:89 0.000
Feature: Localization
2:31.381
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.132
When I log in to a new session in Portuguese (pt) 32.409
Then the keyboard layout is set to "pt" 0.210
When the network is plugged 0.053
And Tor is ready 16.988
Then I successfully start the Unsafe Browser in "pt" 17.333
And I kill the Unsafe Browser 5.787
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 25.976
And DuckDuckGo is the default search engine 25.524
And I kill the Tor Browser 5.504
And the screen keyboard works in Thunderbird 12.741
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:305 2.963
After features/support/hooks.rb:89 0.000
Feature: Localization
2:27.987
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.003
When I log in to a new session in Russian (ru) 32.988
Then the keyboard layout is set to "ru" 0.143
When the network is plugged 0.039
And Tor is ready 16.765
Then I successfully start the Unsafe Browser in "ru" 17.668
And I kill the Unsafe Browser 5.851
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 26.209
And DuckDuckGo is the default search engine 20.084
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 14.014
And the layout of the screen keyboard is set to "ru" 0.617
After features/support/hooks.rb:305 1.098
After features/support/hooks.rb:89 0.000
Feature: Localization
2:43.177
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.774
When I log in to a new session in Spanish (es) 31.512
Then the keyboard layout is set to "es" 0.172
When the network is plugged 0.045
And Tor is ready 18.223
Then I successfully start the Unsafe Browser in "es" 15.095
And I kill the Unsafe Browser 5.758
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 29.261
And DuckDuckGo is the default search engine 33.689
And I kill the Tor Browser 5.518
And the screen keyboard works in Thunderbird 13.351
And the layout of the screen keyboard is set to "us" 0.664
After features/support/hooks.rb:305 1.343
After features/support/hooks.rb:89 0.000
Feature: Localization
2:18.718
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.942
When I log in to a new session in Turkish (tr) 32.526
Then the keyboard layout is set to "tr" 0.331
When the network is plugged 0.045
And Tor is ready 17.289
Then I successfully start the Unsafe Browser in "tr" 15.853
And I kill the Unsafe Browser 5.864
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 28.750
And DuckDuckGo is the default search engine 10.921
And I kill the Tor Browser 5.468
And the screen keyboard works in Thunderbird 12.980
And the layout of the screen keyboard is set to "us" 0.616
After features/support/hooks.rb:305 3.086
After features/support/hooks.rb:89 0.000