Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 52 23 Apr 2024, 06:48

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 262 2 11 0 0 275 20 2 22 1:6:0.240 Failed
20.868
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:259 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.592
And I prepare Tails for memory erasure tests 0.451
When I start a process allocating 128 MiB of memory with a known pattern 1.349
Then patterns cover at least 128 MiB in the guest's memory 3.600

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.302
Then I find very few patterns in the guest's memory 6.571
7.667% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1

Pattern coverage: 7.667% (68 MiB out of 893 MiB reference memory)

After features/support/hooks.rb:305 5.592

SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:27)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/00:29:27_Erasure_of_memory_freed_by_killed_userspace_processes.journal

After features/support/hooks.rb:89 0.000
24.785
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.573
And I prepare Tails for memory erasure tests 0.448
And I find very few patterns in the guest's memory 4.616

Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.250
Then patterns cover at least 99% of the test FS size in the guest's memory 4.008

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.576
Then I find very few patterns in the guest's memory 4.310

Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)

After features/support/hooks.rb:305 1.063
After features/support/hooks.rb:89 0.000
50.139
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.528
And I prepare Tails for memory erasure tests 0.493
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.905
Then I find very few patterns in the guest's memory 4.917

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.852
Then patterns cover at least 86% of the test FS size in the guest's memory 4.248

Pattern coverage: 86.313% (110 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.359
Then I find very few patterns in the guest's memory 4.761

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

# read cache
When I mount the USB drive again 0.322
And I read the content of the test FS 0.724
Then patterns cover at least 99% of the test FS size in the guest's memory 4.190

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.424
Then I find very few patterns in the guest's memory 5.410

Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)

After features/support/hooks.rb:305 0.786
After features/support/hooks.rb:89 0.000
1:17.874
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.151
And I prepare Tails for memory erasure tests 0.478
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 34.619
Then I find very few patterns in the guest's memory 3.554

Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.661
Then patterns cover at least 99% of the test FS size in the guest's memory 7.025

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.085
Then I find very few patterns in the guest's memory 4.043

Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)

# read cache
When I mount the USB drive again 6.740
And I read the content of the test FS 0.561
Then patterns cover at least 99% of the test FS size in the guest's memory 3.816

Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.941
Then I find very few patterns in the guest's memory 4.194

Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)

After features/support/hooks.rb:305 2.410
After features/support/hooks.rb:89 0.000
53.410
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.628
And I prepare Tails for memory erasure tests 0.596
When I fill a 128 MiB file with a known pattern on the root filesystem 17.773
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.764
Then patterns cover at least 128 MiB in the guest's memory 2.915

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.017
And I wait 20 seconds 20.003

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.710

Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)

After features/support/hooks.rb:305 3.505
After features/support/hooks.rb:89 0.000
7:39.373
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:52.057
And I prepare Tails for memory erasure tests 0.488
When I fill a 128 MiB file with a known pattern on the persistent filesystem 24.556
When I trigger shutdown 0.010
And I wait 20 seconds 20.014

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.245

Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)

After features/support/hooks.rb:305 3.675
After features/support/hooks.rb:89 0.012
5:11.882
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 55.861
And I update APT using apt 19.858
And I install "popularity-contest" using apt 22.495
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.777
When I create a persistent storage and activate the Additional Software feature 21.219
Then Additional Software is correctly configured for package "popularity-contest" 1.483
When I shutdown Tails and wait for the computer to power off 10.350
And I start Tails from USB drive "__internal" with network unplugged 1:7.703
And I enable persistence 23.679
And I log in to a new session 36.068
And the Additional Software installation service has started 41.145
Then I am notified that the installation succeeded 2.038
And Additional Software is correctly configured for package "popularity-contest" 0.976
And the package "popularity-contest" is installed after Additional Software has been started 0.225
After features/support/hooks.rb:464 38.914
After features/support/hooks.rb:305 1.189
After features/support/hooks.rb:89 0.012
2:26.304
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.004
Given a computer 0.256
And I start Tails from USB drive "__internal" and I login with an administration password 1:39.943
And I update APT using apt 16.573
When I install "makepp" using apt 23.025
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.433
And the package "makepp" is installed 0.072
After features/support/hooks.rb:464 36.656
After features/support/hooks.rb:305 0.912
After features/support/hooks.rb:89 0.014
5:13.513
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.006
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:21.909
When I uninstall "popularity-contest" using apt 21.795
And I accept removing "popularity-contest" from Additional Software 0.555
Then "popularity-contest" is not in the list of Additional Software 0.724
When I start Synaptic 27.225
And I update APT using Synaptic 22.607
And I install "cowsay" using Synaptic 10.913
And I accept adding "cowsay" to Additional Software 1.476
Then Additional Software is correctly configured for package "cowsay" 0.792
When I uninstall "cowsay" using apt 3.239
And I refuse removing "cowsay" from Additional Software 0.617
Then Additional Software is correctly configured for package "cowsay" 0.757
When I start "Additional Software" via GNOME Activities Overview 10.521
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.894
Then "cowsay" is not in the list of Additional Software 0.793
When I install "cowsay" using apt 3.224
And I refuse adding "cowsay" to Additional Software 0.583
Then "cowsay" is not in the list of Additional Software 0.662
After features/support/hooks.rb:464 0.905
After features/support/hooks.rb:305 0.699
After features/support/hooks.rb:89 0.010
11:38.162
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.006
Given a computer 0.313
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:21.658
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.804
And I accept adding "cowsay" to Additional Software 7.348
And Additional Software is correctly configured for package "cowsay" 0.837
And I shutdown Tails and wait for the computer to power off 6.406
And I start Tails from USB drive "__internal" with network unplugged 59.736
And I enable persistence 13.315
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 35.755
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.440
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.039
And Tor is ready 20.360
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.400
And available upgrades have been checked 0.165
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.413
And I can open the Additional Software configuration window from the notification 3.610
And I shutdown Tails and wait for the computer to power off 2:7.052
And I start Tails from USB drive "__internal" with network unplugged 58.556
And I enable persistence 13.424
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 37.295
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.766
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.061
And Tor is ready 52.863
Then the Additional Software upgrade service has started 0.175
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.091
After features/support/hooks.rb:464 2.401
After features/support/hooks.rb:305 0.950
After features/support/hooks.rb:89 0.024
2:7.420
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.005
Given a computer 0.192
And I start Tails from USB drive "__internal" with network unplugged 57.822
And I enable persistence 12.342
And I remove the "cowsay" deb files from the APT cache 0.626
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.080
And I log in to a new session 37.074
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.538
And I can open the Additional Software log file from the notification 5.166
And the package "cowsay" is not installed 0.575
After features/support/hooks.rb:464 0.101
After features/support/hooks.rb:305 0.821
After features/support/hooks.rb:89 0.010
Feature: Localization
2:35.576
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.158
When I log in to a new session in Arabic (ar) 31.254
Then the keyboard layout is set to "us" 0.237
When the network is plugged 0.037
And Tor is ready 17.383
Then I successfully start the Unsafe Browser in "ar" 15.048
And I kill the Unsafe Browser 6.904
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 28.019
And DuckDuckGo is the default search engine 28.963
And I kill the Tor Browser 5.506
And the screen keyboard works in Thunderbird 13.311
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:305 1.281
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.451
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.216
When I log in to a new session in Chinese (zh_CN) 32.129
Then the keyboard layout is set to "cn" 0.205
When the network is plugged 0.050
And Tor is ready 18.528
Then I successfully start the Unsafe Browser in "zh_CN" 15.547
And I kill the Unsafe Browser 5.875
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 26.470
And DuckDuckGo is the default search engine 11.825
And I kill the Tor Browser 5.440
And the screen keyboard works in Thunderbird 17.484
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:305 2.574
After features/support/hooks.rb:89 0.000
Feature: Localization
2:6.426
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.979
When I log in to a new session in English (en) 17.871
Then the keyboard layout is set to "us" 0.299
When the network is plugged 0.034
And Tor is ready 19.977
Then I successfully start the Unsafe Browser in "en" 16.102
And I kill the Unsafe Browser 5.694
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 28.967
And DuckDuckGo is the default search engine 10.833
And I kill the Tor Browser 5.501
And the screen keyboard works in Thunderbird 12.456
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:305 2.913
After features/support/hooks.rb:89 0.000
Feature: Localization
2:38.615
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.230
When I log in to a new session in French (fr) 35.560
Then the keyboard layout is set to "fr" 0.338
When the network is plugged 0.043
And Tor is ready 16.307
Then I successfully start the Unsafe Browser in "fr" 16.035
And I kill the Unsafe Browser 5.907
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 30.337
And DuckDuckGo is the default search engine 26.009
And I kill the Tor Browser 5.489
And the screen keyboard works in Thunderbird 13.665
And the layout of the screen keyboard is set to "fr" 0.544
After features/support/hooks.rb:305 3.688
After features/support/hooks.rb:89 0.000
Feature: Localization
2:20.317
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.077
When I log in to a new session in German (de) 32.661
Then the keyboard layout is set to "de" 0.389
When the network is plugged 0.040
And Tor is ready 17.609
Then I successfully start the Unsafe Browser in "de" 16.710
And I kill the Unsafe Browser 5.825
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 29.290
And DuckDuckGo is the default search engine 10.288
And I kill the Tor Browser 5.544
And the screen keyboard works in Thunderbird 13.142
And the layout of the screen keyboard is set to "de" 0.618
After features/support/hooks.rb:305 3.073
After features/support/hooks.rb:89 0.000
Feature: Localization
3:25.757
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.006
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.283
When I log in to a new session in Italian (it) 3:17.473
cannot find GnomeApplicationsMenuItalian.png on the screen (FindFailed)
./features/support/helpers/screen.rb:173:in `rescue in wait'
./features/support/helpers/screen.rb:157:in `wait'
./features/step_definitions/common_steps.rb:558:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:514:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:52:in `When I log in to a new session in Italian (it)'
features/localization.feature:23:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "it" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "it" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:305 4.374

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#6)' (at time 02:35:21)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/02:35:21_Tails_is_localized_for_every_tier-1_language,_Examples___6_.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/02:35:21_Tails_is_localized_for_every_tier-1_language,_Examples___6_.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/02:35:21_Tails_is_localized_for_every_tier-1_language,_Examples___6_.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/52/artifact/build-artifacts/02:35:21_Tails_is_localized_for_every_tier-1_language,_Examples___6_.journal

After features/support/hooks.rb:89 0.000
Feature: Localization
2:33.518
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.181
When I log in to a new session in Persian (fa) 33.847
Then the keyboard layout is set to "ir" 0.235
When the network is plugged 0.043
And Tor is ready 16.527
Then I successfully start the Unsafe Browser in "fa" 17.044
And I kill the Unsafe Browser 5.702
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 28.652
And DuckDuckGo is the default search engine 23.533
And I kill the Tor Browser 5.479
And the screen keyboard works in Thunderbird 13.557
And the layout of the screen keyboard is set to "ir" 0.606
After features/support/hooks.rb:305 3.566
After features/support/hooks.rb:89 0.000
Feature: Localization
2:20.256
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.679
When I log in to a new session in Portuguese (pt) 32.239
Then the keyboard layout is set to "pt" 0.215
When the network is plugged 0.038
And Tor is ready 17.403
Then I successfully start the Unsafe Browser in "pt" 14.911
And I kill the Unsafe Browser 5.901
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 28.353
And DuckDuckGo is the default search engine 11.457
And I kill the Tor Browser 5.487
And the screen keyboard works in Thunderbird 14.654
And the layout of the screen keyboard is set to "us" 0.762
After features/support/hooks.rb:305 1.301
After features/support/hooks.rb:89 0.000
Feature: Localization
2:28.561
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.817
When I log in to a new session in Russian (ru) 32.513
Then the keyboard layout is set to "ru" 0.249
When the network is plugged 0.047
And Tor is ready 18.045
Then I successfully start the Unsafe Browser in "ru" 15.153
And I kill the Unsafe Browser 5.975
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 29.565
And DuckDuckGo is the default search engine 18.612
And I kill the Tor Browser 5.489
And the screen keyboard works in Thunderbird 13.439
And the layout of the screen keyboard is set to "ru" 0.528
After features/support/hooks.rb:305 0.917
After features/support/hooks.rb:89 0.000
Feature: Localization
2:20.454
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.072
When I log in to a new session in Spanish (es) 32.026
Then the keyboard layout is set to "es" 0.180
When the network is plugged 0.051
And Tor is ready 17.573
Then I successfully start the Unsafe Browser in "es" 16.595
And I kill the Unsafe Browser 5.964
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 29.479
And DuckDuckGo is the default search engine 11.474
And I kill the Tor Browser 5.491
And the screen keyboard works in Thunderbird 12.838
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:305 1.170
After features/support/hooks.rb:89 0.000
Feature: Localization
2:44.569
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.081
When I log in to a new session in Turkish (tr) 33.471
Then the keyboard layout is set to "tr" 0.349
When the network is plugged 0.037
And Tor is ready 46.553
Then I successfully start the Unsafe Browser in "tr" 14.911
And I kill the Unsafe Browser 5.834
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 26.949
And DuckDuckGo is the default search engine 10.028
And I kill the Tor Browser 5.318
And the screen keyboard works in Thunderbird 12.364
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:305 1.297
After features/support/hooks.rb:89 0.000