Project Number Date
test_Tails_ISO_stable 4962 23 Jul 2024, 08:49

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 270 2 3 0 0 275 20 2 22 1:2:53.334 Failed
18.535
Scenario Erasure of memory freed by killed userspace processes
Before features/support/hooks.rb:269 0.003
Steps
Given I have started Tails from DVD without network and logged in 8.616
And I prepare Tails for memory erasure tests 0.467
When I start a process allocating 128 MiB of memory with a known pattern 1.209
Then patterns cover at least 128 MiB in the guest's memory 3.591

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.421
Then I find very few patterns in the guest's memory 4.228
5.877% of the free memory still has the pattern, but less than 0.800% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:219:in `/^I find very few patterns in the guest's memory$/'
features/erase_memory.feature:19:in `Then I find very few patterns in the guest's memory'
Output 1

Pattern coverage: 5.877% (51 MiB out of 878 MiB reference memory)

After features/support/hooks.rb:326 6.252

SCENARIO FAILED: 'Erasure of memory freed by killed userspace processes' (at time 00:29:23)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/00:29:23_Erasure_of_memory_freed_by_killed_userspace_processes.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/00:29:23_Erasure_of_memory_freed_by_killed_userspace_processes.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/00:29:23_Erasure_of_memory_freed_by_killed_userspace_processes.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/00:29:23_Erasure_of_memory_freed_by_killed_userspace_processes.journal

After features/support/hooks.rb:100 0.000
23.260
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.344
And I prepare Tails for memory erasure tests 0.419
And I find very few patterns in the guest's memory 4.296

Pattern coverage: 0.000% (0 MiB out of 871 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.967
Then patterns cover at least 99% of the test FS size in the guest's memory 3.351

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.656
Then I find very few patterns in the guest's memory 4.223

Pattern coverage: 0.000% (0 MiB out of 871 MiB reference memory)

After features/support/hooks.rb:326 1.817
After features/support/hooks.rb:100 0.000
58.498
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 21.854
And I prepare Tails for memory erasure tests 0.500
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.253
Then I find very few patterns in the guest's memory 4.598

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.774
Then patterns cover at least 86% of the test FS size in the guest's memory 4.172

Pattern coverage: 86.708% (110 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.431
Then I find very few patterns in the guest's memory 3.779

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

# read cache
When I mount the USB drive again 0.375
And I read the content of the test FS 1.744
Then patterns cover at least 99% of the test FS size in the guest's memory 3.290

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.912
Then I find very few patterns in the guest's memory 3.808

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

After features/support/hooks.rb:326 1.894
After features/support/hooks.rb:100 0.000
1:13.945
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.681
And I prepare Tails for memory erasure tests 0.520
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 34.309
Then I find very few patterns in the guest's memory 3.956

Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1.846
Then patterns cover at least 99% of the test FS size in the guest's memory 3.004

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.394
Then I find very few patterns in the guest's memory 3.307

Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)

# read cache
When I mount the USB drive again 5.574
And I read the content of the test FS 0.498
Then patterns cover at least 99% of the test FS size in the guest's memory 2.908

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 3.742
Then I find very few patterns in the guest's memory 3.199

Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)

After features/support/hooks.rb:326 0.864
After features/support/hooks.rb:100 0.000
52.317
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.003
And I prepare Tails for memory erasure tests 0.516
When I fill a 128 MiB file with a known pattern on the root filesystem 16.433
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.762
Then patterns cover at least 128 MiB in the guest's memory 2.702

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.016
And I wait 20 seconds 20.015

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.867

Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)

After features/support/hooks.rb:326 3.619
After features/support/hooks.rb:100 0.000
8:6.684
Before features/support/hooks.rb:269 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:15.152
And I prepare Tails for memory erasure tests 0.493
When I fill a 128 MiB file with a known pattern on the persistent filesystem 28.743
When I trigger shutdown 0.013
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.261

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

After features/support/hooks.rb:326 3.549
After features/support/hooks.rb:100 0.013
5:7.297
Before features/support/hooks.rb:269 0.002
Before features/support/hooks.rb:507 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 58.409
And I update APT using apt 19.428
And I install "popularity-contest" using apt 22.497
Then I am proposed to add the "popularity-contest" package to my Additional Software 10.131
When I create a persistent storage and activate the Additional Software feature 21.336
Then Additional Software is correctly configured for package "popularity-contest" 1.474
When I shutdown Tails and wait for the computer to power off 12.391
And I start Tails from USB drive "__internal" with network unplugged 1:1.931
And I enable persistence 21.829
And I log in to a new session 43.558
And the Additional Software installation service has started 31.193
Then I am notified that the installation succeeded 1.949
And Additional Software is correctly configured for package "popularity-contest" 0.838
And the package "popularity-contest" is installed after Additional Software has been started 0.327
After features/support/hooks.rb:515 39.034
After features/support/hooks.rb:326 1.475
After features/support/hooks.rb:100 0.014
2:34.401
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.007
Given a computer 0.209
And I start Tails from USB drive "__internal" and I login with an administration password 1:47.023
And I update APT using apt 16.614
When I install "makepp" using apt 26.079
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.375
And the package "makepp" is installed 0.098
After features/support/hooks.rb:515 38.691
After features/support/hooks.rb:326 1.339
After features/support/hooks.rb:100 0.013
5:21.468
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.007
Given a computer 0.252
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:25.542
When I uninstall "popularity-contest" using apt 21.898
And I accept removing "popularity-contest" from Additional Software 0.549
Then "popularity-contest" is not in the list of Additional Software 0.749
When I start Synaptic 28.022
And I update APT using Synaptic 22.329
And I install "cowsay" using Synaptic 14.146
And I accept adding "cowsay" to Additional Software 0.766
Then Additional Software is correctly configured for package "cowsay" 0.930
When I uninstall "cowsay" using apt 3.245
And I refuse removing "cowsay" from Additional Software 0.599
Then Additional Software is correctly configured for package "cowsay" 0.930
When I start "Additional Software" via GNOME Activities Overview 10.771
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.169
Then "cowsay" is not in the list of Additional Software 0.917
When I install "cowsay" using apt 3.244
And I refuse adding "cowsay" to Additional Software 0.633
Then "cowsay" is not in the list of Additional Software 0.766
After features/support/hooks.rb:515 1.042
After features/support/hooks.rb:326 0.761
After features/support/hooks.rb:100 0.010
10:6.126
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.005
Given a computer 0.232
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:27.572
And I configure APT to prefer an old version of cowsay 0.032
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.428
And I accept adding "cowsay" to Additional Software 8.174
And Additional Software is correctly configured for package "cowsay" 0.914
And I shutdown Tails and wait for the computer to power off 6.496
And I start Tails from USB drive "__internal" with network unplugged 1:3.835
And I enable persistence 13.542
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.074
And I log in to a new session 45.060
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 32.162
And I revert the APT tweaks that made it prefer an old version of cowsay 0.075
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.102
And the network is plugged 0.050
And Tor is ready 21.521
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.083
And available upgrades have been checked 0.064
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.428
And I can open the Additional Software configuration window from the notification 4.759
And I shutdown Tails and wait for the computer to power off 15.130
And I start Tails from USB drive "__internal" with network unplugged 1:0.989
And I enable persistence 13.277
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 39.227
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.973
And I revert the APT tweaks that made it prefer an old version of cowsay 0.057
And the network is plugged 0.039
And Tor is ready 50.542
Then the Additional Software upgrade service has started 0.163
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.082
After features/support/hooks.rb:515 2.362
After features/support/hooks.rb:326 1.155
After features/support/hooks.rb:100 0.032
2:23.948
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.007
Given a computer 0.247
And I start Tails from USB drive "__internal" with network unplugged 1:6.754
And I enable persistence 13.023
And I remove the "cowsay" deb files from the APT cache 0.779
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.094
And I log in to a new session 38.067
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 18.224
And I can open the Additional Software log file from the notification 6.064
And the package "cowsay" is not installed 0.693
After features/support/hooks.rb:515 0.106
After features/support/hooks.rb:326 1.384
After features/support/hooks.rb:100 0.020
Feature: Localization
2:23.799
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.597
When I log in to a new session in Arabic (ar) 33.088
Then the keyboard layout is set to "us" 0.119
When the network is plugged 0.049
And Tor is ready 15.909
Then I successfully start the Unsafe Browser in "ar" 16.465
And I kill the Unsafe Browser 5.996
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 33.273
And DuckDuckGo is the default search engine 10.018
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 14.236
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:326 1.797
After features/support/hooks.rb:100 0.000
Feature: Localization
2:27.972
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.982
When I log in to a new session in Chinese (zh_CN) 34.849
Then the keyboard layout is set to "cn" 0.329
When the network is plugged 0.051
And Tor is ready 16.612
Then I successfully start the Unsafe Browser in "zh_CN" 15.515
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 30.560
And DuckDuckGo is the default search engine 10.619
And I kill the Tor Browser 5.670
And the screen keyboard works in Thunderbird 18.158
And the layout of the screen keyboard is set to "us" 0.646
After features/support/hooks.rb:326 2.539
After features/support/hooks.rb:100 0.000
Feature: Localization
2:2.802
Before features/support/hooks.rb:269 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.364
When I log in to a new session in English (en) 18.599
Then the keyboard layout is set to "us" 0.190
When the network is plugged 0.055
And Tor is ready 16.745
Then I successfully start the Unsafe Browser in "en" 17.244
And I kill the Unsafe Browser 5.694
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 29.798
And DuckDuckGo is the default search engine 5.462
And I kill the Tor Browser 5.318
And the screen keyboard works in Thunderbird 14.658
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:326 2.414
After features/support/hooks.rb:100 0.000
Feature: Localization
2:20.215
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.236
When I log in to a new session in French (fr) 33.058
Then the keyboard layout is set to "fr" 0.150
When the network is plugged 0.045
And Tor is ready 16.548
Then I successfully start the Unsafe Browser in "fr" 16.322
And I kill the Unsafe Browser 5.999
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 31.392
And DuckDuckGo is the default search engine 10.087
And I kill the Tor Browser 5.372
And the screen keyboard works in Thunderbird 12.324
And the layout of the screen keyboard is set to "fr" 0.544
After features/support/hooks.rb:326 1.230
After features/support/hooks.rb:100 0.000
Feature: Localization
2:22.265
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.313
When I log in to a new session in German (de) 34.047
Then the keyboard layout is set to "de" 0.243
When the network is plugged 0.053
And Tor is ready 15.160
Then I successfully start the Unsafe Browser in "de" 16.851
And I kill the Unsafe Browser 5.790
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 31.420
And DuckDuckGo is the default search engine 10.619
And I kill the Tor Browser 5.635
And the screen keyboard works in Thunderbird 13.417
And the layout of the screen keyboard is set to "de" 0.581
After features/support/hooks.rb:326 1.382
After features/support/hooks.rb:100 0.000
Feature: Localization
2:19.761
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.248
When I log in to a new session in Italian (it) 33.197
Then the keyboard layout is set to "it" 0.230
When the network is plugged 0.060
And Tor is ready 16.706
Then I successfully start the Unsafe Browser in "it" 15.273
And I kill the Unsafe Browser 5.764
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 29.921
And DuckDuckGo is the default search engine 10.187
And I kill the Tor Browser 5.591
And the screen keyboard works in Thunderbird 13.814
And the layout of the screen keyboard is set to "us" 0.668
After features/support/hooks.rb:326 3.265
After features/support/hooks.rb:100 0.000
Feature: Localization
2:23.012
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.829
When I log in to a new session in Persian (fa) 33.842
Then the keyboard layout is set to "ir" 0.120
When the network is plugged 0.047
And Tor is ready 16.293
Then I successfully start the Unsafe Browser in "fa" 15.979
And I kill the Unsafe Browser 6.070
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 30.441
And DuckDuckGo is the default search engine 10.731
And I kill the Tor Browser 5.689
And the screen keyboard works in Thunderbird 14.228
And the layout of the screen keyboard is set to "ir" 0.636
After features/support/hooks.rb:326 1.019
After features/support/hooks.rb:100 0.000
Feature: Localization
2:22.272
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.345
When I log in to a new session in Portuguese (pt) 35.033
Then the keyboard layout is set to "pt" 0.159
When the network is plugged 0.045
And Tor is ready 15.765
Then I successfully start the Unsafe Browser in "pt" 18.291
And I kill the Unsafe Browser 5.940
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 29.439
And DuckDuckGo is the default search engine 10.115
And I kill the Tor Browser 5.405
And the screen keyboard works in Thunderbird 13.056
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:326 4.057
After features/support/hooks.rb:100 0.000
Feature: Localization
2:27.449
Before features/support/hooks.rb:269 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.147
When I log in to a new session in Russian (ru) 36.958
Then the keyboard layout is set to "ru" 0.147
When the network is plugged 0.041
And Tor is ready 17.804
Then I successfully start the Unsafe Browser in "ru" 17.635
And I kill the Unsafe Browser 6.049
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 30.416
And DuckDuckGo is the default search engine 10.171
And I kill the Tor Browser 5.339
And the screen keyboard works in Thunderbird 14.034
And the layout of the screen keyboard is set to "ru" 0.589
After features/support/hooks.rb:326 2.447
After features/support/hooks.rb:100 0.000
Feature: Localization
2:21.009
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.166
When I log in to a new session in Spanish (es) 32.681
Then the keyboard layout is set to "es" 0.186
When the network is plugged 0.250
And Tor is ready 18.430
Then I successfully start the Unsafe Browser in "es" 15.905
And I kill the Unsafe Browser 5.883
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 31.139
And DuckDuckGo is the default search engine 9.576
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 12.764
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:326 3.782
After features/support/hooks.rb:100 0.000
Feature: Localization
1:56.291
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:269 0.008
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.284
When I log in to a new session in Turkish (tr) 33.166
Then the keyboard layout is set to "tr" 0.247
When the network is plugged 0.037
And Tor is ready 17.383
Then I successfully start the Unsafe Browser in "tr" 15.019
And I kill the Unsafe Browser 6.047
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 28.956
And DuckDuckGo is the default search engine 7.049
undefined method `child' for nil:NilClass

           .child(roleName: 'entry')
           ^^^^^^ (NoMethodError)
./features/step_definitions/browser.rb:27:in `browser_url_entry'
./features/step_definitions/browser.rb:32:in `get_current_browser_url'
./features/step_definitions/browser.rb:54:in `block in set_browser_url'
./features/support/helpers/misc_helpers.rb:211:in `block in retry_action'
./features/support/helpers/misc_helpers.rb:208:in `loop'
./features/support/helpers/misc_helpers.rb:208:in `retry_action'
./features/step_definitions/browser.rb:49:in `set_browser_url'
./features/step_definitions/browser.rb:387:in `/^DuckDuckGo is the default search engine$/'
features/localization.feature:57:in `And DuckDuckGo is the default search engine'
features/localization.feature:31:in `And DuckDuckGo is the default search engine'
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "us" 0.000
After features/support/hooks.rb:326 5.763

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#11)' (at time 02:42:17)

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/02:42:17_Tails_is_localized_for_every_tier-1_language,_Examples___11_.file_content_var_log_boot.log

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/02:42:17_Tails_is_localized_for_every_tier-1_language,_Examples___11_.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/02:42:17_Tails_is_localized_for_every_tier-1_language,_Examples___11_.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4962/artifact/build-artifacts/02:42:17_Tails_is_localized_for_every_tier-1_language,_Examples___11_.journal

After features/support/hooks.rb:100 0.000