Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 74 16 May 2024, 06:55

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 263 1 11 0 0 275 21 1 22 1:4:43.407 Failed
35.304
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 23.535
And I prepare Tails for memory erasure tests 0.682
When I start a process allocating 128 MiB of memory with a known pattern 1.252
Then patterns cover at least 128 MiB in the guest's memory 4.198

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 1.357
Then I find very few patterns in the guest's memory 4.277

Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)

After features/support/hooks.rb:305 2.503
After features/support/hooks.rb:89 0.000
39.198
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 22.022
And I prepare Tails for memory erasure tests 0.671
And I find very few patterns in the guest's memory 4.772

Pattern coverage: 0.000% (0 MiB out of 880 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.960
Then patterns cover at least 99% of the test FS size in the guest's memory 4.271

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.824
Then I find very few patterns in the guest's memory 4.674

Pattern coverage: 0.000% (0 MiB out of 880 MiB reference memory)

After features/support/hooks.rb:305 2.023
After features/support/hooks.rb:89 0.000
52.051
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.287
And I prepare Tails for memory erasure tests 0.530
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.424
Then I find very few patterns in the guest's memory 4.824

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.684
Then patterns cover at least 86% of the test FS size in the guest's memory 4.315

Pattern coverage: 88.912% (113 MiB out of 127 MiB reference memory)

When I umount the USB drive 2.270
Then I find very few patterns in the guest's memory 4.609

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

# read cache
When I mount the USB drive again 0.264
And I read the content of the test FS 4.925
Then patterns cover at least 99% of the test FS size in the guest's memory 4.198

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.508
Then I find very few patterns in the guest's memory 4.207

Pattern coverage: 0.000% (0 MiB out of 879 MiB reference memory)

After features/support/hooks.rb:305 4.139
After features/support/hooks.rb:89 0.000
1:19.954
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.352
And I prepare Tails for memory erasure tests 0.523
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 34.441
Then I find very few patterns in the guest's memory 3.969

Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.274
Then patterns cover at least 99% of the test FS size in the guest's memory 3.864

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.068
Then I find very few patterns in the guest's memory 3.311

Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)

# read cache
When I mount the USB drive again 12.838
And I read the content of the test FS 1.023
Then patterns cover at least 99% of the test FS size in the guest's memory 3.082

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.763
Then I find very few patterns in the guest's memory 3.439

Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)

After features/support/hooks.rb:305 0.807
After features/support/hooks.rb:89 0.000
54.541
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.730
And I prepare Tails for memory erasure tests 0.497
When I fill a 128 MiB file with a known pattern on the root filesystem 19.073
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.781
Then patterns cover at least 128 MiB in the guest's memory 2.645

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.013
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.780

Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)

After features/support/hooks.rb:305 3.544
After features/support/hooks.rb:89 0.000
7:49.297
Before features/support/hooks.rb:259 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:5.013
And I prepare Tails for memory erasure tests 0.378
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.715
When I trigger shutdown 0.010
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.159

Pattern coverage: 0.000% (0 MiB out of 900 MiB reference memory)

After features/support/hooks.rb:305 3.510
After features/support/hooks.rb:89 0.011
5:7.289
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.283
And I update APT using apt 20.495
And I install "popularity-contest" using apt 22.327
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.514
When I create a persistent storage and activate the Additional Software feature 22.484
Then Additional Software is correctly configured for package "popularity-contest" 1.463
When I shutdown Tails and wait for the computer to power off 10.448
And I start Tails from USB drive "__internal" with network unplugged 59.209
And I enable persistence 24.846
And I log in to a new session 36.731
And the Additional Software installation service has started 40.838
Then I am notified that the installation succeeded 2.560
And Additional Software is correctly configured for package "popularity-contest" 0.794
And the package "popularity-contest" is installed after Additional Software has been started 0.290
After features/support/hooks.rb:464 39.672
After features/support/hooks.rb:305 1.270
After features/support/hooks.rb:89 0.012
2:26.982
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.004
Given a computer 0.217
And I start Tails from USB drive "__internal" and I login with an administration password 1:40.675
And I update APT using apt 17.032
When I install "makepp" using apt 22.442
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.525
And the package "makepp" is installed 0.088
After features/support/hooks.rb:464 40.096
After features/support/hooks.rb:305 0.845
After features/support/hooks.rb:89 0.013
5:6.948
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.007
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.348
When I uninstall "popularity-contest" using apt 21.809
And I accept removing "popularity-contest" from Additional Software 0.636
Then "popularity-contest" is not in the list of Additional Software 0.731
When I start Synaptic 26.942
And I update APT using Synaptic 22.633
And I install "cowsay" using Synaptic 11.626
And I accept adding "cowsay" to Additional Software 1.102
Then Additional Software is correctly configured for package "cowsay" 0.821
When I uninstall "cowsay" using apt 3.278
And I refuse removing "cowsay" from Additional Software 0.667
Then Additional Software is correctly configured for package "cowsay" 0.795
When I start "Additional Software" via GNOME Activities Overview 10.705
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.112
Then "cowsay" is not in the list of Additional Software 0.849
When I install "cowsay" using apt 3.208
And I refuse adding "cowsay" to Additional Software 0.655
Then "cowsay" is not in the list of Additional Software 0.822
After features/support/hooks.rb:464 0.994
After features/support/hooks.rb:305 0.885
After features/support/hooks.rb:89 0.011
9:56.896
Before features/support/hooks.rb:259 0.024
Before features/support/hooks.rb:456 0.017
Given a computer 0.220
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:24.914
And I configure APT to prefer an old version of cowsay 0.028
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.926
And I accept adding "cowsay" to Additional Software 9.147
And Additional Software is correctly configured for package "cowsay" 1.083
And I shutdown Tails and wait for the computer to power off 6.347
And I start Tails from USB drive "__internal" with network unplugged 1:0.356
And I enable persistence 14.427
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.033
And I log in to a new session 39.643
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 40.972
And I revert the APT tweaks that made it prefer an old version of cowsay 0.050
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.078
And the network is plugged 0.049
And Tor is ready 22.277
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.785
And available upgrades have been checked 0.126
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.903
And I can open the Additional Software configuration window from the notification 3.318
And I shutdown Tails and wait for the computer to power off 14.736
And I start Tails from USB drive "__internal" with network unplugged 59.915
And I enable persistence 13.660
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 36.633
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.678
And I revert the APT tweaks that made it prefer an old version of cowsay 0.050
And the network is plugged 0.049
And Tor is ready 51.139
Then the Additional Software upgrade service has started 0.212
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.101
After features/support/hooks.rb:464 2.136
After features/support/hooks.rb:305 1.280
After features/support/hooks.rb:89 0.030
2:14.496
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.005
Given a computer 0.196
And I start Tails from USB drive "__internal" with network unplugged 1:0.714
And I enable persistence 14.265
And I remove the "cowsay" deb files from the APT cache 0.847
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.103
And I log in to a new session 37.657
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.348
And I can open the Additional Software log file from the notification 5.616
And the package "cowsay" is not installed 0.747
After features/support/hooks.rb:464 0.104
After features/support/hooks.rb:305 1.102
After features/support/hooks.rb:89 0.008
Feature: Localization
2:23.853
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.433
When I log in to a new session in Arabic (ar) 32.666
Then the keyboard layout is set to "us" 0.144
When the network is plugged 0.040
And Tor is ready 16.563
Then I successfully start the Unsafe Browser in "ar" 16.576
And I kill the Unsafe Browser 5.857
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 32.030
And DuckDuckGo is the default search engine 11.180
And I kill the Tor Browser 5.608
And the screen keyboard works in Thunderbird 14.099
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:305 2.665
After features/support/hooks.rb:89 0.000
Feature: Localization
2:28.997
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.373
When I log in to a new session in Chinese (zh_CN) 34.561
Then the keyboard layout is set to "cn" 0.412
When the network is plugged 0.034
And Tor is ready 15.825
Then I successfully start the Unsafe Browser in "zh_CN" 16.844
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 29.458
And DuckDuckGo is the default search engine 11.814
And I kill the Tor Browser 5.585
And the screen keyboard works in Thunderbird 19.560
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:305 1.546
After features/support/hooks.rb:89 0.000
Feature: Localization
2:7.991
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.103
When I log in to a new session in English (en) 21.401
Then the keyboard layout is set to "us" 0.279
When the network is plugged 0.069
And Tor is ready 17.057
Then I successfully start the Unsafe Browser in "en" 16.218
And I kill the Unsafe Browser 5.737
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 29.320
And DuckDuckGo is the default search engine 7.717
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 14.990
And the layout of the screen keyboard is set to "us" 0.667
After features/support/hooks.rb:305 2.681
After features/support/hooks.rb:89 0.000
Feature: Localization
2:23.923
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.868
When I log in to a new session in French (fr) 34.622
Then the keyboard layout is set to "fr" 0.229
When the network is plugged 0.041
And Tor is ready 16.905
Then I successfully start the Unsafe Browser in "fr" 15.779
And I kill the Unsafe Browser 5.704
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 31.245
And DuckDuckGo is the default search engine 11.247
And I kill the Tor Browser 5.516
And the screen keyboard works in Thunderbird 13.030
And the layout of the screen keyboard is set to "fr" 0.599
After features/support/hooks.rb:305 0.973
After features/support/hooks.rb:89 0.000
Feature: Localization
2:29.602
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.039
When I log in to a new session in German (de) 35.917
Then the keyboard layout is set to "de" 0.348
When the network is plugged 0.046
And Tor is ready 17.638
Then I successfully start the Unsafe Browser in "de" 17.519
And I kill the Unsafe Browser 5.738
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 33.500
And DuckDuckGo is the default search engine 11.344
And I kill the Tor Browser 5.591
And the screen keyboard works in Thunderbird 13.217
And the layout of the screen keyboard is set to "de" 0.571
After features/support/hooks.rb:305 1.665
After features/support/hooks.rb:89 0.000
Feature: Localization
2:36.037
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.635
When I log in to a new session in Italian (it) 32.572
Then the keyboard layout is set to "it" 0.501
When the network is plugged 0.042
And Tor is ready 18.724
Then I successfully start the Unsafe Browser in "it" 15.942
And I kill the Unsafe Browser 5.891
When I enable the screen keyboard 0.180
Then the screen keyboard works in Tor Browser 33.835
And DuckDuckGo is the default search engine 17.523
And I kill the Tor Browser 5.453
And the screen keyboard works in Thunderbird 14.169
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:305 3.222
After features/support/hooks.rb:89 0.000
Feature: Localization
3:27.022
Scenario Outline Tails is localized for every tier-1 language
Before features/support/hooks.rb:259 0.004
Steps
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.610
When I log in to a new session in Persian (fa) 3:17.412
cannot find GnomeApplicationsMenuPersian.png on the screen (FindFailed)
./features/support/helpers/screen.rb:173:in `rescue in wait'
./features/support/helpers/screen.rb:157:in `wait'
./features/step_definitions/common_steps.rb:558:in `/^the Tails desktop is ready$/'
./features/step_definitions/common_steps.rb:514:in `/^I log in to a new session(?: in ([^ ]*) \(([^ ]*)\))?( without activating the Persistent Storage)?( after having activated the Persistent Storage| expecting no warning about the Persistent Storage not being activated)?$/'
features/localization.feature:53:in `When I log in to a new session in Persian (fa)'
features/localization.feature:23:in `When I log in to a new session in <language> (<lang_code>)'
Then the keyboard layout is set to "ir" 0.000
When the network is plugged 0.000
And Tor is ready 0.000
Then I successfully start the Unsafe Browser in "fa" 0.000
And I kill the Unsafe Browser 0.000
When I enable the screen keyboard 0.000
Then the screen keyboard works in Tor Browser 0.000
And DuckDuckGo is the default search engine 0.000
And I kill the Tor Browser 0.000
And the screen keyboard works in Thunderbird 0.000
And the layout of the screen keyboard is set to "ir" 0.000
After features/support/hooks.rb:305 4.335

SCENARIO FAILED: 'Tails is localized for every tier-1 language, Examples (#7)' (at time 02:39:27)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/74/artifact/build-artifacts/02:39:27_Tails_is_localized_for_every_tier-1_language,_Examples___7_.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/74/artifact/build-artifacts/02:39:27_Tails_is_localized_for_every_tier-1_language,_Examples___7_.mkv

Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/74/artifact/build-artifacts/02:39:27_Tails_is_localized_for_every_tier-1_language,_Examples___7_.boot-log

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/74/artifact/build-artifacts/02:39:27_Tails_is_localized_for_every_tier-1_language,_Examples___7_.journal

After features/support/hooks.rb:89 0.000
Feature: Localization
2:24.317
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.373
When I log in to a new session in Portuguese (pt) 33.271
Then the keyboard layout is set to "pt" 0.295
When the network is plugged 0.035
And Tor is ready 19.451
Then I successfully start the Unsafe Browser in "pt" 15.856
And I kill the Unsafe Browser 5.737
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 31.273
And DuckDuckGo is the default search engine 10.459
And I kill the Tor Browser 5.486
And the screen keyboard works in Thunderbird 13.312
And the layout of the screen keyboard is set to "us" 0.639
After features/support/hooks.rb:305 1.177
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.690
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.100
When I log in to a new session in Russian (ru) 32.633
Then the keyboard layout is set to "ru" 0.194
When the network is plugged 0.052
And Tor is ready 17.524
Then I successfully start the Unsafe Browser in "ru" 16.927
And I kill the Unsafe Browser 5.734
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 30.364
And DuckDuckGo is the default search engine 10.147
And I kill the Tor Browser 5.267
And the screen keyboard works in Thunderbird 15.020
And the layout of the screen keyboard is set to "ru" 0.618
After features/support/hooks.rb:305 1.730
After features/support/hooks.rb:89 0.000
Feature: Localization
2:33.954
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.431
When I log in to a new session in Spanish (es) 35.856
Then the keyboard layout is set to "es" 0.501
When the network is plugged 0.089
And Tor is ready 16.666
Then I successfully start the Unsafe Browser in "es" 16.654
And I kill the Unsafe Browser 5.906
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 31.185
And DuckDuckGo is the default search engine 18.339
And I kill the Tor Browser 5.588
And the screen keyboard works in Thunderbird 14.041
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:305 1.432
After features/support/hooks.rb:89 0.000
Feature: Localization
2:22.054
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.303
When I log in to a new session in Turkish (tr) 33.061
Then the keyboard layout is set to "tr" 0.227
When the network is plugged 0.037
And Tor is ready 14.992
Then I successfully start the Unsafe Browser in "tr" 16.383
And I kill the Unsafe Browser 5.764
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 30.566
And DuckDuckGo is the default search engine 11.042
And I kill the Tor Browser 5.528
And the screen keyboard works in Thunderbird 15.425
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:305 3.551
After features/support/hooks.rb:89 0.000