Project Number Date
test_Tails_ISO_20268-more-early-patch-functionality 47 18 Apr 2024, 22:54

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 262 1 12 0 0 275 21 1 22 1:32.322 Failed
18.465
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 7.993
And I prepare Tails for memory erasure tests 0.404
When I start a process allocating 128 MiB of memory with a known pattern 1.179
Then patterns cover at least 128 MiB in the guest's memory 3.541

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.854
Then I find very few patterns in the guest's memory 4.493

Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)

After features/support/hooks.rb:305 0.782
After features/support/hooks.rb:89 0.000
24.120
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.129
And I prepare Tails for memory erasure tests 0.365
And I find very few patterns in the guest's memory 4.696

Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.793
Then patterns cover at least 99% of the test FS size in the guest's memory 4.507

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.584
Then I find very few patterns in the guest's memory 4.044

Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)

After features/support/hooks.rb:305 0.697
After features/support/hooks.rb:89 0.000
41.023
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.042
And I prepare Tails for memory erasure tests 0.414
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.829
Then I find very few patterns in the guest's memory 3.811

Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.319
Then patterns cover at least 86% of the test FS size in the guest's memory 3.643

Pattern coverage: 88.930% (113 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.908
Then I find very few patterns in the guest's memory 4.224

Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)

# read cache
When I mount the USB drive again 0.224
And I read the content of the test FS 0.412
Then patterns cover at least 99% of the test FS size in the guest's memory 3.780

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 0.362
Then I find very few patterns in the guest's memory 4.050

Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)

After features/support/hooks.rb:305 0.736
After features/support/hooks.rb:89 0.000
1:7.604
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 7.962
And I prepare Tails for memory erasure tests 0.360
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 33.225
Then I find very few patterns in the guest's memory 4.016

Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1.645
Then patterns cover at least 99% of the test FS size in the guest's memory 3.262

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.702
Then I find very few patterns in the guest's memory 3.800

Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)

# read cache
When I mount the USB drive again 4.182
And I read the content of the test FS 0.421
Then patterns cover at least 99% of the test FS size in the guest's memory 3.353

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.995
Then I find very few patterns in the guest's memory 3.674

Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)

After features/support/hooks.rb:305 0.835
After features/support/hooks.rb:89 0.000
50.267
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.359
And I prepare Tails for memory erasure tests 0.396
When I fill a 128 MiB file with a known pattern on the root filesystem 15.310
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.219
Then patterns cover at least 128 MiB in the guest's memory 3.060

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.012
And I wait 20 seconds 20.012

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.895

Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)

After features/support/hooks.rb:305 3.552
After features/support/hooks.rb:89 0.000
6:47.297
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:3.388
And I prepare Tails for memory erasure tests 0.423
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.262
When I trigger shutdown 0.011
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.191

Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)

After features/support/hooks.rb:305 3.536
After features/support/hooks.rb:89 0.012
5:6.721
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.033
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 57.486
And I update APT using apt 16.665
And I install "popularity-contest" using apt 22.344
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.128
When I create a persistent storage and activate the Additional Software feature 23.374
Then Additional Software is correctly configured for package "popularity-contest" 1.508
When I shutdown Tails and wait for the computer to power off 10.269
And I start Tails from USB drive "__internal" with network unplugged 1:1.334
And I enable persistence 20.669
And I log in to a new session 39.694
And the Additional Software installation service has started 41.527
Then I am notified that the installation succeeded 2.718
And Additional Software is correctly configured for package "popularity-contest" 0.758
And the package "popularity-contest" is installed after Additional Software has been started 0.242
After features/support/hooks.rb:464 37.357
After features/support/hooks.rb:305 1.094
After features/support/hooks.rb:89 0.013
2:25.682
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.198
And I start Tails from USB drive "__internal" and I login with an administration password 1:40.206
And I update APT using apt 16.746
When I install "makepp" using apt 23.009
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.439
And the package "makepp" is installed 0.081
After features/support/hooks.rb:464 35.116
After features/support/hooks.rb:305 0.981
After features/support/hooks.rb:89 0.017
5:8.128
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.007
Given a computer 0.193
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:17.886
When I uninstall "popularity-contest" using apt 21.871
And I accept removing "popularity-contest" from Additional Software 0.590
Then "popularity-contest" is not in the list of Additional Software 0.713
When I start Synaptic 25.396
And I update APT using Synaptic 23.446
And I install "cowsay" using Synaptic 11.186
And I accept adding "cowsay" to Additional Software 0.893
Then Additional Software is correctly configured for package "cowsay" 0.843
When I uninstall "cowsay" using apt 3.212
And I refuse removing "cowsay" from Additional Software 0.523
Then Additional Software is correctly configured for package "cowsay" 0.752
When I start "Additional Software" via GNOME Activities Overview 10.575
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.762
Then "cowsay" is not in the list of Additional Software 0.843
When I install "cowsay" using apt 3.215
And I refuse adding "cowsay" to Additional Software 0.524
Then "cowsay" is not in the list of Additional Software 0.698
After features/support/hooks.rb:464 1.022
After features/support/hooks.rb:305 0.744
After features/support/hooks.rb:89 0.012
11:4.909
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.007
Steps
Given a computer 0.181
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:20.543
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.103
And I accept adding "cowsay" to Additional Software 7.941
And Additional Software is correctly configured for package "cowsay" 0.885
And I shutdown Tails and wait for the computer to power off 6.429
And I start Tails from USB drive "__internal" with network unplugged 59.462
And I enable persistence 13.441
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 35.074
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.336
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.082
And the network is plugged 0.039
And Tor is ready 22.376
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.787
And available upgrades have been checked 0.052
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:1.066
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:146:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:52:in `try_for'
./features/step_definitions/common_steps.rb:591:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:105:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:464 0.029
After features/support/hooks.rb:305 8.696

SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:26:52)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/47/artifact/build-artifacts/01:26:52_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_20268-more-early-patch-functionality/47/artifact/build-artifacts/01:26:52_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv

After features/support/hooks.rb:89 0.015
2:15.034
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.006
Given a computer 0.241
And I start Tails from USB drive "__internal" with network unplugged 1:0.056
And I enable persistence 17.648
And I remove the "cowsay" deb files from the APT cache 0.678
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.083
And I log in to a new session 35.826
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.111
And I can open the Additional Software log file from the notification 5.799
And the package "cowsay" is not installed 0.588
After features/support/hooks.rb:464 0.124
After features/support/hooks.rb:305 1.112
After features/support/hooks.rb:89 0.010
Feature: Localization
2:29.561
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.804
When I log in to a new session in Arabic (ar) 32.423
Then the keyboard layout is set to "us" 0.227
When the network is plugged 0.071
And Tor is ready 15.768
Then I successfully start the Unsafe Browser in "ar" 15.588
And I kill the Unsafe Browser 5.830
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 28.462
And DuckDuckGo is the default search engine 23.194
And I kill the Tor Browser 5.490
And the screen keyboard works in Thunderbird 14.049
And the layout of the screen keyboard is set to "us" 0.534
After features/support/hooks.rb:305 1.507
After features/support/hooks.rb:89 0.000
Feature: Localization
2:21.356
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.255
When I log in to a new session in Chinese (zh_CN) 30.341
Then the keyboard layout is set to "cn" 0.468
When the network is plugged 0.028
And Tor is ready 17.803
Then I successfully start the Unsafe Browser in "zh_CN" 15.398
And I kill the Unsafe Browser 5.796
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 26.775
And DuckDuckGo is the default search engine 12.941
And I kill the Tor Browser 5.431
And the screen keyboard works in Thunderbird 17.489
And the layout of the screen keyboard is set to "us" 0.531
After features/support/hooks.rb:305 1.479
After features/support/hooks.rb:89 0.000
Feature: Localization
1:49.561
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.806
When I log in to a new session in English (en) 16.083
Then the keyboard layout is set to "us" 0.199
When the network is plugged 0.029
And Tor is ready 16.419
Then I successfully start the Unsafe Browser in "en" 15.342
And I kill the Unsafe Browser 5.586
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 25.675
And DuckDuckGo is the default search engine 4.494
And I kill the Tor Browser 5.317
And the screen keyboard works in Thunderbird 11.984
And the layout of the screen keyboard is set to "us" 0.532
After features/support/hooks.rb:305 1.155
After features/support/hooks.rb:89 0.000
Feature: Localization
2:21.128
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.769
When I log in to a new session in French (fr) 30.747
Then the keyboard layout is set to "fr" 0.316
When the network is plugged 0.036
And Tor is ready 15.983
Then I successfully start the Unsafe Browser in "fr" 15.435
And I kill the Unsafe Browser 5.685
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 27.087
And DuckDuckGo is the default search engine 18.867
And I kill the Tor Browser 5.516
And the screen keyboard works in Thunderbird 13.033
And the layout of the screen keyboard is set to "fr" 0.561
After features/support/hooks.rb:305 1.453
After features/support/hooks.rb:89 0.000
Feature: Localization
2:10.743
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.811
When I log in to a new session in German (de) 29.099
Then the keyboard layout is set to "de" 0.216
When the network is plugged 0.035
And Tor is ready 15.319
Then I successfully start the Unsafe Browser in "de" 15.989
And I kill the Unsafe Browser 5.869
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 26.874
And DuckDuckGo is the default search engine 9.818
And I kill the Tor Browser 5.348
And the screen keyboard works in Thunderbird 13.727
And the layout of the screen keyboard is set to "de" 0.542
After features/support/hooks.rb:305 1.047
After features/support/hooks.rb:89 0.000
Feature: Localization
2:12.288
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.782
When I log in to a new session in Italian (it) 30.855
Then the keyboard layout is set to "it" 0.253
When the network is plugged 0.044
And Tor is ready 15.289
Then I successfully start the Unsafe Browser in "it" 14.954
And I kill the Unsafe Browser 5.632
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 27.793
And DuckDuckGo is the default search engine 10.420
And I kill the Tor Browser 5.416
And the screen keyboard works in Thunderbird 13.195
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:305 1.404
After features/support/hooks.rb:89 0.000
Feature: Localization
2:13.274
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.890
When I log in to a new session in Persian (fa) 30.219
Then the keyboard layout is set to "ir" 0.193
When the network is plugged 0.050
And Tor is ready 15.598
Then I successfully start the Unsafe Browser in "fa" 16.776
And I kill the Unsafe Browser 5.674
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 27.020
And DuckDuckGo is the default search engine 10.700
And I kill the Tor Browser 5.505
And the screen keyboard works in Thunderbird 13.036
And the layout of the screen keyboard is set to "ir" 0.520
After features/support/hooks.rb:305 0.790
After features/support/hooks.rb:89 0.000
Feature: Localization
2:11.532
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.765
When I log in to a new session in Portuguese (pt) 30.518
Then the keyboard layout is set to "pt" 0.161
When the network is plugged 0.036
And Tor is ready 16.344
Then I successfully start the Unsafe Browser in "pt" 14.976
And I kill the Unsafe Browser 5.734
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 26.335
And DuckDuckGo is the default search engine 10.869
And I kill the Tor Browser 5.482
And the screen keyboard works in Thunderbird 12.658
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:305 1.511
After features/support/hooks.rb:89 0.000
Feature: Localization
2:9.535
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.805
When I log in to a new session in Russian (ru) 28.681
Then the keyboard layout is set to "ru" 0.217
When the network is plugged 0.054
And Tor is ready 15.097
Then I successfully start the Unsafe Browser in "ru" 14.969
And I kill the Unsafe Browser 5.734
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 25.973
And DuckDuckGo is the default search engine 10.517
And I kill the Tor Browser 5.509
And the screen keyboard works in Thunderbird 14.306
And the layout of the screen keyboard is set to "ru" 0.562
After features/support/hooks.rb:305 1.013
After features/support/hooks.rb:89 0.000
Feature: Localization
2:11.748
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.907
When I log in to a new session in Spanish (es) 29.546
Then the keyboard layout is set to "es" 0.251
When the network is plugged 0.053
And Tor is ready 14.985
Then I successfully start the Unsafe Browser in "es" 15.643
And I kill the Unsafe Browser 5.973
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 26.947
And DuckDuckGo is the default search engine 10.786
And I kill the Tor Browser 5.460
And the screen keyboard works in Thunderbird 13.546
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:305 1.268
After features/support/hooks.rb:89 0.000
Feature: Localization
2:12.335
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.229
When I log in to a new session in Turkish (tr) 29.602
Then the keyboard layout is set to "tr" 0.228
When the network is plugged 0.035
And Tor is ready 16.500
Then I successfully start the Unsafe Browser in "tr" 15.888
And I kill the Unsafe Browser 5.693
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 26.529
And DuckDuckGo is the default search engine 10.393
And I kill the Tor Browser 5.414
And the screen keyboard works in Thunderbird 13.117
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:305 1.325
After features/support/hooks.rb:89 0.000