Project Number Date
test_Tails_ISO_stable 4522 23 Nov 2023, 12:28

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 258 1 12 0 0 271 21 1 22 1:13:8.372 Failed
20.895
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.240
And I prepare Tails for memory erasure tests 0.500
When I start a process allocating 128 MiB of memory with a known pattern 1.318
Then patterns cover at least 128 MiB in the guest's memory 4.848

Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 0.308
Then I find very few patterns in the guest's memory 5.677

Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)

After features/support/hooks.rb:290 0.687
After features/support/hooks.rb:75 0.000
1:6.175
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.304
And I prepare Tails for memory erasure tests 0.577
And I find very few patterns in the guest's memory 4.863

Pattern coverage: 0.000% (0 MiB out of 1175 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.622
Then patterns cover at least 99% of the test FS size in the guest's memory 3.613

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.194
Then I find very few patterns in the guest's memory 4.000

Pattern coverage: 0.000% (0 MiB out of 1175 MiB reference memory)

After features/support/hooks.rb:290 1.685
After features/support/hooks.rb:75 0.000
3:13.359
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.166
And I prepare Tails for memory erasure tests 0.533
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.970
Then I find very few patterns in the guest's memory 3.916

Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2:30.036
Then patterns cover at least 86% of the test FS size in the guest's memory 3.697

Pattern coverage: 97.036% (120 MiB out of 124 MiB reference memory)

When I umount the USB drive 0.590
Then I find very few patterns in the guest's memory 4.159

Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)

# read cache
When I mount the USB drive again 0.270
And I read the content of the test FS 1.077
Then patterns cover at least 99% of the test FS size in the guest's memory 5.569

Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)

When I umount the USB drive 1.016
Then I find very few patterns in the guest's memory 6.356

Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)

After features/support/hooks.rb:290 0.893
After features/support/hooks.rb:75 0.000
2:50.070
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.509
And I prepare Tails for memory erasure tests 0.549
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.988
Then I find very few patterns in the guest's memory 3.550

Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 1:50.850
Then patterns cover at least 99% of the test FS size in the guest's memory 3.706

Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)

When I umount the USB drive 0.729
Then I find very few patterns in the guest's memory 4.425

Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)

# read cache
When I mount the USB drive again 5.999
And I read the content of the test FS 0.513
Then patterns cover at least 99% of the test FS size in the guest's memory 3.657

Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)

When I umount the USB drive 0.489
Then I find very few patterns in the guest's memory 4.100

Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)

After features/support/hooks.rb:290 0.721
After features/support/hooks.rb:75 0.000
48.740
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.204
And I prepare Tails for memory erasure tests 0.476
When I fill a 128 MiB file with a known pattern on the root filesystem 12.197
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.538
Then patterns cover at least 128 MiB in the guest's memory 2.835

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.611
And I wait 20 seconds 20.008

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.869

Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)

After features/support/hooks.rb:290 3.513
After features/support/hooks.rb:75 0.000
6:18.808
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:31.829
And I prepare Tails for memory erasure tests 0.466
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.672
When I trigger shutdown 0.511
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.309

Pattern coverage: 0.000% (0 MiB out of 1175 MiB reference memory)

After features/support/hooks.rb:290 3.503
After features/support/hooks.rb:75 0.014
5:44.248
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:438 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.465
And I update APT using apt 15.720
And I install "popularity-contest" using apt 19.720
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:1.957
When I create a persistent storage and activate the Additional Software feature 17.434
Then Additional Software is correctly configured for package "popularity-contest" 1.325
When I shutdown Tails and wait for the computer to power off 10.084
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:46.139
Then Additional Software is correctly configured for package "popularity-contest" 1.087
And the package "popularity-contest" is installed after Additional Software has been started 0.313
After features/support/hooks.rb:446 35.537
After features/support/hooks.rb:290 1.096
After features/support/hooks.rb:75 0.013
3:3.470
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:438 0.004
Given a computer 0.202
And I start Tails from USB drive "__internal" and I login with an administration password 1:25.703
And I update APT using apt 16.103
When I install "makepp" using apt 19.745
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:1.597
And the package "makepp" is installed 0.118
After features/support/hooks.rb:446 40.504
After features/support/hooks.rb:290 0.943
After features/support/hooks.rb:75 0.016
5:26.509
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:438 0.006
Given a computer 0.211
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:44.955
When I uninstall "popularity-contest" using apt 16.134
And I accept removing "popularity-contest" from Additional Software 0.864
Then "popularity-contest" is not in the list of Additional Software 0.952
When I start Synaptic 20.901
And I update APT using Synaptic 21.873
And I install "cowsay" using Synaptic 8.475
And I accept adding "cowsay" to Additional Software 2.355
Then Additional Software is correctly configured for package "cowsay" 0.958
When I uninstall "cowsay" using apt 3.347
And I refuse removing "cowsay" from Additional Software 0.754
Then Additional Software is correctly configured for package "cowsay" 1.111
When I start "Additional Software" via GNOME Activities Overview 12.550
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.835
Then "cowsay" is not in the list of Additional Software 1.194
When I install "cowsay" using apt 3.355
And I refuse adding "cowsay" to Additional Software 0.777
Then "cowsay" is not in the list of Additional Software 0.898
After features/support/hooks.rb:446 1.162
After features/support/hooks.rb:290 0.822
After features/support/hooks.rb:75 0.011
12:32.679
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:438 0.008
Steps
Given a computer 0.204
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:40.828
And I configure APT to prefer an old version of cowsay 0.033
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.571
And I accept adding "cowsay" to Additional Software 1:15.351
And Additional Software is correctly configured for package "cowsay" 1.626
And I shutdown Tails and wait for the computer to power off 5.178
And I start Tails from USB drive "__internal" with network unplugged 46.887
And I enable persistence 32.682
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 23.214
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.949
And I revert the APT tweaks that made it prefer an old version of cowsay 0.095
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.078
And the network is plugged 0.033
And Tor is ready 21.352
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.255
And available upgrades have been checked 0.109
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:1.198
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:546:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:101:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:446 0.036
After features/support/hooks.rb:290 9.513

SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:44:28)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4522/artifact/build-artifacts/01:44:28_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4522/artifact/build-artifacts/01:44:28_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv

After features/support/hooks.rb:75 0.018
1:54.645
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.008
Given a computer 0.232
And I start Tails from USB drive "__internal" with network unplugged 47.385
And I enable persistence 32.912
And I remove the "cowsay" deb files from the APT cache 0.729
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.094
And I log in to a new session 25.937
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.042
And I can open the Additional Software log file from the notification 3.154
And the package "cowsay" is not installed 0.154
After features/support/hooks.rb:446 0.106
After features/support/hooks.rb:290 1.097
After features/support/hooks.rb:75 0.009
Feature: Localization
2:37.702
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.053
When I log in to a new session in Arabic (ar) 28.999
Then the keyboard layout is set to "us" 0.278
When the network is plugged 0.047
And Tor is ready 16.077
Then I successfully start the Unsafe Browser in "ar" 26.997
And I kill the Unsafe Browser 5.968
When I enable the screen keyboard 0.161
Then the screen keyboard works in Tor Browser 35.746
And DuckDuckGo is the default search engine 4.736
And I kill the Tor Browser 5.312
And the screen keyboard works in Thunderbird 23.729
And the layout of the screen keyboard is set to "us" 0.594
After features/support/hooks.rb:290 1.670
After features/support/hooks.rb:75 0.000
Feature: Localization
2:47.097
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.452
When I log in to a new session in Chinese (zh_CN) 34.093
Then the keyboard layout is set to "cn" 0.231
When the network is plugged 0.045
And Tor is ready 15.249
Then I successfully start the Unsafe Browser in "zh_CN" 28.573
And I kill the Unsafe Browser 5.902
When I enable the screen keyboard 0.177
Then the screen keyboard works in Tor Browser 34.028
And DuckDuckGo is the default search engine 4.650
And I kill the Tor Browser 5.298
And the screen keyboard works in Thunderbird 29.590
And the layout of the screen keyboard is set to "us" 0.804
After features/support/hooks.rb:290 1.732
After features/support/hooks.rb:75 0.000
Feature: Localization
2:56.736
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.614
When I log in to a new session in English (en) 18.234
Then the keyboard layout is set to "us" 0.196
When the network is plugged 0.049
And Tor is ready 46.802
Then I successfully start the Unsafe Browser in "en" 27.803
And I kill the Unsafe Browser 5.824
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 34.824
And DuckDuckGo is the default search engine 4.899
And I kill the Tor Browser 5.329
And the screen keyboard works in Thunderbird 23.310
And the layout of the screen keyboard is set to "us" 0.701
After features/support/hooks.rb:290 1.325
After features/support/hooks.rb:75 0.000
Feature: Localization
2:43.830
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.955
When I log in to a new session in French (fr) 34.170
Then the keyboard layout is set to "fr" 0.289
When the network is plugged 0.088
And Tor is ready 16.109
Then I successfully start the Unsafe Browser in "fr" 31.402
And I kill the Unsafe Browser 6.599
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.104
And DuckDuckGo is the default search engine 4.768
And I kill the Tor Browser 5.344
And the screen keyboard works in Thunderbird 23.315
And the layout of the screen keyboard is set to "fr" 0.561
After features/support/hooks.rb:290 2.810
After features/support/hooks.rb:75 0.000
Feature: Localization
2:38.969
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.307
When I log in to a new session in German (de) 31.578
Then the keyboard layout is set to "de" 0.171
When the network is plugged 0.044
And Tor is ready 16.784
Then I successfully start the Unsafe Browser in "de" 29.446
And I kill the Unsafe Browser 5.927
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 32.384
And DuckDuckGo is the default search engine 4.990
And I kill the Tor Browser 5.454
And the screen keyboard works in Thunderbird 23.101
And the layout of the screen keyboard is set to "de" 0.639
After features/support/hooks.rb:290 2.592
After features/support/hooks.rb:75 0.000
Feature: Localization
2:38.652
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.651
When I log in to a new session in Italian (it) 30.326
Then the keyboard layout is set to "it" 0.271
When the network is plugged 0.037
And Tor is ready 16.231
Then I successfully start the Unsafe Browser in "it" 28.462
And I kill the Unsafe Browser 5.949
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.148
And DuckDuckGo is the default search engine 4.992
And I kill the Tor Browser 5.352
And the screen keyboard works in Thunderbird 23.473
And the layout of the screen keyboard is set to "us" 0.624
After features/support/hooks.rb:290 1.385
After features/support/hooks.rb:75 0.000
Feature: Localization
2:40.017
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.254
When I log in to a new session in Persian (fa) 31.215
Then the keyboard layout is set to "ir" 0.292
When the network is plugged 0.049
And Tor is ready 15.769
Then I successfully start the Unsafe Browser in "fa" 28.788
And I kill the Unsafe Browser 5.760
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 34.143
And DuckDuckGo is the default search engine 4.877
And I kill the Tor Browser 5.481
And the screen keyboard works in Thunderbird 23.662
And the layout of the screen keyboard is set to "ir" 0.621
After features/support/hooks.rb:290 1.269
After features/support/hooks.rb:75 0.000
Feature: Localization
2:41.246
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.405
When I log in to a new session in Portuguese (pt) 29.328
Then the keyboard layout is set to "pt" 0.168
When the network is plugged 0.040
And Tor is ready 19.345
Then I successfully start the Unsafe Browser in "pt" 29.832
And I kill the Unsafe Browser 5.919
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 35.030
And DuckDuckGo is the default search engine 5.257
And I kill the Tor Browser 5.383
And the screen keyboard works in Thunderbird 21.801
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:290 1.657
After features/support/hooks.rb:75 0.000
Feature: Localization
2:48.996
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.708
When I log in to a new session in Russian (ru) 35.075
Then the keyboard layout is set to "ru" 0.155
When the network is plugged 0.046
And Tor is ready 16.912
Then I successfully start the Unsafe Browser in "ru" 31.392
And I kill the Unsafe Browser 6.418
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 35.318
And DuckDuckGo is the default search engine 4.822
And I kill the Tor Browser 5.386
And the screen keyboard works in Thunderbird 24.019
And the layout of the screen keyboard is set to "ru" 0.587
After features/support/hooks.rb:290 1.067
After features/support/hooks.rb:75 0.000
Feature: Localization
2:34.498
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.809
When I log in to a new session in Spanish (es) 29.555
Then the keyboard layout is set to "es" 0.270
When the network is plugged 0.037
And Tor is ready 16.403
Then I successfully start the Unsafe Browser in "es" 26.908
And I kill the Unsafe Browser 5.917
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 33.346
And DuckDuckGo is the default search engine 4.890
And I kill the Tor Browser 5.304
And the screen keyboard works in Thunderbird 23.362
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:290 2.909
After features/support/hooks.rb:75 0.000
Feature: Localization
2:41.019
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.799
When I log in to a new session in Turkish (tr) 30.484
Then the keyboard layout is set to "tr" 0.174
When the network is plugged 0.048
And Tor is ready 15.328
Then I successfully start the Unsafe Browser in "tr" 28.397
And I kill the Unsafe Browser 6.442
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 37.735
And DuckDuckGo is the default search engine 5.048
And I kill the Tor Browser 5.373
And the screen keyboard works in Thunderbird 22.382
And the layout of the screen keyboard is set to "us" 0.648
After features/support/hooks.rb:290 1.067
After features/support/hooks.rb:75 0.000