Project Number Date
test_Tails_ISO_stable 4960 22 Jul 2024, 12:26

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 262 1 12 0 0 275 21 1 22 1:3:15.924 Failed
24.103
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.557
And I prepare Tails for memory erasure tests 0.519
When I start a process allocating 128 MiB of memory with a known pattern 2.415
Then patterns cover at least 128 MiB in the guest's memory 4.443

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I kill the allocating process 2.761
Then I find very few patterns in the guest's memory 5.407

Pattern coverage: 0.000% (0 MiB out of 905 MiB reference memory)

After features/support/hooks.rb:326 0.803
After features/support/hooks.rb:100 0.000
25.648
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.126
And I prepare Tails for memory erasure tests 0.535
And I find very few patterns in the guest's memory 4.775

Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)

When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.416
Then patterns cover at least 99% of the test FS size in the guest's memory 4.155

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I umount "/mnt" 0.937
Then I find very few patterns in the guest's memory 4.701

Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)

After features/support/hooks.rb:326 1.274
After features/support/hooks.rb:100 0.000
50.295
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and logged in 8.720
And I prepare Tails for memory erasure tests 0.403
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.157
Then I find very few patterns in the guest's memory 4.598

Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 3.185
Then patterns cover at least 86% of the test FS size in the guest's memory 4.878

Pattern coverage: 90.574% (115 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.860
Then I find very few patterns in the guest's memory 4.862

Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)

# read cache
When I mount the USB drive again 0.832
And I read the content of the test FS 1.130
Then patterns cover at least 99% of the test FS size in the guest's memory 4.065

Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)

When I umount the USB drive 1.111
Then I find very few patterns in the guest's memory 4.487

Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)

After features/support/hooks.rb:326 0.939
After features/support/hooks.rb:100 0.000
1:17.875
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 9.258
And I prepare Tails for memory erasure tests 0.444
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 35.667
Then I find very few patterns in the guest's memory 3.429

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

# write cache
When I fill the USB drive with a known pattern 2.317
Then patterns cover at least 99% of the test FS size in the guest's memory 3.173

Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 1.650
Then I find very few patterns in the guest's memory 3.831

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

# read cache
When I mount the USB drive again 9.244
And I read the content of the test FS 0.442
Then patterns cover at least 99% of the test FS size in the guest's memory 3.670

Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)

When I umount the USB drive 0.749
Then I find very few patterns in the guest's memory 3.994

Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)

After features/support/hooks.rb:326 1.887
After features/support/hooks.rb:100 0.000
52.814
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.708
And I prepare Tails for memory erasure tests 0.400
When I fill a 128 MiB file with a known pattern on the root filesystem 17.131
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.577
Then patterns cover at least 128 MiB in the guest's memory 3.197

Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)

When I trigger shutdown 0.022
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 1.756

Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)

After features/support/hooks.rb:326 3.529
After features/support/hooks.rb:100 0.000
8:49.862
Before features/support/hooks.rb:269 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 8:2.335
And I prepare Tails for memory erasure tests 0.446
When I fill a 128 MiB file with a known pattern on the persistent filesystem 24.514
When I trigger shutdown 0.012
And I wait 20 seconds 20.020

Slept for 20 seconds

Then I find very few patterns in the guest's memory 2.532

Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)

After features/support/hooks.rb:326 3.561
After features/support/hooks.rb:100 0.012
5:0.079
Before features/support/hooks.rb:269 0.003
Before features/support/hooks.rb:507 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 58.933
And I update APT using apt 17.866
And I install "popularity-contest" using apt 25.791
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.757
When I create a persistent storage and activate the Additional Software feature 19.622
Then Additional Software is correctly configured for package "popularity-contest" 2.347
When I shutdown Tails and wait for the computer to power off 12.701
And I start Tails from USB drive "__internal" with network unplugged 58.038
And I enable persistence 19.222
And I log in to a new session 45.640
And the Additional Software installation service has started 31.235
Then I am notified that the installation succeeded 1.778
And Additional Software is correctly configured for package "popularity-contest" 0.899
And the package "popularity-contest" is installed after Additional Software has been started 0.245
After features/support/hooks.rb:515 35.763
After features/support/hooks.rb:326 1.341
After features/support/hooks.rb:100 0.013
2:50.752
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:507 0.004
Given a computer 0.215
And I start Tails from USB drive "__internal" and I login with an administration password 2:4.912
And I update APT using apt 16.118
When I install "makepp" using apt 22.916
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.509
And the package "makepp" is installed 0.079
After features/support/hooks.rb:515 36.534
After features/support/hooks.rb:326 1.022
After features/support/hooks.rb:100 0.013
5:0.364
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.006
Given a computer 0.202
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:9.611
When I uninstall "popularity-contest" using apt 21.744
And I accept removing "popularity-contest" from Additional Software 0.579
Then "popularity-contest" is not in the list of Additional Software 0.685
When I start Synaptic 25.528
And I update APT using Synaptic 22.296
And I install "cowsay" using Synaptic 9.424
And I accept adding "cowsay" to Additional Software 2.929
Then Additional Software is correctly configured for package "cowsay" 0.738
When I uninstall "cowsay" using apt 3.221
And I refuse removing "cowsay" from Additional Software 0.537
Then Additional Software is correctly configured for package "cowsay" 0.790
When I start "Additional Software" via GNOME Activities Overview 10.531
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.946
Then "cowsay" is not in the list of Additional Software 1.143
When I install "cowsay" using apt 3.209
And I refuse adding "cowsay" to Additional Software 0.594
Then "cowsay" is not in the list of Additional Software 0.648
After features/support/hooks.rb:515 0.958
After features/support/hooks.rb:326 0.709
After features/support/hooks.rb:100 0.010
11:0.599
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:507 0.006
Steps
Given a computer 0.214
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:18.227
And I configure APT to prefer an old version of cowsay 0.029
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.051
And I accept adding "cowsay" to Additional Software 6.863
And Additional Software is correctly configured for package "cowsay" 0.898
And I shutdown Tails and wait for the computer to power off 6.777
And I start Tails from USB drive "__internal" with network unplugged 57.616
And I enable persistence 10.125
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 36.567
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.418
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.095
And the network is plugged 0.054
And Tor is ready 21.436
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 11.476
And available upgrades have been checked 0.575
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:1.082
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:586:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:105:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:515 0.041
After features/support/hooks.rb:326 8.233

SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:32:21)

Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4960/artifact/build-artifacts/01:32:21_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png

Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4960/artifact/build-artifacts/01:32:21_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv

Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4960/artifact/build-artifacts/01:32:21_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.journal

After features/support/hooks.rb:100 0.019
2:10.124
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.005
Given a computer 0.193
And I start Tails from USB drive "__internal" with network unplugged 57.360
And I enable persistence 13.110
And I remove the "cowsay" deb files from the APT cache 0.738
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.098
And I log in to a new session 37.637
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.784
And I can open the Additional Software log file from the notification 5.540
And the package "cowsay" is not installed 0.660
After features/support/hooks.rb:515 0.140
After features/support/hooks.rb:326 1.582
After features/support/hooks.rb:100 0.010
Feature: Localization
2:14.913
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.862
When I log in to a new session in Arabic (ar) 32.490
Then the keyboard layout is set to "us" 0.299
When the network is plugged 0.059
And Tor is ready 17.631
Then I successfully start the Unsafe Browser in "ar" 15.200
And I kill the Unsafe Browser 5.867
When I enable the screen keyboard 0.229
Then the screen keyboard works in Tor Browser 27.350
And DuckDuckGo is the default search engine 9.447
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 12.613
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:326 2.475
After features/support/hooks.rb:100 0.000
Feature: Localization
2:25.384
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.961
When I log in to a new session in Chinese (zh_CN) 33.788
Then the keyboard layout is set to "cn" 0.543
When the network is plugged 0.042
And Tor is ready 18.169
Then I successfully start the Unsafe Browser in "zh_CN" 16.345
And I kill the Unsafe Browser 5.717
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 29.196
And DuckDuckGo is the default search engine 9.228
And I kill the Tor Browser 5.255
And the screen keyboard works in Thunderbird 18.481
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:326 1.579
After features/support/hooks.rb:100 0.000
Feature: Localization
1:52.706
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.032
When I log in to a new session in English (en) 17.625
Then the keyboard layout is set to "us" 0.121
When the network is plugged 0.062
And Tor is ready 17.880
Then I successfully start the Unsafe Browser in "en" 15.152
And I kill the Unsafe Browser 5.889
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 25.590
And DuckDuckGo is the default search engine 4.511
And I kill the Tor Browser 5.226
And the screen keyboard works in Thunderbird 11.942
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:326 1.492
After features/support/hooks.rb:100 0.000
Feature: Localization
2:14.451
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.946
When I log in to a new session in French (fr) 34.262
Then the keyboard layout is set to "fr" 0.280
When the network is plugged 0.086
And Tor is ready 16.858
Then I successfully start the Unsafe Browser in "fr" 14.524
And I kill the Unsafe Browser 5.954
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 27.046
And DuckDuckGo is the default search engine 9.072
And I kill the Tor Browser 5.303
And the screen keyboard works in Thunderbird 12.434
And the layout of the screen keyboard is set to "fr" 0.573
After features/support/hooks.rb:326 2.802
After features/support/hooks.rb:100 0.000
Feature: Localization
2:12.738
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.172
When I log in to a new session in German (de) 32.489
Then the keyboard layout is set to "de" 0.234
When the network is plugged 0.063
And Tor is ready 15.543
Then I successfully start the Unsafe Browser in "de" 15.461
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 27.472
And DuckDuckGo is the default search engine 9.038
And I kill the Tor Browser 5.249
And the screen keyboard works in Thunderbird 12.509
And the layout of the screen keyboard is set to "de" 0.566
After features/support/hooks.rb:326 1.639
After features/support/hooks.rb:100 0.000
Feature: Localization
2:13.927
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.261
When I log in to a new session in Italian (it) 32.455
Then the keyboard layout is set to "it" 0.274
When the network is plugged 0.070
And Tor is ready 16.281
Then I successfully start the Unsafe Browser in "it" 15.094
And I kill the Unsafe Browser 5.910
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 27.810
And DuckDuckGo is the default search engine 9.710
And I kill the Tor Browser 5.274
And the screen keyboard works in Thunderbird 12.136
And the layout of the screen keyboard is set to "us" 0.529
After features/support/hooks.rb:326 1.107
After features/support/hooks.rb:100 0.000
Feature: Localization
2:15.949
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.991
When I log in to a new session in Persian (fa) 31.815
Then the keyboard layout is set to "ir" 0.165
When the network is plugged 0.061
And Tor is ready 18.550
Then I successfully start the Unsafe Browser in "fa" 14.652
And I kill the Unsafe Browser 5.847
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 28.532
And DuckDuckGo is the default search engine 9.384
And I kill the Tor Browser 5.236
And the screen keyboard works in Thunderbird 13.092
And the layout of the screen keyboard is set to "ir" 0.514
After features/support/hooks.rb:326 1.650
After features/support/hooks.rb:100 0.000
Feature: Localization
2:13.172
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.942
When I log in to a new session in Portuguese (pt) 32.020
Then the keyboard layout is set to "pt" 0.111
When the network is plugged 0.045
And Tor is ready 17.017
Then I successfully start the Unsafe Browser in "pt" 14.510
And I kill the Unsafe Browser 5.905
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 28.167
And DuckDuckGo is the default search engine 9.513
And I kill the Tor Browser 5.311
And the screen keyboard works in Thunderbird 11.960
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:326 1.287
After features/support/hooks.rb:100 0.000
Feature: Localization
2:13.378
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.928
When I log in to a new session in Russian (ru) 32.220
Then the keyboard layout is set to "ru" 0.148
When the network is plugged 0.037
And Tor is ready 15.896
Then I successfully start the Unsafe Browser in "ru" 15.071
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 28.500
And DuckDuckGo is the default search engine 8.751
And I kill the Tor Browser 5.212
And the screen keyboard works in Thunderbird 13.074
And the layout of the screen keyboard is set to "ru" 0.546
After features/support/hooks.rb:326 1.737
After features/support/hooks.rb:100 0.000
Feature: Localization
2:17.827
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.137
When I log in to a new session in Spanish (es) 33.210
Then the keyboard layout is set to "es" 0.188
When the network is plugged 0.060
And Tor is ready 20.201
Then I successfully start the Unsafe Browser in "es" 14.508
And I kill the Unsafe Browser 5.858
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 28.943
And DuckDuckGo is the default search engine 8.801
And I kill the Tor Browser 5.258
And the screen keyboard works in Thunderbird 12.004
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:326 1.110
After features/support/hooks.rb:100 0.000
Feature: Localization
2:18.952
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.971
When I log in to a new session in Turkish (tr) 34.620
Then the keyboard layout is set to "tr" 0.176
When the network is plugged 0.044
And Tor is ready 19.606
Then I successfully start the Unsafe Browser in "tr" 14.111
And I kill the Unsafe Browser 5.888
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 28.099
And DuckDuckGo is the default search engine 8.966
And I kill the Tor Browser 5.221
And the screen keyboard works in Thunderbird 13.588
And the layout of the screen keyboard is set to "us" 0.543
After features/support/hooks.rb:326 2.360
After features/support/hooks.rb:100 0.000