Project Number Date
test_Tails_ISO_devel 3288 19 Feb 2024, 15:17

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 267 1 12 0 0 280 23 1 24 1:22:57.747 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.890
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.309
And I prepare Tails for memory erasure tests 0.397
When I start a process allocating 128 MiB of memory with a known pattern 1.425
Then patterns cover at least 128 MiB in the guest's memory 3.492 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.550
Then I find very few patterns in the guest's memory 3.715 
Pattern coverage: 0.000% (0 MiB out of 824 MiB reference memory)
After features/support/hooks.rb:291 0.755
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.257
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.702
And I prepare Tails for memory erasure tests 0.712
And I find very few patterns in the guest's memory 3.970 
Pattern coverage: 0.000% (0 MiB out of 812 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.550
Then patterns cover at least 99% of the test FS size in the guest's memory 3.570 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.401
Then I find very few patterns in the guest's memory 4.348 
Pattern coverage: 0.000% (0 MiB out of 812 MiB reference memory)
After features/support/hooks.rb:291 0.712
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
40.843
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.605
And I prepare Tails for memory erasure tests 0.556
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.970
Then I find very few patterns in the guest's memory 4.370 
Pattern coverage: 0.000% (0 MiB out of 817 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.237
Then patterns cover at least 86% of the test FS size in the guest's memory 3.976 
Pattern coverage: 91.857% (117 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.267
Then I find very few patterns in the guest's memory 4.387 
Pattern coverage: 0.000% (0 MiB out of 817 MiB reference memory)
# read cache
When I mount the USB drive again 0.230
And I read the content of the test FS 0.759
Then patterns cover at least 99% of the test FS size in the guest's memory 3.772 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.429
Then I find very few patterns in the guest's memory 4.279 
Pattern coverage: 0.000% (0 MiB out of 817 MiB reference memory)
After features/support/hooks.rb:291 0.937
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.979
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.578
And I prepare Tails for memory erasure tests 0.651
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.914
Then I find very few patterns in the guest's memory 3.924 
Pattern coverage: 0.000% (0 MiB out of 816 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.682
Then patterns cover at least 99% of the test FS size in the guest's memory 3.169 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.687
Then I find very few patterns in the guest's memory 3.857 
Pattern coverage: 0.000% (0 MiB out of 816 MiB reference memory)
# read cache
When I mount the USB drive again 3.457
And I read the content of the test FS 0.394
Then patterns cover at least 99% of the test FS size in the guest's memory 4.315 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.449
Then I find very few patterns in the guest's memory 3.895 
Pattern coverage: 0.000% (0 MiB out of 816 MiB reference memory)
After features/support/hooks.rb:291 0.921
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.676
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.740
And I prepare Tails for memory erasure tests 0.579
When I fill a 128 MiB file with a known pattern on the root filesystem 12.967
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 0.929
Then patterns cover at least 128 MiB in the guest's memory 3.188 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.455
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.805 
Pattern coverage: 0.000% (0 MiB out of 832 MiB reference memory)
After features/support/hooks.rb:291 3.490
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:12.379
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:26.590
And I prepare Tails for memory erasure tests 0.410
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.207
When I trigger shutdown 0.047
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.105 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
After features/support/hooks.rb:291 3.477
After features/support/hooks.rb:75 0.040
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
2:26.446
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.013
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:25.589
And I update APT using apt 11.906
When I install "popularity-contest" using apt 19.246
Then I am notified I can not use Additional Software for "popularity-contest" 6.923
And I can open the Additional Software documentation from the notification 22.780
After features/support/hooks.rb:450 28.166
After features/support/hooks.rb:291 2.191
After features/support/hooks.rb:75 0.003
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:29.159
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.620
And I update APT using apt 11.421
And I install "popularity-contest" using apt 19.415
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.127
When I create a persistent storage and activate the Additional Software feature 20.345
Then Additional Software is correctly configured for package "popularity-contest" 1.854
When I shutdown Tails and wait for the computer to power off 10.101
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 3:27.078
Then Additional Software is correctly configured for package "popularity-contest" 0.821
And the package "popularity-contest" is installed after Additional Software has been started 0.373
After features/support/hooks.rb:450 28.211
After features/support/hooks.rb:291 2.152
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:27.672
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 1.542
And I start Tails from USB drive "__internal" and I login with an administration password 1:45.389
And I update APT using apt 12.707
When I install "makepp" using apt 20.895
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 7.053
And the package "makepp" is installed 0.084
After features/support/hooks.rb:450 29.580
After features/support/hooks.rb:291 0.919
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:7.965
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.007
Given a computer 0.225
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 4:30.263
When I uninstall "popularity-contest" using apt 15.619
And I accept removing "popularity-contest" from Additional Software 0.607
Then "popularity-contest" is not in the list of Additional Software 0.742
When I start Synaptic 20.680
And I update APT using Synaptic 23.833
And I install "cowsay" using Synaptic 9.271
And I accept adding "cowsay" to Additional Software 0.904
Then Additional Software is correctly configured for package "cowsay" 0.859
When I uninstall "cowsay" using apt 3.250
And I refuse removing "cowsay" from Additional Software 0.602
Then Additional Software is correctly configured for package "cowsay" 0.859
When I start "Additional Software" via GNOME Activities Overview 10.365
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.366
Then "cowsay" is not in the list of Additional Software 1.038
When I install "cowsay" using apt 3.241
And I refuse adding "cowsay" to Additional Software 0.565
Then "cowsay" is not in the list of Additional Software 0.665
After features/support/hooks.rb:450 1.019
After features/support/hooks.rb:291 0.639
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:27.585
Scenario Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Steps
Given a computer 0.174
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:7.924
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 22.679
And I accept adding "cowsay" to Additional Software 3.473
And Additional Software is correctly configured for package "cowsay" 0.876
And I shutdown Tails and wait for the computer to power off 6.065
And I start Tails from USB drive "__internal" with network unplugged 57.701
And I enable persistence 31.590
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 1:13.143
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.985
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.689
And Tor is ready 24.127
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.760
And available upgrades have been checked 0.077
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5:1.133
try_for() 
try_for() timeout expired (Timeout::Error)
./features/support/helpers/misc_helpers.rb:145:in `rescue in try_for'
./features/support/helpers/misc_helpers.rb:51:in `try_for'
./features/step_definitions/common_steps.rb:603:in `/^I see the "(.+)" notification(?: after at most (\d+) seconds)?$/'
features/additional_software_packages.feature:101:in `And I see the "The upgrade of your additional software failed" notification after at most 300 seconds'
And I can open the Additional Software configuration window from the notification 0.000
And I shutdown Tails and wait for the computer to power off 0.000
And I start Tails from USB drive "__internal" with network unplugged 0.000
And I enable persistence 0.000
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.000
And I log in to a new session 0.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 0.000
And I revert the APT tweaks that made it prefer an old version of cowsay 0.000
And the network is plugged 0.000
And Tor is ready 0.000
Then the Additional Software upgrade service has started 0.000
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.000
After features/support/hooks.rb:450 0.030
After features/support/hooks.rb:291 9.809 
SCENARIO FAILED: 'Recovering in offline mode after Additional Software previously failed to upgrade and then succeed to upgrade when online' (at time 01:36:01)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3288/artifact/build-artifacts/01:36:01_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3288/artifact/build-artifacts/01:36:01_Recovering_in_offline_mode_after_Additional_Software_previously_failed_to_upgrade_and_then_succeed_to_upgrade_when_online.mkv
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:55.526
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.190
And I start Tails from USB drive "__internal" with network unplugged 1:2.211
And I enable persistence 34.390
And I remove the "cowsay" deb files from the APT cache 0.676
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.078
And I log in to a new session 1:2.730
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 10.038
And I can open the Additional Software log file from the notification 4.622
And the package "cowsay" is not installed 0.587
After features/support/hooks.rb:450 0.121
After features/support/hooks.rb:291 1.036
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.083
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.854
When I log in to a new session in Arabic (ar) 32.190
Then the keyboard layout is set to "us" 0.114
When the network is plugged 0.031
And Tor is ready 18.546
Then I successfully start the Unsafe Browser in "ar" 14.820
And I kill the Unsafe Browser 5.723
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 32.496
And DuckDuckGo is the default search engine 10.558
And I kill the Tor Browser 5.529
And the screen keyboard works in Thunderbird 20.527
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 1.349
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.530
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.750
When I log in to a new session in Chinese (zh_CN) 31.817
Then the keyboard layout is set to "cn" 0.144
When the network is plugged 0.027
And Tor is ready 16.162
Then I successfully start the Unsafe Browser in "zh_CN" 16.243
And I kill the Unsafe Browser 5.834
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 33.846
And DuckDuckGo is the default search engine 18.842
And I kill the Tor Browser 5.511
And the screen keyboard works in Thunderbird 24.630
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:291 1.242
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.227
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.102
When I log in to a new session in English (en) 18.701
Then the keyboard layout is set to "us" 0.123
When the network is plugged 0.026
And Tor is ready 13.092
Then I successfully start the Unsafe Browser in "en" 14.336
And I kill the Unsafe Browser 6.313
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 34.214
And DuckDuckGo is the default search engine 10.046
And I kill the Tor Browser 5.225
And the screen keyboard works in Thunderbird 21.342
And the layout of the screen keyboard is set to "us" 0.588
After features/support/hooks.rb:291 1.581
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.029
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.100
When I log in to a new session in French (fr) 31.346
Then the keyboard layout is set to "fr" 0.137
When the network is plugged 0.031
And Tor is ready 15.728
Then I successfully start the Unsafe Browser in "fr" 13.744
And I kill the Unsafe Browser 6.039
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 31.905
And DuckDuckGo is the default search engine 10.270
And I kill the Tor Browser 5.498
And the screen keyboard works in Thunderbird 21.503
And the layout of the screen keyboard is set to "fr" 0.584
After features/support/hooks.rb:291 2.879
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.319
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.650
When I log in to a new session in German (de) 32.282
Then the keyboard layout is set to "de" 0.127
When the network is plugged 0.020
And Tor is ready 14.346
Then I successfully start the Unsafe Browser in "de" 15.204
And I kill the Unsafe Browser 5.875
When I enable the screen keyboard 0.161
Then the screen keyboard works in Tor Browser 32.920
And DuckDuckGo is the default search engine 21.864
And I kill the Tor Browser 5.578
And the screen keyboard works in Thunderbird 21.689
And the layout of the screen keyboard is set to "de" 0.597
After features/support/hooks.rb:291 1.405
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.388
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.221
When I log in to a new session in Italian (it) 32.791
Then the keyboard layout is set to "it" 0.202
When the network is plugged 0.050
And Tor is ready 14.877
Then I successfully start the Unsafe Browser in "it" 14.930
And I kill the Unsafe Browser 5.813
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.598
And DuckDuckGo is the default search engine 10.895
And I kill the Tor Browser 5.489
And the screen keyboard works in Thunderbird 21.815
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 1.718
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.806
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.031
When I log in to a new session in Persian (fa) 31.882
Then the keyboard layout is set to "ir" 0.176
When the network is plugged 0.036
And Tor is ready 16.856
Then I successfully start the Unsafe Browser in "fa" 14.370
And I kill the Unsafe Browser 5.838
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.978
And DuckDuckGo is the default search engine 18.842
And I kill the Tor Browser 5.506
And the screen keyboard works in Thunderbird 20.650
And the layout of the screen keyboard is set to "ir" 0.528
After features/support/hooks.rb:291 0.998
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.191
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.982
When I log in to a new session in Portuguese (pt) 32.454
Then the keyboard layout is set to "pt" 0.102
When the network is plugged 0.024
And Tor is ready 16.213
Then I successfully start the Unsafe Browser in "pt" 15.038
And I kill the Unsafe Browser 5.899
When I enable the screen keyboard 0.159
Then the screen keyboard works in Tor Browser 35.091
And DuckDuckGo is the default search engine 19.542
And I kill the Tor Browser 5.531
And the screen keyboard works in Thunderbird 20.573
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:291 2.491
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.726
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.015
When I log in to a new session in Russian (ru) 31.435
Then the keyboard layout is set to "ru" 0.126
When the network is plugged 0.034
And Tor is ready 14.340
Then I successfully start the Unsafe Browser in "ru" 15.662
And I kill the Unsafe Browser 5.811
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 34.478
And DuckDuckGo is the default search engine 21.425
And I kill the Tor Browser 5.561
And the screen keyboard works in Thunderbird 22.114
And the layout of the screen keyboard is set to "ru" 0.573
After features/support/hooks.rb:291 1.448
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.755
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.032
When I log in to a new session in Spanish (es) 32.161
Then the keyboard layout is set to "es" 0.102
When the network is plugged 0.034
And Tor is ready 17.035
Then I successfully start the Unsafe Browser in "es" 13.698
And I kill the Unsafe Browser 6.086
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 32.202
And DuckDuckGo is the default search engine 10.770
And I kill the Tor Browser 5.453
And the screen keyboard works in Thunderbird 20.491
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.188
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.624
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.888
When I log in to a new session in Turkish (tr) 31.779
Then the keyboard layout is set to "tr" 0.111
When the network is plugged 0.031
And Tor is ready 13.978
Then I successfully start the Unsafe Browser in "tr" 15.277
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.198
Then the screen keyboard works in Tor Browser 34.429
And DuckDuckGo is the default search engine 11.274
And I kill the Tor Browser 5.524
And the screen keyboard works in Thunderbird 20.703
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 1.505
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:39.679
When the network is plugged 0.049
And I wait 720 seconds 12:0.087 
Slept for 720 seconds
Then I successfully configure Tor 39.497
And the time has synced 0.044
After features/support/hooks.rb:291 1.541
After features/support/hooks.rb:75 0.000