Project Number Date
test_Tails_ISO_stable 4763 02 Apr 2024, 23:14

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 267 1 7 0 0 275 21 1 22 55:51.162 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.289
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.238
And I prepare Tails for memory erasure tests 0.400
When I start a process allocating 128 MiB of memory with a known pattern 1.385
Then patterns cover at least 128 MiB in the guest's memory 4.333 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.544
Then I find very few patterns in the guest's memory 6.386 
Pattern coverage: 0.000% (0 MiB out of 847 MiB reference memory)
After features/support/hooks.rb:291 0.714
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
25.265
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.177
And I prepare Tails for memory erasure tests 0.434
And I find very few patterns in the guest's memory 4.803 
Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.494
Then patterns cover at least 99% of the test FS size in the guest's memory 4.575 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.590
Then I find very few patterns in the guest's memory 4.189 
Pattern coverage: 0.000% (0 MiB out of 874 MiB reference memory)
After features/support/hooks.rb:291 0.996
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
29.670
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:245 0.002
Steps
Given I have started Tails from DVD without network and logged in 9.022
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.815
Then I find very few patterns in the guest's memory 4.894 
Pattern coverage: 0.000% (0 MiB out of 866 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.474
Then patterns cover at least 86% of the test FS size in the guest's memory 5.013
85.505% 
85.505% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 85.505% (109 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:291 4.592 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:28:43)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4763/artifact/build-artifacts/00:28:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4763/artifact/build-artifacts/00:28:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4763/artifact/build-artifacts/00:28:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4763/artifact/build-artifacts/00:28:43_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:6.647
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.222
And I prepare Tails for memory erasure tests 0.436
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.329
Then I find very few patterns in the guest's memory 3.958 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.561
Then patterns cover at least 99% of the test FS size in the guest's memory 3.439 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.701
Then I find very few patterns in the guest's memory 4.668 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
# read cache
When I mount the USB drive again 3.506
And I read the content of the test FS 0.534
Then patterns cover at least 99% of the test FS size in the guest's memory 3.533 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 4.640
Then I find very few patterns in the guest's memory 4.115 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
After features/support/hooks.rb:291 1.212
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.532
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.272
And I prepare Tails for memory erasure tests 0.457
When I fill a 128 MiB file with a known pattern on the root filesystem 17.401
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.220
Then patterns cover at least 128 MiB in the guest's memory 3.328 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.818 
Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)
After features/support/hooks.rb:291 3.506
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:40.488
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:55.980
And I prepare Tails for memory erasure tests 0.413
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.787
When I trigger shutdown 0.010
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.276 
Pattern coverage: 0.000% (0 MiB out of 913 MiB reference memory)
After features/support/hooks.rb:291 3.480
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:50.893
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 59.078
And I update APT using apt 20.468
And I install "popularity-contest" using apt 19.186
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.219
When I create a persistent storage and activate the Additional Software feature 20.500
Then Additional Software is correctly configured for package "popularity-contest" 1.553
When I shutdown Tails and wait for the computer to power off 12.660
And I start Tails from USB drive "__internal" with network unplugged 1:0.764
And I enable persistence 21.796
And I log in to a new session 33.667
And the Additional Software installation service has started 30.900
Then I am notified that the installation succeeded 2.093
And Additional Software is correctly configured for package "popularity-contest" 0.765
And the package "popularity-contest" is installed after Additional Software has been started 0.237
After features/support/hooks.rb:450 38.420
After features/support/hooks.rb:291 1.400
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:7.853
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.193
And I start Tails from USB drive "__internal" and I login with an administration password 1:28.344
And I update APT using apt 15.546
When I install "makepp" using apt 19.310
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.398
And the package "makepp" is installed 0.061
After features/support/hooks.rb:450 40.291
After features/support/hooks.rb:291 0.859
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:34.110
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:50.936
When I uninstall "popularity-contest" using apt 18.699
And I accept removing "popularity-contest" from Additional Software 0.524
Then "popularity-contest" is not in the list of Additional Software 0.664
When I start Synaptic 23.813
And I update APT using Synaptic 22.554
And I install "cowsay" using Synaptic 9.421
And I accept adding "cowsay" to Additional Software 1.111
Then Additional Software is correctly configured for package "cowsay" 0.765
When I uninstall "cowsay" using apt 3.272
And I refuse removing "cowsay" from Additional Software 0.534
Then Additional Software is correctly configured for package "cowsay" 0.722
When I start "Additional Software" via GNOME Activities Overview 9.761
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.585
Then "cowsay" is not in the list of Additional Software 1.089
When I install "cowsay" using apt 3.211
And I refuse adding "cowsay" to Additional Software 0.577
Then "cowsay" is not in the list of Additional Software 0.676
After features/support/hooks.rb:450 1.086
After features/support/hooks.rb:291 0.756
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
8:47.844
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.213
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.012
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.435
And I accept adding "cowsay" to Additional Software 5.668
And Additional Software is correctly configured for package "cowsay" 0.798
And I shutdown Tails and wait for the computer to power off 6.328
And I start Tails from USB drive "__internal" with network unplugged 1:2.387
And I enable persistence 10.930
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.031
And I log in to a new session 34.415
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.030
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.077
And the network is plugged 0.065
And Tor is ready 17.804
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.352
And available upgrades have been checked 0.109
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.004
And I can open the Additional Software configuration window from the notification 3.255
And I shutdown Tails and wait for the computer to power off 13.160
And I start Tails from USB drive "__internal" with network unplugged 53.992
And I enable persistence 11.472
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 33.900
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.557
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
And the network is plugged 0.063
And Tor is ready 50.314
Then the Additional Software upgrade service has started 0.202
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.097
After features/support/hooks.rb:450 2.175
After features/support/hooks.rb:291 1.248
After features/support/hooks.rb:75 0.023
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:0.781
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.007
Given a computer 0.704
And I start Tails from USB drive "__internal" with network unplugged 53.680
And I enable persistence 10.337
And I remove the "cowsay" deb files from the APT cache 0.612
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.093
And I log in to a new session 35.555
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.765
And I can open the Additional Software log file from the notification 5.453
And the package "cowsay" is not installed 0.579
After features/support/hooks.rb:450 0.105
After features/support/hooks.rb:291 1.071
After features/support/hooks.rb:75 0.013
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.388
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.862
When I log in to a new session in Arabic (ar) 31.001
Then the keyboard layout is set to "us" 0.149
When the network is plugged 0.052
And Tor is ready 14.371
Then I successfully start the Unsafe Browser in "ar" 14.996
And I kill the Unsafe Browser 5.716
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 27.380
And DuckDuckGo is the default search engine 10.901
And I kill the Tor Browser 5.538
And the screen keyboard works in Thunderbird 12.763
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.091
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.604
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.182
When I log in to a new session in Chinese (zh_CN) 31.420
Then the keyboard layout is set to "cn" 0.234
When the network is plugged 0.048
And Tor is ready 15.159
Then I successfully start the Unsafe Browser in "zh_CN" 14.768
And I kill the Unsafe Browser 5.769
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 25.405
And DuckDuckGo is the default search engine 9.713
And I kill the Tor Browser 5.245
And the screen keyboard works in Thunderbird 18.960
And the layout of the screen keyboard is set to "us" 0.579
After features/support/hooks.rb:291 1.398
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:47.246
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.018
When I log in to a new session in English (en) 16.209
Then the keyboard layout is set to "us" 0.131
When the network is plugged 0.035
And Tor is ready 16.079
Then I successfully start the Unsafe Browser in "en" 14.933
And I kill the Unsafe Browser 5.616
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 25.830
And DuckDuckGo is the default search engine 4.517
And I kill the Tor Browser 5.241
And the screen keyboard works in Thunderbird 9.956
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.433
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.994
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.195
When I log in to a new session in French (fr) 28.420
Then the keyboard layout is set to "fr" 0.180
When the network is plugged 0.047
And Tor is ready 13.685
Then I successfully start the Unsafe Browser in "fr" 14.852
And I kill the Unsafe Browser 5.952
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 27.233
And DuckDuckGo is the default search engine 10.710
And I kill the Tor Browser 5.502
And the screen keyboard works in Thunderbird 12.489
And the layout of the screen keyboard is set to "fr" 0.611
After features/support/hooks.rb:291 1.183
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.776
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.495
When I log in to a new session in German (de) 29.685
Then the keyboard layout is set to "de" 0.200
When the network is plugged 0.042
And Tor is ready 17.563
Then I successfully start the Unsafe Browser in "de" 14.471
And I kill the Unsafe Browser 5.720
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 26.218
And DuckDuckGo is the default search engine 11.069
And I kill the Tor Browser 5.575
And the screen keyboard works in Thunderbird 13.006
And the layout of the screen keyboard is set to "de" 0.625
After features/support/hooks.rb:291 1.661
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:8.660
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.315
When I log in to a new session in Italian (it) 29.829
Then the keyboard layout is set to "it" 0.121
When the network is plugged 0.034
And Tor is ready 14.765
Then I successfully start the Unsafe Browser in "it" 14.027
And I kill the Unsafe Browser 5.659
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 26.253
And DuckDuckGo is the default search engine 11.248
And I kill the Tor Browser 5.566
And the screen keyboard works in Thunderbird 12.153
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:291 1.087
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.317
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.909
When I log in to a new session in Persian (fa) 28.851
Then the keyboard layout is set to "ir" 0.253
When the network is plugged 0.043
And Tor is ready 15.609
Then I successfully start the Unsafe Browser in "fa" 14.031
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 28.599
And DuckDuckGo is the default search engine 10.972
And I kill the Tor Browser 5.448
And the screen keyboard works in Thunderbird 12.080
And the layout of the screen keyboard is set to "ir" 0.577
After features/support/hooks.rb:291 0.950
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.413
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.837
When I log in to a new session in Portuguese (pt) 29.578
Then the keyboard layout is set to "pt" 0.231
When the network is plugged 0.048
And Tor is ready 16.288
Then I successfully start the Unsafe Browser in "pt" 14.190
And I kill the Unsafe Browser 5.689
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 27.584
And DuckDuckGo is the default search engine 10.382
And I kill the Tor Browser 5.484
And the screen keyboard works in Thunderbird 12.448
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.172
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.194
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.957
When I log in to a new session in Russian (ru) 29.245
Then the keyboard layout is set to "ru" 0.138
When the network is plugged 0.039
And Tor is ready 15.370
Then I successfully start the Unsafe Browser in "ru" 15.144
And I kill the Unsafe Browser 5.676
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 26.810
And DuckDuckGo is the default search engine 11.109
And I kill the Tor Browser 5.476
And the screen keyboard works in Thunderbird 13.593
And the layout of the screen keyboard is set to "ru" 0.537
After features/support/hooks.rb:291 1.094
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.834
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.217
When I log in to a new session in Spanish (es) 28.648
Then the keyboard layout is set to "es" 0.251
When the network is plugged 0.037
And Tor is ready 14.071
Then I successfully start the Unsafe Browser in "es" 15.335
And I kill the Unsafe Browser 5.644
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 26.940
And DuckDuckGo is the default search engine 10.841
And I kill the Tor Browser 5.449
And the screen keyboard works in Thunderbird 11.785
And the layout of the screen keyboard is set to "us" 0.526
After features/support/hooks.rb:291 1.090
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.353
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.928
When I log in to a new session in Turkish (tr) 28.884
Then the keyboard layout is set to "tr" 0.194
When the network is plugged 0.039
And Tor is ready 17.136
Then I successfully start the Unsafe Browser in "tr" 13.663
And I kill the Unsafe Browser 5.634
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 26.222
And DuckDuckGo is the default search engine 10.816
And I kill the Tor Browser 5.461
And the screen keyboard works in Thunderbird 12.705
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:291 1.382
After features/support/hooks.rb:75 0.000