Project Number Date
test_Tails_ISO_stable 4903 18 Jun 2024, 22:12

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 267 1 7 0 0 275 21 1 22 1:5:17.862 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.291
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.843
And I prepare Tails for memory erasure tests 0.612
When I start a process allocating 128 MiB of memory with a known pattern 2.581
Then patterns cover at least 128 MiB in the guest's memory 3.658 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.230
Then I find very few patterns in the guest's memory 4.364 
Pattern coverage: 0.000% (0 MiB out of 876 MiB reference memory)
After features/support/hooks.rb:326 2.446
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.039
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.489
And I prepare Tails for memory erasure tests 0.642
And I find very few patterns in the guest's memory 4.843 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 3.001
Then patterns cover at least 99% of the test FS size in the guest's memory 4.051 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.511
Then I find very few patterns in the guest's memory 4.499 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:326 0.827
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
29.337
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:269 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.365
And I prepare Tails for memory erasure tests 0.402
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.276
Then I find very few patterns in the guest's memory 4.626 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.648
Then patterns cover at least 86% of the test FS size in the guest's memory 4.018
85.538% 
85.538% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 85.538% (109 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:326 5.266 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:30:42)
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4903/artifact/build-artifacts/00:30:42_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.file_content_var_log_boot.log
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4903/artifact/build-artifacts/00:30:42_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4903/artifact/build-artifacts/00:30:42_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_stable/4903/artifact/build-artifacts/00:30:42_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:16.313
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.957
And I prepare Tails for memory erasure tests 0.467
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 36.681
Then I find very few patterns in the guest's memory 4.498 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.140
Then patterns cover at least 99% of the test FS size in the guest's memory 3.533 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.755
Then I find very few patterns in the guest's memory 4.004 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
# read cache
When I mount the USB drive again 5.367
And I read the content of the test FS 0.911
Then patterns cover at least 99% of the test FS size in the guest's memory 3.323 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.705
Then I find very few patterns in the guest's memory 3.967 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
After features/support/hooks.rb:326 0.982
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
53.119
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.482
And I prepare Tails for memory erasure tests 0.538
When I fill a 128 MiB file with a known pattern on the root filesystem 16.602
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.624
Then patterns cover at least 128 MiB in the guest's memory 2.980 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.024
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.850 
Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)
After features/support/hooks.rb:326 3.554
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
8:41.462
Before features/support/hooks.rb:269 0.005
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:53.030
And I prepare Tails for memory erasure tests 0.465
When I fill a 128 MiB file with a known pattern on the persistent filesystem 25.659
When I trigger shutdown 0.011
And I wait 20 seconds 20.004 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.291 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:326 3.506
After features/support/hooks.rb:100 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:13.412
Before features/support/hooks.rb:269 0.003
Before features/support/hooks.rb:507 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:2.106
And I update APT using apt 20.630
And I install "popularity-contest" using apt 25.814
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.019
When I create a persistent storage and activate the Additional Software feature 20.559
Then Additional Software is correctly configured for package "popularity-contest" 1.518
When I shutdown Tails and wait for the computer to power off 12.548
And I start Tails from USB drive "__internal" with network unplugged 59.009
And I enable persistence 19.080
And I log in to a new session 39.291
And the Additional Software installation service has started 41.703
Then I am notified that the installation succeeded 2.944
And Additional Software is correctly configured for package "popularity-contest" 0.874
And the package "popularity-contest" is installed after Additional Software has been started 0.310
After features/support/hooks.rb:515 39.907
After features/support/hooks.rb:326 1.493
After features/support/hooks.rb:100 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:28.821
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.006
Given a computer 0.246
And I start Tails from USB drive "__internal" and I login with an administration password 1:39.700
And I update APT using apt 19.639
When I install "makepp" using apt 22.610
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.528
And the package "makepp" is installed 0.096
After features/support/hooks.rb:515 39.977
After features/support/hooks.rb:326 1.017
After features/support/hooks.rb:100 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:6.394
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.007
Given a computer 0.259
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.879
When I uninstall "popularity-contest" using apt 21.998
And I accept removing "popularity-contest" from Additional Software 0.533
Then "popularity-contest" is not in the list of Additional Software 0.693
When I start Synaptic 25.529
And I update APT using Synaptic 22.738
And I install "cowsay" using Synaptic 11.303
And I accept adding "cowsay" to Additional Software 1.581
Then Additional Software is correctly configured for package "cowsay" 0.910
When I uninstall "cowsay" using apt 3.262
And I refuse removing "cowsay" from Additional Software 1.942
Then Additional Software is correctly configured for package "cowsay" 0.784
When I start "Additional Software" via GNOME Activities Overview 10.747
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.773
Then "cowsay" is not in the list of Additional Software 0.903
When I install "cowsay" using apt 3.303
And I refuse adding "cowsay" to Additional Software 0.578
Then "cowsay" is not in the list of Additional Software 0.669
After features/support/hooks.rb:515 1.069
After features/support/hooks.rb:326 0.959
After features/support/hooks.rb:100 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:57.752
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.006
Given a computer 0.243
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:20.103
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.169
And I accept adding "cowsay" to Additional Software 8.788
And Additional Software is correctly configured for package "cowsay" 0.923
And I shutdown Tails and wait for the computer to power off 8.795
And I start Tails from USB drive "__internal" with network unplugged 59.312
And I enable persistence 14.410
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 43.618
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.996
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.072
And the network is plugged 0.050
And Tor is ready 19.574
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.530
And available upgrades have been checked 0.170
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5.999
And I can open the Additional Software configuration window from the notification 4.864
And I shutdown Tails and wait for the computer to power off 19.663
And I start Tails from USB drive "__internal" with network unplugged 1:0.275
And I enable persistence 15.418
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.032
And I log in to a new session 33.217
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.429
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
And the network is plugged 0.051
And Tor is ready 54.524
Then the Additional Software upgrade service has started 0.212
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.111
After features/support/hooks.rb:515 2.420
After features/support/hooks.rb:326 1.355
After features/support/hooks.rb:100 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:16.663
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.007
Given a computer 0.788
And I start Tails from USB drive "__internal" with network unplugged 1:1.542
And I enable persistence 14.629
And I remove the "cowsay" deb files from the APT cache 0.847
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.098
And I log in to a new session 38.632
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.720
And I can open the Additional Software log file from the notification 5.711
And the package "cowsay" is not installed 0.693
After features/support/hooks.rb:515 0.110
After features/support/hooks.rb:326 1.169
After features/support/hooks.rb:100 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.256
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.481
When I log in to a new session in Arabic (ar) 34.184
Then the keyboard layout is set to "us" 0.410
When the network is plugged 0.038
And Tor is ready 16.662
Then I successfully start the Unsafe Browser in "ar" 15.319
And I kill the Unsafe Browser 6.041
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 33.111
And DuckDuckGo is the default search engine 18.818
And I kill the Tor Browser 5.602
And the screen keyboard works in Thunderbird 15.744
And the layout of the screen keyboard is set to "us" 0.708
After features/support/hooks.rb:326 1.381
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.067
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.891
When I log in to a new session in Chinese (zh_CN) 39.575
Then the keyboard layout is set to "cn" 0.555
When the network is plugged 0.074
And Tor is ready 18.885
Then I successfully start the Unsafe Browser in "zh_CN" 18.500
And I kill the Unsafe Browser 5.994
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 35.931
And DuckDuckGo is the default search engine 13.581
And I kill the Tor Browser 5.620
And the screen keyboard works in Thunderbird 22.616
And the layout of the screen keyboard is set to "us" 0.699
After features/support/hooks.rb:326 1.699
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.444
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.763
When I log in to a new session in English (en) 18.339
Then the keyboard layout is set to "us" 0.178
When the network is plugged 0.060
And Tor is ready 16.619
Then I successfully start the Unsafe Browser in "en" 17.995
And I kill the Unsafe Browser 5.703
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 33.100
And DuckDuckGo is the default search engine 6.092
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 14.555
And the layout of the screen keyboard is set to "us" 0.576
After features/support/hooks.rb:326 1.786
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.169
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.885
When I log in to a new session in French (fr) 36.992
Then the keyboard layout is set to "fr" 0.147
When the network is plugged 0.058
And Tor is ready 17.590
Then I successfully start the Unsafe Browser in "fr" 16.477
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 31.189
And DuckDuckGo is the default search engine 10.875
And I kill the Tor Browser 5.578
And the screen keyboard works in Thunderbird 14.896
And the layout of the screen keyboard is set to "fr" 0.551
After features/support/hooks.rb:326 1.344
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:53.251
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.781
When I log in to a new session in German (de) 34.217
Then the keyboard layout is set to "de" 0.182
When the network is plugged 0.062
And Tor is ready 45.833
Then I successfully start the Unsafe Browser in "de" 16.416
And I kill the Unsafe Browser 5.897
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 31.428
And DuckDuckGo is the default search engine 10.669
And I kill the Tor Browser 5.632
And the screen keyboard works in Thunderbird 13.424
And the layout of the screen keyboard is set to "de" 0.564
After features/support/hooks.rb:326 2.011
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.890
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.091
When I log in to a new session in Italian (it) 33.860
Then the keyboard layout is set to "it" 0.224
When the network is plugged 0.635
And Tor is ready 17.908
Then I successfully start the Unsafe Browser in "it" 17.084
And I kill the Unsafe Browser 5.954
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 31.665
And DuckDuckGo is the default search engine 11.373
And I kill the Tor Browser 5.563
And the screen keyboard works in Thunderbird 13.736
And the layout of the screen keyboard is set to "us" 0.633
After features/support/hooks.rb:326 1.532
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.835
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.629
When I log in to a new session in Persian (fa) 35.883
Then the keyboard layout is set to "ir" 0.334
When the network is plugged 0.132
And Tor is ready 19.320
Then I successfully start the Unsafe Browser in "fa" 15.365
And I kill the Unsafe Browser 6.938
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 32.486
And DuckDuckGo is the default search engine 9.892
And I kill the Tor Browser 5.236
And the screen keyboard works in Thunderbird 13.871
And the layout of the screen keyboard is set to "ir" 0.603
After features/support/hooks.rb:326 3.326
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.727
Before features/support/hooks.rb:269 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.570
When I log in to a new session in Portuguese (pt) 36.094
Then the keyboard layout is set to "pt" 0.198
When the network is plugged 0.054
And Tor is ready 16.178
Then I successfully start the Unsafe Browser in "pt" 16.071
And I kill the Unsafe Browser 5.815
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.605
And DuckDuckGo is the default search engine 10.872
And I kill the Tor Browser 5.602
And the screen keyboard works in Thunderbird 14.870
And the layout of the screen keyboard is set to "us" 0.675
After features/support/hooks.rb:326 0.931
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:53.659
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.583
When I log in to a new session in Russian (ru) 33.533
Then the keyboard layout is set to "ru" 0.323
When the network is plugged 0.048
And Tor is ready 46.386
Then I successfully start the Unsafe Browser in "ru" 15.032
And I kill the Unsafe Browser 6.009
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 32.382
And DuckDuckGo is the default search engine 10.821
And I kill the Tor Browser 5.515
And the screen keyboard works in Thunderbird 14.277
And the layout of the screen keyboard is set to "ru" 0.614
After features/support/hooks.rb:326 1.257
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.140
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.429
When I log in to a new session in Spanish (es) 33.834
Then the keyboard layout is set to "es" 0.177
When the network is plugged 0.062
And Tor is ready 17.186
Then I successfully start the Unsafe Browser in "es" 15.747
And I kill the Unsafe Browser 5.731
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 31.201
And DuckDuckGo is the default search engine 10.031
And I kill the Tor Browser 5.277
And the screen keyboard works in Thunderbird 12.735
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:326 2.531
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.810
Before features/support/hooks.rb:269 0.026
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.819
When I log in to a new session in Turkish (tr) 36.496
Then the keyboard layout is set to "tr" 0.160
When the network is plugged 0.056
And Tor is ready 16.955
Then I successfully start the Unsafe Browser in "tr" 15.415
And I kill the Unsafe Browser 5.914
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 30.641
And DuckDuckGo is the default search engine 11.131
And I kill the Tor Browser 5.508
And the screen keyboard works in Thunderbird 14.966
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:326 1.488
After features/support/hooks.rb:100 0.000