Project Number Date
test_Tails_ISO_devel 3400 26 May 2024, 13:22

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 276 1 7 0 0 284 23 1 24 1:21:0.932 Failed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.568
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.712
And I prepare Tails for memory erasure tests 0.442
When I start a process allocating 128 MiB of memory with a known pattern 2.432
Then patterns cover at least 128 MiB in the guest's memory 3.684 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.222
Then I find very few patterns in the guest's memory 4.075 
Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)
After features/support/hooks.rb:305 1.310
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.357
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.269
And I prepare Tails for memory erasure tests 0.436
And I find very few patterns in the guest's memory 3.984 
Pattern coverage: 0.000% (0 MiB out of 892 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.645
Then patterns cover at least 99% of the test FS size in the guest's memory 3.443 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.669
Then I find very few patterns in the guest's memory 4.907 
Pattern coverage: 0.000% (0 MiB out of 892 MiB reference memory)
After features/support/hooks.rb:305 0.897
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
30.324
Scenario Erasure of read and write disk caches on unmount: vfat
Before features/support/hooks.rb:259 0.002
Steps
Given I have started Tails from DVD without network and logged in 8.646
And I prepare Tails for memory erasure tests 0.463
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.970
Then I find very few patterns in the guest's memory 4.802 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.487
Then patterns cover at least 86% of the test FS size in the guest's memory 3.954
85.085% 
85.085% of the test FS size (127.599609375 MiB) has the pattern, but more than 86.000% was expected.
<false> is not true. (Test::Unit::AssertionFailedError)
./features/step_definitions/erase_memory.rb:170:in `/^patterns cover at least (\d+)% of the test FS size in the guest's memory$/'
features/erase_memory.feature:37:in `Then patterns cover at least 86% of the test FS size in the guest's memory'
Output 1 
Pattern coverage: 85.085% (108 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
# read cache
When I mount the USB drive again 0.000
And I read the content of the test FS 0.000
Then patterns cover at least 99% of the test FS size in the guest's memory 0.000
When I umount the USB drive 0.000
Then I find very few patterns in the guest's memory 0.000
After features/support/hooks.rb:305 4.220 
SCENARIO FAILED: 'Erasure of read and write disk caches on unmount: vfat' (at time 00:30:21)
Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3400/artifact/build-artifacts/00:30:21_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.png
Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3400/artifact/build-artifacts/00:30:21_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.mkv
Boot log: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3400/artifact/build-artifacts/00:30:21_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.boot-log
Systemd journal: https://jenkins.tails.boum.org/job/test_Tails_ISO_devel/3400/artifact/build-artifacts/00:30:21_Erasure_of_read_and_write_disk_caches_on_unmount:_vfat.journal
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:19.840
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.693
And I prepare Tails for memory erasure tests 0.591
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 37.106
Then I find very few patterns in the guest's memory 3.854 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.057
Then patterns cover at least 99% of the test FS size in the guest's memory 4.412 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 2.079
Then I find very few patterns in the guest's memory 4.134 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
# read cache
When I mount the USB drive again 5.594
And I read the content of the test FS 0.506
Then patterns cover at least 99% of the test FS size in the guest's memory 3.960 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.739
Then I find very few patterns in the guest's memory 4.108 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
After features/support/hooks.rb:305 1.280
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
56.678
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 10.847
And I prepare Tails for memory erasure tests 0.520
When I fill a 128 MiB file with a known pattern on the root filesystem 18.241
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.934
Then patterns cover at least 128 MiB in the guest's memory 3.300 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.004 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.816 
Pattern coverage: 0.000% (0 MiB out of 868 MiB reference memory)
After features/support/hooks.rb:305 3.535
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:54.423
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:10.208
And I prepare Tails for memory erasure tests 0.488
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.531
When I trigger shutdown 0.011
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.163 
Pattern coverage: 0.000% (0 MiB out of 909 MiB reference memory)
After features/support/hooks.rb:305 3.481
After features/support/hooks.rb:89 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:13.488
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:46.944
And I update APT using apt 19.299
When I install "popularity-contest" using apt 23.447
Then I am notified I can not use Additional Software for "popularity-contest" 11.210
And I can open the Additional Software documentation from the notification 32.585
After features/support/hooks.rb:464 41.279
After features/support/hooks.rb:305 2.494
After features/support/hooks.rb:89 0.006
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:24.157
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:6.320
And I update APT using apt 17.784
And I install "popularity-contest" using apt 25.606
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.718
When I create a persistent storage and activate the Additional Software feature 21.385
Then Additional Software is correctly configured for package "popularity-contest" 1.492
When I shutdown Tails and wait for the computer to power off 12.397
And I start Tails from USB drive "__internal" with network unplugged 1:0.533
And I enable persistence 28.354
And I log in to a new session 37.674
And the Additional Software installation service has started 41.187
Then I am notified that the installation succeeded 2.606
And Additional Software is correctly configured for package "popularity-contest" 0.848
And the package "popularity-contest" is installed after Additional Software has been started 0.248
After features/support/hooks.rb:464 40.793
After features/support/hooks.rb:305 0.980
After features/support/hooks.rb:89 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:29.040
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.008
Given a computer 0.286
And I start Tails from USB drive "__internal" and I login with an administration password 1:42.352
And I update APT using apt 17.461
When I install "makepp" using apt 22.363
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.501
And the package "makepp" is installed 0.074
After features/support/hooks.rb:464 37.583
After features/support/hooks.rb:305 0.940
After features/support/hooks.rb:89 0.036
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:4.967
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.008
Given a computer 0.216
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.103
When I uninstall "popularity-contest" using apt 21.818
And I accept removing "popularity-contest" from Additional Software 0.588
Then "popularity-contest" is not in the list of Additional Software 0.699
When I start Synaptic 27.970
And I update APT using Synaptic 21.850
And I install "cowsay" using Synaptic 10.134
And I accept adding "cowsay" to Additional Software 1.335
Then Additional Software is correctly configured for package "cowsay" 0.832
When I uninstall "cowsay" using apt 3.221
And I refuse removing "cowsay" from Additional Software 0.606
Then Additional Software is correctly configured for package "cowsay" 0.864
When I start "Additional Software" via GNOME Activities Overview 10.578
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.598
Then "cowsay" is not in the list of Additional Software 0.921
When I install "cowsay" using apt 3.269
And I refuse adding "cowsay" to Additional Software 0.700
Then "cowsay" is not in the list of Additional Software 0.655
After features/support/hooks.rb:464 0.901
After features/support/hooks.rb:305 0.638
After features/support/hooks.rb:89 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:46.156
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.006
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:22.735
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.965
And I accept adding "cowsay" to Additional Software 6.761
And Additional Software is correctly configured for package "cowsay" 0.854
And I shutdown Tails and wait for the computer to power off 6.405
And I start Tails from USB drive "__internal" with network unplugged 1:0.468
And I enable persistence 13.043
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 36.728
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.169
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.069
And the network is plugged 0.054
And Tor is ready 24.146
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.477
And available upgrades have been checked 0.145
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.286
And I can open the Additional Software configuration window from the notification 4.027
And I shutdown Tails and wait for the computer to power off 2:6.742
And I start Tails from USB drive "__internal" with network unplugged 1:1.230
And I enable persistence 13.764
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 37.080
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.023
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
And the network is plugged 0.034
And Tor is ready 50.284
Then the Additional Software upgrade service has started 0.184
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.077
After features/support/hooks.rb:464 2.161
After features/support/hooks.rb:305 1.100
After features/support/hooks.rb:89 0.034
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:15.308
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.006
Given a computer 0.200
And I start Tails from USB drive "__internal" with network unplugged 1:0.609
And I enable persistence 12.391
And I remove the "cowsay" deb files from the APT cache 0.584
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.091
And I log in to a new session 40.289
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.181
And I can open the Additional Software log file from the notification 6.351
And the package "cowsay" is not installed 0.607
After features/support/hooks.rb:464 0.115
After features/support/hooks.rb:305 1.183
After features/support/hooks.rb:89 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.462
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.285
When I log in to a new session in Arabic (ar) 31.088
Then the keyboard layout is set to "us" 0.144
When the network is plugged 0.063
And Tor is ready 14.183
Then I successfully start the Unsafe Browser in "ar" 18.371
And I kill the Unsafe Browser 5.926
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 32.330
And DuckDuckGo is the default search engine 11.727
And I kill the Tor Browser 5.660
And the screen keyboard works in Thunderbird 14.865
And the layout of the screen keyboard is set to "us" 0.686
After features/support/hooks.rb:305 1.242
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.745
Before features/support/hooks.rb:259 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.862
When I log in to a new session in Chinese (zh_CN) 33.898
Then the keyboard layout is set to "cn" 0.348
When the network is plugged 0.039
And Tor is ready 17.907
Then I successfully start the Unsafe Browser in "zh_CN" 17.666
And I kill the Unsafe Browser 5.793
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 25.960
And DuckDuckGo is the default search engine 11.832
And I kill the Tor Browser 5.507
And the screen keyboard works in Thunderbird 17.223
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:305 1.973
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:59.203
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.094
When I log in to a new session in English (en) 17.440
Then the keyboard layout is set to "us" 0.102
When the network is plugged 0.064
And Tor is ready 15.782
Then I successfully start the Unsafe Browser in "en" 16.319
And I kill the Unsafe Browser 5.758
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 31.175
And DuckDuckGo is the default search engine 5.020
And I kill the Tor Browser 5.247
And the screen keyboard works in Thunderbird 13.466
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:305 3.572
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.971
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.439
When I log in to a new session in French (fr) 31.935
Then the keyboard layout is set to "fr" 0.241
When the network is plugged 0.032
And Tor is ready 19.409
Then I successfully start the Unsafe Browser in "fr" 16.111
And I kill the Unsafe Browser 5.910
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 30.308
And DuckDuckGo is the default search engine 17.656
And I kill the Tor Browser 5.528
And the screen keyboard works in Thunderbird 12.752
And the layout of the screen keyboard is set to "fr" 0.543
After features/support/hooks.rb:305 1.063
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.956
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.930
When I log in to a new session in German (de) 31.856
Then the keyboard layout is set to "de" 0.289
When the network is plugged 0.041
And Tor is ready 45.077
Then I successfully start the Unsafe Browser in "de" 15.421
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 31.094
And DuckDuckGo is the default search engine 11.787
And I kill the Tor Browser 5.523
And the screen keyboard works in Thunderbird 13.472
And the layout of the screen keyboard is set to "de" 0.564
After features/support/hooks.rb:305 1.322
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.919
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.923
When I log in to a new session in Italian (it) 32.799
Then the keyboard layout is set to "it" 0.163
When the network is plugged 0.048
And Tor is ready 17.028
Then I successfully start the Unsafe Browser in "it" 15.746
And I kill the Unsafe Browser 5.775
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 31.540
And DuckDuckGo is the default search engine 12.158
And I kill the Tor Browser 5.539
And the screen keyboard works in Thunderbird 14.439
And the layout of the screen keyboard is set to "us" 0.636
After features/support/hooks.rb:305 1.597
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.610
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.791
When I log in to a new session in Persian (fa) 32.272
Then the keyboard layout is set to "ir" 0.303
When the network is plugged 0.537
And Tor is ready 15.658
Then I successfully start the Unsafe Browser in "fa" 16.343
And I kill the Unsafe Browser 5.834
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 31.069
And DuckDuckGo is the default search engine 11.301
And I kill the Tor Browser 5.445
And the screen keyboard works in Thunderbird 13.332
And the layout of the screen keyboard is set to "ir" 0.598
After features/support/hooks.rb:305 1.173
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.304
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.121
When I log in to a new session in Portuguese (pt) 32.398
Then the keyboard layout is set to "pt" 0.155
When the network is plugged 0.041
And Tor is ready 44.906
Then I successfully start the Unsafe Browser in "pt" 16.263
And I kill the Unsafe Browser 5.807
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 29.933
And DuckDuckGo is the default search engine 10.388
And I kill the Tor Browser 5.480
And the screen keyboard works in Thunderbird 15.060
And the layout of the screen keyboard is set to "us" 0.655
After features/support/hooks.rb:305 1.393
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.298
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.396
When I log in to a new session in Russian (ru) 30.585
Then the keyboard layout is set to "ru" 0.128
When the network is plugged 0.049
And Tor is ready 15.957
Then I successfully start the Unsafe Browser in "ru" 16.539
And I kill the Unsafe Browser 5.746
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 30.247
And DuckDuckGo is the default search engine 10.704
And I kill the Tor Browser 5.500
And the screen keyboard works in Thunderbird 14.704
And the layout of the screen keyboard is set to "ru" 0.621
After features/support/hooks.rb:305 1.050
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.272
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.123
When I log in to a new session in Spanish (es) 31.795
Then the keyboard layout is set to "es" 0.179
When the network is plugged 0.115
And Tor is ready 46.736
Then I successfully start the Unsafe Browser in "es" 16.252
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 30.283
And DuckDuckGo is the default search engine 11.085
And I kill the Tor Browser 5.505
And the screen keyboard works in Thunderbird 12.734
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:305 1.278
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.594
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.999
When I log in to a new session in Turkish (tr) 31.361
Then the keyboard layout is set to "tr" 0.134
When the network is plugged 0.096
And Tor is ready 16.448
Then I successfully start the Unsafe Browser in "tr" 17.205
And I kill the Unsafe Browser 5.832
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 30.630
And DuckDuckGo is the default search engine 10.481
And I kill the Tor Browser 5.493
And the screen keyboard works in Thunderbird 13.229
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:305 1.130
After features/support/hooks.rb:89 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:12.280
When the network is plugged 0.041
And I wait 720 seconds 12:0.075 
Slept for 720 seconds
Then I successfully configure Tor 12.083
And the time has synced 0.079
After features/support/hooks.rb:305 0.766
After features/support/hooks.rb:89 0.000