Project Number Date
test_Tails_ISO_stable 4588 24 Dec 2023, 12:04

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:13.427 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.382
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.977
And I prepare Tails for memory erasure tests 0.488
When I start a process allocating 128 MiB of memory with a known pattern 1.353
Then patterns cover at least 128 MiB in the guest's memory 3.328 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.372
Then I find very few patterns in the guest's memory 3.860 
Pattern coverage: 0.000% (0 MiB out of 1243 MiB reference memory)
After features/support/hooks.rb:291 0.686
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.298
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.237
And I prepare Tails for memory erasure tests 0.466
And I find very few patterns in the guest's memory 3.610 
Pattern coverage: 0.000% (0 MiB out of 1254 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.228
Then patterns cover at least 99% of the test FS size in the guest's memory 3.073 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.269
Then I find very few patterns in the guest's memory 4.413 
Pattern coverage: 0.000% (0 MiB out of 1254 MiB reference memory)
After features/support/hooks.rb:291 1.237
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:40.490
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.750
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.860
Then I find very few patterns in the guest's memory 3.561 
Pattern coverage: 0.000% (0 MiB out of 1243 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3:5.394
Then patterns cover at least 86% of the test FS size in the guest's memory 3.177 
Pattern coverage: 96.836% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.627
Then I find very few patterns in the guest's memory 3.617 
Pattern coverage: 0.000% (0 MiB out of 1243 MiB reference memory)
# read cache
When I mount the USB drive again 0.630
And I read the content of the test FS 0.731
Then patterns cover at least 99% of the test FS size in the guest's memory 2.921 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.229
Then I find very few patterns in the guest's memory 3.536 
Pattern coverage: 0.000% (0 MiB out of 1243 MiB reference memory)
After features/support/hooks.rb:291 0.717
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:28.142
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.228
And I prepare Tails for memory erasure tests 0.503
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.218
Then I find very few patterns in the guest's memory 3.473 
Pattern coverage: 0.000% (0 MiB out of 1241 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:35.725
Then patterns cover at least 99% of the test FS size in the guest's memory 2.663 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.587
Then I find very few patterns in the guest's memory 3.253 
Pattern coverage: 0.000% (0 MiB out of 1241 MiB reference memory)
# read cache
When I mount the USB drive again 2.962
And I read the content of the test FS 0.385
Then patterns cover at least 99% of the test FS size in the guest's memory 2.297 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.572
Then I find very few patterns in the guest's memory 3.271 
Pattern coverage: 0.000% (0 MiB out of 1241 MiB reference memory)
After features/support/hooks.rb:291 0.770
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.728
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.943
And I prepare Tails for memory erasure tests 0.383
When I fill a 128 MiB file with a known pattern on the root filesystem 12.176
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.365
Then patterns cover at least 128 MiB in the guest's memory 2.478 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.572
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.786 
Pattern coverage: 0.000% (0 MiB out of 1245 MiB reference memory)
After features/support/hooks.rb:291 3.527
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:55.709
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:9.989
And I prepare Tails for memory erasure tests 0.425
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.761
When I trigger shutdown 0.360
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.157 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
After features/support/hooks.rb:291 3.479
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:56.563
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:16.812
And I update APT using apt 16.071
And I install "popularity-contest" using apt 19.790
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.551
When I create a persistent storage and activate the Additional Software feature 16.960
Then Additional Software is correctly configured for package "popularity-contest" 1.470
When I shutdown Tails and wait for the computer to power off 11.106
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:34.617
Then Additional Software is correctly configured for package "popularity-contest" 0.883
And the package "popularity-contest" is installed after Additional Software has been started 0.298
After features/support/hooks.rb:450 38.284
After features/support/hooks.rb:291 1.139
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:52.192
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.205
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.043
And I update APT using apt 16.481
When I install "makepp" using apt 19.496
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.891
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 34.096
After features/support/hooks.rb:291 0.911
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:45.969
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.201
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:4.897
When I uninstall "popularity-contest" using apt 18.866
And I accept removing "popularity-contest" from Additional Software 0.650
Then "popularity-contest" is not in the list of Additional Software 0.791
When I start Synaptic 19.968
And I update APT using Synaptic 21.705
And I install "cowsay" using Synaptic 9.629
And I accept adding "cowsay" to Additional Software 0.806
Then Additional Software is correctly configured for package "cowsay" 0.916
When I uninstall "cowsay" using apt 3.371
And I refuse removing "cowsay" from Additional Software 0.684
Then Additional Software is correctly configured for package "cowsay" 0.866
When I start "Additional Software" via GNOME Activities Overview 12.444
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.351
Then "cowsay" is not in the list of Additional Software 1.066
When I install "cowsay" using apt 3.286
And I refuse adding "cowsay" to Additional Software 0.678
Then "cowsay" is not in the list of Additional Software 0.784
After features/support/hooks.rb:450 1.075
After features/support/hooks.rb:291 0.673
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:21.291
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.176
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:59.459
And I configure APT to prefer an old version of cowsay 0.028
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.761
And I accept adding "cowsay" to Additional Software 1:1.463
And Additional Software is correctly configured for package "cowsay" 1.491
And I shutdown Tails and wait for the computer to power off 6.057
And I start Tails from USB drive "__internal" with network unplugged 43.434
And I enable persistence 31.328
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 22.351
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.871
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.082
And the network is plugged 0.070
And Tor is ready 46.584
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.935
And available upgrades have been checked 0.226
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.399
And I can open the Additional Software configuration window from the notification 2.696
And I shutdown Tails and wait for the computer to power off 2:3.591
And I start Tails from USB drive "__internal" with network unplugged 47.852
And I enable persistence 32.010
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 20.846
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.630
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
And the network is plugged 0.056
And Tor is ready 1:6.464
Then the Additional Software upgrade service has started 0.181
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.090
After features/support/hooks.rb:450 2.732
After features/support/hooks.rb:291 1.095
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:46.379
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.182
And I start Tails from USB drive "__internal" with network unplugged 44.611
And I enable persistence 31.766
And I remove the "cowsay" deb files from the APT cache 0.728
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.080
And I log in to a new session 23.900
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.808
And I can open the Additional Software log file from the notification 2.900
And the package "cowsay" is not installed 0.401
After features/support/hooks.rb:450 0.115
After features/support/hooks.rb:291 0.698
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.511
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.678
When I log in to a new session in Arabic (ar) 31.265
Then the keyboard layout is set to "us" 0.221
When the network is plugged 0.054
And Tor is ready 15.718
Then I successfully start the Unsafe Browser in "ar" 27.315
And I kill the Unsafe Browser 6.306
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 33.387
And DuckDuckGo is the default search engine 9.532
And I kill the Tor Browser 5.282
And the screen keyboard works in Thunderbird 21.075
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:291 1.486
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.401
Before features/support/hooks.rb:245 0.015
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.555
When I log in to a new session in Chinese (zh_CN) 30.556
Then the keyboard layout is set to "cn" 0.165
When the network is plugged 0.033
And Tor is ready 13.780
Then I successfully start the Unsafe Browser in "zh_CN" 26.988
And I kill the Unsafe Browser 5.910
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 35.421
And DuckDuckGo is the default search engine 9.436
And I kill the Tor Browser 5.374
And the screen keyboard works in Thunderbird 27.479
And the layout of the screen keyboard is set to "us" 0.586
After features/support/hooks.rb:291 1.309
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.813
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.888
When I log in to a new session in English (en) 16.192
Then the keyboard layout is set to "us" 0.229
When the network is plugged 0.065
And Tor is ready 16.106
Then I successfully start the Unsafe Browser in "en" 24.924
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 32.235
And DuckDuckGo is the default search engine 5.131
And I kill the Tor Browser 5.287
And the screen keyboard works in Thunderbird 20.191
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.289
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.879
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.222
When I log in to a new session in French (fr) 27.093
Then the keyboard layout is set to "fr" 0.210
When the network is plugged 0.037
And Tor is ready 15.900
Then I successfully start the Unsafe Browser in "fr" 27.849
And I kill the Unsafe Browser 6.389
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 32.745
And DuckDuckGo is the default search engine 9.608
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 20.843
And the layout of the screen keyboard is set to "fr" 0.568
After features/support/hooks.rb:291 2.831
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.241
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.630
When I log in to a new session in German (de) 28.482
Then the keyboard layout is set to "de" 0.212
When the network is plugged 0.038
And Tor is ready 14.324
Then I successfully start the Unsafe Browser in "de" 26.331
And I kill the Unsafe Browser 5.854
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 32.445
And DuckDuckGo is the default search engine 9.610
And I kill the Tor Browser 5.277
And the screen keyboard works in Thunderbird 22.318
And the layout of the screen keyboard is set to "de" 0.591
After features/support/hooks.rb:291 1.201
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:8.958
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.550
When I log in to a new session in Italian (it) 30.187
Then the keyboard layout is set to "it" 0.255
When the network is plugged 0.055
And Tor is ready 42.861
Then I successfully start the Unsafe Browser in "it" 28.776
And I kill the Unsafe Browser 5.818
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 33.227
And DuckDuckGo is the default search engine 9.338
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 23.834
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:291 1.137
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.183
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.745
When I log in to a new session in Persian (fa) 29.562
Then the keyboard layout is set to "ir" 0.141
When the network is plugged 0.044
And Tor is ready 14.891
Then I successfully start the Unsafe Browser in "fa" 27.984
And I kill the Unsafe Browser 5.743
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 33.766
And DuckDuckGo is the default search engine 9.664
And I kill the Tor Browser 5.342
And the screen keyboard works in Thunderbird 22.607
And the layout of the screen keyboard is set to "ir" 0.572
After features/support/hooks.rb:291 1.090
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.815
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.413
When I log in to a new session in Portuguese (pt) 28.999
Then the keyboard layout is set to "pt" 0.161
When the network is plugged 0.040
And Tor is ready 14.267
Then I successfully start the Unsafe Browser in "pt" 25.296
And I kill the Unsafe Browser 7.082
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 33.929
And DuckDuckGo is the default search engine 9.759
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 22.834
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 2.357
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.852
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.642
When I log in to a new session in Russian (ru) 28.110
Then the keyboard layout is set to "ru" 0.123
When the network is plugged 0.032
And Tor is ready 15.337
Then I successfully start the Unsafe Browser in "ru" 26.281
And I kill the Unsafe Browser 6.763
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 35.341
And DuckDuckGo is the default search engine 9.696
And I kill the Tor Browser 5.355
And the screen keyboard works in Thunderbird 23.464
And the layout of the screen keyboard is set to "ru" 0.587
After features/support/hooks.rb:291 1.131
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.078
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.581
When I log in to a new session in Spanish (es) 29.431
Then the keyboard layout is set to "es" 0.118
When the network is plugged 0.044
And Tor is ready 14.507
Then I successfully start the Unsafe Browser in "es" 26.581
And I kill the Unsafe Browser 6.157
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 33.081
And DuckDuckGo is the default search engine 9.337
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 21.207
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 2.387
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.543
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.565
When I log in to a new session in Turkish (tr) 37.092
Then the keyboard layout is set to "tr" 0.130
When the network is plugged 0.044
And Tor is ready 14.643
Then I successfully start the Unsafe Browser in "tr" 25.906
And I kill the Unsafe Browser 5.882
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 33.475
And DuckDuckGo is the default search engine 9.814
And I kill the Tor Browser 5.270
And the screen keyboard works in Thunderbird 24.015
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:291 3.711
After features/support/hooks.rb:75 0.000