Project Number Date
test_Tails_ISO_devel 3295 24 Feb 2024, 12:47

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:23:57.611 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.296
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.871
And I prepare Tails for memory erasure tests 0.366
When I start a process allocating 128 MiB of memory with a known pattern 1.257
Then patterns cover at least 128 MiB in the guest's memory 3.846 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.816
Then I find very few patterns in the guest's memory 4.138 
Pattern coverage: 0.000% (0 MiB out of 859 MiB reference memory)
After features/support/hooks.rb:291 2.296
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.041
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.263
And I prepare Tails for memory erasure tests 0.382
And I find very few patterns in the guest's memory 3.805 
Pattern coverage: 0.000% (0 MiB out of 859 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.108
Then patterns cover at least 99% of the test FS size in the guest's memory 3.695 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.304
Then I find very few patterns in the guest's memory 4.482 
Pattern coverage: 0.000% (0 MiB out of 859 MiB reference memory)
After features/support/hooks.rb:291 0.826
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
45.281
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.477
And I prepare Tails for memory erasure tests 0.428
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.962
Then I find very few patterns in the guest's memory 4.561 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.355
Then patterns cover at least 86% of the test FS size in the guest's memory 4.319 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.485
Then I find very few patterns in the guest's memory 5.326 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
# read cache
When I mount the USB drive again 0.242
And I read the content of the test FS 0.619
Then patterns cover at least 99% of the test FS size in the guest's memory 3.658 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.741
Then I find very few patterns in the guest's memory 4.102 
Pattern coverage: 0.000% (0 MiB out of 863 MiB reference memory)
After features/support/hooks.rb:291 1.173
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.371
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.601
And I prepare Tails for memory erasure tests 0.430
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.901
Then I find very few patterns in the guest's memory 3.345 
Pattern coverage: 0.000% (0 MiB out of 870 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.227
Then patterns cover at least 99% of the test FS size in the guest's memory 2.557 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.459
Then I find very few patterns in the guest's memory 3.141 
Pattern coverage: 0.000% (0 MiB out of 870 MiB reference memory)
# read cache
When I mount the USB drive again 3.819
And I read the content of the test FS 0.417
Then patterns cover at least 99% of the test FS size in the guest's memory 3.003 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.524
Then I find very few patterns in the guest's memory 3.940 
Pattern coverage: 0.000% (0 MiB out of 870 MiB reference memory)
After features/support/hooks.rb:291 0.931
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.553
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.983
And I prepare Tails for memory erasure tests 0.414
When I fill a 128 MiB file with a known pattern on the root filesystem 13.910
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.040
Then patterns cover at least 128 MiB in the guest's memory 2.865 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.499
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.820 
Pattern coverage: 0.000% (0 MiB out of 867 MiB reference memory)
After features/support/hooks.rb:291 3.536
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:25.963
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:39.585
And I prepare Tails for memory erasure tests 0.456
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.606
When I trigger shutdown 0.112
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.182 
Pattern coverage: 0.000% (0 MiB out of 902 MiB reference memory)
After features/support/hooks.rb:291 3.563
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:10.129
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:56.330
And I update APT using apt 19.296
When I install "popularity-contest" using apt 19.339
Then I am notified I can not use Additional Software for "popularity-contest" 7.547
And I can open the Additional Software documentation from the notification 27.615
After features/support/hooks.rb:450 41.875
After features/support/hooks.rb:291 2.866
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:3.331
Before features/support/hooks.rb:245 0.010
Before features/support/hooks.rb:442 0.009
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:19.896
And I update APT using apt 16.270
And I install "popularity-contest" using apt 19.165
Then I am proposed to add the "popularity-contest" package to my Additional Software 9.092
When I create a persistent storage and activate the Additional Software feature 20.279
Then Additional Software is correctly configured for package "popularity-contest" 1.567
When I shutdown Tails and wait for the computer to power off 12.084
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 3:23.825
Then Additional Software is correctly configured for package "popularity-contest" 0.872
And the package "popularity-contest" is installed after Additional Software has been started 0.276
After features/support/hooks.rb:450 40.868
After features/support/hooks.rb:291 1.767
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:21.351
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.010
Given a computer 0.214
And I start Tails from USB drive "__internal" and I login with an administration password 1:36.577
And I update APT using apt 17.332
When I install "makepp" using apt 22.751
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.385
And the package "makepp" is installed 0.090
After features/support/hooks.rb:450 41.973
After features/support/hooks.rb:291 1.066
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:58.950
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.212
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 4:13.330
When I uninstall "popularity-contest" using apt 18.725
And I accept removing "popularity-contest" from Additional Software 0.526
Then "popularity-contest" is not in the list of Additional Software 0.633
When I start Synaptic 23.777
And I update APT using Synaptic 23.812
And I install "cowsay" using Synaptic 12.388
And I accept adding "cowsay" to Additional Software 0.610
Then Additional Software is correctly configured for package "cowsay" 0.919
When I uninstall "cowsay" using apt 3.270
And I refuse removing "cowsay" from Additional Software 0.535
Then Additional Software is correctly configured for package "cowsay" 0.848
When I start "Additional Software" via GNOME Activities Overview 9.934
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.178
Then "cowsay" is not in the list of Additional Software 0.822
When I install "cowsay" using apt 3.193
And I refuse adding "cowsay" to Additional Software 0.523
Then "cowsay" is not in the list of Additional Software 0.705
After features/support/hooks.rb:450 1.550
After features/support/hooks.rb:291 0.738
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:1.093
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.201
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:27.374
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.636
And I accept adding "cowsay" to Additional Software 4.771
And Additional Software is correctly configured for package "cowsay" 0.803
And I shutdown Tails and wait for the computer to power off 6.252
And I start Tails from USB drive "__internal" with network unplugged 58.643
And I enable persistence 35.028
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 1:2.986
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.944
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.083
And the network is plugged 0.041
And Tor is ready 23.279
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.372
And available upgrades have been checked 0.123
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.274
And I can open the Additional Software configuration window from the notification 3.057
And I shutdown Tails and wait for the computer to power off 18.147
And I start Tails from USB drive "__internal" with network unplugged 58.325
And I enable persistence 36.681
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.031
And I log in to a new session 58.506
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.595
And I revert the APT tweaks that made it prefer an old version of cowsay 0.051
And the network is plugged 0.042
And Tor is ready 42.377
Then the Additional Software upgrade service has started 0.252
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.101
After features/support/hooks.rb:450 2.338
After features/support/hooks.rb:291 0.907
After features/support/hooks.rb:75 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:42.811
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.620
And I start Tails from USB drive "__internal" with network unplugged 58.451
And I enable persistence 34.897
And I remove the "cowsay" deb files from the APT cache 0.735
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.085
And I log in to a new session 59.166
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.451
And I can open the Additional Software log file from the notification 4.264
And the package "cowsay" is not installed 0.137
After features/support/hooks.rb:450 0.124
After features/support/hooks.rb:291 1.056
After features/support/hooks.rb:75 0.013
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.267
Before features/support/hooks.rb:245 0.017
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.166
When I log in to a new session in Arabic (ar) 28.948
Then the keyboard layout is set to "us" 0.231
When the network is plugged 0.095
And Tor is ready 15.260
Then I successfully start the Unsafe Browser in "ar" 13.475
And I kill the Unsafe Browser 5.919
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 34.247
And DuckDuckGo is the default search engine 22.526
And I kill the Tor Browser 5.576
And the screen keyboard works in Thunderbird 21.110
And the layout of the screen keyboard is set to "us" 0.589
After features/support/hooks.rb:291 1.167
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.631
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.070
When I log in to a new session in Chinese (zh_CN) 30.812
Then the keyboard layout is set to "cn" 0.164
When the network is plugged 0.052
And Tor is ready 13.803
Then I successfully start the Unsafe Browser in "zh_CN" 14.471
And I kill the Unsafe Browser 5.927
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 35.989
And DuckDuckGo is the default search engine 22.236
And I kill the Tor Browser 5.543
And the screen keyboard works in Thunderbird 23.885
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:291 1.382
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.955
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 21.521
When I log in to a new session in English (en) 17.324
Then the keyboard layout is set to "us" 0.260
When the network is plugged 0.057
And Tor is ready 14.459
Then I successfully start the Unsafe Browser in "en" 14.605
And I kill the Unsafe Browser 5.808
When I enable the screen keyboard 0.168
Then the screen keyboard works in Tor Browser 33.037
And DuckDuckGo is the default search engine 10.447
And I kill the Tor Browser 5.478
And the screen keyboard works in Thunderbird 20.227
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.749
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.463
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.178
When I log in to a new session in French (fr) 30.831
Then the keyboard layout is set to "fr" 0.187
When the network is plugged 0.042
And Tor is ready 13.911
Then I successfully start the Unsafe Browser in "fr" 15.355
And I kill the Unsafe Browser 5.775
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 34.559
And DuckDuckGo is the default search engine 11.552
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 21.861
And the layout of the screen keyboard is set to "fr" 0.600
After features/support/hooks.rb:291 1.622
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.780
Before features/support/hooks.rb:245 0.024
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.527
When I log in to a new session in German (de) 31.154
Then the keyboard layout is set to "de" 0.176
When the network is plugged 0.041
And Tor is ready 14.391
Then I successfully start the Unsafe Browser in "de" 13.459
And I kill the Unsafe Browser 5.806
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 34.471
And DuckDuckGo is the default search engine 22.193
And I kill the Tor Browser 5.509
And the screen keyboard works in Thunderbird 21.213
And the layout of the screen keyboard is set to "de" 0.699
After features/support/hooks.rb:291 2.551
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.096
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.419
When I log in to a new session in Italian (it) 28.524
Then the keyboard layout is set to "it" 0.218
When the network is plugged 0.036
And Tor is ready 14.295
Then I successfully start the Unsafe Browser in "it" 13.905
And I kill the Unsafe Browser 5.812
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 36.092
And DuckDuckGo is the default search engine 22.250
And I kill the Tor Browser 5.499
And the screen keyboard works in Thunderbird 20.318
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 1.587
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.144
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.465
When I log in to a new session in Persian (fa) 29.896
Then the keyboard layout is set to "ir" 0.271
When the network is plugged 0.059
And Tor is ready 13.788
Then I successfully start the Unsafe Browser in "fa" 13.767
And I kill the Unsafe Browser 5.857
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 35.442
And DuckDuckGo is the default search engine 21.525
And I kill the Tor Browser 5.550
And the screen keyboard works in Thunderbird 22.826
And the layout of the screen keyboard is set to "ir" 0.572
After features/support/hooks.rb:291 1.200
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:3.717
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.457
When I log in to a new session in Portuguese (pt) 29.240
Then the keyboard layout is set to "pt" 0.186
When the network is plugged 0.112
And Tor is ready 43.411
Then I successfully start the Unsafe Browser in "pt" 12.737
And I kill the Unsafe Browser 5.758
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 35.226
And DuckDuckGo is the default search engine 21.502
And I kill the Tor Browser 5.543
And the screen keyboard works in Thunderbird 20.822
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:291 1.226
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.410
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.473
When I log in to a new session in Russian (ru) 27.816
Then the keyboard layout is set to "ru" 0.128
When the network is plugged 0.056
And Tor is ready 14.267
Then I successfully start the Unsafe Browser in "ru" 14.546
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 34.668
And DuckDuckGo is the default search engine 18.212
And I kill the Tor Browser 5.600
And the screen keyboard works in Thunderbird 24.107
And the layout of the screen keyboard is set to "ru" 0.578
After features/support/hooks.rb:291 1.493
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.667
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.524
When I log in to a new session in Spanish (es) 29.653
Then the keyboard layout is set to "es" 0.214
When the network is plugged 0.042
And Tor is ready 15.625
Then I successfully start the Unsafe Browser in "es" 13.151
And I kill the Unsafe Browser 5.784
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 32.916
And DuckDuckGo is the default search engine 19.004
And I kill the Tor Browser 5.600
And the screen keyboard works in Thunderbird 21.384
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.753
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.075
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.128
When I log in to a new session in Turkish (tr) 29.452
Then the keyboard layout is set to "tr" 0.212
When the network is plugged 0.053
And Tor is ready 13.975
Then I successfully start the Unsafe Browser in "tr" 12.890
And I kill the Unsafe Browser 5.848
When I enable the screen keyboard 0.170
Then the screen keyboard works in Tor Browser 34.334
And DuckDuckGo is the default search engine 18.817
And I kill the Tor Browser 5.698
And the screen keyboard works in Thunderbird 20.899
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.201
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:9.228
When the network is plugged 0.061
And I wait 720 seconds 12:0.098 
Slept for 720 seconds
Then I successfully configure Tor 9.000
And the time has synced 0.068
After features/support/hooks.rb:291 0.631
After features/support/hooks.rb:75 0.000