Project Number Date
test_Tails_ISO_devel 3239 16 Jan 2024, 19:30

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:26:50.622 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.917
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.506
And I prepare Tails for memory erasure tests 0.603
When I start a process allocating 128 MiB of memory with a known pattern 2.356
Then patterns cover at least 128 MiB in the guest's memory 3.416 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.281
Then I find very few patterns in the guest's memory 3.753 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 0.676
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.806
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.530
And I prepare Tails for memory erasure tests 0.615
And I find very few patterns in the guest's memory 4.012 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.582
Then patterns cover at least 99% of the test FS size in the guest's memory 4.415 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.345
Then I find very few patterns in the guest's memory 4.304 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 0.747
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:2.816
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.486
And I prepare Tails for memory erasure tests 0.563
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.951
Then I find very few patterns in the guest's memory 4.472 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:25.028
Then patterns cover at least 86% of the test FS size in the guest's memory 3.166 
Pattern coverage: 95.754% (119 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.581
Then I find very few patterns in the guest's memory 3.848 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# read cache
When I mount the USB drive again 0.267
And I read the content of the test FS 0.765
Then patterns cover at least 99% of the test FS size in the guest's memory 3.859 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.375
Then I find very few patterns in the guest's memory 4.451 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
After features/support/hooks.rb:291 0.844
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:40.137
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.465
And I prepare Tails for memory erasure tests 0.587
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.703
Then I find very few patterns in the guest's memory 3.529 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:45.854
Then patterns cover at least 99% of the test FS size in the guest's memory 2.884 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.837
Then I find very few patterns in the guest's memory 3.405 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
# read cache
When I mount the USB drive again 3.491
And I read the content of the test FS 0.604
Then patterns cover at least 99% of the test FS size in the guest's memory 2.770 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.532
Then I find very few patterns in the guest's memory 3.472 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
After features/support/hooks.rb:291 1.195
After features/support/hooks.rb:75 0.003
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.788
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.451
And I prepare Tails for memory erasure tests 0.603
When I fill a 128 MiB file with a known pattern on the root filesystem 15.711
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 7.152
Then patterns cover at least 128 MiB in the guest's memory 2.393 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.563
And I wait 20 seconds 20.002 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.909 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 3.497
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:57.205
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:12.863
And I prepare Tails for memory erasure tests 0.489
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.090
When I trigger shutdown 0.416
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.324 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 3.539
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:34.708
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:31.024
And I update APT using apt 17.620
When I install "popularity-contest" using apt 19.929
Then I am notified I can not use Additional Software for "popularity-contest" 1:2.295
And I can open the Additional Software documentation from the notification 23.836
After features/support/hooks.rb:450 41.083
After features/support/hooks.rb:291 1.907
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:45.771
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.051
And I update APT using apt 16.467
And I install "popularity-contest" using apt 19.879
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.981
When I create a persistent storage and activate the Additional Software feature 19.125
Then Additional Software is correctly configured for package "popularity-contest" 1.310
When I shutdown Tails and wait for the computer to power off 11.081
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:44.617
Then Additional Software is correctly configured for package "popularity-contest" 1.007
And the package "popularity-contest" is installed after Additional Software has been started 0.247
After features/support/hooks.rb:450 40.647
After features/support/hooks.rb:291 1.249
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:52.734
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.009
Given a computer 0.237
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.816
And I update APT using apt 16.164
When I install "makepp" using apt 19.703
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.706
And the package "makepp" is installed 0.107
After features/support/hooks.rb:450 40.286
After features/support/hooks.rb:291 0.860
After features/support/hooks.rb:75 0.018
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:56.731
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.272
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:13.537
When I uninstall "popularity-contest" using apt 19.097
And I accept removing "popularity-contest" from Additional Software 0.715
Then "popularity-contest" is not in the list of Additional Software 0.826
When I start Synaptic 20.417
And I update APT using Synaptic 21.871
And I install "cowsay" using Synaptic 8.775
And I accept adding "cowsay" to Additional Software 0.930
Then Additional Software is correctly configured for package "cowsay" 0.960
When I uninstall "cowsay" using apt 3.429
And I refuse removing "cowsay" from Additional Software 0.699
Then Additional Software is correctly configured for package "cowsay" 0.867
When I start "Additional Software" via GNOME Activities Overview 12.522
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.545
Then "cowsay" is not in the list of Additional Software 0.995
When I install "cowsay" using apt 3.301
And I refuse adding "cowsay" to Additional Software 2.219
Then "cowsay" is not in the list of Additional Software 0.745
After features/support/hooks.rb:450 0.998
After features/support/hooks.rb:291 0.705
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:4.798
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.005
Given a computer 0.228
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:28.037
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.666
And I accept adding "cowsay" to Additional Software 1:5.702
And Additional Software is correctly configured for package "cowsay" 1.475
And I shutdown Tails and wait for the computer to power off 5.094
And I start Tails from USB drive "__internal" with network unplugged 44.988
And I enable persistence 33.370
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 25.717
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.398
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.094
And the network is plugged 0.041
And Tor is ready 18.418
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.728
And available upgrades have been checked 0.228
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.542
And I can open the Additional Software configuration window from the notification 2.828
And I shutdown Tails and wait for the computer to power off 2:2.638
And I start Tails from USB drive "__internal" with network unplugged 46.290
And I enable persistence 30.822
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 22.752
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.832
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.101
And Tor is ready 40.350
Then the Additional Software upgrade service has started 0.161
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.099
After features/support/hooks.rb:450 2.737
After features/support/hooks.rb:291 0.839
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.988
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.007
Given a computer 0.202
And I start Tails from USB drive "__internal" with network unplugged 45.509
And I enable persistence 31.656
And I remove the "cowsay" deb files from the APT cache 0.720
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.088
And I log in to a new session 25.248
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.623
And I can open the Additional Software log file from the notification 2.631
And the package "cowsay" is not installed 0.305
After features/support/hooks.rb:450 0.109
After features/support/hooks.rb:291 0.670
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.095
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.518
When I log in to a new session in Arabic (ar) 28.321
Then the keyboard layout is set to "us" 0.174
When the network is plugged 0.042
And Tor is ready 16.214
Then I successfully start the Unsafe Browser in "ar" 27.178
And I kill the Unsafe Browser 5.711
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 34.480
And DuckDuckGo is the default search engine 10.450
And I kill the Tor Browser 5.622
And the screen keyboard works in Thunderbird 21.658
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 1.296
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.602
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.919
When I log in to a new session in Chinese (zh_CN) 28.104
Then the keyboard layout is set to "cn" 0.130
When the network is plugged 0.044
And Tor is ready 16.686
Then I successfully start the Unsafe Browser in "zh_CN" 28.771
And I kill the Unsafe Browser 5.890
When I enable the screen keyboard 0.188
Then the screen keyboard works in Tor Browser 35.088
And DuckDuckGo is the default search engine 9.706
And I kill the Tor Browser 5.383
And the screen keyboard works in Thunderbird 25.988
And the layout of the screen keyboard is set to "us" 0.699
After features/support/hooks.rb:291 1.209
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.696
Before features/support/hooks.rb:245 0.017
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.127
When I log in to a new session in English (en) 16.601
Then the keyboard layout is set to "us" 0.158
When the network is plugged 0.047
And Tor is ready 43.396
Then I successfully start the Unsafe Browser in "en" 26.384
And I kill the Unsafe Browser 6.498
When I enable the screen keyboard 0.388
Then the screen keyboard works in Tor Browser 37.122
And DuckDuckGo is the default search engine 5.232
And I kill the Tor Browser 5.307
And the screen keyboard works in Thunderbird 21.867
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.030
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.076
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.002
When I log in to a new session in French (fr) 30.734
Then the keyboard layout is set to "fr" 0.392
When the network is plugged 0.035
And Tor is ready 15.489
Then I successfully start the Unsafe Browser in "fr" 27.513
And I kill the Unsafe Browser 5.892
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 35.348
And DuckDuckGo is the default search engine 10.086
And I kill the Tor Browser 5.269
And the screen keyboard works in Thunderbird 23.411
And the layout of the screen keyboard is set to "fr" 0.772
After features/support/hooks.rb:291 1.972
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.082
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.078
When I log in to a new session in German (de) 29.026
Then the keyboard layout is set to "de" 0.138
When the network is plugged 0.049
And Tor is ready 16.837
Then I successfully start the Unsafe Browser in "de" 26.453
And I kill the Unsafe Browser 6.344
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 33.518
And DuckDuckGo is the default search engine 10.591
And I kill the Tor Browser 5.619
And the screen keyboard works in Thunderbird 20.669
And the layout of the screen keyboard is set to "de" 0.596
After features/support/hooks.rb:291 1.689
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.465
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.149
When I log in to a new session in Italian (it) 29.939
Then the keyboard layout is set to "it" 0.205
When the network is plugged 0.051
And Tor is ready 15.753
Then I successfully start the Unsafe Browser in "it" 29.499
And I kill the Unsafe Browser 5.997
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 34.538
And DuckDuckGo is the default search engine 9.922
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 21.383
And the layout of the screen keyboard is set to "us" 0.593
After features/support/hooks.rb:291 1.675
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.903
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.646
When I log in to a new session in Persian (fa) 30.435
Then the keyboard layout is set to "ir" 0.135
When the network is plugged 0.041
And Tor is ready 15.284
Then I successfully start the Unsafe Browser in "fa" 28.190
And I kill the Unsafe Browser 5.817
When I enable the screen keyboard 0.181
Then the screen keyboard works in Tor Browser 35.033
And DuckDuckGo is the default search engine 9.521
And I kill the Tor Browser 5.329
And the screen keyboard works in Thunderbird 23.731
And the layout of the screen keyboard is set to "ir" 0.553
After features/support/hooks.rb:291 3.338
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.605
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.693
When I log in to a new session in Portuguese (pt) 28.872
Then the keyboard layout is set to "pt" 0.158
When the network is plugged 0.041
And Tor is ready 16.593
Then I successfully start the Unsafe Browser in "pt" 28.094
And I kill the Unsafe Browser 6.091
When I enable the screen keyboard 0.164
Then the screen keyboard works in Tor Browser 33.638
And DuckDuckGo is the default search engine 9.583
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 21.767
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:291 2.163
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.884
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.384
When I log in to a new session in Russian (ru) 29.836
Then the keyboard layout is set to "ru" 0.246
When the network is plugged 0.039
And Tor is ready 15.725
Then I successfully start the Unsafe Browser in "ru" 28.253
And I kill the Unsafe Browser 7.240
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 34.616
And DuckDuckGo is the default search engine 9.166
And I kill the Tor Browser 5.332
And the screen keyboard works in Thunderbird 22.287
And the layout of the screen keyboard is set to "ru" 0.602
After features/support/hooks.rb:291 1.141
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.031
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.326
When I log in to a new session in Spanish (es) 29.997
Then the keyboard layout is set to "es" 0.187
When the network is plugged 0.045
And Tor is ready 15.325
Then I successfully start the Unsafe Browser in "es" 26.445
And I kill the Unsafe Browser 5.893
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.190
And DuckDuckGo is the default search engine 9.566
And I kill the Tor Browser 5.390
And the screen keyboard works in Thunderbird 20.956
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.127
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.644
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.329
When I log in to a new session in Turkish (tr) 28.126
Then the keyboard layout is set to "tr" 0.236
When the network is plugged 0.045
And Tor is ready 16.931
Then I successfully start the Unsafe Browser in "tr" 27.146
And I kill the Unsafe Browser 5.958
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 33.736
And DuckDuckGo is the default search engine 10.247
And I kill the Tor Browser 5.457
And the screen keyboard works in Thunderbird 21.712
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:291 1.190
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.127
When the network is plugged 0.044
And I wait 720 seconds 12:0.058 
Slept for 720 seconds
Then I successfully configure Tor 9.974
And the time has synced 0.050
After features/support/hooks.rb:291 0.683
After features/support/hooks.rb:75 0.000