Project Number Date
test_Tails_ISO_stable 4671 17 Feb 2024, 11:59

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:40.442 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.475
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.455
And I prepare Tails for memory erasure tests 0.629
When I start a process allocating 128 MiB of memory with a known pattern 1.326
Then patterns cover at least 128 MiB in the guest's memory 4.408 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.191
Then I find very few patterns in the guest's memory 4.462 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 0.818
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:4.283
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.263
And I prepare Tails for memory erasure tests 0.586
And I find very few patterns in the guest's memory 4.635 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.513
Then patterns cover at least 99% of the test FS size in the guest's memory 4.093 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.383
Then I find very few patterns in the guest's memory 6.808 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:291 0.842
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:48.569
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.404
And I prepare Tails for memory erasure tests 0.709
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.594
Then I find very few patterns in the guest's memory 4.206 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:8.685
Then patterns cover at least 86% of the test FS size in the guest's memory 3.253 
Pattern coverage: 96.369% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.479
Then I find very few patterns in the guest's memory 3.750 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# read cache
When I mount the USB drive again 0.240
And I read the content of the test FS 1.076
Then patterns cover at least 99% of the test FS size in the guest's memory 3.912 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.362
Then I find very few patterns in the guest's memory 4.894 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 0.714
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:29.582
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.014
And I prepare Tails for memory erasure tests 1.012
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.475
Then I find very few patterns in the guest's memory 3.681 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:34.245
Then patterns cover at least 99% of the test FS size in the guest's memory 2.827 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.697
Then I find very few patterns in the guest's memory 3.504 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
# read cache
When I mount the USB drive again 3.428
And I read the content of the test FS 0.732
Then patterns cover at least 99% of the test FS size in the guest's memory 2.925 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.415
Then I find very few patterns in the guest's memory 3.621 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 1.112
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
53.194
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.983
And I prepare Tails for memory erasure tests 0.653
When I fill a 128 MiB file with a known pattern on the root filesystem 15.895
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.680
Then patterns cover at least 128 MiB in the guest's memory 3.398 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.711
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.851 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 3.499
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:9.159
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:23.424
And I prepare Tails for memory erasure tests 0.538
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.606
When I trigger shutdown 0.367
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.203 
Pattern coverage: 0.000% (0 MiB out of 1176 MiB reference memory)
After features/support/hooks.rb:291 3.495
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:56.460
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 57.778
And I update APT using apt 17.790
And I install "popularity-contest" using apt 22.957
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.683
When I create a persistent storage and activate the Additional Software feature 19.612
Then Additional Software is correctly configured for package "popularity-contest" 1.516
When I shutdown Tails and wait for the computer to power off 10.095
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:45.818
Then Additional Software is correctly configured for package "popularity-contest" 0.932
And the package "popularity-contest" is installed after Additional Software has been started 0.274
After features/support/hooks.rb:450 36.609
After features/support/hooks.rb:291 1.212
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:0.709
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.224
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.839
And I update APT using apt 17.199
When I install "makepp" using apt 19.615
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.727
And the package "makepp" is installed 0.104
After features/support/hooks.rb:450 37.133
After features/support/hooks.rb:291 0.930
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.086
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.252
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:7.223
When I uninstall "popularity-contest" using apt 16.419
And I accept removing "popularity-contest" from Additional Software 0.701
Then "popularity-contest" is not in the list of Additional Software 0.828
When I start Synaptic 24.125
And I update APT using Synaptic 21.672
And I install "cowsay" using Synaptic 10.161
And I accept adding "cowsay" to Additional Software 0.888
Then Additional Software is correctly configured for package "cowsay" 0.948
When I uninstall "cowsay" using apt 3.331
And I refuse removing "cowsay" from Additional Software 0.677
Then Additional Software is correctly configured for package "cowsay" 0.956
When I start "Additional Software" via GNOME Activities Overview 12.752
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.853
Then "cowsay" is not in the list of Additional Software 1.335
When I install "cowsay" using apt 3.391
And I refuse adding "cowsay" to Additional Software 0.698
Then "cowsay" is not in the list of Additional Software 0.866
After features/support/hooks.rb:450 1.284
After features/support/hooks.rb:291 0.780
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:19.629
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.196
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:5.371
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.532
And I accept adding "cowsay" to Additional Software 1:5.081
And Additional Software is correctly configured for package "cowsay" 1.437
And I shutdown Tails and wait for the computer to power off 6.080
And I start Tails from USB drive "__internal" with network unplugged 48.036
And I enable persistence 31.500
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.029
And I log in to a new session 24.895
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.428
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.105
And the network is plugged 0.049
And Tor is ready 16.671
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 36.417
And available upgrades have been checked 0.292
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.051
And I can open the Additional Software configuration window from the notification 2.714
And I shutdown Tails and wait for the computer to power off 2:2.469
And I start Tails from USB drive "__internal" with network unplugged 45.555
And I enable persistence 34.495
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 28.412
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.524
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
And the network is plugged 0.053
And Tor is ready 39.773
Then the Additional Software upgrade service has started 0.202
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.093
After features/support/hooks.rb:450 2.555
After features/support/hooks.rb:291 0.788
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:53.117
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.252
And I start Tails from USB drive "__internal" with network unplugged 45.015
And I enable persistence 32.893
And I remove the "cowsay" deb files from the APT cache 0.828
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.093
And I log in to a new session 31.116
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 0.749
And I can open the Additional Software log file from the notification 1.807
And the package "cowsay" is not installed 0.359
After features/support/hooks.rb:450 0.103
After features/support/hooks.rb:291 0.819
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.964
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.624
When I log in to a new session in Arabic (ar) 35.655
Then the keyboard layout is set to "us" 0.164
When the network is plugged 0.044
And Tor is ready 16.120
Then I successfully start the Unsafe Browser in "ar" 27.376
And I kill the Unsafe Browser 6.014
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 34.589
And DuckDuckGo is the default search engine 10.688
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 22.335
And the layout of the screen keyboard is set to "us" 0.666
After features/support/hooks.rb:291 0.950
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.187
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.157
When I log in to a new session in Chinese (zh_CN) 30.732
Then the keyboard layout is set to "cn" 0.137
When the network is plugged 0.034
And Tor is ready 14.575
Then I successfully start the Unsafe Browser in "zh_CN" 29.115
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.306
And DuckDuckGo is the default search engine 11.050
And I kill the Tor Browser 5.613
And the screen keyboard works in Thunderbird 31.799
And the layout of the screen keyboard is set to "us" 0.696
After features/support/hooks.rb:291 1.408
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:53.256
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.840
When I log in to a new session in English (en) 16.251
Then the keyboard layout is set to "us" 0.393
When the network is plugged 0.069
And Tor is ready 44.259
Then I successfully start the Unsafe Browser in "en" 27.859
And I kill the Unsafe Browser 6.000
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 33.487
And DuckDuckGo is the default search engine 5.659
And I kill the Tor Browser 5.269
And the screen keyboard works in Thunderbird 24.489
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:291 2.478
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.722
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.131
When I log in to a new session in French (fr) 30.480
Then the keyboard layout is set to "fr" 0.160
When the network is plugged 0.038
And Tor is ready 15.745
Then I successfully start the Unsafe Browser in "fr" 25.373
And I kill the Unsafe Browser 6.194
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 31.993
And DuckDuckGo is the default search engine 10.561
And I kill the Tor Browser 5.568
And the screen keyboard works in Thunderbird 23.690
And the layout of the screen keyboard is set to "fr" 0.656
After features/support/hooks.rb:291 1.434
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.252
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.986
When I log in to a new session in German (de) 30.553
Then the keyboard layout is set to "de" 0.237
When the network is plugged 0.035
And Tor is ready 15.240
Then I successfully start the Unsafe Browser in "de" 26.319
And I kill the Unsafe Browser 5.854
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 32.130
And DuckDuckGo is the default search engine 10.453
And I kill the Tor Browser 5.646
And the screen keyboard works in Thunderbird 22.098
And the layout of the screen keyboard is set to "de" 0.567
After features/support/hooks.rb:291 1.260
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.747
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.808
When I log in to a new session in Italian (it) 30.600
Then the keyboard layout is set to "it" 0.230
When the network is plugged 0.037
And Tor is ready 15.214
Then I successfully start the Unsafe Browser in "it" 26.839
And I kill the Unsafe Browser 6.006
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 32.979
And DuckDuckGo is the default search engine 11.073
And I kill the Tor Browser 5.587
And the screen keyboard works in Thunderbird 21.656
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.179
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.972
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.971
When I log in to a new session in Persian (fa) 30.353
Then the keyboard layout is set to "ir" 0.127
When the network is plugged 0.067
And Tor is ready 15.910
Then I successfully start the Unsafe Browser in "fa" 29.101
And I kill the Unsafe Browser 5.712
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 34.313
And DuckDuckGo is the default search engine 11.589
And I kill the Tor Browser 5.650
And the screen keyboard works in Thunderbird 23.467
And the layout of the screen keyboard is set to "ir" 0.565
After features/support/hooks.rb:291 1.122
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.760
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.877
When I log in to a new session in Portuguese (pt) 32.723
Then the keyboard layout is set to "pt" 0.285
When the network is plugged 0.038
And Tor is ready 15.382
Then I successfully start the Unsafe Browser in "pt" 28.468
And I kill the Unsafe Browser 6.235
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 33.290
And DuckDuckGo is the default search engine 10.909
And I kill the Tor Browser 5.591
And the screen keyboard works in Thunderbird 22.262
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 1.166
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.301
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.808
When I log in to a new session in Russian (ru) 29.182
Then the keyboard layout is set to "ru" 0.150
When the network is plugged 0.034
And Tor is ready 16.014
Then I successfully start the Unsafe Browser in "ru" 27.838
And I kill the Unsafe Browser 5.852
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 33.887
And DuckDuckGo is the default search engine 10.506
And I kill the Tor Browser 5.617
And the screen keyboard works in Thunderbird 25.675
And the layout of the screen keyboard is set to "ru" 0.607
After features/support/hooks.rb:291 1.345
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.491
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.065
When I log in to a new session in Spanish (es) 27.816
Then the keyboard layout is set to "es" 0.145
When the network is plugged 0.035
And Tor is ready 15.354
Then I successfully start the Unsafe Browser in "es" 25.561
And I kill the Unsafe Browser 5.948
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 32.999
And DuckDuckGo is the default search engine 10.963
And I kill the Tor Browser 5.577
And the screen keyboard works in Thunderbird 22.341
And the layout of the screen keyboard is set to "us" 0.543
After features/support/hooks.rb:291 2.173
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.517
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.810
When I log in to a new session in Turkish (tr) 28.187
Then the keyboard layout is set to "tr" 0.134
When the network is plugged 0.034
And Tor is ready 15.442
Then I successfully start the Unsafe Browser in "tr" 26.864
And I kill the Unsafe Browser 5.812
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 31.906
And DuckDuckGo is the default search engine 11.762
And I kill the Tor Browser 5.537
And the screen keyboard works in Thunderbird 22.338
And the layout of the screen keyboard is set to "us" 0.531
After features/support/hooks.rb:291 2.208
After features/support/hooks.rb:75 0.000