Project Number Date
test_Tails_ISO_stable 4599 02 Jan 2024, 12:06

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:28.019 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.437
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.831
And I prepare Tails for memory erasure tests 0.584
When I start a process allocating 128 MiB of memory with a known pattern 2.351
Then patterns cover at least 128 MiB in the guest's memory 3.379 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.288
Then I find very few patterns in the guest's memory 4.002 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
After features/support/hooks.rb:291 0.788
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.830
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 10.169
And I prepare Tails for memory erasure tests 0.619
And I find very few patterns in the guest's memory 3.935 
Pattern coverage: 0.000% (0 MiB out of 1229 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.345
Then patterns cover at least 99% of the test FS size in the guest's memory 3.135 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.316
Then I find very few patterns in the guest's memory 4.307 
Pattern coverage: 0.000% (0 MiB out of 1229 MiB reference memory)
After features/support/hooks.rb:291 0.782
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:58.785
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.058
And I prepare Tails for memory erasure tests 0.519
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.945
Then I find very few patterns in the guest's memory 3.815 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:23.899
Then patterns cover at least 86% of the test FS size in the guest's memory 2.930 
Pattern coverage: 95.011% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.452
Then I find very few patterns in the guest's memory 3.822 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
# read cache
When I mount the USB drive again 0.281
And I read the content of the test FS 0.542
Then patterns cover at least 99% of the test FS size in the guest's memory 3.348 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.387
Then I find very few patterns in the guest's memory 3.781 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 1.118
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:26.300
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.963
And I prepare Tails for memory erasure tests 0.604
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.394
Then I find very few patterns in the guest's memory 3.342 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:29.996
Then patterns cover at least 99% of the test FS size in the guest's memory 2.843 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.157
Then I find very few patterns in the guest's memory 3.344 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# read cache
When I mount the USB drive again 4.445
And I read the content of the test FS 0.421
Then patterns cover at least 99% of the test FS size in the guest's memory 2.702 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.704
Then I find very few patterns in the guest's memory 3.378 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 1.867
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.243
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.041
And I prepare Tails for memory erasure tests 0.575
When I fill a 128 MiB file with a known pattern on the root filesystem 11.713
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.556
Then patterns cover at least 128 MiB in the guest's memory 2.579 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.931
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.824 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
After features/support/hooks.rb:291 3.478
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:15.917
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:32.591
And I prepare Tails for memory erasure tests 0.450
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.214
When I trigger shutdown 0.380
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.261 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
After features/support/hooks.rb:291 3.492
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:28.627
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 48.296
And I update APT using apt 16.782
And I install "popularity-contest" using apt 19.695
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.307
When I create a persistent storage and activate the Additional Software feature 18.478
Then Additional Software is correctly configured for package "popularity-contest" 1.540
When I shutdown Tails and wait for the computer to power off 11.086
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:32.272
Then Additional Software is correctly configured for package "popularity-contest" 0.911
And the package "popularity-contest" is installed after Additional Software has been started 0.256
After features/support/hooks.rb:450 36.727
After features/support/hooks.rb:291 1.112
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:51.556
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.327
And I start Tails from USB drive "__internal" and I login with an administration password 1:18.937
And I update APT using apt 15.759
When I install "makepp" using apt 19.728
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.721
And the package "makepp" is installed 0.082
After features/support/hooks.rb:450 38.977
After features/support/hooks.rb:291 0.971
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.333
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.230
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:6.137
When I uninstall "popularity-contest" using apt 15.795
And I accept removing "popularity-contest" from Additional Software 1.995
Then "popularity-contest" is not in the list of Additional Software 0.825
When I start Synaptic 23.485
And I update APT using Synaptic 22.041
And I install "cowsay" using Synaptic 11.208
And I accept adding "cowsay" to Additional Software 0.816
Then Additional Software is correctly configured for package "cowsay" 0.896
When I uninstall "cowsay" using apt 3.353
And I refuse removing "cowsay" from Additional Software 0.751
Then Additional Software is correctly configured for package "cowsay" 0.801
When I start "Additional Software" via GNOME Activities Overview 12.533
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.788
Then "cowsay" is not in the list of Additional Software 0.894
When I install "cowsay" using apt 3.321
And I refuse adding "cowsay" to Additional Software 0.724
Then "cowsay" is not in the list of Additional Software 0.732
After features/support/hooks.rb:450 1.104
After features/support/hooks.rb:291 1.436
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:39.800
Before features/support/hooks.rb:245 0.017
Before features/support/hooks.rb:442 0.020
Given a computer 0.263
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:2.322
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.926
And I accept adding "cowsay" to Additional Software 1:3.569
And Additional Software is correctly configured for package "cowsay" 1.490
And I shutdown Tails and wait for the computer to power off 5.071
And I start Tails from USB drive "__internal" with network unplugged 46.131
And I enable persistence 31.105
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 28.579
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.593
And I revert the APT tweaks that made it prefer an old version of cowsay 0.050
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.093
And the network is plugged 0.040
And Tor is ready 18.911
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.560
And available upgrades have been checked 0.073
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.079
And I can open the Additional Software configuration window from the notification 2.508
And I shutdown Tails and wait for the computer to power off 2:2.711
And I start Tails from USB drive "__internal" with network unplugged 46.797
And I enable persistence 31.820
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 24.558
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.488
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
And the network is plugged 0.039
And Tor is ready 39.618
Then the Additional Software upgrade service has started 0.170
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.097
After features/support/hooks.rb:450 2.208
After features/support/hooks.rb:291 0.833
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.593
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.214
And I start Tails from USB drive "__internal" with network unplugged 46.237
And I enable persistence 31.848
And I remove the "cowsay" deb files from the APT cache 0.677
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.079
And I log in to a new session 25.319
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.067
And I can open the Additional Software log file from the notification 1.970
And the package "cowsay" is not installed 0.179
After features/support/hooks.rb:450 0.125
After features/support/hooks.rb:291 0.910
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.476
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.732
When I log in to a new session in Arabic (ar) 30.517
Then the keyboard layout is set to "us" 0.172
When the network is plugged 0.038
And Tor is ready 15.601
Then I successfully start the Unsafe Browser in "ar" 25.002
And I kill the Unsafe Browser 6.178
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 34.128
And DuckDuckGo is the default search engine 9.831
And I kill the Tor Browser 5.341
And the screen keyboard works in Thunderbird 22.212
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 1.081
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.863
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.619
When I log in to a new session in Chinese (zh_CN) 29.134
Then the keyboard layout is set to "cn" 0.112
When the network is plugged 0.038
And Tor is ready 15.417
Then I successfully start the Unsafe Browser in "zh_CN" 27.951
And I kill the Unsafe Browser 5.947
When I enable the screen keyboard 0.194
Then the screen keyboard works in Tor Browser 34.024
And DuckDuckGo is the default search engine 10.752
And I kill the Tor Browser 5.662
And the screen keyboard works in Thunderbird 24.377
And the layout of the screen keyboard is set to "us" 0.629
After features/support/hooks.rb:291 1.208
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.829
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.519
When I log in to a new session in English (en) 17.521
Then the keyboard layout is set to "us" 0.140
When the network is plugged 0.036
And Tor is ready 14.835
Then I successfully start the Unsafe Browser in "en" 26.679
And I kill the Unsafe Browser 5.854
When I enable the screen keyboard 0.171
Then the screen keyboard works in Tor Browser 32.848
And DuckDuckGo is the default search engine 5.448
And I kill the Tor Browser 5.277
And the screen keyboard works in Thunderbird 22.956
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:291 0.988
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.559
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.406
When I log in to a new session in French (fr) 28.565
Then the keyboard layout is set to "fr" 0.171
When the network is plugged 0.046
And Tor is ready 13.884
Then I successfully start the Unsafe Browser in "fr" 26.995
And I kill the Unsafe Browser 6.810
When I enable the screen keyboard 0.176
Then the screen keyboard works in Tor Browser 34.070
And DuckDuckGo is the default search engine 9.821
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 22.698
And the layout of the screen keyboard is set to "fr" 0.556
After features/support/hooks.rb:291 1.422
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.842
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.916
When I log in to a new session in German (de) 29.781
Then the keyboard layout is set to "de" 0.148
When the network is plugged 0.048
And Tor is ready 15.235
Then I successfully start the Unsafe Browser in "de" 25.028
And I kill the Unsafe Browser 6.561
When I enable the screen keyboard 0.176
Then the screen keyboard works in Tor Browser 34.797
And DuckDuckGo is the default search engine 9.722
And I kill the Tor Browser 5.366
And the screen keyboard works in Thunderbird 21.438
And the layout of the screen keyboard is set to "de" 0.620
After features/support/hooks.rb:291 4.190
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.864
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.666
When I log in to a new session in Italian (it) 33.104
Then the keyboard layout is set to "it" 0.152
When the network is plugged 0.034
And Tor is ready 15.687
Then I successfully start the Unsafe Browser in "it" 24.831
And I kill the Unsafe Browser 5.965
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 33.459
And DuckDuckGo is the default search engine 10.243
And I kill the Tor Browser 5.587
And the screen keyboard works in Thunderbird 22.347
And the layout of the screen keyboard is set to "us" 0.625
After features/support/hooks.rb:291 1.271
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.756
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.661
When I log in to a new session in Persian (fa) 28.725
Then the keyboard layout is set to "ir" 0.165
When the network is plugged 0.044
And Tor is ready 12.539
Then I successfully start the Unsafe Browser in "fa" 28.727
And I kill the Unsafe Browser 6.067
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 35.321
And DuckDuckGo is the default search engine 10.676
And I kill the Tor Browser 5.627
And the screen keyboard works in Thunderbird 23.481
And the layout of the screen keyboard is set to "ir" 0.569
After features/support/hooks.rb:291 1.107
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.685
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.608
When I log in to a new session in Portuguese (pt) 29.119
Then the keyboard layout is set to "pt" 0.158
When the network is plugged 0.044
And Tor is ready 15.437
Then I successfully start the Unsafe Browser in "pt" 25.615
And I kill the Unsafe Browser 6.508
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 33.715
And DuckDuckGo is the default search engine 9.659
And I kill the Tor Browser 5.368
And the screen keyboard works in Thunderbird 22.669
And the layout of the screen keyboard is set to "us" 0.624
After features/support/hooks.rb:291 1.110
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.659
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.387
When I log in to a new session in Russian (ru) 28.799
Then the keyboard layout is set to "ru" 0.159
When the network is plugged 0.038
And Tor is ready 16.411
Then I successfully start the Unsafe Browser in "ru" 26.486
And I kill the Unsafe Browser 6.060
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 35.105
And DuckDuckGo is the default search engine 9.896
And I kill the Tor Browser 5.293
And the screen keyboard works in Thunderbird 24.324
And the layout of the screen keyboard is set to "ru" 0.593
After features/support/hooks.rb:291 1.446
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.688
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.042
When I log in to a new session in Spanish (es) 28.025
Then the keyboard layout is set to "es" 0.196
When the network is plugged 0.044
And Tor is ready 16.104
Then I successfully start the Unsafe Browser in "es" 24.596
And I kill the Unsafe Browser 5.881
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 34.532
And DuckDuckGo is the default search engine 10.399
And I kill the Tor Browser 5.548
And the screen keyboard works in Thunderbird 22.553
And the layout of the screen keyboard is set to "us" 0.641
After features/support/hooks.rb:291 1.584
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.367
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.715
When I log in to a new session in Turkish (tr) 29.343
Then the keyboard layout is set to "tr" 0.175
When the network is plugged 0.055
And Tor is ready 16.042
Then I successfully start the Unsafe Browser in "tr" 26.459
And I kill the Unsafe Browser 6.016
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 33.677
And DuckDuckGo is the default search engine 9.683
And I kill the Tor Browser 6.028
And the screen keyboard works in Thunderbird 24.440
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 1.221
After features/support/hooks.rb:75 0.000