Project Number Date
test_Tails_ISO_stable 4576 18 Dec 2023, 22:11

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:7:32.010 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.020
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.869
And I prepare Tails for memory erasure tests 0.457
When I start a process allocating 128 MiB of memory with a known pattern 1.262
Then patterns cover at least 128 MiB in the guest's memory 3.364 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.242
Then I find very few patterns in the guest's memory 3.823 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 0.720
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.134
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.928
And I prepare Tails for memory erasure tests 0.483
And I find very few patterns in the guest's memory 3.667 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.897
Then patterns cover at least 99% of the test FS size in the guest's memory 3.108 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.241
Then I find very few patterns in the guest's memory 3.808 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
After features/support/hooks.rb:291 0.741
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:41.193
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.968
And I prepare Tails for memory erasure tests 0.503
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.867
Then I find very few patterns in the guest's memory 3.798 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3:6.475
Then patterns cover at least 86% of the test FS size in the guest's memory 3.173 
Pattern coverage: 95.014% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.341
Then I find very few patterns in the guest's memory 3.562 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
# read cache
When I mount the USB drive again 0.196
And I read the content of the test FS 0.521
Then patterns cover at least 99% of the test FS size in the guest's memory 2.972 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.221
Then I find very few patterns in the guest's memory 3.590 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
After features/support/hooks.rb:291 0.702
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:39.359
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.883
And I prepare Tails for memory erasure tests 0.422
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.136
Then I find very few patterns in the guest's memory 3.193 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:39.174
Then patterns cover at least 99% of the test FS size in the guest's memory 2.592 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.615
Then I find very few patterns in the guest's memory 3.228 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# read cache
When I mount the USB drive again 6.813
And I read the content of the test FS 0.328
Then patterns cover at least 99% of the test FS size in the guest's memory 2.628 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.944
Then I find very few patterns in the guest's memory 3.396 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
After features/support/hooks.rb:291 0.906
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.319
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.943
And I prepare Tails for memory erasure tests 0.430
When I fill a 128 MiB file with a known pattern on the root filesystem 12.681
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.559
Then patterns cover at least 128 MiB in the guest's memory 2.457 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.511
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.715 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 3.476
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:38.332
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 4:54.618
And I prepare Tails for memory erasure tests 0.447
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.809
When I trigger shutdown 0.304
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.133 
Pattern coverage: 0.000% (0 MiB out of 1177 MiB reference memory)
After features/support/hooks.rb:291 3.456
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:14.860
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.010
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 47.985
And I update APT using apt 15.604
And I install "popularity-contest" using apt 19.746
Then I am proposed to add the "popularity-contest" package to my Additional Software 52.889
When I create a persistent storage and activate the Additional Software feature 16.904
Then Additional Software is correctly configured for package "popularity-contest" 1.266
When I shutdown Tails and wait for the computer to power off 9.090
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.235
Then Additional Software is correctly configured for package "popularity-contest" 0.863
And the package "popularity-contest" is installed after Additional Software has been started 0.275
After features/support/hooks.rb:450 33.891
After features/support/hooks.rb:291 1.119
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:45.365
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.177
And I start Tails from USB drive "__internal" and I login with an administration password 1:14.548
And I update APT using apt 16.123
When I install "makepp" using apt 19.517
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 54.902
And the package "makepp" is installed 0.094
After features/support/hooks.rb:450 37.049
After features/support/hooks.rb:291 0.906
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:47.911
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.206
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:7.128
When I uninstall "popularity-contest" using apt 15.731
And I accept removing "popularity-contest" from Additional Software 1.810
Then "popularity-contest" is not in the list of Additional Software 0.707
When I start Synaptic 21.540
And I update APT using Synaptic 21.858
And I install "cowsay" using Synaptic 9.981
And I accept adding "cowsay" to Additional Software 0.830
Then Additional Software is correctly configured for package "cowsay" 0.900
When I uninstall "cowsay" using apt 3.285
And I refuse removing "cowsay" from Additional Software 0.676
Then Additional Software is correctly configured for package "cowsay" 0.834
When I start "Additional Software" via GNOME Activities Overview 12.464
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.419
Then "cowsay" is not in the list of Additional Software 0.949
When I install "cowsay" using apt 3.220
And I refuse adding "cowsay" to Additional Software 0.659
Then "cowsay" is not in the list of Additional Software 0.706
After features/support/hooks.rb:450 0.843
After features/support/hooks.rb:291 0.705
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:5.115
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.181
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:53.517
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.901
And I accept adding "cowsay" to Additional Software 58.955
And Additional Software is correctly configured for package "cowsay" 1.315
And I shutdown Tails and wait for the computer to power off 5.118
And I start Tails from USB drive "__internal" with network unplugged 43.860
And I enable persistence 29.503
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 22.211
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.871
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.123
And the network is plugged 0.039
And Tor is ready 15.223
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.535
And available upgrades have been checked 0.129
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 4.118
And I can open the Additional Software configuration window from the notification 2.624
And I shutdown Tails and wait for the computer to power off 2:2.713
And I start Tails from USB drive "__internal" with network unplugged 42.724
And I enable persistence 29.989
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 20.800
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.103
And I revert the APT tweaks that made it prefer an old version of cowsay 0.039
And the network is plugged 0.043
And Tor is ready 39.083
Then the Additional Software upgrade service has started 0.166
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.093
After features/support/hooks.rb:450 2.194
After features/support/hooks.rb:291 1.087
After features/support/hooks.rb:75 0.033
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:45.451
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.198
And I start Tails from USB drive "__internal" with network unplugged 43.595
And I enable persistence 31.948
And I remove the "cowsay" deb files from the APT cache 0.563
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.072
And I log in to a new session 25.045
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 0.978
And I can open the Additional Software log file from the notification 2.739
And the package "cowsay" is not installed 0.308
After features/support/hooks.rb:450 0.100
After features/support/hooks.rb:291 0.663
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.169
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.377
When I log in to a new session in Arabic (ar) 27.259
Then the keyboard layout is set to "us" 0.154
When the network is plugged 0.051
And Tor is ready 16.423
Then I successfully start the Unsafe Browser in "ar" 26.406
And I kill the Unsafe Browser 5.720
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 33.070
And DuckDuckGo is the default search engine 9.341
And I kill the Tor Browser 5.409
And the screen keyboard works in Thunderbird 21.286
And the layout of the screen keyboard is set to "us" 0.531
After features/support/hooks.rb:291 0.890
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.534
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.759
When I log in to a new session in Chinese (zh_CN) 27.485
Then the keyboard layout is set to "cn" 0.342
When the network is plugged 0.046
And Tor is ready 16.743
Then I successfully start the Unsafe Browser in "zh_CN" 26.716
And I kill the Unsafe Browser 5.716
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 32.485
And DuckDuckGo is the default search engine 9.034
And I kill the Tor Browser 5.276
And the screen keyboard works in Thunderbird 26.200
And the layout of the screen keyboard is set to "us" 0.594
After features/support/hooks.rb:291 1.259
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.897
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.055
When I log in to a new session in English (en) 14.123
Then the keyboard layout is set to "us" 0.121
When the network is plugged 0.040
And Tor is ready 14.584
Then I successfully start the Unsafe Browser in "en" 24.537
And I kill the Unsafe Browser 5.797
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 32.633
And DuckDuckGo is the default search engine 5.122
And I kill the Tor Browser 5.272
And the screen keyboard works in Thunderbird 20.925
And the layout of the screen keyboard is set to "us" 0.544
After features/support/hooks.rb:291 0.968
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.089
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.806
When I log in to a new session in French (fr) 27.091
Then the keyboard layout is set to "fr" 0.160
When the network is plugged 0.047
And Tor is ready 14.581
Then I successfully start the Unsafe Browser in "fr" 26.230
And I kill the Unsafe Browser 5.858
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 31.858
And DuckDuckGo is the default search engine 9.391
And I kill the Tor Browser 5.278
And the screen keyboard works in Thunderbird 21.084
And the layout of the screen keyboard is set to "fr" 0.562
After features/support/hooks.rb:291 1.437
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.078
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.265
When I log in to a new session in German (de) 27.695
Then the keyboard layout is set to "de" 0.208
When the network is plugged 0.076
And Tor is ready 16.801
Then I successfully start the Unsafe Browser in "de" 28.474
And I kill the Unsafe Browser 5.826
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 32.204
And DuckDuckGo is the default search engine 9.125
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 21.343
And the layout of the screen keyboard is set to "de" 0.575
After features/support/hooks.rb:291 3.500
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.219
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.660
When I log in to a new session in Italian (it) 29.128
Then the keyboard layout is set to "it" 0.149
When the network is plugged 0.065
And Tor is ready 15.501
Then I successfully start the Unsafe Browser in "it" 26.343
And I kill the Unsafe Browser 5.776
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 31.497
And DuckDuckGo is the default search engine 8.927
And I kill the Tor Browser 5.272
And the screen keyboard works in Thunderbird 21.135
And the layout of the screen keyboard is set to "us" 0.625
After features/support/hooks.rb:291 1.192
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.118
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.803
When I log in to a new session in Persian (fa) 28.133
Then the keyboard layout is set to "ir" 0.192
When the network is plugged 0.036
And Tor is ready 13.844
Then I successfully start the Unsafe Browser in "fa" 26.048
And I kill the Unsafe Browser 6.463
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 33.800
And DuckDuckGo is the default search engine 9.150
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 21.633
And the layout of the screen keyboard is set to "ir" 0.543
After features/support/hooks.rb:291 0.910
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.543
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.582
When I log in to a new session in Portuguese (pt) 27.273
Then the keyboard layout is set to "pt" 0.138
When the network is plugged 0.045
And Tor is ready 16.053
Then I successfully start the Unsafe Browser in "pt" 26.231
And I kill the Unsafe Browser 5.870
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 31.808
And DuckDuckGo is the default search engine 8.846
And I kill the Tor Browser 5.359
And the screen keyboard works in Thunderbird 20.699
And the layout of the screen keyboard is set to "us" 0.530
After features/support/hooks.rb:291 2.412
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.257
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.185
When I log in to a new session in Russian (ru) 28.109
Then the keyboard layout is set to "ru" 0.177
When the network is plugged 0.077
And Tor is ready 15.976
Then I successfully start the Unsafe Browser in "ru" 27.439
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 33.831
And DuckDuckGo is the default search engine 9.429
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 24.184
And the layout of the screen keyboard is set to "ru" 0.579
After features/support/hooks.rb:291 1.382
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.817
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.811
When I log in to a new session in Spanish (es) 29.131
Then the keyboard layout is set to "es" 0.211
When the network is plugged 0.039
And Tor is ready 13.762
Then I successfully start the Unsafe Browser in "es" 25.971
And I kill the Unsafe Browser 5.922
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 31.973
And DuckDuckGo is the default search engine 9.436
And I kill the Tor Browser 5.319
And the screen keyboard works in Thunderbird 21.538
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 1.623
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.218
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.789
When I log in to a new session in Turkish (tr) 28.271
Then the keyboard layout is set to "tr" 0.133
When the network is plugged 0.051
And Tor is ready 15.388
Then I successfully start the Unsafe Browser in "tr" 26.549
And I kill the Unsafe Browser 5.736
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.012
And DuckDuckGo is the default search engine 9.172
And I kill the Tor Browser 5.320
And the screen keyboard works in Thunderbird 21.114
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 1.733
After features/support/hooks.rb:75 0.000