Project Number Date
test_Tails_ISO_devel 3236 14 Jan 2024, 12:34

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:26:30.854 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.974
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.571
And I prepare Tails for memory erasure tests 0.889
When I start a process allocating 128 MiB of memory with a known pattern 1.210
Then patterns cover at least 128 MiB in the guest's memory 3.321 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.287
Then I find very few patterns in the guest's memory 3.693 
Pattern coverage: 0.000% (0 MiB out of 1222 MiB reference memory)
After features/support/hooks.rb:291 0.655
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.731
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.463
And I prepare Tails for memory erasure tests 0.688
And I find very few patterns in the guest's memory 4.408 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.892
Then patterns cover at least 99% of the test FS size in the guest's memory 3.696 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.254
Then I find very few patterns in the guest's memory 4.325 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 1.482
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:54.192
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.369
And I prepare Tails for memory erasure tests 0.525
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.822
Then I find very few patterns in the guest's memory 4.180 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:16.062
Then patterns cover at least 86% of the test FS size in the guest's memory 3.588 
Pattern coverage: 94.130% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.721
Then I find very few patterns in the guest's memory 4.165 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 0.254
And I read the content of the test FS 0.578
Then patterns cover at least 99% of the test FS size in the guest's memory 3.922 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.443
Then I find very few patterns in the guest's memory 4.557 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 1.394
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:28.884
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.170
And I prepare Tails for memory erasure tests 0.499
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.740
Then I find very few patterns in the guest's memory 3.938 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:33.207
Then patterns cover at least 99% of the test FS size in the guest's memory 3.406 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.649
Then I find very few patterns in the guest's memory 4.056 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# read cache
When I mount the USB drive again 3.451
And I read the content of the test FS 0.607
Then patterns cover at least 99% of the test FS size in the guest's memory 3.497 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.475
Then I find very few patterns in the guest's memory 4.183 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 1.204
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
46.169
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.000
And I prepare Tails for memory erasure tests 0.565
When I fill a 128 MiB file with a known pattern on the root filesystem 10.478
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.410
Then patterns cover at least 128 MiB in the guest's memory 3.235 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.580
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.878 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 3.421
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:26.665
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:39.756
And I prepare Tails for memory erasure tests 0.458
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.571
When I trigger shutdown 0.240
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.619 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
After features/support/hooks.rb:291 3.493
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:32.394
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:32.613
And I update APT using apt 17.384
When I install "popularity-contest" using apt 20.052
Then I am notified I can not use Additional Software for "popularity-contest" 59.491
And I can open the Additional Software documentation from the notification 22.852
After features/support/hooks.rb:450 40.373
After features/support/hooks.rb:291 2.006
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:59.089
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:8.403
And I update APT using apt 16.478
And I install "popularity-contest" using apt 19.757
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:4.512
When I create a persistent storage and activate the Additional Software feature 19.905
Then Additional Software is correctly configured for package "popularity-contest" 1.454
When I shutdown Tails and wait for the computer to power off 11.167
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:36.109
Then Additional Software is correctly configured for package "popularity-contest" 0.995
And the package "popularity-contest" is installed after Additional Software has been started 0.305
After features/support/hooks.rb:450 39.289
After features/support/hooks.rb:291 1.289
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:56.867
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.233
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.268
And I update APT using apt 16.655
When I install "makepp" using apt 20.155
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.459
And the package "makepp" is installed 0.095
After features/support/hooks.rb:450 40.811
After features/support/hooks.rb:291 0.944
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:9.161
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.010
Given a computer 0.292
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:21.502
When I uninstall "popularity-contest" using apt 19.006
And I accept removing "popularity-contest" from Additional Software 0.682
Then "popularity-contest" is not in the list of Additional Software 0.861
When I start Synaptic 25.129
And I update APT using Synaptic 21.919
And I install "cowsay" using Synaptic 9.187
And I accept adding "cowsay" to Additional Software 1.238
Then Additional Software is correctly configured for package "cowsay" 0.971
When I uninstall "cowsay" using apt 3.347
And I refuse removing "cowsay" from Additional Software 0.603
Then Additional Software is correctly configured for package "cowsay" 0.967
When I start "Additional Software" via GNOME Activities Overview 12.616
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.072
Then "cowsay" is not in the list of Additional Software 1.007
When I install "cowsay" using apt 3.302
And I refuse adding "cowsay" to Additional Software 0.628
Then "cowsay" is not in the list of Additional Software 0.822
After features/support/hooks.rb:450 1.109
After features/support/hooks.rb:291 0.719
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:51.332
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.232
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.892
And I configure APT to prefer an old version of cowsay 0.027
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.104
And I accept adding "cowsay" to Additional Software 1:4.747
And Additional Software is correctly configured for package "cowsay" 1.384
And I shutdown Tails and wait for the computer to power off 6.055
And I start Tails from USB drive "__internal" with network unplugged 47.361
And I enable persistence 32.323
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 24.176
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.839
And I revert the APT tweaks that made it prefer an old version of cowsay 0.086
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.121
And the network is plugged 0.033
And Tor is ready 18.558
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.653
And available upgrades have been checked 0.209
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.955
And I can open the Additional Software configuration window from the notification 3.934
And I shutdown Tails and wait for the computer to power off 2:3.452
And I start Tails from USB drive "__internal" with network unplugged 45.483
And I enable persistence 32.714
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 25.034
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.341
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.047
And Tor is ready 40.173
Then the Additional Software upgrade service has started 0.193
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.092
After features/support/hooks.rb:450 2.804
After features/support/hooks.rb:291 0.754
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:52.757
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.009
Given a computer 0.263
And I start Tails from USB drive "__internal" with network unplugged 46.750
And I enable persistence 30.866
And I remove the "cowsay" deb files from the APT cache 0.618
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.111
And I log in to a new session 25.947
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.780
And I can open the Additional Software log file from the notification 3.232
And the package "cowsay" is not installed 0.186
After features/support/hooks.rb:450 0.123
After features/support/hooks.rb:291 1.188
After features/support/hooks.rb:75 0.035
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.267
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.899
When I log in to a new session in Arabic (ar) 29.407
Then the keyboard layout is set to "us" 0.195
When the network is plugged 0.040
And Tor is ready 14.383
Then I successfully start the Unsafe Browser in "ar" 29.076
And I kill the Unsafe Browser 5.963
When I enable the screen keyboard 0.194
Then the screen keyboard works in Tor Browser 34.707
And DuckDuckGo is the default search engine 9.591
And I kill the Tor Browser 5.269
And the screen keyboard works in Thunderbird 24.965
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.088
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.061
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.868
When I log in to a new session in Chinese (zh_CN) 29.565
Then the keyboard layout is set to "cn" 0.183
When the network is plugged 0.051
And Tor is ready 13.948
Then I successfully start the Unsafe Browser in "zh_CN" 26.586
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 34.459
And DuckDuckGo is the default search engine 9.887
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 24.592
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:291 1.318
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.202
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.127
When I log in to a new session in English (en) 16.627
Then the keyboard layout is set to "us" 0.139
When the network is plugged 0.040
And Tor is ready 14.162
Then I successfully start the Unsafe Browser in "en" 25.777
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.198
Then the screen keyboard works in Tor Browser 34.537
And DuckDuckGo is the default search engine 5.415
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 21.376
And the layout of the screen keyboard is set to "us" 0.593
After features/support/hooks.rb:291 1.071
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.982
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.439
When I log in to a new session in French (fr) 31.465
Then the keyboard layout is set to "fr" 0.244
When the network is plugged 0.044
And Tor is ready 16.889
Then I successfully start the Unsafe Browser in "fr" 25.085
And I kill the Unsafe Browser 5.815
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.021
And DuckDuckGo is the default search engine 10.054
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 23.799
And the layout of the screen keyboard is set to "fr" 0.658
After features/support/hooks.rb:291 1.165
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.245
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.541
When I log in to a new session in German (de) 29.579
Then the keyboard layout is set to "de" 0.582
When the network is plugged 0.041
And Tor is ready 15.244
Then I successfully start the Unsafe Browser in "de" 28.671
And I kill the Unsafe Browser 6.338
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 33.651
And DuckDuckGo is the default search engine 9.929
And I kill the Tor Browser 5.382
And the screen keyboard works in Thunderbird 22.583
And the layout of the screen keyboard is set to "de" 0.562
After features/support/hooks.rb:291 1.516
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.974
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.851
When I log in to a new session in Italian (it) 29.041
Then the keyboard layout is set to "it" 0.193
When the network is plugged 0.050
And Tor is ready 15.339
Then I successfully start the Unsafe Browser in "it" 27.900
And I kill the Unsafe Browser 5.899
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.307
And DuckDuckGo is the default search engine 9.819
And I kill the Tor Browser 5.286
And the screen keyboard works in Thunderbird 21.585
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 3.396
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.041
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.769
When I log in to a new session in Persian (fa) 27.950
Then the keyboard layout is set to "ir" 0.296
When the network is plugged 0.048
And Tor is ready 17.647
Then I successfully start the Unsafe Browser in "fa" 27.489
And I kill the Unsafe Browser 5.782
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 34.796
And DuckDuckGo is the default search engine 9.439
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 22.751
And the layout of the screen keyboard is set to "ir" 0.573
After features/support/hooks.rb:291 2.192
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.839
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.907
When I log in to a new session in Portuguese (pt) 28.310
Then the keyboard layout is set to "pt" 0.173
When the network is plugged 0.053
And Tor is ready 15.334
Then I successfully start the Unsafe Browser in "pt" 29.073
And I kill the Unsafe Browser 5.877
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.500
And DuckDuckGo is the default search engine 10.055
And I kill the Tor Browser 5.271
And the screen keyboard works in Thunderbird 21.525
And the layout of the screen keyboard is set to "us" 0.636
After features/support/hooks.rb:291 1.145
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.454
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.700
When I log in to a new session in Russian (ru) 28.864
Then the keyboard layout is set to "ru" 0.128
When the network is plugged 0.043
And Tor is ready 14.558
Then I successfully start the Unsafe Browser in "ru" 31.581
And I kill the Unsafe Browser 5.760
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 35.401
And DuckDuckGo is the default search engine 9.816
And I kill the Tor Browser 5.280
And the screen keyboard works in Thunderbird 23.563
And the layout of the screen keyboard is set to "ru" 0.580
After features/support/hooks.rb:291 3.884
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.314
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 21.729
When I log in to a new session in Spanish (es) 29.755
Then the keyboard layout is set to "es" 0.271
When the network is plugged 0.042
And Tor is ready 15.446
Then I successfully start the Unsafe Browser in "es" 24.136
And I kill the Unsafe Browser 6.535
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 33.502
And DuckDuckGo is the default search engine 9.349
And I kill the Tor Browser 5.343
And the screen keyboard works in Thunderbird 21.528
And the layout of the screen keyboard is set to "us" 0.536
After features/support/hooks.rb:291 1.149
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.777
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.631
When I log in to a new session in Turkish (tr) 28.093
Then the keyboard layout is set to "tr" 0.135
When the network is plugged 0.036
And Tor is ready 15.738
Then I successfully start the Unsafe Browser in "tr" 24.822
And I kill the Unsafe Browser 5.903
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 32.950
And DuckDuckGo is the default search engine 9.515
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 20.978
And the layout of the screen keyboard is set to "us" 0.542
After features/support/hooks.rb:291 1.082
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.470
When the network is plugged 0.042
And I wait 720 seconds 12:0.097 
Slept for 720 seconds
Then I successfully configure Tor 10.261
And the time has synced 0.068
After features/support/hooks.rb:291 0.700
After features/support/hooks.rb:75 0.000