Project Number Date
test_Tails_ISO_devel 3227 09 Jan 2024, 12:27

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:23:49.166 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.358
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.835
And I prepare Tails for memory erasure tests 0.709
When I start a process allocating 128 MiB of memory with a known pattern 1.283
Then patterns cover at least 128 MiB in the guest's memory 3.395 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.271
Then I find very few patterns in the guest's memory 3.862 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 0.856
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.860
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.557
And I prepare Tails for memory erasure tests 0.536
And I find very few patterns in the guest's memory 3.750 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.824
Then patterns cover at least 99% of the test FS size in the guest's memory 3.269 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.238
Then I find very few patterns in the guest's memory 3.684 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 1.201
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:20.041
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.323
And I prepare Tails for memory erasure tests 0.640
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.933
Then I find very few patterns in the guest's memory 4.771 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:42.523
Then patterns cover at least 86% of the test FS size in the guest's memory 2.917 
Pattern coverage: 97.011% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.416
Then I find very few patterns in the guest's memory 3.649 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 0.294
And I read the content of the test FS 0.664
Then patterns cover at least 99% of the test FS size in the guest's memory 3.174 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.256
Then I find very few patterns in the guest's memory 4.476 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 0.856
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:41.049
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.020
And I prepare Tails for memory erasure tests 0.928
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.322
Then I find very few patterns in the guest's memory 3.461 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:37.354
Then patterns cover at least 99% of the test FS size in the guest's memory 5.086 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.725
Then I find very few patterns in the guest's memory 4.678 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
# read cache
When I mount the USB drive again 3.456
And I read the content of the test FS 0.441
Then patterns cover at least 99% of the test FS size in the guest's memory 3.151 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.496
Then I find very few patterns in the guest's memory 3.925 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
After features/support/hooks.rb:291 1.166
After features/support/hooks.rb:75 0.001
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.541
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 9.406
And I prepare Tails for memory erasure tests 0.595
When I fill a 128 MiB file with a known pattern on the root filesystem 14.157
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.675
Then patterns cover at least 128 MiB in the guest's memory 3.214 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.578
And I wait 20 seconds 20.012 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.901 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
After features/support/hooks.rb:291 3.456
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:56.696
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:10.557
And I prepare Tails for memory erasure tests 0.497
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.200
When I trigger shutdown 0.226
And I wait 20 seconds 20.005 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.209 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 3.441
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:23.401
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:22.964
And I update APT using apt 17.943
When I install "popularity-contest" using apt 19.789
Then I am notified I can not use Additional Software for "popularity-contest" 58.734
And I can open the Additional Software documentation from the notification 23.969
After features/support/hooks.rb:450 41.316
After features/support/hooks.rb:291 2.708
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:37.071
Before features/support/hooks.rb:245 0.010
Before features/support/hooks.rb:442 0.012
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 48.725
And I update APT using apt 16.811
And I install "popularity-contest" using apt 19.662
Then I am proposed to add the "popularity-contest" package to my Additional Software 55.281
When I create a persistent storage and activate the Additional Software feature 19.164
Then Additional Software is correctly configured for package "popularity-contest" 1.442
When I shutdown Tails and wait for the computer to power off 11.284
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:43.429
Then Additional Software is correctly configured for package "popularity-contest" 0.911
And the package "popularity-contest" is installed after Additional Software has been started 0.358
After features/support/hooks.rb:450 38.783
After features/support/hooks.rb:291 1.362
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:26.965
Before features/support/hooks.rb:245 0.010
Before features/support/hooks.rb:442 0.008
Given a computer 0.234
And I start Tails from USB drive "__internal" and I login with an administration password 1:49.905
And I update APT using apt 15.654
When I install "makepp" using apt 23.011
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.038
And the package "makepp" is installed 0.121
After features/support/hooks.rb:450 41.207
After features/support/hooks.rb:291 0.952
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:44.399
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.012
Given a computer 0.248
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:59.853
When I uninstall "popularity-contest" using apt 15.905
And I accept removing "popularity-contest" from Additional Software 2.046
Then "popularity-contest" is not in the list of Additional Software 0.833
When I start Synaptic 23.250
And I update APT using Synaptic 21.968
And I install "cowsay" using Synaptic 9.472
And I accept adding "cowsay" to Additional Software 0.882
Then Additional Software is correctly configured for package "cowsay" 0.852
When I uninstall "cowsay" using apt 3.256
And I refuse removing "cowsay" from Additional Software 0.675
Then Additional Software is correctly configured for package "cowsay" 0.857
When I start "Additional Software" via GNOME Activities Overview 12.604
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.001
Then "cowsay" is not in the list of Additional Software 0.951
When I install "cowsay" using apt 3.312
And I refuse adding "cowsay" to Additional Software 0.659
Then "cowsay" is not in the list of Additional Software 0.766
After features/support/hooks.rb:450 1.253
After features/support/hooks.rb:291 0.690
After features/support/hooks.rb:75 0.042
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:36.023
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.225
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:58.089
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.828
And I accept adding "cowsay" to Additional Software 1:0.763
And Additional Software is correctly configured for package "cowsay" 1.373
And I shutdown Tails and wait for the computer to power off 6.093
And I start Tails from USB drive "__internal" with network unplugged 45.172
And I enable persistence 32.233
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 22.799
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.575
And I revert the APT tweaks that made it prefer an old version of cowsay 0.078
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.108
And the network is plugged 0.046
And Tor is ready 15.868
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.579
And available upgrades have been checked 0.254
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.653
And I can open the Additional Software configuration window from the notification 2.853
And I shutdown Tails and wait for the computer to power off 8.096
And I start Tails from USB drive "__internal" with network unplugged 44.148
And I enable persistence 30.690
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 32.465
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.201
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
And the network is plugged 0.037
And Tor is ready 38.414
Then the Additional Software upgrade service has started 0.169
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.083
After features/support/hooks.rb:450 2.223
After features/support/hooks.rb:291 0.772
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.850
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.195
And I start Tails from USB drive "__internal" with network unplugged 44.420
And I enable persistence 32.239
And I remove the "cowsay" deb files from the APT cache 0.638
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.079
And I log in to a new session 23.049
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.168
And I can open the Additional Software log file from the notification 2.864
And the package "cowsay" is not installed 0.194
After features/support/hooks.rb:450 0.132
After features/support/hooks.rb:291 0.855
After features/support/hooks.rb:75 0.013
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.008
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 13.561
When I log in to a new session in Arabic (ar) 29.183
Then the keyboard layout is set to "us" 0.143
When the network is plugged 0.046
And Tor is ready 15.649
Then I successfully start the Unsafe Browser in "ar" 26.761
And I kill the Unsafe Browser 5.713
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 33.122
And DuckDuckGo is the default search engine 9.303
And I kill the Tor Browser 5.257
And the screen keyboard works in Thunderbird 23.552
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.360
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.470
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.886
When I log in to a new session in Chinese (zh_CN) 29.863
Then the keyboard layout is set to "cn" 0.140
When the network is plugged 0.049
And Tor is ready 13.599
Then I successfully start the Unsafe Browser in "zh_CN" 27.305
And I kill the Unsafe Browser 6.002
When I enable the screen keyboard 0.183
Then the screen keyboard works in Tor Browser 33.432
And DuckDuckGo is the default search engine 9.546
And I kill the Tor Browser 5.290
And the screen keyboard works in Thunderbird 27.421
And the layout of the screen keyboard is set to "us" 0.746
After features/support/hooks.rb:291 1.888
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.286
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.871
When I log in to a new session in English (en) 16.034
Then the keyboard layout is set to "us" 0.127
When the network is plugged 0.045
And Tor is ready 14.306
Then I successfully start the Unsafe Browser in "en" 29.166
And I kill the Unsafe Browser 5.899
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 32.617
And DuckDuckGo is the default search engine 5.133
And I kill the Tor Browser 5.249
And the screen keyboard works in Thunderbird 22.123
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.235
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.137
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.773
When I log in to a new session in French (fr) 28.475
Then the keyboard layout is set to "fr" 0.274
When the network is plugged 0.046
And Tor is ready 15.824
Then I successfully start the Unsafe Browser in "fr" 26.122
And I kill the Unsafe Browser 5.778
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 32.786
And DuckDuckGo is the default search engine 9.231
And I kill the Tor Browser 5.293
And the screen keyboard works in Thunderbird 21.809
And the layout of the screen keyboard is set to "fr" 0.601
After features/support/hooks.rb:291 0.994
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.074
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.691
When I log in to a new session in German (de) 29.437
Then the keyboard layout is set to "de" 0.140
When the network is plugged 0.055
And Tor is ready 14.404
Then I successfully start the Unsafe Browser in "de" 28.903
And I kill the Unsafe Browser 6.035
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 32.730
And DuckDuckGo is the default search engine 9.413
And I kill the Tor Browser 5.328
And the screen keyboard works in Thunderbird 21.237
And the layout of the screen keyboard is set to "de" 0.555
After features/support/hooks.rb:291 1.141
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.026
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.686
When I log in to a new session in Italian (it) 28.457
Then the keyboard layout is set to "it" 0.288
When the network is plugged 0.036
And Tor is ready 14.894
Then I successfully start the Unsafe Browser in "it" 27.396
And I kill the Unsafe Browser 5.747
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 33.142
And DuckDuckGo is the default search engine 9.400
And I kill the Tor Browser 5.385
And the screen keyboard works in Thunderbird 20.880
And the layout of the screen keyboard is set to "us" 0.586
After features/support/hooks.rb:291 1.820
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.596
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.612
When I log in to a new session in Persian (fa) 27.630
Then the keyboard layout is set to "ir" 0.134
When the network is plugged 0.050
And Tor is ready 14.509
Then I successfully start the Unsafe Browser in "fa" 28.128
And I kill the Unsafe Browser 6.922
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 35.028
And DuckDuckGo is the default search engine 9.421
And I kill the Tor Browser 5.346
And the screen keyboard works in Thunderbird 22.094
And the layout of the screen keyboard is set to "ir" 0.593
After features/support/hooks.rb:291 1.113
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.667
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.578
When I log in to a new session in Portuguese (pt) 28.421
Then the keyboard layout is set to "pt" 0.158
When the network is plugged 0.042
And Tor is ready 14.652
Then I successfully start the Unsafe Browser in "pt" 26.710
And I kill the Unsafe Browser 6.135
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 33.168
And DuckDuckGo is the default search engine 16.974
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 20.614
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.841
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.241
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.764
When I log in to a new session in Russian (ru) 34.521
Then the keyboard layout is set to "ru" 0.261
When the network is plugged 0.056
And Tor is ready 13.464
Then I successfully start the Unsafe Browser in "ru" 26.650
And I kill the Unsafe Browser 6.565
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 34.873
And DuckDuckGo is the default search engine 9.753
And I kill the Tor Browser 5.307
And the screen keyboard works in Thunderbird 24.316
And the layout of the screen keyboard is set to "ru" 0.578
After features/support/hooks.rb:291 2.678
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.146
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.763
When I log in to a new session in Spanish (es) 28.618
Then the keyboard layout is set to "es" 0.251
When the network is plugged 0.037
And Tor is ready 15.018
Then I successfully start the Unsafe Browser in "es" 28.688
And I kill the Unsafe Browser 5.790
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 32.102
And DuckDuckGo is the default search engine 9.520
And I kill the Tor Browser 5.327
And the screen keyboard works in Thunderbird 22.269
And the layout of the screen keyboard is set to "us" 0.604
After features/support/hooks.rb:291 1.286
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.618
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.438
When I log in to a new session in Turkish (tr) 27.505
Then the keyboard layout is set to "tr" 0.135
When the network is plugged 0.053
And Tor is ready 16.783
Then I successfully start the Unsafe Browser in "tr" 26.048
And I kill the Unsafe Browser 5.869
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 32.357
And DuckDuckGo is the default search engine 9.841
And I kill the Tor Browser 5.310
And the screen keyboard works in Thunderbird 23.525
And the layout of the screen keyboard is set to "us" 0.602
After features/support/hooks.rb:291 0.971
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.631
When the network is plugged 0.048
And I wait 720 seconds 12:0.009 
Slept for 720 seconds
Then I successfully configure Tor 10.521
And the time has synced 0.051
After features/support/hooks.rb:291 0.920
After features/support/hooks.rb:75 0.000