Project Number Date
test_Tails_ISO_stable 4602 05 Jan 2024, 12:15

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:51.556 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.482
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.166
And I prepare Tails for memory erasure tests 0.577
When I start a process allocating 128 MiB of memory with a known pattern 2.340
Then patterns cover at least 128 MiB in the guest's memory 3.134 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.253
Then I find very few patterns in the guest's memory 4.010 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 0.782
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.794
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.772
And I prepare Tails for memory erasure tests 0.504
And I find very few patterns in the guest's memory 3.790 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.730
Then patterns cover at least 99% of the test FS size in the guest's memory 2.870 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.336
Then I find very few patterns in the guest's memory 3.790 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
After features/support/hooks.rb:291 0.914
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:6.812
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.092
And I prepare Tails for memory erasure tests 0.581
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.897
Then I find very few patterns in the guest's memory 3.792 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:29.502
Then patterns cover at least 86% of the test FS size in the guest's memory 3.124 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.818
Then I find very few patterns in the guest's memory 4.012 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
# read cache
When I mount the USB drive again 0.272
And I read the content of the test FS 0.714
Then patterns cover at least 99% of the test FS size in the guest's memory 3.054 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.259
Then I find very few patterns in the guest's memory 3.690 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
After features/support/hooks.rb:291 1.010
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:22.895
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.884
And I prepare Tails for memory erasure tests 0.506
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.210
Then I find very few patterns in the guest's memory 3.052 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:27.293
Then patterns cover at least 99% of the test FS size in the guest's memory 3.729 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.072
Then I find very few patterns in the guest's memory 4.448 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# read cache
When I mount the USB drive again 3.933
And I read the content of the test FS 1.102
Then patterns cover at least 99% of the test FS size in the guest's memory 2.780 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.495
Then I find very few patterns in the guest's memory 3.384 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 0.792
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.390
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.379
And I prepare Tails for memory erasure tests 0.506
When I fill a 128 MiB file with a known pattern on the root filesystem 12.210
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.188
Then patterns cover at least 128 MiB in the guest's memory 2.643 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.586
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.859 
Pattern coverage: 0.000% (0 MiB out of 1179 MiB reference memory)
After features/support/hooks.rb:291 3.480
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:19.275
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:33.114
And I prepare Tails for memory erasure tests 0.512
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.022
When I trigger shutdown 0.471
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.145 
Pattern coverage: 0.000% (0 MiB out of 1165 MiB reference memory)
After features/support/hooks.rb:291 3.523
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:35.142
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.684
And I update APT using apt 16.163
And I install "popularity-contest" using apt 19.608
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.194
When I create a persistent storage and activate the Additional Software feature 18.747
Then Additional Software is correctly configured for package "popularity-contest" 1.436
When I shutdown Tails and wait for the computer to power off 9.348
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:39.746
Then Additional Software is correctly configured for package "popularity-contest" 0.934
And the package "popularity-contest" is installed after Additional Software has been started 0.278
After features/support/hooks.rb:450 39.191
After features/support/hooks.rb:291 1.238
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:2.346
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.204
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.338
And I update APT using apt 16.343
When I install "makepp" using apt 22.938
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.410
And the package "makepp" is installed 0.110
After features/support/hooks.rb:450 38.065
After features/support/hooks.rb:291 0.989
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:2.011
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.293
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:15.896
When I uninstall "popularity-contest" using apt 15.987
And I accept removing "popularity-contest" from Additional Software 1.870
Then "popularity-contest" is not in the list of Additional Software 0.793
When I start Synaptic 23.936
And I update APT using Synaptic 21.616
And I install "cowsay" using Synaptic 11.250
And I accept adding "cowsay" to Additional Software 0.881
Then Additional Software is correctly configured for package "cowsay" 0.955
When I uninstall "cowsay" using apt 3.390
And I refuse removing "cowsay" from Additional Software 0.725
Then Additional Software is correctly configured for package "cowsay" 0.861
When I start "Additional Software" via GNOME Activities Overview 12.580
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.072
Then "cowsay" is not in the list of Additional Software 0.959
When I install "cowsay" using apt 3.292
And I refuse adding "cowsay" to Additional Software 0.773
Then "cowsay" is not in the list of Additional Software 0.873
After features/support/hooks.rb:450 1.045
After features/support/hooks.rb:291 0.796
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:0.590
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.419
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:5.115
And I configure APT to prefer an old version of cowsay 0.036
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.566
And I accept adding "cowsay" to Additional Software 1:10.196
And Additional Software is correctly configured for package "cowsay" 1.507
And I shutdown Tails and wait for the computer to power off 7.078
And I start Tails from USB drive "__internal" with network unplugged 46.422
And I enable persistence 33.366
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 21.912
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.445
And I revert the APT tweaks that made it prefer an old version of cowsay 0.105
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.098
And the network is plugged 0.040
And Tor is ready 17.404
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.224
And available upgrades have been checked 0.256
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.579
And I can open the Additional Software configuration window from the notification 2.763
And I shutdown Tails and wait for the computer to power off 2:2.599
And I start Tails from USB drive "__internal" with network unplugged 45.197
And I enable persistence 34.696
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 22.465
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.552
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.045
And Tor is ready 42.040
Then the Additional Software upgrade service has started 0.241
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.095
After features/support/hooks.rb:450 2.248
After features/support/hooks.rb:291 0.825
After features/support/hooks.rb:75 0.043
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.431
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.192
And I start Tails from USB drive "__internal" with network unplugged 52.906
And I enable persistence 31.553
And I remove the "cowsay" deb files from the APT cache 0.814
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.087
And I log in to a new session 24.010
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.463
And I can open the Additional Software log file from the notification 2.228
And the package "cowsay" is not installed 0.174
After features/support/hooks.rb:450 0.161
After features/support/hooks.rb:291 0.860
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.679
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.126
When I log in to a new session in Arabic (ar) 34.963
Then the keyboard layout is set to "us" 0.265
When the network is plugged 0.045
And Tor is ready 16.988
Then I successfully start the Unsafe Browser in "ar" 27.061
And I kill the Unsafe Browser 5.964
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 35.196
And DuckDuckGo is the default search engine 9.502
And I kill the Tor Browser 5.303
And the screen keyboard works in Thunderbird 22.475
And the layout of the screen keyboard is set to "us" 0.614
After features/support/hooks.rb:291 1.094
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.710
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.784
When I log in to a new session in Chinese (zh_CN) 27.444
Then the keyboard layout is set to "cn" 0.150
When the network is plugged 0.043
And Tor is ready 14.581
Then I successfully start the Unsafe Browser in "zh_CN" 29.855
And I kill the Unsafe Browser 5.874
When I enable the screen keyboard 0.360
Then the screen keyboard works in Tor Browser 35.304
And DuckDuckGo is the default search engine 9.781
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 27.638
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.319
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.943
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.802
When I log in to a new session in English (en) 14.524
Then the keyboard layout is set to "us" 0.208
When the network is plugged 0.041
And Tor is ready 15.963
Then I successfully start the Unsafe Browser in "en" 27.925
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 34.166
And DuckDuckGo is the default search engine 5.370
And I kill the Tor Browser 5.488
And the screen keyboard works in Thunderbird 23.933
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.024
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.321
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.491
When I log in to a new session in French (fr) 29.885
Then the keyboard layout is set to "fr" 0.285
When the network is plugged 0.038
And Tor is ready 15.462
Then I successfully start the Unsafe Browser in "fr" 29.233
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.164
Then the screen keyboard works in Tor Browser 33.260
And DuckDuckGo is the default search engine 9.650
And I kill the Tor Browser 5.328
And the screen keyboard works in Thunderbird 22.085
And the layout of the screen keyboard is set to "fr" 0.611
After features/support/hooks.rb:291 1.922
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.555
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.814
When I log in to a new session in German (de) 30.316
Then the keyboard layout is set to "de" 0.137
When the network is plugged 0.033
And Tor is ready 15.624
Then I successfully start the Unsafe Browser in "de" 25.992
And I kill the Unsafe Browser 5.980
When I enable the screen keyboard 0.173
Then the screen keyboard works in Tor Browser 34.350
And DuckDuckGo is the default search engine 9.926
And I kill the Tor Browser 5.417
And the screen keyboard works in Thunderbird 22.099
And the layout of the screen keyboard is set to "de" 0.689
After features/support/hooks.rb:291 3.559
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.468
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.066
When I log in to a new session in Italian (it) 28.950
Then the keyboard layout is set to "it" 0.159
When the network is plugged 0.040
And Tor is ready 14.759
Then I successfully start the Unsafe Browser in "it" 27.374
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 33.216
And DuckDuckGo is the default search engine 11.481
And I kill the Tor Browser 5.952
And the screen keyboard works in Thunderbird 20.863
And the layout of the screen keyboard is set to "us" 0.576
After features/support/hooks.rb:291 1.276
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.196
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.556
When I log in to a new session in Persian (fa) 29.814
Then the keyboard layout is set to "ir" 0.158
When the network is plugged 0.043
And Tor is ready 15.469
Then I successfully start the Unsafe Browser in "fa" 27.771
And I kill the Unsafe Browser 5.732
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 34.152
And DuckDuckGo is the default search engine 9.432
And I kill the Tor Browser 5.329
And the screen keyboard works in Thunderbird 23.029
And the layout of the screen keyboard is set to "ir" 0.571
After features/support/hooks.rb:291 1.106
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.663
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.946
When I log in to a new session in Portuguese (pt) 29.630
Then the keyboard layout is set to "pt" 0.141
When the network is plugged 0.045
And Tor is ready 16.770
Then I successfully start the Unsafe Browser in "pt" 26.937
And I kill the Unsafe Browser 5.912
When I enable the screen keyboard 0.185
Then the screen keyboard works in Tor Browser 33.810
And DuckDuckGo is the default search engine 10.009
And I kill the Tor Browser 5.374
And the screen keyboard works in Thunderbird 23.330
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.103
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.075
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.314
When I log in to a new session in Russian (ru) 28.727
Then the keyboard layout is set to "ru" 0.177
When the network is plugged 0.033
And Tor is ready 16.304
Then I successfully start the Unsafe Browser in "ru" 29.994
And I kill the Unsafe Browser 6.023
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 36.137
And DuckDuckGo is the default search engine 9.656
And I kill the Tor Browser 5.377
And the screen keyboard works in Thunderbird 24.593
And the layout of the screen keyboard is set to "ru" 0.582
After features/support/hooks.rb:291 1.076
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.914
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.589
When I log in to a new session in Spanish (es) 33.282
Then the keyboard layout is set to "es" 0.199
When the network is plugged 0.033
And Tor is ready 15.642
Then I successfully start the Unsafe Browser in "es" 26.392
And I kill the Unsafe Browser 6.023
When I enable the screen keyboard 0.168
Then the screen keyboard works in Tor Browser 34.015
And DuckDuckGo is the default search engine 10.062
And I kill the Tor Browser 5.338
And the screen keyboard works in Thunderbird 23.584
And the layout of the screen keyboard is set to "us" 0.579
After features/support/hooks.rb:291 1.349
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.854
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.800
When I log in to a new session in Turkish (tr) 28.530
Then the keyboard layout is set to "tr" 0.278
When the network is plugged 0.051
And Tor is ready 16.571
Then I successfully start the Unsafe Browser in "tr" 29.243
And I kill the Unsafe Browser 5.817
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 33.390
And DuckDuckGo is the default search engine 10.174
And I kill the Tor Browser 5.480
And the screen keyboard works in Thunderbird 22.747
And the layout of the screen keyboard is set to "us" 0.595
After features/support/hooks.rb:291 1.230
After features/support/hooks.rb:75 0.000