Project Number Date
test_Tails_ISO_stable 4525 23 Nov 2023, 17:31

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:56.851 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.110
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.337
And I prepare Tails for memory erasure tests 0.475
When I start a process allocating 128 MiB of memory with a known pattern 2.352
Then patterns cover at least 128 MiB in the guest's memory 3.533 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.275
Then I find very few patterns in the guest's memory 4.135 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
After features/support/hooks.rb:290 1.046
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:8.407
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.870
And I prepare Tails for memory erasure tests 0.509
And I find very few patterns in the guest's memory 5.015 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 45.744
Then patterns cover at least 99% of the test FS size in the guest's memory 3.591 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.818
Then I find very few patterns in the guest's memory 3.857 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:290 1.036
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:9.506
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 9.265
And I prepare Tails for memory erasure tests 0.593
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.099
Then I find very few patterns in the guest's memory 3.859 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:31.019
Then patterns cover at least 86% of the test FS size in the guest's memory 3.503 
Pattern coverage: 99.898% (124 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.674
Then I find very few patterns in the guest's memory 3.973 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
# read cache
When I mount the USB drive again 0.249
And I read the content of the test FS 0.655
Then patterns cover at least 99% of the test FS size in the guest's memory 3.295 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.335
Then I find very few patterns in the guest's memory 3.980 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
After features/support/hooks.rb:290 0.959
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:42.074
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.345
And I prepare Tails for memory erasure tests 0.443
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.108
Then I find very few patterns in the guest's memory 3.873 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:44.128
Then patterns cover at least 99% of the test FS size in the guest's memory 2.689 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.974
Then I find very few patterns in the guest's memory 3.270 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
# read cache
When I mount the USB drive again 3.572
And I read the content of the test FS 0.370
Then patterns cover at least 99% of the test FS size in the guest's memory 2.852 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.598
Then I find very few patterns in the guest's memory 3.846 
Pattern coverage: 0.000% (0 MiB out of 1218 MiB reference memory)
After features/support/hooks.rb:290 0.918
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.908
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.211
And I prepare Tails for memory erasure tests 0.472
When I fill a 128 MiB file with a known pattern on the root filesystem 13.811
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.512
Then patterns cover at least 128 MiB in the guest's memory 3.365 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.713
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.801 
Pattern coverage: 0.000% (0 MiB out of 1239 MiB reference memory)
After features/support/hooks.rb:290 3.425
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:19.180
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:34.682
And I prepare Tails for memory erasure tests 0.428
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.343
When I trigger shutdown 0.440
And I wait 20 seconds 20.006 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.278 
Pattern coverage: 0.000% (0 MiB out of 1182 MiB reference memory)
After features/support/hooks.rb:290 3.521
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:3.003
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:438 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:22.386
And I update APT using apt 16.025
And I install "popularity-contest" using apt 19.791
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.548
When I create a persistent storage and activate the Additional Software feature 17.788
Then Additional Software is correctly configured for package "popularity-contest" 1.437
When I shutdown Tails and wait for the computer to power off 10.267
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.474
Then Additional Software is correctly configured for package "popularity-contest" 1.000
And the package "popularity-contest" is installed after Additional Software has been started 0.283
After features/support/hooks.rb:446 36.212
After features/support/hooks.rb:290 1.163
After features/support/hooks.rb:75 0.035
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:55.585
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:438 0.006
Given a computer 0.179
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.828
And I update APT using apt 15.768
When I install "makepp" using apt 19.748
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.975
And the package "makepp" is installed 0.085
After features/support/hooks.rb:446 35.175
After features/support/hooks.rb:290 0.933
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:20.922
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:438 0.005
Given a computer 0.245
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:38.855
When I uninstall "popularity-contest" using apt 19.004
And I accept removing "popularity-contest" from Additional Software 0.693
Then "popularity-contest" is not in the list of Additional Software 0.810
When I start Synaptic 20.069
And I update APT using Synaptic 22.032
And I install "cowsay" using Synaptic 8.906
And I accept adding "cowsay" to Additional Software 0.796
Then Additional Software is correctly configured for package "cowsay" 0.936
When I uninstall "cowsay" using apt 3.302
And I refuse removing "cowsay" from Additional Software 0.814
Then Additional Software is correctly configured for package "cowsay" 1.186
When I start "Additional Software" via GNOME Activities Overview 12.426
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.797
Then "cowsay" is not in the list of Additional Software 1.173
When I install "cowsay" using apt 3.319
And I refuse adding "cowsay" to Additional Software 0.721
Then "cowsay" is not in the list of Additional Software 0.829
After features/support/hooks.rb:446 1.115
After features/support/hooks.rb:290 0.785
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:23.606
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:438 0.009
Given a computer 0.232
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:11.781
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.005
And I accept adding "cowsay" to Additional Software 1:9.087
And Additional Software is correctly configured for package "cowsay" 1.796
And I shutdown Tails and wait for the computer to power off 5.072
And I start Tails from USB drive "__internal" with network unplugged 46.453
And I enable persistence 32.195
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.032
And I log in to a new session 25.066
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.426
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.125
And the network is plugged 0.050
And Tor is ready 18.788
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.853
And available upgrades have been checked 0.218
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.112
And I can open the Additional Software configuration window from the notification 2.846
And I shutdown Tails and wait for the computer to power off 2:2.856
And I start Tails from USB drive "__internal" with network unplugged 48.350
And I enable persistence 33.366
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 25.994
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.403
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
And the network is plugged 0.454
And Tor is ready 40.568
Then the Additional Software upgrade service has started 0.202
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.090
After features/support/hooks.rb:446 2.489
After features/support/hooks.rb:290 1.006
After features/support/hooks.rb:75 0.043
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.482
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.007
Given a computer 0.323
And I start Tails from USB drive "__internal" with network unplugged 49.034
And I enable persistence 34.125
And I remove the "cowsay" deb files from the APT cache 0.864
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.099
And I log in to a new session 23.820
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.810
And I can open the Additional Software log file from the notification 3.194
And the package "cowsay" is not installed 0.209
After features/support/hooks.rb:446 0.114
After features/support/hooks.rb:290 1.292
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.180
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.716
When I log in to a new session in Arabic (ar) 30.099
Then the keyboard layout is set to "us" 0.139
When the network is plugged 0.066
And Tor is ready 19.805
Then I successfully start the Unsafe Browser in "ar" 28.799
And I kill the Unsafe Browser 6.422
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 36.268
And DuckDuckGo is the default search engine 4.847
And I kill the Tor Browser 5.296
And the screen keyboard works in Thunderbird 21.999
And the layout of the screen keyboard is set to "us" 0.625
After features/support/hooks.rb:290 1.302
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.035
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.925
When I log in to a new session in Chinese (zh_CN) 29.549
Then the keyboard layout is set to "cn" 0.144
When the network is plugged 0.046
And Tor is ready 14.169
Then I successfully start the Unsafe Browser in "zh_CN" 30.770
And I kill the Unsafe Browser 6.100
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 35.372
And DuckDuckGo is the default search engine 5.141
And I kill the Tor Browser 5.372
And the screen keyboard works in Thunderbird 28.739
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:290 1.167
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.366
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.634
When I log in to a new session in English (en) 18.115
Then the keyboard layout is set to "us" 0.171
When the network is plugged 0.044
And Tor is ready 13.663
Then I successfully start the Unsafe Browser in "en" 29.589
And I kill the Unsafe Browser 6.107
When I enable the screen keyboard 0.167
Then the screen keyboard works in Tor Browser 33.706
And DuckDuckGo is the default search engine 5.096
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 22.160
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:290 1.257
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:2.975
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.353
When I log in to a new session in French (fr) 30.399
Then the keyboard layout is set to "fr" 0.348
When the network is plugged 0.050
And Tor is ready 45.732
Then I successfully start the Unsafe Browser in "fr" 25.741
And I kill the Unsafe Browser 6.194
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 33.606
And DuckDuckGo is the default search engine 4.967
And I kill the Tor Browser 5.422
And the screen keyboard works in Thunderbird 21.399
And the layout of the screen keyboard is set to "fr" 0.652
After features/support/hooks.rb:290 1.476
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.801
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.151
When I log in to a new session in German (de) 29.889
Then the keyboard layout is set to "de" 0.239
When the network is plugged 0.055
And Tor is ready 15.453
Then I successfully start the Unsafe Browser in "de" 25.254
And I kill the Unsafe Browser 6.598
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 34.159
And DuckDuckGo is the default search engine 4.930
And I kill the Tor Browser 5.312
And the screen keyboard works in Thunderbird 22.036
And the layout of the screen keyboard is set to "de" 0.597
After features/support/hooks.rb:290 1.189
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.996
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.088
When I log in to a new session in Italian (it) 29.446
Then the keyboard layout is set to "it" 0.177
When the network is plugged 0.042
And Tor is ready 16.868
Then I successfully start the Unsafe Browser in "it" 26.535
And I kill the Unsafe Browser 5.949
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 34.810
And DuckDuckGo is the default search engine 4.711
And I kill the Tor Browser 5.293
And the screen keyboard works in Thunderbird 22.303
And the layout of the screen keyboard is set to "us" 0.622
After features/support/hooks.rb:290 1.099
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.908
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.006
When I log in to a new session in Persian (fa) 29.452
Then the keyboard layout is set to "ir" 0.246
When the network is plugged 0.040
And Tor is ready 15.712
Then I successfully start the Unsafe Browser in "fa" 30.157
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 34.527
And DuckDuckGo is the default search engine 4.849
And I kill the Tor Browser 5.325
And the screen keyboard works in Thunderbird 26.109
And the layout of the screen keyboard is set to "ir" 0.571
After features/support/hooks.rb:290 1.604
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.922
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.495
When I log in to a new session in Portuguese (pt) 30.141
Then the keyboard layout is set to "pt" 0.127
When the network is plugged 0.046
And Tor is ready 16.484
Then I successfully start the Unsafe Browser in "pt" 27.413
And I kill the Unsafe Browser 6.424
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 32.246
And DuckDuckGo is the default search engine 4.694
And I kill the Tor Browser 5.308
And the screen keyboard works in Thunderbird 24.801
And the layout of the screen keyboard is set to "us" 0.600
After features/support/hooks.rb:290 1.226
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:14.769
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.067
When I log in to a new session in Russian (ru) 32.108
Then the keyboard layout is set to "ru" 0.283
When the network is plugged 0.040
And Tor is ready 45.620
Then I successfully start the Unsafe Browser in "ru" 31.373
And I kill the Unsafe Browser 6.217
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 33.871
And DuckDuckGo is the default search engine 4.650
And I kill the Tor Browser 5.278
And the screen keyboard works in Thunderbird 26.545
And the layout of the screen keyboard is set to "ru" 0.582
After features/support/hooks.rb:290 1.254
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.681
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.313
When I log in to a new session in Spanish (es) 34.947
Then the keyboard layout is set to "es" 0.148
When the network is plugged 0.090
And Tor is ready 14.790
Then I successfully start the Unsafe Browser in "es" 28.371
And I kill the Unsafe Browser 6.756
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 34.786
And DuckDuckGo is the default search engine 5.010
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 22.380
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:290 1.199
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.426
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.009
When I log in to a new session in Turkish (tr) 29.546
Then the keyboard layout is set to "tr" 0.182
When the network is plugged 0.039
And Tor is ready 14.456
Then I successfully start the Unsafe Browser in "tr" 28.615
And I kill the Unsafe Browser 5.857
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 33.271
And DuckDuckGo is the default search engine 4.950
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 21.394
And the layout of the screen keyboard is set to "us" 0.626
After features/support/hooks.rb:290 1.399
After features/support/hooks.rb:75 0.000