Project Number Date
test_Tails_ISO_stable 4554 05 Dec 2023, 18:43

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:54.236 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.925
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 7.724
And I prepare Tails for memory erasure tests 0.549
When I start a process allocating 128 MiB of memory with a known pattern 2.403
Then patterns cover at least 128 MiB in the guest's memory 4.351 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.276
Then I find very few patterns in the guest's memory 4.620 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 0.678
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:4.747
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.898
And I prepare Tails for memory erasure tests 0.456
And I find very few patterns in the guest's memory 5.576 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.368
Then patterns cover at least 99% of the test FS size in the guest's memory 3.304 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.215
Then I find very few patterns in the guest's memory 3.927 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
After features/support/hooks.rb:291 0.834
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:0.415
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.306
And I prepare Tails for memory erasure tests 0.743
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.187
Then I find very few patterns in the guest's memory 4.748 
Pattern coverage: 0.000% (0 MiB out of 1175 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:22.292
Then patterns cover at least 86% of the test FS size in the guest's memory 3.413 
Pattern coverage: 90.924% (113 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.547
Then I find very few patterns in the guest's memory 3.887 
Pattern coverage: 0.000% (0 MiB out of 1175 MiB reference memory)
# read cache
When I mount the USB drive again 0.269
And I read the content of the test FS 0.558
Then patterns cover at least 99% of the test FS size in the guest's memory 3.391 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.270
Then I find very few patterns in the guest's memory 3.799 
Pattern coverage: 0.000% (0 MiB out of 1175 MiB reference memory)
After features/support/hooks.rb:291 0.851
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:35.570
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.029
And I prepare Tails for memory erasure tests 0.642
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.905
Then I find very few patterns in the guest's memory 3.526 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:41.999
Then patterns cover at least 99% of the test FS size in the guest's memory 2.974 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.162
Then I find very few patterns in the guest's memory 3.395 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
# read cache
When I mount the USB drive again 3.428
And I read the content of the test FS 0.481
Then patterns cover at least 99% of the test FS size in the guest's memory 2.852 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.599
Then I find very few patterns in the guest's memory 3.572 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 0.765
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.731
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.043
And I prepare Tails for memory erasure tests 0.598
When I fill a 128 MiB file with a known pattern on the root filesystem 14.026
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.020
Then patterns cover at least 128 MiB in the guest's memory 2.760 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.469
And I wait 20 seconds 20.005 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.807 
Pattern coverage: 0.000% (0 MiB out of 1183 MiB reference memory)
After features/support/hooks.rb:291 3.443
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:4.457
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:17.515
And I prepare Tails for memory erasure tests 0.489
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.762
When I trigger shutdown 0.401
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.268 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 3.483
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:22.646
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 48.997
And I update APT using apt 15.640
And I install "popularity-contest" using apt 19.556
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.136
When I create a persistent storage and activate the Additional Software feature 18.916
Then Additional Software is correctly configured for package "popularity-contest" 1.296
When I shutdown Tails and wait for the computer to power off 10.077
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.789
Then Additional Software is correctly configured for package "popularity-contest" 0.949
And the package "popularity-contest" is installed after Additional Software has been started 0.285
After features/support/hooks.rb:450 35.842
After features/support/hooks.rb:291 1.299
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:52.612
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.217
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.273
And I update APT using apt 15.165
When I install "makepp" using apt 19.434
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.423
And the package "makepp" is installed 0.096
After features/support/hooks.rb:450 35.938
After features/support/hooks.rb:291 0.900
After features/support/hooks.rb:75 0.042
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:42.035
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.261
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:59.061
When I uninstall "popularity-contest" using apt 15.985
And I accept removing "popularity-contest" from Additional Software 2.135
Then "popularity-contest" is not in the list of Additional Software 0.770
When I start Synaptic 23.370
And I update APT using Synaptic 22.145
And I install "cowsay" using Synaptic 8.385
And I accept adding "cowsay" to Additional Software 0.833
Then Additional Software is correctly configured for package "cowsay" 0.895
When I uninstall "cowsay" using apt 3.307
And I refuse removing "cowsay" from Additional Software 0.752
Then Additional Software is correctly configured for package "cowsay" 0.955
When I start "Additional Software" via GNOME Activities Overview 12.626
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.596
Then "cowsay" is not in the list of Additional Software 1.110
When I install "cowsay" using apt 3.331
And I refuse adding "cowsay" to Additional Software 0.678
Then "cowsay" is not in the list of Additional Software 0.832
After features/support/hooks.rb:450 0.923
After features/support/hooks.rb:291 0.813
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:44.191
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.189
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:4.705
And I configure APT to prefer an old version of cowsay 0.034
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.759
And I accept adding "cowsay" to Additional Software 1:4.184
And Additional Software is correctly configured for package "cowsay" 1.458
And I shutdown Tails and wait for the computer to power off 5.076
And I start Tails from USB drive "__internal" with network unplugged 44.920
And I enable persistence 33.027
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 20.503
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.807
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.101
And the network is plugged 0.070
And Tor is ready 18.664
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.704
And available upgrades have been checked 0.079
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.705
And I can open the Additional Software configuration window from the notification 3.771
And I shutdown Tails and wait for the computer to power off 2:2.540
And I start Tails from USB drive "__internal" with network unplugged 44.787
And I enable persistence 30.690
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 22.356
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.087
And I revert the APT tweaks that made it prefer an old version of cowsay 0.077
And the network is plugged 0.047
And Tor is ready 40.417
Then the Additional Software upgrade service has started 0.204
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.124
After features/support/hooks.rb:450 2.247
After features/support/hooks.rb:291 0.952
After features/support/hooks.rb:75 0.056
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.651
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.191
And I start Tails from USB drive "__internal" with network unplugged 44.494
And I enable persistence 32.926
And I remove the "cowsay" deb files from the APT cache 0.578
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.099
And I log in to a new session 28.030
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 0.858
And I can open the Additional Software log file from the notification 2.140
And the package "cowsay" is not installed 0.332
After features/support/hooks.rb:450 0.138
After features/support/hooks.rb:291 1.119
After features/support/hooks.rb:75 0.014
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.888
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.986
When I log in to a new session in Arabic (ar) 27.702
Then the keyboard layout is set to "us" 0.145
When the network is plugged 0.047
And Tor is ready 14.829
Then I successfully start the Unsafe Browser in "ar" 25.442
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 34.221
And DuckDuckGo is the default search engine 9.313
And I kill the Tor Browser 5.254
And the screen keyboard works in Thunderbird 23.391
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:19.835
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.447
When I log in to a new session in Chinese (zh_CN) 28.013
Then the keyboard layout is set to "cn" 0.278
When the network is plugged 0.047
And Tor is ready 44.757
Then I successfully start the Unsafe Browser in "zh_CN" 27.213
And I kill the Unsafe Browser 5.720
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 33.314
And DuckDuckGo is the default search engine 17.283
And I kill the Tor Browser 5.660
And the screen keyboard works in Thunderbird 27.398
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.316
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.253
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.948
When I log in to a new session in English (en) 15.193
Then the keyboard layout is set to "us" 0.218
When the network is plugged 0.046
And Tor is ready 43.476
Then I successfully start the Unsafe Browser in "en" 27.381
And I kill the Unsafe Browser 5.813
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 32.081
And DuckDuckGo is the default search engine 5.897
And I kill the Tor Browser 5.304
And the screen keyboard works in Thunderbird 22.155
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.377
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:0.245
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.762
When I log in to a new session in French (fr) 28.248
Then the keyboard layout is set to "fr" 0.189
When the network is plugged 0.053
And Tor is ready 43.290
Then I successfully start the Unsafe Browser in "fr" 25.451
And I kill the Unsafe Browser 6.053
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 32.915
And DuckDuckGo is the default search engine 9.593
And I kill the Tor Browser 5.456
And the screen keyboard works in Thunderbird 20.536
And the layout of the screen keyboard is set to "fr" 0.581
After features/support/hooks.rb:291 1.083
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.943
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.114
When I log in to a new session in German (de) 28.404
Then the keyboard layout is set to "de" 0.139
When the network is plugged 0.048
And Tor is ready 13.733
Then I successfully start the Unsafe Browser in "de" 25.878
And I kill the Unsafe Browser 5.739
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 32.584
And DuckDuckGo is the default search engine 9.554
And I kill the Tor Browser 5.326
And the screen keyboard works in Thunderbird 21.724
And the layout of the screen keyboard is set to "de" 0.589
After features/support/hooks.rb:291 1.453
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.759
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.824
When I log in to a new session in Italian (it) 28.230
Then the keyboard layout is set to "it" 0.202
When the network is plugged 0.038
And Tor is ready 14.129
Then I successfully start the Unsafe Browser in "it" 25.280
And I kill the Unsafe Browser 5.952
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 33.544
And DuckDuckGo is the default search engine 9.193
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 22.353
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 2.676
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.919
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.619
When I log in to a new session in Persian (fa) 28.471
Then the keyboard layout is set to "ir" 0.208
When the network is plugged 0.044
And Tor is ready 14.722
Then I successfully start the Unsafe Browser in "fa" 27.198
And I kill the Unsafe Browser 5.790
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 34.015
And DuckDuckGo is the default search engine 9.481
And I kill the Tor Browser 5.409
And the screen keyboard works in Thunderbird 24.197
And the layout of the screen keyboard is set to "ir" 0.634
After features/support/hooks.rb:291 1.067
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:5.681
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.037
When I log in to a new session in Portuguese (pt) 29.927
Then the keyboard layout is set to "pt" 0.133
When the network is plugged 0.057
And Tor is ready 43.980
Then I successfully start the Unsafe Browser in "pt" 26.191
And I kill the Unsafe Browser 5.889
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 32.557
And DuckDuckGo is the default search engine 10.047
And I kill the Tor Browser 5.389
And the screen keyboard works in Thunderbird 22.791
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 2.501
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.114
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.898
When I log in to a new session in Russian (ru) 30.174
Then the keyboard layout is set to "ru" 0.145
When the network is plugged 0.044
And Tor is ready 15.437
Then I successfully start the Unsafe Browser in "ru" 28.201
And I kill the Unsafe Browser 5.844
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 35.557
And DuckDuckGo is the default search engine 9.638
And I kill the Tor Browser 5.247
And the screen keyboard works in Thunderbird 24.229
And the layout of the screen keyboard is set to "ru" 0.568
After features/support/hooks.rb:291 4.264
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.955
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.321
When I log in to a new session in Spanish (es) 28.787
Then the keyboard layout is set to "es" 0.282
When the network is plugged 0.122
And Tor is ready 16.308
Then I successfully start the Unsafe Browser in "es" 25.589
And I kill the Unsafe Browser 5.747
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 33.155
And DuckDuckGo is the default search engine 9.934
And I kill the Tor Browser 5.329
And the screen keyboard works in Thunderbird 21.703
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:291 1.183
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.654
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.335
When I log in to a new session in Turkish (tr) 27.711
Then the keyboard layout is set to "tr" 0.382
When the network is plugged 0.036
And Tor is ready 15.269
Then I successfully start the Unsafe Browser in "tr" 29.254
And I kill the Unsafe Browser 5.952
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 33.151
And DuckDuckGo is the default search engine 9.557
And I kill the Tor Browser 5.338
And the screen keyboard works in Thunderbird 20.979
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.155
After features/support/hooks.rb:75 0.000