Project Number Date
test_Tails_ISO_stable 4587 23 Dec 2023, 12:02

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:19.433 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.403
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.153
And I prepare Tails for memory erasure tests 0.814
When I start a process allocating 128 MiB of memory with a known pattern 1.275
Then patterns cover at least 128 MiB in the guest's memory 3.929 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.320
Then I find very few patterns in the guest's memory 3.910 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 0.785
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.503
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.009
And I prepare Tails for memory erasure tests 0.563
And I find very few patterns in the guest's memory 4.702 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.179
Then patterns cover at least 99% of the test FS size in the guest's memory 3.133 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.232
Then I find very few patterns in the guest's memory 3.682 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.801
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:8.683
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.885
And I prepare Tails for memory erasure tests 0.543
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.820
Then I find very few patterns in the guest's memory 4.086 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:33.040
Then patterns cover at least 86% of the test FS size in the guest's memory 3.083 
Pattern coverage: 93.717% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.493
Then I find very few patterns in the guest's memory 3.778 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# read cache
When I mount the USB drive again 0.318
And I read the content of the test FS 0.506
Then patterns cover at least 99% of the test FS size in the guest's memory 2.951 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.352
Then I find very few patterns in the guest's memory 3.825 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.806
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:53.596
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.672
And I prepare Tails for memory erasure tests 0.522
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.234
Then I find very few patterns in the guest's memory 3.522 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:1.072
Then patterns cover at least 99% of the test FS size in the guest's memory 2.721 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.605
Then I find very few patterns in the guest's memory 3.109 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 3.438
And I read the content of the test FS 0.369
Then patterns cover at least 99% of the test FS size in the guest's memory 2.547 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.401
Then I find very few patterns in the guest's memory 3.378 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.721
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
45.474
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.783
And I prepare Tails for memory erasure tests 0.571
When I fill a 128 MiB file with a known pattern on the root filesystem 10.928
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.243
Then patterns cover at least 128 MiB in the guest's memory 2.588 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.562
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.777 
Pattern coverage: 0.000% (0 MiB out of 1220 MiB reference memory)
After features/support/hooks.rb:291 3.486
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:7.369
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:24.596
And I prepare Tails for memory erasure tests 0.387
When I fill a 128 MiB file with a known pattern on the persistent filesystem 19.808
When I trigger shutdown 0.451
And I wait 20 seconds 20.002 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.123 
Pattern coverage: 0.000% (0 MiB out of 1155 MiB reference memory)
After features/support/hooks.rb:291 3.452
After features/support/hooks.rb:75 0.048
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:24.875
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.587
And I update APT using apt 16.517
And I install "popularity-contest" using apt 19.628
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.162
When I create a persistent storage and activate the Additional Software feature 16.609
Then Additional Software is correctly configured for package "popularity-contest" 1.380
When I shutdown Tails and wait for the computer to power off 10.079
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.570
Then Additional Software is correctly configured for package "popularity-contest" 1.090
And the package "popularity-contest" is installed after Additional Software has been started 0.249
After features/support/hooks.rb:450 37.246
After features/support/hooks.rb:291 1.000
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:51.783
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.237
And I start Tails from USB drive "__internal" and I login with an administration password 1:18.841
And I update APT using apt 15.803
When I install "makepp" using apt 19.559
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 57.265
And the package "makepp" is installed 0.076
After features/support/hooks.rb:450 37.844
After features/support/hooks.rb:291 0.880
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:37.519
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.188
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:58.415
When I uninstall "popularity-contest" using apt 15.870
And I accept removing "popularity-contest" from Additional Software 2.428
Then "popularity-contest" is not in the list of Additional Software 0.784
When I start Synaptic 20.124
And I update APT using Synaptic 21.533
And I install "cowsay" using Synaptic 8.250
And I accept adding "cowsay" to Additional Software 0.784
Then Additional Software is correctly configured for package "cowsay" 0.928
When I uninstall "cowsay" using apt 3.316
And I refuse removing "cowsay" from Additional Software 0.723
Then Additional Software is correctly configured for package "cowsay" 0.885
When I start "Additional Software" via GNOME Activities Overview 12.628
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.599
Then "cowsay" is not in the list of Additional Software 1.087
When I install "cowsay" using apt 3.315
And I refuse adding "cowsay" to Additional Software 0.786
Then "cowsay" is not in the list of Additional Software 0.868
After features/support/hooks.rb:450 1.201
After features/support/hooks.rb:291 0.801
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:28.076
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.178
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:5.501
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.622
And I accept adding "cowsay" to Additional Software 1:2.309
And Additional Software is correctly configured for package "cowsay" 1.348
And I shutdown Tails and wait for the computer to power off 5.068
And I start Tails from USB drive "__internal" with network unplugged 44.728
And I enable persistence 31.924
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 21.726
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.593
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.084
And the network is plugged 0.047
And Tor is ready 17.784
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.733
And available upgrades have been checked 0.159
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.069
And I can open the Additional Software configuration window from the notification 2.852
And I shutdown Tails and wait for the computer to power off 2:2.575
And I start Tails from USB drive "__internal" with network unplugged 44.437
And I enable persistence 32.132
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 21.557
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.386
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
And the network is plugged 0.254
And Tor is ready 39.477
Then the Additional Software upgrade service has started 0.217
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.104
After features/support/hooks.rb:450 2.306
After features/support/hooks.rb:291 0.715
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.587
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.196
And I start Tails from USB drive "__internal" with network unplugged 45.996
And I enable persistence 33.496
And I remove the "cowsay" deb files from the APT cache 0.670
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.083
And I log in to a new session 29.381
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.477
And I can open the Additional Software log file from the notification 2.177
And the package "cowsay" is not installed 0.107
After features/support/hooks.rb:450 0.124
After features/support/hooks.rb:291 0.916
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.395
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.052
When I log in to a new session in Arabic (ar) 28.410
Then the keyboard layout is set to "us" 0.123
When the network is plugged 0.067
And Tor is ready 15.345
Then I successfully start the Unsafe Browser in "ar" 25.588
And I kill the Unsafe Browser 5.765
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 32.668
And DuckDuckGo is the default search engine 9.798
And I kill the Tor Browser 5.275
And the screen keyboard works in Thunderbird 22.520
And the layout of the screen keyboard is set to "us" 0.627
After features/support/hooks.rb:291 1.392
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.888
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 12.889
When I log in to a new session in Chinese (zh_CN) 27.451
Then the keyboard layout is set to "cn" 0.188
When the network is plugged 0.043
And Tor is ready 14.895
Then I successfully start the Unsafe Browser in "zh_CN" 29.530
And I kill the Unsafe Browser 7.980
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 34.368
And DuckDuckGo is the default search engine 9.550
And I kill the Tor Browser 5.296
And the screen keyboard works in Thunderbird 25.989
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:291 1.162
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.901
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.353
When I log in to a new session in English (en) 15.816
Then the keyboard layout is set to "us" 0.199
When the network is plugged 0.049
And Tor is ready 13.656
Then I successfully start the Unsafe Browser in "en" 27.226
And I kill the Unsafe Browser 6.495
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 34.195
And DuckDuckGo is the default search engine 5.144
And I kill the Tor Browser 5.281
And the screen keyboard works in Thunderbird 22.758
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.079
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.864
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.909
When I log in to a new session in French (fr) 28.598
Then the keyboard layout is set to "fr" 0.145
When the network is plugged 0.050
And Tor is ready 14.424
Then I successfully start the Unsafe Browser in "fr" 25.040
And I kill the Unsafe Browser 5.887
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 32.387
And DuckDuckGo is the default search engine 9.351
And I kill the Tor Browser 5.342
And the screen keyboard works in Thunderbird 21.028
And the layout of the screen keyboard is set to "fr" 0.556
After features/support/hooks.rb:291 2.853
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.899
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.839
When I log in to a new session in German (de) 29.069
Then the keyboard layout is set to "de" 0.118
When the network is plugged 0.041
And Tor is ready 16.534
Then I successfully start the Unsafe Browser in "de" 24.938
And I kill the Unsafe Browser 5.843
When I enable the screen keyboard 0.161
Then the screen keyboard works in Tor Browser 32.744
And DuckDuckGo is the default search engine 9.347
And I kill the Tor Browser 5.352
And the screen keyboard works in Thunderbird 22.334
And the layout of the screen keyboard is set to "de" 0.573
After features/support/hooks.rb:291 1.325
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.970
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.565
When I log in to a new session in Italian (it) 28.543
Then the keyboard layout is set to "it" 0.116
When the network is plugged 0.042
And Tor is ready 17.511
Then I successfully start the Unsafe Browser in "it" 26.461
And I kill the Unsafe Browser 5.775
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 33.609
And DuckDuckGo is the default search engine 9.513
And I kill the Tor Browser 5.372
And the screen keyboard works in Thunderbird 21.771
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:291 1.309
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.985
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.747
When I log in to a new session in Persian (fa) 27.781
Then the keyboard layout is set to "ir" 0.399
When the network is plugged 0.036
And Tor is ready 16.445
Then I successfully start the Unsafe Browser in "fa" 26.482
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 34.193
And DuckDuckGo is the default search engine 9.674
And I kill the Tor Browser 5.332
And the screen keyboard works in Thunderbird 24.297
And the layout of the screen keyboard is set to "ir" 0.559
After features/support/hooks.rb:291 1.065
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.751
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.835
When I log in to a new session in Portuguese (pt) 28.614
Then the keyboard layout is set to "pt" 0.155
When the network is plugged 0.038
And Tor is ready 15.677
Then I successfully start the Unsafe Browser in "pt" 28.239
And I kill the Unsafe Browser 6.623
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 33.180
And DuckDuckGo is the default search engine 9.954
And I kill the Tor Browser 5.388
And the screen keyboard works in Thunderbird 21.327
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.234
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.155
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.339
When I log in to a new session in Russian (ru) 29.033
Then the keyboard layout is set to "ru" 0.124
When the network is plugged 0.047
And Tor is ready 17.309
Then I successfully start the Unsafe Browser in "ru" 29.186
And I kill the Unsafe Browser 6.569
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 34.390
And DuckDuckGo is the default search engine 9.584
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 24.442
And the layout of the screen keyboard is set to "ru" 0.621
After features/support/hooks.rb:291 2.401
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.121
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.294
When I log in to a new session in Spanish (es) 29.037
Then the keyboard layout is set to "es" 0.147
When the network is plugged 0.051
And Tor is ready 15.282
Then I successfully start the Unsafe Browser in "es" 29.342
And I kill the Unsafe Browser 5.789
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 32.894
And DuckDuckGo is the default search engine 9.563
And I kill the Tor Browser 5.350
And the screen keyboard works in Thunderbird 23.697
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.128
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.626
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.482
When I log in to a new session in Turkish (tr) 28.659
Then the keyboard layout is set to "tr" 0.143
When the network is plugged 0.033
And Tor is ready 15.173
Then I successfully start the Unsafe Browser in "tr" 24.868
And I kill the Unsafe Browser 6.034
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 33.599
And DuckDuckGo is the default search engine 9.841
And I kill the Tor Browser 5.292
And the screen keyboard works in Thunderbird 21.731
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:291 1.212
After features/support/hooks.rb:75 0.000