Project Number Date
test_Tails_ISO_stable 4566 13 Dec 2023, 12:11

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:54.499 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.377
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and logged in 8.041
And I prepare Tails for memory erasure tests 0.582
When I start a process allocating 128 MiB of memory with a known pattern 1.290
Then patterns cover at least 128 MiB in the guest's memory 3.450 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.273
Then I find very few patterns in the guest's memory 3.739 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 1.480
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.417
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.268
And I prepare Tails for memory erasure tests 0.656
And I find very few patterns in the guest's memory 3.882 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.604
Then patterns cover at least 99% of the test FS size in the guest's memory 3.062 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.200
Then I find very few patterns in the guest's memory 3.742 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 2.382
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:19.309
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.465
And I prepare Tails for memory erasure tests 0.488
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.831
Then I find very few patterns in the guest's memory 3.760 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:42.140
Then patterns cover at least 86% of the test FS size in the guest's memory 2.843 
Pattern coverage: 95.500% (119 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.463
Then I find very few patterns in the guest's memory 3.633 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
# read cache
When I mount the USB drive again 0.236
And I read the content of the test FS 0.529
Then patterns cover at least 99% of the test FS size in the guest's memory 3.324 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.302
Then I find very few patterns in the guest's memory 4.288 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 0.772
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:47.014
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.493
And I prepare Tails for memory erasure tests 0.545
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.409
Then I find very few patterns in the guest's memory 3.502 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:46.475
Then patterns cover at least 99% of the test FS size in the guest's memory 2.965 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.555
Then I find very few patterns in the guest's memory 3.405 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
# read cache
When I mount the USB drive again 3.943
And I read the content of the test FS 0.450
Then patterns cover at least 99% of the test FS size in the guest's memory 2.827 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.577
Then I find very few patterns in the guest's memory 3.859 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 1.204
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.280
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.282
And I prepare Tails for memory erasure tests 0.502
When I fill a 128 MiB file with a known pattern on the root filesystem 13.989
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.236
Then patterns cover at least 128 MiB in the guest's memory 2.488 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.901
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.860 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 3.650
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:58.853
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:13.253
And I prepare Tails for memory erasure tests 0.478
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.486
When I trigger shutdown 0.464
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.153 
Pattern coverage: 0.000% (0 MiB out of 1177 MiB reference memory)
After features/support/hooks.rb:291 3.474
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:45.348
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.744
And I update APT using apt 15.395
And I install "popularity-contest" using apt 19.629
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:1.708
When I create a persistent storage and activate the Additional Software feature 19.761
Then Additional Software is correctly configured for package "popularity-contest" 1.377
When I shutdown Tails and wait for the computer to power off 11.112
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:44.357
Then Additional Software is correctly configured for package "popularity-contest" 0.974
And the package "popularity-contest" is installed after Additional Software has been started 0.285
After features/support/hooks.rb:450 38.665
After features/support/hooks.rb:291 1.567
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:57.008
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.196
And I start Tails from USB drive "__internal" and I login with an administration password 1:20.763
And I update APT using apt 15.927
When I install "makepp" using apt 19.760
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:0.271
And the package "makepp" is installed 0.089
After features/support/hooks.rb:450 39.614
After features/support/hooks.rb:291 0.908
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:53.287
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.193
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:6.551
When I uninstall "popularity-contest" using apt 15.840
And I accept removing "popularity-contest" from Additional Software 1.887
Then "popularity-contest" is not in the list of Additional Software 0.944
When I start Synaptic 24.517
And I update APT using Synaptic 23.650
And I install "cowsay" using Synaptic 10.059
And I accept adding "cowsay" to Additional Software 0.864
Then Additional Software is correctly configured for package "cowsay" 0.915
When I uninstall "cowsay" using apt 3.342
And I refuse removing "cowsay" from Additional Software 0.620
Then Additional Software is correctly configured for package "cowsay" 0.911
When I start "Additional Software" via GNOME Activities Overview 12.381
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.736
Then "cowsay" is not in the list of Additional Software 1.092
When I install "cowsay" using apt 3.319
And I refuse adding "cowsay" to Additional Software 0.729
Then "cowsay" is not in the list of Additional Software 0.727
After features/support/hooks.rb:450 0.992
After features/support/hooks.rb:291 0.724
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:2.604
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.174
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:7.921
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.398
And I accept adding "cowsay" to Additional Software 1:6.238
And Additional Software is correctly configured for package "cowsay" 1.496
And I shutdown Tails and wait for the computer to power off 5.052
And I start Tails from USB drive "__internal" with network unplugged 45.639
And I enable persistence 34.063
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.029
And I log in to a new session 24.844
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.619
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.147
And the network is plugged 0.034
And Tor is ready 17.833
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.643
And available upgrades have been checked 0.163
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.483
And I can open the Additional Software configuration window from the notification 2.855
And I shutdown Tails and wait for the computer to power off 2:2.644
And I start Tails from USB drive "__internal" with network unplugged 45.977
And I enable persistence 31.511
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 21.524
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.829
And I revert the APT tweaks that made it prefer an old version of cowsay 0.048
And the network is plugged 0.040
And Tor is ready 47.965
Then the Additional Software upgrade service has started 0.218
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.086
After features/support/hooks.rb:450 2.264
After features/support/hooks.rb:291 0.805
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.642
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.008
Given a computer 0.198
And I start Tails from USB drive "__internal" with network unplugged 45.944
And I enable persistence 31.685
And I remove the "cowsay" deb files from the APT cache 0.586
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.092
And I log in to a new session 26.380
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.283
And I can open the Additional Software log file from the notification 2.328
And the package "cowsay" is not installed 0.142
After features/support/hooks.rb:450 0.105
After features/support/hooks.rb:291 0.763
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.865
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.106
When I log in to a new session in Arabic (ar) 29.591
Then the keyboard layout is set to "us" 0.255
When the network is plugged 0.044
And Tor is ready 16.123
Then I successfully start the Unsafe Browser in "ar" 27.387
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 36.051
And DuckDuckGo is the default search engine 9.699
And I kill the Tor Browser 5.405
And the screen keyboard works in Thunderbird 22.677
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 1.321
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.258
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.738
When I log in to a new session in Chinese (zh_CN) 28.802
Then the keyboard layout is set to "cn" 0.135
When the network is plugged 0.053
And Tor is ready 15.317
Then I successfully start the Unsafe Browser in "zh_CN" 28.052
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.197
Then the screen keyboard works in Tor Browser 35.400
And DuckDuckGo is the default search engine 9.595
And I kill the Tor Browser 5.720
And the screen keyboard works in Thunderbird 23.832
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:291 1.394
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.124
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.472
When I log in to a new session in English (en) 21.268
Then the keyboard layout is set to "us" 0.199
When the network is plugged 0.050
And Tor is ready 15.462
Then I successfully start the Unsafe Browser in "en" 25.268
And I kill the Unsafe Browser 5.976
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 32.110
And DuckDuckGo is the default search engine 5.437
And I kill the Tor Browser 5.424
And the screen keyboard works in Thunderbird 21.728
And the layout of the screen keyboard is set to "us" 0.597
After features/support/hooks.rb:291 1.483
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.943
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.771
When I log in to a new session in French (fr) 28.854
Then the keyboard layout is set to "fr" 0.218
When the network is plugged 0.040
And Tor is ready 14.833
Then I successfully start the Unsafe Browser in "fr" 26.238
And I kill the Unsafe Browser 5.939
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 32.904
And DuckDuckGo is the default search engine 9.821
And I kill the Tor Browser 5.370
And the screen keyboard works in Thunderbird 22.203
And the layout of the screen keyboard is set to "fr" 0.592
After features/support/hooks.rb:291 1.256
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.222
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.370
When I log in to a new session in German (de) 28.671
Then the keyboard layout is set to "de" 0.252
When the network is plugged 0.034
And Tor is ready 15.545
Then I successfully start the Unsafe Browser in "de" 27.234
And I kill the Unsafe Browser 5.728
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 33.944
And DuckDuckGo is the default search engine 9.826
And I kill the Tor Browser 5.388
And the screen keyboard works in Thunderbird 22.489
And the layout of the screen keyboard is set to "de" 0.630
After features/support/hooks.rb:291 1.107
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.124
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.946
When I log in to a new session in Italian (it) 30.830
Then the keyboard layout is set to "it" 0.256
When the network is plugged 0.058
And Tor is ready 14.600
Then I successfully start the Unsafe Browser in "it" 25.923
And I kill the Unsafe Browser 5.957
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 33.222
And DuckDuckGo is the default search engine 10.058
And I kill the Tor Browser 5.379
And the screen keyboard works in Thunderbird 22.182
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.857
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.474
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.757
When I log in to a new session in Persian (fa) 29.277
Then the keyboard layout is set to "ir" 0.148
When the network is plugged 0.038
And Tor is ready 16.024
Then I successfully start the Unsafe Browser in "fa" 26.963
And I kill the Unsafe Browser 5.942
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.525
And DuckDuckGo is the default search engine 9.905
And I kill the Tor Browser 5.455
And the screen keyboard works in Thunderbird 23.671
And the layout of the screen keyboard is set to "ir" 0.610
After features/support/hooks.rb:291 1.066
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.533
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.642
When I log in to a new session in Portuguese (pt) 30.883
Then the keyboard layout is set to "pt" 0.153
When the network is plugged 0.046
And Tor is ready 16.964
Then I successfully start the Unsafe Browser in "pt" 27.532
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 34.287
And DuckDuckGo is the default search engine 9.565
And I kill the Tor Browser 5.306
And the screen keyboard works in Thunderbird 22.522
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:291 1.037
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.085
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.902
When I log in to a new session in Russian (ru) 28.422
Then the keyboard layout is set to "ru" 0.207
When the network is plugged 0.032
And Tor is ready 15.653
Then I successfully start the Unsafe Browser in "ru" 28.068
And I kill the Unsafe Browser 5.847
When I enable the screen keyboard 0.265
Then the screen keyboard works in Tor Browser 35.941
And DuckDuckGo is the default search engine 9.717
And I kill the Tor Browser 5.307
And the screen keyboard works in Thunderbird 25.129
And the layout of the screen keyboard is set to "ru" 0.590
After features/support/hooks.rb:291 1.064
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.164
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.441
When I log in to a new session in Spanish (es) 31.350
Then the keyboard layout is set to "es" 0.208
When the network is plugged 0.032
And Tor is ready 16.669
Then I successfully start the Unsafe Browser in "es" 26.651
And I kill the Unsafe Browser 6.032
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 33.914
And DuckDuckGo is the default search engine 10.003
And I kill the Tor Browser 5.402
And the screen keyboard works in Thunderbird 22.701
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:291 1.194
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.558
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.156
When I log in to a new session in Turkish (tr) 33.454
Then the keyboard layout is set to "tr" 0.167
When the network is plugged 0.059
And Tor is ready 14.172
Then I successfully start the Unsafe Browser in "tr" 26.944
And I kill the Unsafe Browser 5.946
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 33.762
And DuckDuckGo is the default search engine 9.386
And I kill the Tor Browser 5.360
And the screen keyboard works in Thunderbird 22.363
And the layout of the screen keyboard is set to "us" 0.662
After features/support/hooks.rb:291 1.204
After features/support/hooks.rb:75 0.000