Project Number Date
test_Tails_ISO_stable 4552 05 Dec 2023, 15:24

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:31.278 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.190
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.371
And I prepare Tails for memory erasure tests 0.625
When I start a process allocating 128 MiB of memory with a known pattern 1.402
Then patterns cover at least 128 MiB in the guest's memory 3.669 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.327
Then I find very few patterns in the guest's memory 3.794 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 0.706
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.043
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.787
And I prepare Tails for memory erasure tests 0.476
And I find very few patterns in the guest's memory 4.088 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.287
Then patterns cover at least 99% of the test FS size in the guest's memory 3.196 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.297
Then I find very few patterns in the guest's memory 3.909 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 0.855
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:27.293
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.336
And I prepare Tails for memory erasure tests 0.626
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.861
Then I find very few patterns in the guest's memory 4.031 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:51.070
Then patterns cover at least 86% of the test FS size in the guest's memory 3.208 
Pattern coverage: 93.710% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.436
Then I find very few patterns in the guest's memory 3.863 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 0.261
And I read the content of the test FS 0.580
Then patterns cover at least 99% of the test FS size in the guest's memory 3.004 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.246
Then I find very few patterns in the guest's memory 3.764 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 0.878
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:45.366
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.493
And I prepare Tails for memory erasure tests 0.506
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.388
Then I find very few patterns in the guest's memory 3.635 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:49.593
Then patterns cover at least 99% of the test FS size in the guest's memory 2.743 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.670
Then I find very few patterns in the guest's memory 3.375 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 3.176
And I read the content of the test FS 0.538
Then patterns cover at least 99% of the test FS size in the guest's memory 2.455 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.371
Then I find very few patterns in the guest's memory 3.416 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 1.294
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.172
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.217
And I prepare Tails for memory erasure tests 0.468
When I fill a 128 MiB file with a known pattern on the root filesystem 17.140
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.549
Then patterns cover at least 128 MiB in the guest's memory 2.409 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.596
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.774 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 3.443
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:0.812
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:12.577
And I prepare Tails for memory erasure tests 0.509
When I fill a 128 MiB file with a known pattern on the persistent filesystem 25.213
When I trigger shutdown 0.261
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.230 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 3.519
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:37.732
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.009
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.003
And I update APT using apt 15.604
And I install "popularity-contest" using apt 19.458
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.227
When I create a persistent storage and activate the Additional Software feature 17.380
Then Additional Software is correctly configured for package "popularity-contest" 1.368
When I shutdown Tails and wait for the computer to power off 11.128
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:42.322
Then Additional Software is correctly configured for package "popularity-contest" 0.951
And the package "popularity-contest" is installed after Additional Software has been started 0.286
After features/support/hooks.rb:450 39.076
After features/support/hooks.rb:291 1.673
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:2.909
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.164
And I start Tails from USB drive "__internal" and I login with an administration password 1:22.291
And I update APT using apt 15.559
When I install "makepp" using apt 20.875
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:3.944
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 42.064
After features/support/hooks.rb:291 0.917
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:1.770
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.168
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.196
When I uninstall "popularity-contest" using apt 19.038
And I accept removing "popularity-contest" from Additional Software 0.810
Then "popularity-contest" is not in the list of Additional Software 0.991
When I start Synaptic 24.143
And I update APT using Synaptic 21.800
And I install "cowsay" using Synaptic 9.587
And I accept adding "cowsay" to Additional Software 0.824
Then Additional Software is correctly configured for package "cowsay" 0.923
When I uninstall "cowsay" using apt 3.368
And I refuse removing "cowsay" from Additional Software 0.734
Then Additional Software is correctly configured for package "cowsay" 0.885
When I start "Additional Software" via GNOME Activities Overview 12.445
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.876
Then "cowsay" is not in the list of Additional Software 1.113
When I install "cowsay" using apt 3.305
And I refuse adding "cowsay" to Additional Software 0.715
Then "cowsay" is not in the list of Additional Software 0.840
After features/support/hooks.rb:450 1.101
After features/support/hooks.rb:291 0.757
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:24.581
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.151
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:15.099
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.023
And I accept adding "cowsay" to Additional Software 1:10.028
And Additional Software is correctly configured for package "cowsay" 1.401
And I shutdown Tails and wait for the computer to power off 6.263
And I start Tails from USB drive "__internal" with network unplugged 46.437
And I enable persistence 30.331
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.029
And I log in to a new session 27.628
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.915
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.096
And the network is plugged 0.036
And Tor is ready 19.782
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.695
And available upgrades have been checked 0.074
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.089
And I can open the Additional Software configuration window from the notification 3.158
And I shutdown Tails and wait for the computer to power off 2:2.555
And I start Tails from USB drive "__internal" with network unplugged 47.204
And I enable persistence 36.891
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 27.633
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.828
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
And the network is plugged 0.039
And Tor is ready 42.732
Then the Additional Software upgrade service has started 0.186
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.082
After features/support/hooks.rb:450 3.014
After features/support/hooks.rb:291 1.066
After features/support/hooks.rb:75 0.034
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:44.902
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.009
Given a computer 0.202
And I start Tails from USB drive "__internal" with network unplugged 46.747
And I enable persistence 31.603
And I remove the "cowsay" deb files from the APT cache 0.574
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.086
And I log in to a new session 20.372
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.752
And I can open the Additional Software log file from the notification 3.076
And the package "cowsay" is not installed 0.487
After features/support/hooks.rb:450 0.113
After features/support/hooks.rb:291 0.670
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.480
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.183
When I log in to a new session in Arabic (ar) 28.682
Then the keyboard layout is set to "us" 0.146
When the network is plugged 0.027
And Tor is ready 16.095
Then I successfully start the Unsafe Browser in "ar" 28.177
And I kill the Unsafe Browser 5.858
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 35.435
And DuckDuckGo is the default search engine 10.110
And I kill the Tor Browser 5.621
And the screen keyboard works in Thunderbird 22.371
And the layout of the screen keyboard is set to "us" 0.605
After features/support/hooks.rb:291 1.752
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.063
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.763
When I log in to a new session in Chinese (zh_CN) 28.974
Then the keyboard layout is set to "cn" 0.153
When the network is plugged 0.024
And Tor is ready 14.410
Then I successfully start the Unsafe Browser in "zh_CN" 28.092
And I kill the Unsafe Browser 5.811
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 35.027
And DuckDuckGo is the default search engine 9.753
And I kill the Tor Browser 5.349
And the screen keyboard works in Thunderbird 27.921
And the layout of the screen keyboard is set to "us" 0.638
After features/support/hooks.rb:291 1.254
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.297
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.105
When I log in to a new session in English (en) 18.863
Then the keyboard layout is set to "us" 0.148
When the network is plugged 0.062
And Tor is ready 15.610
Then I successfully start the Unsafe Browser in "en" 30.771
And I kill the Unsafe Browser 6.713
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 33.777
And DuckDuckGo is the default search engine 5.414
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 22.772
And the layout of the screen keyboard is set to "us" 0.629
After features/support/hooks.rb:291 1.063
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.383
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.818
When I log in to a new session in French (fr) 29.186
Then the keyboard layout is set to "fr" 0.268
When the network is plugged 0.030
And Tor is ready 13.983
Then I successfully start the Unsafe Browser in "fr" 27.670
And I kill the Unsafe Browser 5.860
When I enable the screen keyboard 0.185
Then the screen keyboard works in Tor Browser 35.630
And DuckDuckGo is the default search engine 9.748
And I kill the Tor Browser 5.359
And the screen keyboard works in Thunderbird 21.981
And the layout of the screen keyboard is set to "fr" 0.659
After features/support/hooks.rb:291 1.243
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.062
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.968
When I log in to a new session in German (de) 28.860
Then the keyboard layout is set to "de" 0.348
When the network is plugged 0.022
And Tor is ready 14.475
Then I successfully start the Unsafe Browser in "de" 26.654
And I kill the Unsafe Browser 5.936
When I enable the screen keyboard 0.261
Then the screen keyboard works in Tor Browser 34.959
And DuckDuckGo is the default search engine 10.020
And I kill the Tor Browser 5.349
And the screen keyboard works in Thunderbird 20.565
And the layout of the screen keyboard is set to "de" 0.638
After features/support/hooks.rb:291 1.123
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.020
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.964
When I log in to a new session in Italian (it) 29.834
Then the keyboard layout is set to "it" 0.332
When the network is plugged 0.023
And Tor is ready 15.738
Then I successfully start the Unsafe Browser in "it" 27.481
And I kill the Unsafe Browser 5.844
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 35.218
And DuckDuckGo is the default search engine 9.643
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 22.836
And the layout of the screen keyboard is set to "us" 0.606
After features/support/hooks.rb:291 1.198
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.737
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.005
When I log in to a new session in Persian (fa) 32.182
Then the keyboard layout is set to "ir" 0.347
When the network is plugged 0.020
And Tor is ready 15.327
Then I successfully start the Unsafe Browser in "fa" 32.921
And I kill the Unsafe Browser 5.932
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 38.886
And DuckDuckGo is the default search engine 18.763
And I kill the Tor Browser 5.586
And the screen keyboard works in Thunderbird 26.014
And the layout of the screen keyboard is set to "ir" 0.583
After features/support/hooks.rb:291 1.204
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.518
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.747
When I log in to a new session in Portuguese (pt) 31.326
Then the keyboard layout is set to "pt" 0.168
When the network is plugged 0.050
And Tor is ready 17.312
Then I successfully start the Unsafe Browser in "pt" 32.154
And I kill the Unsafe Browser 5.930
When I enable the screen keyboard 0.188
Then the screen keyboard works in Tor Browser 36.201
And DuckDuckGo is the default search engine 10.361
And I kill the Tor Browser 5.507
And the screen keyboard works in Thunderbird 23.002
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 1.163
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.141
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.580
When I log in to a new session in Russian (ru) 28.504
Then the keyboard layout is set to "ru" 0.204
When the network is plugged 0.067
And Tor is ready 15.698
Then I successfully start the Unsafe Browser in "ru" 27.486
And I kill the Unsafe Browser 7.583
When I enable the screen keyboard 0.166
Then the screen keyboard works in Tor Browser 37.088
And DuckDuckGo is the default search engine 18.721
And I kill the Tor Browser 5.578
And the screen keyboard works in Thunderbird 24.870
And the layout of the screen keyboard is set to "ru" 0.591
After features/support/hooks.rb:291 1.107
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.608
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.870
When I log in to a new session in Spanish (es) 29.578
Then the keyboard layout is set to "es" 0.254
When the network is plugged 0.114
And Tor is ready 16.581
Then I successfully start the Unsafe Browser in "es" 25.380
And I kill the Unsafe Browser 6.125
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 35.722
And DuckDuckGo is the default search engine 10.532
And I kill the Tor Browser 5.602
And the screen keyboard works in Thunderbird 22.080
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:291 1.278
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.188
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.529
When I log in to a new session in Turkish (tr) 33.312
Then the keyboard layout is set to "tr" 0.201
When the network is plugged 0.025
And Tor is ready 16.275
Then I successfully start the Unsafe Browser in "tr" 27.794
And I kill the Unsafe Browser 5.857
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 35.607
And DuckDuckGo is the default search engine 10.139
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 23.171
And the layout of the screen keyboard is set to "us" 0.653
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.000