Project Number Date
test_Tails_ISO_stable 4564 12 Dec 2023, 12:06

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:24.519 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.221
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.810
And I prepare Tails for memory erasure tests 0.532
When I start a process allocating 128 MiB of memory with a known pattern 2.412
Then patterns cover at least 128 MiB in the guest's memory 3.276 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.380
Then I find very few patterns in the guest's memory 3.808 
Pattern coverage: 0.000% (0 MiB out of 1233 MiB reference memory)
After features/support/hooks.rb:291 1.326
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.565
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.063
And I prepare Tails for memory erasure tests 0.751
And I find very few patterns in the guest's memory 3.755 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 42.965
Then patterns cover at least 99% of the test FS size in the guest's memory 3.060 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.362
Then I find very few patterns in the guest's memory 3.605 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 0.833
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:48.058
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.001
And I prepare Tails for memory erasure tests 0.824
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.897
Then I find very few patterns in the guest's memory 3.795 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:11.115
Then patterns cover at least 86% of the test FS size in the guest's memory 3.236 
Pattern coverage: 97.272% (121 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.584
Then I find very few patterns in the guest's memory 4.405 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
# read cache
When I mount the USB drive again 0.226
And I read the content of the test FS 0.672
Then patterns cover at least 99% of the test FS size in the guest's memory 3.688 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.326
Then I find very few patterns in the guest's memory 4.284 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
After features/support/hooks.rb:291 0.903
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:30.905
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.296
And I prepare Tails for memory erasure tests 0.721
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.368
Then I find very few patterns in the guest's memory 3.588 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:37.915
Then patterns cover at least 99% of the test FS size in the guest's memory 2.681 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.581
Then I find very few patterns in the guest's memory 3.255 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# read cache
When I mount the USB drive again 3.646
And I read the content of the test FS 0.433
Then patterns cover at least 99% of the test FS size in the guest's memory 2.775 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.924
Then I find very few patterns in the guest's memory 3.715 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.993
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.598
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.904
And I prepare Tails for memory erasure tests 0.562
When I fill a 128 MiB file with a known pattern on the root filesystem 13.518
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.689
Then patterns cover at least 128 MiB in the guest's memory 3.270 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.701
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.931 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 3.496
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:7.341
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:20.692
And I prepare Tails for memory erasure tests 0.451
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.823
When I trigger shutdown 0.219
And I wait 20 seconds 20.006 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.148 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 3.459
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:38.462
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.012
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.855
And I update APT using apt 16.396
And I install "popularity-contest" using apt 19.856
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.031
When I create a persistent storage and activate the Additional Software feature 19.342
Then Additional Software is correctly configured for package "popularity-contest" 1.342
When I shutdown Tails and wait for the computer to power off 9.099
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:41.108
Then Additional Software is correctly configured for package "popularity-contest" 1.067
And the package "popularity-contest" is installed after Additional Software has been started 0.362
After features/support/hooks.rb:450 35.617
After features/support/hooks.rb:291 0.842
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:54.141
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.205
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.053
And I update APT using apt 15.659
When I install "makepp" using apt 19.674
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 57.456
And the package "makepp" is installed 0.091
After features/support/hooks.rb:450 37.112
After features/support/hooks.rb:291 0.931
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:21.412
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.201
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:38.885
When I uninstall "popularity-contest" using apt 15.947
And I accept removing "popularity-contest" from Additional Software 0.642
Then "popularity-contest" is not in the list of Additional Software 0.940
When I start Synaptic 23.474
And I update APT using Synaptic 21.936
And I install "cowsay" using Synaptic 8.961
And I accept adding "cowsay" to Additional Software 0.869
Then Additional Software is correctly configured for package "cowsay" 0.886
When I uninstall "cowsay" using apt 3.292
And I refuse removing "cowsay" from Additional Software 0.676
Then Additional Software is correctly configured for package "cowsay" 0.920
When I start "Additional Software" via GNOME Activities Overview 12.573
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.473
Then "cowsay" is not in the list of Additional Software 1.036
When I install "cowsay" using apt 3.294
And I refuse adding "cowsay" to Additional Software 0.639
Then "cowsay" is not in the list of Additional Software 0.760
After features/support/hooks.rb:450 1.199
After features/support/hooks.rb:291 0.664
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:55.636
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.217
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:1.095
And I configure APT to prefer an old version of cowsay 0.033
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.398
And I accept adding "cowsay" to Additional Software 1:6.682
And Additional Software is correctly configured for package "cowsay" 1.374
And I shutdown Tails and wait for the computer to power off 6.061
And I start Tails from USB drive "__internal" with network unplugged 46.936
And I enable persistence 33.783
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.033
And I log in to a new session 23.273
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.179
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.108
And the network is plugged 0.055
And Tor is ready 16.041
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.961
And available upgrades have been checked 0.227
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.966
And I can open the Additional Software configuration window from the notification 3.220
And I shutdown Tails and wait for the computer to power off 2:2.641
And I start Tails from USB drive "__internal" with network unplugged 53.097
And I enable persistence 31.034
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 23.499
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.033
And I revert the APT tweaks that made it prefer an old version of cowsay 0.076
And the network is plugged 0.040
And Tor is ready 39.188
Then the Additional Software upgrade service has started 0.190
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.099
After features/support/hooks.rb:450 2.328
After features/support/hooks.rb:291 1.008
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:45.251
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.199
And I start Tails from USB drive "__internal" with network unplugged 45.549
And I enable persistence 31.007
And I remove the "cowsay" deb files from the APT cache 0.771
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.080
And I log in to a new session 24.043
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.559
And I can open the Additional Software log file from the notification 1.855
And the package "cowsay" is not installed 0.184
After features/support/hooks.rb:450 0.108
After features/support/hooks.rb:291 0.624
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.008
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.296
When I log in to a new session in Arabic (ar) 28.678
Then the keyboard layout is set to "us" 0.167
When the network is plugged 0.039
And Tor is ready 16.380
Then I successfully start the Unsafe Browser in "ar" 26.700
And I kill the Unsafe Browser 5.846
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 32.859
And DuckDuckGo is the default search engine 9.281
And I kill the Tor Browser 5.389
And the screen keyboard works in Thunderbird 22.677
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.097
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.115
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.739
When I log in to a new session in Chinese (zh_CN) 28.722
Then the keyboard layout is set to "cn" 0.135
When the network is plugged 0.057
And Tor is ready 16.374
Then I successfully start the Unsafe Browser in "zh_CN" 26.459
And I kill the Unsafe Browser 5.919
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 33.405
And DuckDuckGo is the default search engine 9.564
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 27.891
And the layout of the screen keyboard is set to "us" 1.367
After features/support/hooks.rb:291 1.340
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.651
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.833
When I log in to a new session in English (en) 14.713
Then the keyboard layout is set to "us" 0.159
When the network is plugged 0.035
And Tor is ready 15.422
Then I successfully start the Unsafe Browser in "en" 29.421
And I kill the Unsafe Browser 5.888
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 32.368
And DuckDuckGo is the default search engine 5.176
And I kill the Tor Browser 5.378
And the screen keyboard works in Thunderbird 21.574
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:291 1.040
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.643
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.798
When I log in to a new session in French (fr) 28.029
Then the keyboard layout is set to "fr" 0.130
When the network is plugged 0.038
And Tor is ready 15.871
Then I successfully start the Unsafe Browser in "fr" 26.656
And I kill the Unsafe Browser 6.021
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 31.927
And DuckDuckGo is the default search engine 9.258
And I kill the Tor Browser 5.268
And the screen keyboard works in Thunderbird 20.927
And the layout of the screen keyboard is set to "fr" 0.571
After features/support/hooks.rb:291 1.182
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.488
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.249
When I log in to a new session in German (de) 35.597
Then the keyboard layout is set to "de" 0.135
When the network is plugged 0.081
And Tor is ready 15.933
Then I successfully start the Unsafe Browser in "de" 27.056
And I kill the Unsafe Browser 5.798
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 31.828
And DuckDuckGo is the default search engine 9.750
And I kill the Tor Browser 5.298
And the screen keyboard works in Thunderbird 22.055
And the layout of the screen keyboard is set to "de" 0.551
After features/support/hooks.rb:291 2.077
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.729
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.715
When I log in to a new session in Italian (it) 29.376
Then the keyboard layout is set to "it" 0.127
When the network is plugged 0.049
And Tor is ready 14.972
Then I successfully start the Unsafe Browser in "it" 24.487
And I kill the Unsafe Browser 6.334
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 34.247
And DuckDuckGo is the default search engine 9.506
And I kill the Tor Browser 5.309
And the screen keyboard works in Thunderbird 19.886
And the layout of the screen keyboard is set to "us" 0.603
After features/support/hooks.rb:291 1.125
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:8.431
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.882
When I log in to a new session in Persian (fa) 27.898
Then the keyboard layout is set to "ir" 0.142
When the network is plugged 0.046
And Tor is ready 44.748
Then I successfully start the Unsafe Browser in "fa" 27.166
And I kill the Unsafe Browser 5.863
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 33.480
And DuckDuckGo is the default search engine 9.324
And I kill the Tor Browser 5.319
And the screen keyboard works in Thunderbird 22.821
And the layout of the screen keyboard is set to "ir" 0.585
After features/support/hooks.rb:291 2.642
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.919
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.879
When I log in to a new session in Portuguese (pt) 30.300
Then the keyboard layout is set to "pt" 0.125
When the network is plugged 0.033
And Tor is ready 13.704
Then I successfully start the Unsafe Browser in "pt" 26.974
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.126
And DuckDuckGo is the default search engine 9.169
And I kill the Tor Browser 5.420
And the screen keyboard works in Thunderbird 21.608
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 3.806
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.517
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.403
When I log in to a new session in Russian (ru) 31.578
Then the keyboard layout is set to "ru" 0.286
When the network is plugged 0.036
And Tor is ready 16.355
Then I successfully start the Unsafe Browser in "ru" 28.165
And I kill the Unsafe Browser 5.942
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 34.126
And DuckDuckGo is the default search engine 9.474
And I kill the Tor Browser 5.352
And the screen keyboard works in Thunderbird 24.130
And the layout of the screen keyboard is set to "ru" 0.579
After features/support/hooks.rb:291 2.524
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.169
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.728
When I log in to a new session in Spanish (es) 30.668
Then the keyboard layout is set to "es" 0.144
When the network is plugged 0.046
And Tor is ready 16.483
Then I successfully start the Unsafe Browser in "es" 27.757
And I kill the Unsafe Browser 6.021
When I enable the screen keyboard 0.178
Then the screen keyboard works in Tor Browser 32.927
And DuckDuckGo is the default search engine 9.479
And I kill the Tor Browser 5.310
And the screen keyboard works in Thunderbird 21.839
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.245
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.837
When I log in to a new session in Turkish (tr) 29.213
Then the keyboard layout is set to "tr" 0.137
When the network is plugged 0.034
And Tor is ready 13.968
Then I successfully start the Unsafe Browser in "tr" 25.247
And I kill the Unsafe Browser 5.856
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 34.080
And DuckDuckGo is the default search engine 9.448
And I kill the Tor Browser 5.518
And the screen keyboard works in Thunderbird 22.186
And the layout of the screen keyboard is set to "us" 0.588
After features/support/hooks.rb:291 1.106
After features/support/hooks.rb:75 0.000