Project Number Date
test_Tails_ISO_stable 4688 29 Feb 2024, 17:26

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 59:1.076 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.724
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.019
And I prepare Tails for memory erasure tests 0.422
When I start a process allocating 128 MiB of memory with a known pattern 1.136
Then patterns cover at least 128 MiB in the guest's memory 3.511 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.801
Then I find very few patterns in the guest's memory 3.831 
Pattern coverage: 0.000% (0 MiB out of 929 MiB reference memory)
After features/support/hooks.rb:291 0.787
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.754
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.874
And I prepare Tails for memory erasure tests 0.342
And I find very few patterns in the guest's memory 4.027 
Pattern coverage: 0.000% (0 MiB out of 928 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.335
Then patterns cover at least 99% of the test FS size in the guest's memory 3.137 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.328
Then I find very few patterns in the guest's memory 3.707 
Pattern coverage: 0.000% (0 MiB out of 928 MiB reference memory)
After features/support/hooks.rb:291 0.775
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
37.062
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.961
And I prepare Tails for memory erasure tests 0.388
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.704
Then I find very few patterns in the guest's memory 3.444 
Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.158
Then patterns cover at least 86% of the test FS size in the guest's memory 3.397 
Pattern coverage: 98.283% (125 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.011
Then I find very few patterns in the guest's memory 3.747 
Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)
# read cache
When I mount the USB drive again 0.186
And I read the content of the test FS 0.488
Then patterns cover at least 99% of the test FS size in the guest's memory 3.356 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.526
Then I find very few patterns in the guest's memory 3.690 
Pattern coverage: 0.000% (0 MiB out of 910 MiB reference memory)
After features/support/hooks.rb:291 0.809
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.016
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.957
And I prepare Tails for memory erasure tests 0.396
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 31.900
Then I find very few patterns in the guest's memory 3.448 
Pattern coverage: 0.000% (0 MiB out of 925 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.511
Then patterns cover at least 99% of the test FS size in the guest's memory 2.690 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.723
Then I find very few patterns in the guest's memory 3.191 
Pattern coverage: 0.000% (0 MiB out of 925 MiB reference memory)
# read cache
When I mount the USB drive again 3.948
And I read the content of the test FS 0.389
Then patterns cover at least 99% of the test FS size in the guest's memory 2.777 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.472
Then I find very few patterns in the guest's memory 3.606 
Pattern coverage: 0.000% (0 MiB out of 925 MiB reference memory)
After features/support/hooks.rb:291 0.685
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.350
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.288
And I prepare Tails for memory erasure tests 0.397
When I fill a 128 MiB file with a known pattern on the root filesystem 12.987
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.358
Then patterns cover at least 128 MiB in the guest's memory 2.562 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.720 
Pattern coverage: 0.000% (0 MiB out of 932 MiB reference memory)
After features/support/hooks.rb:291 3.476
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:23.801
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:36.462
And I prepare Tails for memory erasure tests 0.372
When I fill a 128 MiB file with a known pattern on the persistent filesystem 24.818
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.117 
Pattern coverage: 0.000% (0 MiB out of 936 MiB reference memory)
After features/support/hooks.rb:291 3.508
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:41.886
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 47.431
And I update APT using apt 17.993
And I install "popularity-contest" using apt 19.180
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.736
When I create a persistent storage and activate the Additional Software feature 16.987
Then Additional Software is correctly configured for package "popularity-contest" 2.336
When I shutdown Tails and wait for the computer to power off 12.045
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:38.084
Then Additional Software is correctly configured for package "popularity-contest" 0.840
And the package "popularity-contest" is installed after Additional Software has been started 0.250
After features/support/hooks.rb:450 40.399
After features/support/hooks.rb:291 1.387
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:7.230
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.221
And I start Tails from USB drive "__internal" and I login with an administration password 1:26.663
And I update APT using apt 16.816
When I install "makepp" using apt 19.133
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.323
And the package "makepp" is installed 0.071
After features/support/hooks.rb:450 38.601
After features/support/hooks.rb:291 0.994
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:45.729
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.164
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:6.882
When I uninstall "popularity-contest" using apt 18.766
And I accept removing "popularity-contest" from Additional Software 0.539
Then "popularity-contest" is not in the list of Additional Software 0.684
When I start Synaptic 23.039
And I update APT using Synaptic 22.057
And I install "cowsay" using Synaptic 8.207
And I accept adding "cowsay" to Additional Software 1.113
Then Additional Software is correctly configured for package "cowsay" 0.769
When I uninstall "cowsay" using apt 3.181
And I refuse removing "cowsay" from Additional Software 0.501
Then Additional Software is correctly configured for package "cowsay" 0.709
When I start "Additional Software" via GNOME Activities Overview 9.763
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.123
Then "cowsay" is not in the list of Additional Software 0.923
When I install "cowsay" using apt 3.190
And I refuse adding "cowsay" to Additional Software 0.493
Then "cowsay" is not in the list of Additional Software 0.618
After features/support/hooks.rb:450 0.963
After features/support/hooks.rb:291 0.665
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:53.650
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.155
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:20.582
And I configure APT to prefer an old version of cowsay 0.020
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 22.792
And I accept adding "cowsay" to Additional Software 5.730
And Additional Software is correctly configured for package "cowsay" 0.813
And I shutdown Tails and wait for the computer to power off 6.042
And I start Tails from USB drive "__internal" with network unplugged 52.438
And I enable persistence 29.224
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 34.418
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.017
And I revert the APT tweaks that made it prefer an old version of cowsay 0.050
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.054
And the network is plugged 0.039
And Tor is ready 45.037
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.857
And available upgrades have been checked 0.175
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.209
And I can open the Additional Software configuration window from the notification 3.349
And I shutdown Tails and wait for the computer to power off 18.069
And I start Tails from USB drive "__internal" with network unplugged 52.221
And I enable persistence 32.059
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 32.087
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.426
And I revert the APT tweaks that made it prefer an old version of cowsay 0.068
And the network is plugged 0.033
And Tor is ready 48.394
Then the Additional Software upgrade service has started 0.162
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.068
After features/support/hooks.rb:450 2.216
After features/support/hooks.rb:291 0.805
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:15.244
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.155
And I start Tails from USB drive "__internal" with network unplugged 52.934
And I enable persistence 31.311
And I remove the "cowsay" deb files from the APT cache 0.620
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.071
And I log in to a new session 31.229
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.325
And I can open the Additional Software log file from the notification 5.003
And the package "cowsay" is not installed 0.592
After features/support/hooks.rb:450 0.110
After features/support/hooks.rb:291 0.910
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.815
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.027
When I log in to a new session in Arabic (ar) 30.427
Then the keyboard layout is set to "us" 0.141
When the network is plugged 0.040
And Tor is ready 13.138
Then I successfully start the Unsafe Browser in "ar" 13.476
And I kill the Unsafe Browser 5.790
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 32.944
And DuckDuckGo is the default search engine 11.184
And I kill the Tor Browser 5.451
And the screen keyboard works in Thunderbird 20.498
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:291 1.018
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.221
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.001
When I log in to a new session in Chinese (zh_CN) 28.733
Then the keyboard layout is set to "cn" 0.149
When the network is plugged 0.108
And Tor is ready 19.626
Then I successfully start the Unsafe Browser in "zh_CN" 14.159
And I kill the Unsafe Browser 5.687
When I enable the screen keyboard 0.160
Then the screen keyboard works in Tor Browser 35.883
And DuckDuckGo is the default search engine 10.479
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 24.078
And the layout of the screen keyboard is set to "us" 0.630
After features/support/hooks.rb:291 1.883
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:58.713
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.180
When I log in to a new session in English (en) 14.475
Then the keyboard layout is set to "us" 0.203
When the network is plugged 0.036
And Tor is ready 14.227
Then I successfully start the Unsafe Browser in "en" 13.007
And I kill the Unsafe Browser 5.943
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 31.684
And DuckDuckGo is the default search engine 5.119
And I kill the Tor Browser 5.215
And the screen keyboard works in Thunderbird 19.906
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:291 1.201
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.666
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.837
When I log in to a new session in French (fr) 28.538
Then the keyboard layout is set to "fr" 0.178
When the network is plugged 0.040
And Tor is ready 14.173
Then I successfully start the Unsafe Browser in "fr" 13.132
And I kill the Unsafe Browser 5.788
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 31.484
And DuckDuckGo is the default search engine 10.571
And I kill the Tor Browser 5.486
And the screen keyboard works in Thunderbird 19.737
And the layout of the screen keyboard is set to "fr" 0.607
After features/support/hooks.rb:291 0.879
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.235
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.894
When I log in to a new session in German (de) 28.272
Then the keyboard layout is set to "de" 0.137
When the network is plugged 0.034
And Tor is ready 13.399
Then I successfully start the Unsafe Browser in "de" 12.749
And I kill the Unsafe Browser 5.736
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 31.691
And DuckDuckGo is the default search engine 10.659
And I kill the Tor Browser 5.456
And the screen keyboard works in Thunderbird 20.560
And the layout of the screen keyboard is set to "de" 0.545
After features/support/hooks.rb:291 0.837
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.855
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.900
When I log in to a new session in Italian (it) 28.770
Then the keyboard layout is set to "it" 0.120
When the network is plugged 0.095
And Tor is ready 13.215
Then I successfully start the Unsafe Browser in "it" 14.033
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 33.200
And DuckDuckGo is the default search engine 10.539
And I kill the Tor Browser 5.452
And the screen keyboard works in Thunderbird 21.040
And the layout of the screen keyboard is set to "us" 0.615
After features/support/hooks.rb:291 1.146
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.206
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.848
When I log in to a new session in Persian (fa) 31.014
Then the keyboard layout is set to "ir" 0.135
When the network is plugged 0.050
And Tor is ready 15.527
Then I successfully start the Unsafe Browser in "fa" 13.389
And I kill the Unsafe Browser 5.818
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 33.856
And DuckDuckGo is the default search engine 9.963
And I kill the Tor Browser 5.276
And the screen keyboard works in Thunderbird 20.687
And the layout of the screen keyboard is set to "ir" 0.551
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.818
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.087
When I log in to a new session in Portuguese (pt) 28.818
Then the keyboard layout is set to "pt" 0.230
When the network is plugged 0.045
And Tor is ready 14.639
Then I successfully start the Unsafe Browser in "pt" 13.149
And I kill the Unsafe Browser 5.822
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 33.309
And DuckDuckGo is the default search engine 10.780
And I kill the Tor Browser 5.385
And the screen keyboard works in Thunderbird 19.823
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:291 1.067
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.061
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.042
When I log in to a new session in Russian (ru) 29.774
Then the keyboard layout is set to "ru" 0.271
When the network is plugged 0.036
And Tor is ready 14.812
Then I successfully start the Unsafe Browser in "ru" 12.886
And I kill the Unsafe Browser 5.810
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 34.153
And DuckDuckGo is the default search engine 10.430
And I kill the Tor Browser 5.546
And the screen keyboard works in Thunderbird 21.608
And the layout of the screen keyboard is set to "ru" 0.598
After features/support/hooks.rb:291 1.041
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.762
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.507
When I log in to a new session in Spanish (es) 30.580
Then the keyboard layout is set to "es" 0.135
When the network is plugged 0.046
And Tor is ready 15.863
Then I successfully start the Unsafe Browser in "es" 14.699
And I kill the Unsafe Browser 5.727
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 34.032
And DuckDuckGo is the default search engine 9.744
And I kill the Tor Browser 5.347
And the screen keyboard works in Thunderbird 20.382
And the layout of the screen keyboard is set to "us" 0.602
After features/support/hooks.rb:291 1.085
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.269
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.436
When I log in to a new session in Turkish (tr) 30.290
Then the keyboard layout is set to "tr" 0.212
When the network is plugged 0.080
And Tor is ready 13.513
Then I successfully start the Unsafe Browser in "tr" 13.747
And I kill the Unsafe Browser 5.791
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 32.433
And DuckDuckGo is the default search engine 10.363
And I kill the Tor Browser 5.432
And the screen keyboard works in Thunderbird 21.248
And the layout of the screen keyboard is set to "us" 0.626
After features/support/hooks.rb:291 1.202
After features/support/hooks.rb:75 0.000