Project Number Date
test_Tails_ISO_stable 4679 23 Feb 2024, 12:08

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:38.709 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.286
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.529
And I prepare Tails for memory erasure tests 0.515
When I start a process allocating 128 MiB of memory with a known pattern 2.302
Then patterns cover at least 128 MiB in the guest's memory 3.739 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.243
Then I find very few patterns in the guest's memory 3.956 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 0.688
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.946
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.774
And I prepare Tails for memory erasure tests 0.674
And I find very few patterns in the guest's memory 4.674 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.010
Then patterns cover at least 99% of the test FS size in the guest's memory 3.278 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.225
Then I find very few patterns in the guest's memory 4.309 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 0.802
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:48.200
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.728
And I prepare Tails for memory erasure tests 0.668
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.027
Then I find very few patterns in the guest's memory 4.257 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3:12.862
Then patterns cover at least 86% of the test FS size in the guest's memory 3.082 
Pattern coverage: 96.745% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.424
Then I find very few patterns in the guest's memory 3.832 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# read cache
When I mount the USB drive again 0.197
And I read the content of the test FS 0.536
Then patterns cover at least 99% of the test FS size in the guest's memory 3.242 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.290
Then I find very few patterns in the guest's memory 4.048 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 0.812
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:48.664
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.653
And I prepare Tails for memory erasure tests 0.614
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 20.728
Then I find very few patterns in the guest's memory 3.697 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:58.970
Then patterns cover at least 99% of the test FS size in the guest's memory 2.845 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.639
Then I find very few patterns in the guest's memory 3.330 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
# read cache
When I mount the USB drive again 2.844
And I read the content of the test FS 0.450
Then patterns cover at least 99% of the test FS size in the guest's memory 2.874 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.446
Then I find very few patterns in the guest's memory 3.568 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:291 0.753
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.491
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.440
And I prepare Tails for memory erasure tests 0.688
When I fill a 128 MiB file with a known pattern on the root filesystem 16.382
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.439
Then patterns cover at least 128 MiB in the guest's memory 2.758 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.992
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.776 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 3.412
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:47.781
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:4.677
And I prepare Tails for memory erasure tests 0.434
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.271
When I trigger shutdown 0.191
And I wait 20 seconds 20.006 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.199 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
After features/support/hooks.rb:291 3.474
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:20.546
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.013
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.559
And I update APT using apt 15.764
And I install "popularity-contest" using apt 19.720
Then I am proposed to add the "popularity-contest" package to my Additional Software 54.903
When I create a persistent storage and activate the Additional Software feature 18.166
Then Additional Software is correctly configured for package "popularity-contest" 1.494
When I shutdown Tails and wait for the computer to power off 10.181
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:29.567
Then Additional Software is correctly configured for package "popularity-contest" 0.880
And the package "popularity-contest" is installed after Additional Software has been started 0.308
After features/support/hooks.rb:450 35.417
After features/support/hooks.rb:291 1.002
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:47.693
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.156
And I start Tails from USB drive "__internal" and I login with an administration password 1:20.029
And I update APT using apt 15.604
When I install "makepp" using apt 19.507
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 52.326
And the package "makepp" is installed 0.069
After features/support/hooks.rb:450 39.336
After features/support/hooks.rb:291 0.874
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:54.809
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.154
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:8.670
When I uninstall "popularity-contest" using apt 18.966
And I accept removing "popularity-contest" from Additional Software 0.603
Then "popularity-contest" is not in the list of Additional Software 0.902
When I start Synaptic 23.730
And I update APT using Synaptic 22.006
And I install "cowsay" using Synaptic 9.254
And I accept adding "cowsay" to Additional Software 0.837
Then Additional Software is correctly configured for package "cowsay" 0.875
When I uninstall "cowsay" using apt 3.362
And I refuse removing "cowsay" from Additional Software 0.700
Then Additional Software is correctly configured for package "cowsay" 0.997
When I start "Additional Software" via GNOME Activities Overview 12.654
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.133
Then "cowsay" is not in the list of Additional Software 1.133
When I install "cowsay" using apt 3.317
And I refuse adding "cowsay" to Additional Software 0.754
Then "cowsay" is not in the list of Additional Software 0.752
After features/support/hooks.rb:450 1.387
After features/support/hooks.rb:291 0.750
After features/support/hooks.rb:75 0.037
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:57.752
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.175
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:57.008
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.038
And I accept adding "cowsay" to Additional Software 1:1.772
And Additional Software is correctly configured for package "cowsay" 1.373
And I shutdown Tails and wait for the computer to power off 6.088
And I start Tails from USB drive "__internal" with network unplugged 45.453
And I enable persistence 31.588
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 23.586
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.480
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.094
And the network is plugged 0.074
And Tor is ready 46.778
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 10.057
And available upgrades have been checked 0.542
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.174
And I can open the Additional Software configuration window from the notification 2.713
And I shutdown Tails and wait for the computer to power off 2:2.703
And I start Tails from USB drive "__internal" with network unplugged 46.478
And I enable persistence 31.417
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 24.616
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.839
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
And the network is plugged 0.033
And Tor is ready 36.211
Then the Additional Software upgrade service has started 0.186
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.103
After features/support/hooks.rb:450 2.399
After features/support/hooks.rb:291 0.825
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:43.530
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.164
And I start Tails from USB drive "__internal" with network unplugged 44.901
And I enable persistence 31.322
And I remove the "cowsay" deb files from the APT cache 0.739
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.098
And I log in to a new session 19.558
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.866
And I can open the Additional Software log file from the notification 2.699
And the package "cowsay" is not installed 0.178
After features/support/hooks.rb:450 0.117
After features/support/hooks.rb:291 0.818
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.304
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.772
When I log in to a new session in Arabic (ar) 28.472
Then the keyboard layout is set to "us" 0.153
When the network is plugged 0.042
And Tor is ready 14.923
Then I successfully start the Unsafe Browser in "ar" 27.808
And I kill the Unsafe Browser 5.846
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 32.350
And DuckDuckGo is the default search engine 9.974
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 22.900
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.280
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.103
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.752
When I log in to a new session in Chinese (zh_CN) 28.994
Then the keyboard layout is set to "cn" 0.133
When the network is plugged 0.040
And Tor is ready 15.035
Then I successfully start the Unsafe Browser in "zh_CN" 25.669
And I kill the Unsafe Browser 6.276
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 32.778
And DuckDuckGo is the default search engine 9.864
And I kill the Tor Browser 5.298
And the screen keyboard works in Thunderbird 22.571
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.111
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.768
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.756
When I log in to a new session in English (en) 18.137
Then the keyboard layout is set to "us" 0.200
When the network is plugged 0.027
And Tor is ready 43.052
Then I successfully start the Unsafe Browser in "en" 26.142
And I kill the Unsafe Browser 6.093
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 30.578
And DuckDuckGo is the default search engine 5.646
And I kill the Tor Browser 5.346
And the screen keyboard works in Thunderbird 21.082
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 0.977
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.384
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.996
When I log in to a new session in French (fr) 28.510
Then the keyboard layout is set to "fr" 0.226
When the network is plugged 0.039
And Tor is ready 16.817
Then I successfully start the Unsafe Browser in "fr" 26.755
And I kill the Unsafe Browser 5.787
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 31.725
And DuckDuckGo is the default search engine 10.252
And I kill the Tor Browser 5.297
And the screen keyboard works in Thunderbird 21.324
And the layout of the screen keyboard is set to "fr" 0.554
After features/support/hooks.rb:291 1.932
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.120
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.628
When I log in to a new session in German (de) 29.151
Then the keyboard layout is set to "de" 0.149
When the network is plugged 0.038
And Tor is ready 43.806
Then I successfully start the Unsafe Browser in "de" 26.184
And I kill the Unsafe Browser 6.038
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 31.278
And DuckDuckGo is the default search engine 10.325
And I kill the Tor Browser 5.505
And the screen keyboard works in Thunderbird 23.314
And the layout of the screen keyboard is set to "de" 0.580
After features/support/hooks.rb:291 1.470
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.937
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.928
When I log in to a new session in Italian (it) 30.295
Then the keyboard layout is set to "it" 0.185
When the network is plugged 0.029
And Tor is ready 15.033
Then I successfully start the Unsafe Browser in "it" 25.165
And I kill the Unsafe Browser 6.001
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 30.840
And DuckDuckGo is the default search engine 9.994
And I kill the Tor Browser 5.259
And the screen keyboard works in Thunderbird 21.527
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:291 1.122
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.351
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.824
When I log in to a new session in Persian (fa) 28.873
Then the keyboard layout is set to "ir" 0.199
When the network is plugged 0.038
And Tor is ready 13.942
Then I successfully start the Unsafe Browser in "fa" 27.009
And I kill the Unsafe Browser 6.540
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 33.180
And DuckDuckGo is the default search engine 10.223
And I kill the Tor Browser 5.307
And the screen keyboard works in Thunderbird 24.564
And the layout of the screen keyboard is set to "ir" 0.538
After features/support/hooks.rb:291 1.216
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.716
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.704
When I log in to a new session in Portuguese (pt) 30.939
Then the keyboard layout is set to "pt" 0.162
When the network is plugged 0.023
And Tor is ready 17.431
Then I successfully start the Unsafe Browser in "pt" 28.656
And I kill the Unsafe Browser 6.238
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 32.246
And DuckDuckGo is the default search engine 10.494
And I kill the Tor Browser 5.590
And the screen keyboard works in Thunderbird 21.548
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 1.210
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.484
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.755
When I log in to a new session in Russian (ru) 28.791
Then the keyboard layout is set to "ru" 0.160
When the network is plugged 0.049
And Tor is ready 14.576
Then I successfully start the Unsafe Browser in "ru" 26.853
And I kill the Unsafe Browser 6.034
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 32.320
And DuckDuckGo is the default search engine 10.160
And I kill the Tor Browser 5.571
And the screen keyboard works in Thunderbird 22.496
And the layout of the screen keyboard is set to "ru" 0.581
After features/support/hooks.rb:291 3.248
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.920
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.705
When I log in to a new session in Spanish (es) 28.467
Then the keyboard layout is set to "es" 0.167
When the network is plugged 0.034
And Tor is ready 14.806
Then I successfully start the Unsafe Browser in "es" 26.344
And I kill the Unsafe Browser 5.861
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 31.789
And DuckDuckGo is the default search engine 10.598
And I kill the Tor Browser 5.672
And the screen keyboard works in Thunderbird 21.789
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:291 0.999
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.913
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.678
When I log in to a new session in Turkish (tr) 30.018
Then the keyboard layout is set to "tr" 0.134
When the network is plugged 0.028
And Tor is ready 14.064
Then I successfully start the Unsafe Browser in "tr" 28.043
And I kill the Unsafe Browser 6.245
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 31.335
And DuckDuckGo is the default search engine 18.755
And I kill the Tor Browser 5.458
And the screen keyboard works in Thunderbird 20.491
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.143
After features/support/hooks.rb:75 0.000