Project Number Date
test_Tails_ISO_stable 4662 12 Feb 2024, 14:52

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:17.171 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
16.855
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.952
And I prepare Tails for memory erasure tests 0.435
When I start a process allocating 128 MiB of memory with a known pattern 1.288
Then patterns cover at least 128 MiB in the guest's memory 3.349 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.194
Then I find very few patterns in the guest's memory 3.635 
Pattern coverage: 0.000% (0 MiB out of 1235 MiB reference memory)
After features/support/hooks.rb:291 0.692
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.795
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.826
And I prepare Tails for memory erasure tests 0.556
And I find very few patterns in the guest's memory 4.515 
Pattern coverage: 0.000% (0 MiB out of 1240 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.029
Then patterns cover at least 99% of the test FS size in the guest's memory 3.026 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.264
Then I find very few patterns in the guest's memory 3.576 
Pattern coverage: 0.000% (0 MiB out of 1240 MiB reference memory)
After features/support/hooks.rb:291 0.876
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:17.210
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.969
And I prepare Tails for memory erasure tests 0.576
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.984
Then I find very few patterns in the guest's memory 3.660 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:43.052
Then patterns cover at least 86% of the test FS size in the guest's memory 3.100 
Pattern coverage: 94.369% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.436
Then I find very few patterns in the guest's memory 3.541 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
# read cache
When I mount the USB drive again 0.335
And I read the content of the test FS 0.639
Then patterns cover at least 99% of the test FS size in the guest's memory 3.032 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.279
Then I find very few patterns in the guest's memory 3.600 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
After features/support/hooks.rb:291 0.706
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:39.310
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.175
And I prepare Tails for memory erasure tests 0.585
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.867
Then I find very few patterns in the guest's memory 3.219 
Pattern coverage: 0.000% (0 MiB out of 1245 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:46.155
Then patterns cover at least 99% of the test FS size in the guest's memory 2.684 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.613
Then I find very few patterns in the guest's memory 3.247 
Pattern coverage: 0.000% (0 MiB out of 1245 MiB reference memory)
# read cache
When I mount the USB drive again 3.312
And I read the content of the test FS 0.391
Then patterns cover at least 99% of the test FS size in the guest's memory 2.383 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.502
Then I find very few patterns in the guest's memory 3.168 
Pattern coverage: 0.000% (0 MiB out of 1245 MiB reference memory)
After features/support/hooks.rb:291 0.660
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.278
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.623
And I prepare Tails for memory erasure tests 0.534
When I fill a 128 MiB file with a known pattern on the root filesystem 14.019
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.442
Then patterns cover at least 128 MiB in the guest's memory 2.532 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.364
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.747 
Pattern coverage: 0.000% (0 MiB out of 1248 MiB reference memory)
After features/support/hooks.rb:291 3.445
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:56.666
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:12.737
And I prepare Tails for memory erasure tests 0.432
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.952
When I trigger shutdown 0.440
And I wait 20 seconds 20.003 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.099 
Pattern coverage: 0.000% (0 MiB out of 1158 MiB reference memory)
After features/support/hooks.rb:291 3.487
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:27.189
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.333
And I update APT using apt 16.756
And I install "popularity-contest" using apt 19.941
Then I am proposed to add the "popularity-contest" package to my Additional Software 55.278
When I create a persistent storage and activate the Additional Software feature 17.296
Then Additional Software is correctly configured for package "popularity-contest" 1.448
When I shutdown Tails and wait for the computer to power off 10.073
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.789
Then Additional Software is correctly configured for package "popularity-contest" 1.006
And the package "popularity-contest" is installed after Additional Software has been started 0.266
After features/support/hooks.rb:450 38.581
After features/support/hooks.rb:291 1.047
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:49.419
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.154
And I start Tails from USB drive "__internal" and I login with an administration password 1:18.850
And I update APT using apt 16.242
When I install "makepp" using apt 19.714
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 54.371
And the package "makepp" is installed 0.086
After features/support/hooks.rb:450 36.149
After features/support/hooks.rb:291 0.868
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:37.781
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:56.415
When I uninstall "popularity-contest" using apt 15.931
And I accept removing "popularity-contest" from Additional Software 0.654
Then "popularity-contest" is not in the list of Additional Software 0.762
When I start Synaptic 20.469
And I update APT using Synaptic 21.900
And I install "cowsay" using Synaptic 11.642
And I accept adding "cowsay" to Additional Software 0.884
Then Additional Software is correctly configured for package "cowsay" 1.013
When I uninstall "cowsay" using apt 3.295
And I refuse removing "cowsay" from Additional Software 0.615
Then Additional Software is correctly configured for package "cowsay" 0.941
When I start "Additional Software" via GNOME Activities Overview 12.633
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.992
Then "cowsay" is not in the list of Additional Software 0.824
When I install "cowsay" using apt 3.245
And I refuse adding "cowsay" to Additional Software 0.630
Then "cowsay" is not in the list of Additional Software 0.708
After features/support/hooks.rb:450 0.988
After features/support/hooks.rb:291 1.043
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:52.340
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.613
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:5.340
And I configure APT to prefer an old version of cowsay 0.031
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.230
And I accept adding "cowsay" to Additional Software 1:5.745
And Additional Software is correctly configured for package "cowsay" 1.380
And I shutdown Tails and wait for the computer to power off 5.077
And I start Tails from USB drive "__internal" with network unplugged 45.426
And I enable persistence 32.267
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 27.594
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.405
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.101
And the network is plugged 0.036
And Tor is ready 15.982
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.597
And available upgrades have been checked 0.090
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.480
And I can open the Additional Software configuration window from the notification 2.892
And I shutdown Tails and wait for the computer to power off 2:2.840
And I start Tails from USB drive "__internal" with network unplugged 45.300
And I enable persistence 31.876
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 23.390
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.294
And I revert the APT tweaks that made it prefer an old version of cowsay 0.051
And the network is plugged 0.044
And Tor is ready 48.810
Then the Additional Software upgrade service has started 0.185
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.147
After features/support/hooks.rb:450 2.447
After features/support/hooks.rb:291 1.457
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.674
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.168
And I start Tails from USB drive "__internal" with network unplugged 45.600
And I enable persistence 31.476
And I remove the "cowsay" deb files from the APT cache 0.720
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.092
And I log in to a new session 26.897
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.385
And I can open the Additional Software log file from the notification 2.192
And the package "cowsay" is not installed 0.141
After features/support/hooks.rb:450 0.102
After features/support/hooks.rb:291 0.813
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.797
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.894
When I log in to a new session in Arabic (ar) 28.373
Then the keyboard layout is set to "us" 0.144
When the network is plugged 0.025
And Tor is ready 14.165
Then I successfully start the Unsafe Browser in "ar" 27.357
And I kill the Unsafe Browser 6.006
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 33.539
And DuckDuckGo is the default search engine 11.539
And I kill the Tor Browser 5.606
And the screen keyboard works in Thunderbird 21.458
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 1.265
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.556
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.873
When I log in to a new session in Chinese (zh_CN) 27.694
Then the keyboard layout is set to "cn" 0.206
When the network is plugged 0.033
And Tor is ready 14.093
Then I successfully start the Unsafe Browser in "zh_CN" 26.206
And I kill the Unsafe Browser 5.911
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 32.809
And DuckDuckGo is the default search engine 10.492
And I kill the Tor Browser 5.541
And the screen keyboard works in Thunderbird 25.973
And the layout of the screen keyboard is set to "us" 0.605
After features/support/hooks.rb:291 1.123
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.601
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.740
When I log in to a new session in English (en) 15.027
Then the keyboard layout is set to "us" 0.256
When the network is plugged 0.027
And Tor is ready 15.698
Then I successfully start the Unsafe Browser in "en" 26.614
And I kill the Unsafe Browser 5.783
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 33.397
And DuckDuckGo is the default search engine 5.184
And I kill the Tor Browser 5.339
And the screen keyboard works in Thunderbird 20.821
And the layout of the screen keyboard is set to "us" 0.615
After features/support/hooks.rb:291 1.307
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.508
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.888
When I log in to a new session in French (fr) 29.032
Then the keyboard layout is set to "fr" 0.187
When the network is plugged 0.026
And Tor is ready 14.964
Then I successfully start the Unsafe Browser in "fr" 28.758
And I kill the Unsafe Browser 7.612
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 36.545
And DuckDuckGo is the default search engine 10.706
And I kill the Tor Browser 5.665
And the screen keyboard works in Thunderbird 22.352
And the layout of the screen keyboard is set to "fr" 0.623
After features/support/hooks.rb:291 1.280
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.668
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.259
When I log in to a new session in German (de) 28.366
Then the keyboard layout is set to "de" 0.162
When the network is plugged 0.024
And Tor is ready 15.865
Then I successfully start the Unsafe Browser in "de" 30.619
And I kill the Unsafe Browser 6.132
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 33.032
And DuckDuckGo is the default search engine 10.814
And I kill the Tor Browser 5.672
And the screen keyboard works in Thunderbird 21.948
And the layout of the screen keyboard is set to "de" 0.632
After features/support/hooks.rb:291 2.297
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.140
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.849
When I log in to a new session in Italian (it) 30.224
Then the keyboard layout is set to "it" 0.152
When the network is plugged 0.026
And Tor is ready 16.678
Then I successfully start the Unsafe Browser in "it" 27.717
And I kill the Unsafe Browser 5.790
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 31.750
And DuckDuckGo is the default search engine 10.492
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 23.202
And the layout of the screen keyboard is set to "us" 0.596
After features/support/hooks.rb:291 1.121
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.096
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.749
When I log in to a new session in Persian (fa) 28.098
Then the keyboard layout is set to "ir" 0.234
When the network is plugged 0.020
And Tor is ready 14.991
Then I successfully start the Unsafe Browser in "fa" 28.223
And I kill the Unsafe Browser 5.887
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 33.667
And DuckDuckGo is the default search engine 10.767
And I kill the Tor Browser 5.564
And the screen keyboard works in Thunderbird 23.166
And the layout of the screen keyboard is set to "ir" 0.572
After features/support/hooks.rb:291 1.173
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.548
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.872
When I log in to a new session in Portuguese (pt) 28.315
Then the keyboard layout is set to "pt" 0.129
When the network is plugged 0.023
And Tor is ready 14.438
Then I successfully start the Unsafe Browser in "pt" 25.948
And I kill the Unsafe Browser 6.686
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 32.936
And DuckDuckGo is the default search engine 10.816
And I kill the Tor Browser 5.419
And the screen keyboard works in Thunderbird 22.244
And the layout of the screen keyboard is set to "us" 0.598
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.594
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.950
When I log in to a new session in Russian (ru) 28.465
Then the keyboard layout is set to "ru" 0.160
When the network is plugged 0.049
And Tor is ready 14.357
Then I successfully start the Unsafe Browser in "ru" 27.880
And I kill the Unsafe Browser 6.116
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 33.737
And DuckDuckGo is the default search engine 10.938
And I kill the Tor Browser 5.554
And the screen keyboard works in Thunderbird 23.648
And the layout of the screen keyboard is set to "ru" 0.585
After features/support/hooks.rb:291 2.521
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.514
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.736
When I log in to a new session in Spanish (es) 27.998
Then the keyboard layout is set to "es" 0.164
When the network is plugged 0.027
And Tor is ready 14.019
Then I successfully start the Unsafe Browser in "es" 26.320
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 32.196
And DuckDuckGo is the default search engine 10.640
And I kill the Tor Browser 5.668
And the screen keyboard works in Thunderbird 21.108
And the layout of the screen keyboard is set to "us" 0.627
After features/support/hooks.rb:291 2.067
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.624
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.352
When I log in to a new session in Turkish (tr) 28.025
Then the keyboard layout is set to "tr" 0.210
When the network is plugged 0.033
And Tor is ready 15.549
Then I successfully start the Unsafe Browser in "tr" 27.135
And I kill the Unsafe Browser 7.208
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 32.839
And DuckDuckGo is the default search engine 11.058
And I kill the Tor Browser 5.517
And the screen keyboard works in Thunderbird 19.941
And the layout of the screen keyboard is set to "us" 0.625
After features/support/hooks.rb:291 1.516
After features/support/hooks.rb:75 0.000