Project Number Date
test_Tails_ISO_stable 4675 20 Feb 2024, 12:19

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:52.467 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.296
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.841
And I prepare Tails for memory erasure tests 0.470
When I start a process allocating 128 MiB of memory with a known pattern 2.299
Then patterns cover at least 128 MiB in the guest's memory 4.305 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.360
Then I find very few patterns in the guest's memory 4.018 
Pattern coverage: 0.000% (0 MiB out of 1233 MiB reference memory)
After features/support/hooks.rb:291 0.656
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.949
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.876
And I prepare Tails for memory erasure tests 0.507
And I find very few patterns in the guest's memory 4.377 
Pattern coverage: 0.000% (0 MiB out of 1225 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.122
Then patterns cover at least 99% of the test FS size in the guest's memory 4.197 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.381
Then I find very few patterns in the guest's memory 4.486 
Pattern coverage: 0.000% (0 MiB out of 1225 MiB reference memory)
After features/support/hooks.rb:291 0.744
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:6.176
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.737
And I prepare Tails for memory erasure tests 0.476
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.925
Then I find very few patterns in the guest's memory 4.536 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:28.950
Then patterns cover at least 86% of the test FS size in the guest's memory 3.294 
Pattern coverage: 95.024% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.449
Then I find very few patterns in the guest's memory 3.977 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
# read cache
When I mount the USB drive again 0.263
And I read the content of the test FS 0.601
Then patterns cover at least 99% of the test FS size in the guest's memory 4.774 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.472
Then I find very few patterns in the guest's memory 3.715 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
After features/support/hooks.rb:291 0.852
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:18.714
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.769
And I prepare Tails for memory erasure tests 0.533
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.539
Then I find very few patterns in the guest's memory 3.367 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:26.479
Then patterns cover at least 99% of the test FS size in the guest's memory 2.846 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.631
Then I find very few patterns in the guest's memory 3.420 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 3.105
And I read the content of the test FS 0.408
Then patterns cover at least 99% of the test FS size in the guest's memory 2.448 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.778
Then I find very few patterns in the guest's memory 3.384 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 2.033
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.757
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.739
And I prepare Tails for memory erasure tests 0.491
When I fill a 128 MiB file with a known pattern on the root filesystem 13.024
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.528
Then patterns cover at least 128 MiB in the guest's memory 3.400 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.612
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.940 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
After features/support/hooks.rb:291 3.490
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:23.044
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:38.702
And I prepare Tails for memory erasure tests 0.528
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.627
When I trigger shutdown 0.886
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.279 
Pattern coverage: 0.000% (0 MiB out of 1183 MiB reference memory)
After features/support/hooks.rb:291 3.470
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:34.628
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.022
And I update APT using apt 17.063
And I install "popularity-contest" using apt 19.709
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.420
When I create a persistent storage and activate the Additional Software feature 17.882
Then Additional Software is correctly configured for package "popularity-contest" 1.494
When I shutdown Tails and wait for the computer to power off 11.087
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:35.581
Then Additional Software is correctly configured for package "popularity-contest" 0.953
And the package "popularity-contest" is installed after Additional Software has been started 0.412
After features/support/hooks.rb:450 37.610
After features/support/hooks.rb:291 1.168
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:0.717
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.207
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.074
And I update APT using apt 15.856
When I install "makepp" using apt 19.849
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:1.636
And the package "makepp" is installed 0.094
After features/support/hooks.rb:450 39.315
After features/support/hooks.rb:291 0.891
After features/support/hooks.rb:75 0.033
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:30.910
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.187
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:44.340
When I uninstall "popularity-contest" using apt 19.039
And I accept removing "popularity-contest" from Additional Software 0.772
Then "popularity-contest" is not in the list of Additional Software 0.829
When I start Synaptic 23.944
And I update APT using Synaptic 22.037
And I install "cowsay" using Synaptic 8.943
And I accept adding "cowsay" to Additional Software 0.840
Then Additional Software is correctly configured for package "cowsay" 0.998
When I uninstall "cowsay" using apt 3.419
And I refuse removing "cowsay" from Additional Software 0.643
Then Additional Software is correctly configured for package "cowsay" 1.077
When I start "Additional Software" via GNOME Activities Overview 13.039
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.931
Then "cowsay" is not in the list of Additional Software 1.089
When I install "cowsay" using apt 3.362
And I refuse adding "cowsay" to Additional Software 0.638
Then "cowsay" is not in the list of Additional Software 0.774
After features/support/hooks.rb:450 1.148
After features/support/hooks.rb:291 0.814
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:36.648
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.011
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:9.357
And I configure APT to prefer an old version of cowsay 0.029
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.294
And I accept adding "cowsay" to Additional Software 1:9.244
And Additional Software is correctly configured for package "cowsay" 1.215
And I shutdown Tails and wait for the computer to power off 6.067
And I start Tails from USB drive "__internal" with network unplugged 46.954
And I enable persistence 32.362
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 25.041
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.673
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.076
And the network is plugged 0.052
And Tor is ready 18.905
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.213
And available upgrades have been checked 0.117
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.137
And I can open the Additional Software configuration window from the notification 3.211
And I shutdown Tails and wait for the computer to power off 2:2.580
And I start Tails from USB drive "__internal" with network unplugged 47.084
And I enable persistence 38.782
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.029
And I log in to a new session 25.460
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.132
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
And the network is plugged 0.049
And Tor is ready 50.903
Then the Additional Software upgrade service has started 0.208
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.116
After features/support/hooks.rb:450 2.426
After features/support/hooks.rb:291 0.969
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.456
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.218
And I start Tails from USB drive "__internal" with network unplugged 47.179
And I enable persistence 30.944
And I remove the "cowsay" deb files from the APT cache 0.698
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.089
And I log in to a new session 23.176
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.683
And I can open the Additional Software log file from the notification 3.295
And the package "cowsay" is not installed 0.170
After features/support/hooks.rb:450 0.108
After features/support/hooks.rb:291 0.805
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.214
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.239
When I log in to a new session in Arabic (ar) 27.986
Then the keyboard layout is set to "us" 0.186
When the network is plugged 0.039
And Tor is ready 15.254
Then I successfully start the Unsafe Browser in "ar" 27.435
And I kill the Unsafe Browser 5.743
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 34.409
And DuckDuckGo is the default search engine 10.566
And I kill the Tor Browser 5.511
And the screen keyboard works in Thunderbird 22.134
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 1.067
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.324
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.114
When I log in to a new session in Chinese (zh_CN) 30.030
Then the keyboard layout is set to "cn" 0.153
When the network is plugged 0.049
And Tor is ready 14.934
Then I successfully start the Unsafe Browser in "zh_CN" 28.010
And I kill the Unsafe Browser 5.725
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 34.186
And DuckDuckGo is the default search engine 10.490
And I kill the Tor Browser 5.557
And the screen keyboard works in Thunderbird 28.242
And the layout of the screen keyboard is set to "us" 0.681
After features/support/hooks.rb:291 1.439
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.444
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.116
When I log in to a new session in English (en) 18.715
Then the keyboard layout is set to "us" 0.289
When the network is plugged 0.065
And Tor is ready 15.035
Then I successfully start the Unsafe Browser in "en" 26.688
And I kill the Unsafe Browser 5.875
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 33.740
And DuckDuckGo is the default search engine 6.165
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 22.695
And the layout of the screen keyboard is set to "us" 0.579
After features/support/hooks.rb:291 1.094
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.684
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.223
When I log in to a new session in French (fr) 29.632
Then the keyboard layout is set to "fr" 0.145
When the network is plugged 0.050
And Tor is ready 16.848
Then I successfully start the Unsafe Browser in "fr" 28.575
And I kill the Unsafe Browser 6.336
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 34.797
And DuckDuckGo is the default search engine 11.488
And I kill the Tor Browser 5.576
And the screen keyboard works in Thunderbird 23.255
And the layout of the screen keyboard is set to "fr" 0.631
After features/support/hooks.rb:291 1.341
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.350
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.118
When I log in to a new session in German (de) 32.243
Then the keyboard layout is set to "de" 0.314
When the network is plugged 0.038
And Tor is ready 15.035
Then I successfully start the Unsafe Browser in "de" 29.212
And I kill the Unsafe Browser 5.841
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 34.447
And DuckDuckGo is the default search engine 10.921
And I kill the Tor Browser 5.671
And the screen keyboard works in Thunderbird 23.685
And the layout of the screen keyboard is set to "de" 0.707
After features/support/hooks.rb:291 1.501
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.762
Before features/support/hooks.rb:245 0.023
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.903
When I log in to a new session in Italian (it) 30.312
Then the keyboard layout is set to "it" 0.242
When the network is plugged 0.044
And Tor is ready 14.149
Then I successfully start the Unsafe Browser in "it" 29.135
And I kill the Unsafe Browser 5.817
When I enable the screen keyboard 0.185
Then the screen keyboard works in Tor Browser 34.581
And DuckDuckGo is the default search engine 11.553
And I kill the Tor Browser 5.640
And the screen keyboard works in Thunderbird 22.587
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 1.380
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.821
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.914
When I log in to a new session in Persian (fa) 28.434
Then the keyboard layout is set to "ir" 0.193
When the network is plugged 0.033
And Tor is ready 14.551
Then I successfully start the Unsafe Browser in "fa" 27.789
And I kill the Unsafe Browser 5.779
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 35.441
And DuckDuckGo is the default search engine 10.371
And I kill the Tor Browser 5.560
And the screen keyboard works in Thunderbird 24.869
And the layout of the screen keyboard is set to "ir" 0.746
After features/support/hooks.rb:291 1.353
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:20.653
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.653
When I log in to a new session in Portuguese (pt) 29.438
Then the keyboard layout is set to "pt" 0.271
When the network is plugged 0.109
And Tor is ready 53.858
Then I successfully start the Unsafe Browser in "pt" 28.191
And I kill the Unsafe Browser 5.793
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 34.513
And DuckDuckGo is the default search engine 10.686
And I kill the Tor Browser 5.490
And the screen keyboard works in Thunderbird 21.958
And the layout of the screen keyboard is set to "us" 0.595
After features/support/hooks.rb:291 1.184
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.840
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.030
When I log in to a new session in Russian (ru) 34.411
Then the keyboard layout is set to "ru" 0.124
When the network is plugged 0.079
And Tor is ready 13.992
Then I successfully start the Unsafe Browser in "ru" 27.229
And I kill the Unsafe Browser 5.995
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 33.518
And DuckDuckGo is the default search engine 10.302
And I kill the Tor Browser 5.651
And the screen keyboard works in Thunderbird 25.714
And the layout of the screen keyboard is set to "ru" 0.648
After features/support/hooks.rb:291 1.190
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.288
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.230
When I log in to a new session in Spanish (es) 31.504
Then the keyboard layout is set to "es" 0.226
When the network is plugged 0.043
And Tor is ready 15.617
Then I successfully start the Unsafe Browser in "es" 26.478
And I kill the Unsafe Browser 5.960
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 34.572
And DuckDuckGo is the default search engine 11.226
And I kill the Tor Browser 5.656
And the screen keyboard works in Thunderbird 22.023
And the layout of the screen keyboard is set to "us" 0.620
After features/support/hooks.rb:291 1.353
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.780
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.491
When I log in to a new session in Turkish (tr) 32.965
Then the keyboard layout is set to "tr" 0.411
When the network is plugged 0.064
And Tor is ready 15.568
Then I successfully start the Unsafe Browser in "tr" 25.314
And I kill the Unsafe Browser 6.075
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 32.056
And DuckDuckGo is the default search engine 14.302
And I kill the Tor Browser 5.559
And the screen keyboard works in Thunderbird 22.241
And the layout of the screen keyboard is set to "us" 0.563
After features/support/hooks.rb:291 1.259
After features/support/hooks.rb:75 0.000