Project Number Date
test_Tails_ISO_stable 4845 16 May 2024, 17:35

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 275 0 0 0 0 275 22 0 22 1:1:40.311 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.163
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 7.990
And I prepare Tails for memory erasure tests 0.470
When I start a process allocating 128 MiB of memory with a known pattern 2.429
Then patterns cover at least 128 MiB in the guest's memory 4.087 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.168
Then I find very few patterns in the guest's memory 4.016 
Pattern coverage: 0.000% (0 MiB out of 906 MiB reference memory)
After features/support/hooks.rb:305 0.768
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
27.594
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.116
And I prepare Tails for memory erasure tests 0.515
And I find very few patterns in the guest's memory 4.485 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 5.723
Then patterns cover at least 99% of the test FS size in the guest's memory 3.917 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.743
Then I find very few patterns in the guest's memory 4.093 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:305 1.310
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.789
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.974
And I prepare Tails for memory erasure tests 0.523
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.111
Then I find very few patterns in the guest's memory 4.816 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.878
Then patterns cover at least 86% of the test FS size in the guest's memory 4.014 
Pattern coverage: 92.347% (117 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.765
Then I find very few patterns in the guest's memory 4.313 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
# read cache
When I mount the USB drive again 0.415
And I read the content of the test FS 0.921
Then patterns cover at least 99% of the test FS size in the guest's memory 3.948 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.733
Then I find very few patterns in the guest's memory 4.373 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:305 1.403
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:14.376
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.203
And I prepare Tails for memory erasure tests 0.521
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 38.080
Then I find very few patterns in the guest's memory 3.738 
Pattern coverage: 0.000% (0 MiB out of 899 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.137
Then patterns cover at least 99% of the test FS size in the guest's memory 3.187 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.839
Then I find very few patterns in the guest's memory 3.390 
Pattern coverage: 0.000% (0 MiB out of 899 MiB reference memory)
# read cache
When I mount the USB drive again 5.141
And I read the content of the test FS 0.600
Then patterns cover at least 99% of the test FS size in the guest's memory 3.254 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.628
Then I find very few patterns in the guest's memory 3.653 
Pattern coverage: 0.000% (0 MiB out of 899 MiB reference memory)
After features/support/hooks.rb:305 0.802
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.842
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.184
And I prepare Tails for memory erasure tests 0.524
When I fill a 128 MiB file with a known pattern on the root filesystem 15.714
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.788
Then patterns cover at least 128 MiB in the guest's memory 2.803 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.011
And I wait 20 seconds 20.007 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.808 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:305 3.491
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:14.514
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:29.366
And I prepare Tails for memory erasure tests 0.404
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.407
When I trigger shutdown 0.010
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.311 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
After features/support/hooks.rb:305 3.554
After features/support/hooks.rb:89 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:2.523
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.591
And I update APT using apt 18.600
And I install "popularity-contest" using apt 22.356
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.981
When I create a persistent storage and activate the Additional Software feature 20.846
Then Additional Software is correctly configured for package "popularity-contest" 1.506
When I shutdown Tails and wait for the computer to power off 12.524
And I start Tails from USB drive "__internal" with network unplugged 58.691
And I enable persistence 20.849
And I log in to a new session 38.607
And the Additional Software installation service has started 41.549
Then I am notified that the installation succeeded 2.440
And Additional Software is correctly configured for package "popularity-contest" 0.756
And the package "popularity-contest" is installed after Additional Software has been started 0.219
After features/support/hooks.rb:464 35.318
After features/support/hooks.rb:305 1.147
After features/support/hooks.rb:89 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:24.695
Before features/support/hooks.rb:259 0.003
Before features/support/hooks.rb:456 0.004
Given a computer 0.175
And I start Tails from USB drive "__internal" and I login with an administration password 1:39.136
And I update APT using apt 16.483
When I install "makepp" using apt 22.376
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.450
And the package "makepp" is installed 0.074
After features/support/hooks.rb:464 36.619
After features/support/hooks.rb:305 1.029
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.848
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.004
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:0.230
When I uninstall "popularity-contest" using apt 21.730
And I accept removing "popularity-contest" from Additional Software 0.560
Then "popularity-contest" is not in the list of Additional Software 0.661
When I start Synaptic 23.665
And I update APT using Synaptic 22.716
And I install "cowsay" using Synaptic 9.129
And I accept adding "cowsay" to Additional Software 4.550
Then Additional Software is correctly configured for package "cowsay" 0.832
When I uninstall "cowsay" using apt 6.304
And I refuse removing "cowsay" from Additional Software 0.586
Then Additional Software is correctly configured for package "cowsay" 0.899
When I start "Additional Software" via GNOME Activities Overview 10.507
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.891
Then "cowsay" is not in the list of Additional Software 0.902
When I install "cowsay" using apt 3.197
And I refuse adding "cowsay" to Additional Software 0.594
Then "cowsay" is not in the list of Additional Software 0.705
After features/support/hooks.rb:464 0.931
After features/support/hooks.rb:305 0.629
After features/support/hooks.rb:89 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:44.680
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.005
Given a computer 0.164
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:16.960
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.416
And I accept adding "cowsay" to Additional Software 5.575
And Additional Software is correctly configured for package "cowsay" 0.944
And I shutdown Tails and wait for the computer to power off 6.430
And I start Tails from USB drive "__internal" with network unplugged 1:5.497
And I enable persistence 12.269
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 37.631
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.977
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.030
And Tor is ready 20.048
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.913
And available upgrades have been checked 0.093
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.207
And I can open the Additional Software configuration window from the notification 3.337
And I shutdown Tails and wait for the computer to power off 19.426
And I start Tails from USB drive "__internal" with network unplugged 58.823
And I enable persistence 11.085
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 35.325
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.062
And I revert the APT tweaks that made it prefer an old version of cowsay 0.051
And the network is plugged 0.039
And Tor is ready 51.865
Then the Additional Software upgrade service has started 0.187
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.105
After features/support/hooks.rb:464 2.135
After features/support/hooks.rb:305 1.135
After features/support/hooks.rb:89 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:9.161
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.007
Given a computer 0.174
And I start Tails from USB drive "__internal" with network unplugged 59.201
And I enable persistence 12.243
And I remove the "cowsay" deb files from the APT cache 0.689
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.093
And I log in to a new session 35.429
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.581
And I can open the Additional Software log file from the notification 6.162
And the package "cowsay" is not installed 0.585
After features/support/hooks.rb:464 0.099
After features/support/hooks.rb:305 0.806
After features/support/hooks.rb:89 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.165
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.042
When I log in to a new session in Arabic (ar) 30.887
Then the keyboard layout is set to "us" 0.258
When the network is plugged 0.045
And Tor is ready 16.608
Then I successfully start the Unsafe Browser in "ar" 15.502
And I kill the Unsafe Browser 5.870
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 31.423
And DuckDuckGo is the default search engine 12.227
And I kill the Tor Browser 5.491
And the screen keyboard works in Thunderbird 14.141
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:305 1.017
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:54.675
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.092
When I log in to a new session in Chinese (zh_CN) 31.655
Then the keyboard layout is set to "cn" 0.388
When the network is plugged 0.050
And Tor is ready 45.584
Then I successfully start the Unsafe Browser in "zh_CN" 17.220
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.204
Then the screen keyboard works in Tor Browser 31.316
And DuckDuckGo is the default search engine 10.475
And I kill the Tor Browser 5.597
And the screen keyboard works in Thunderbird 17.699
And the layout of the screen keyboard is set to "us" 0.617
After features/support/hooks.rb:305 1.539
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:57.396
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.168
When I log in to a new session in English (en) 18.041
Then the keyboard layout is set to "us" 0.165
When the network is plugged 0.055
And Tor is ready 16.346
Then I successfully start the Unsafe Browser in "en" 16.315
And I kill the Unsafe Browser 5.701
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 28.962
And DuckDuckGo is the default search engine 5.371
And I kill the Tor Browser 5.334
And the screen keyboard works in Thunderbird 12.230
And the layout of the screen keyboard is set to "us" 0.581
After features/support/hooks.rb:305 1.052
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.254
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.003
When I log in to a new session in French (fr) 34.950
Then the keyboard layout is set to "fr" 0.287
When the network is plugged 0.039
And Tor is ready 16.551
Then I successfully start the Unsafe Browser in "fr" 15.979
And I kill the Unsafe Browser 5.844
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 28.925
And DuckDuckGo is the default search engine 17.828
And I kill the Tor Browser 5.518
And the screen keyboard works in Thunderbird 13.609
And the layout of the screen keyboard is set to "fr" 0.580
After features/support/hooks.rb:305 1.498
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.681
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.741
When I log in to a new session in German (de) 31.150
Then the keyboard layout is set to "de" 0.270
When the network is plugged 0.036
And Tor is ready 16.012
Then I successfully start the Unsafe Browser in "de" 15.064
And I kill the Unsafe Browser 5.952
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 30.214
And DuckDuckGo is the default search engine 18.409
And I kill the Tor Browser 5.554
And the screen keyboard works in Thunderbird 12.532
And the layout of the screen keyboard is set to "de" 0.615
After features/support/hooks.rb:305 1.071
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.426
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.905
When I log in to a new session in Italian (it) 33.138
Then the keyboard layout is set to "it" 0.201
When the network is plugged 0.035
And Tor is ready 16.017
Then I successfully start the Unsafe Browser in "it" 15.283
And I kill the Unsafe Browser 5.775
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 29.823
And DuckDuckGo is the default search engine 10.444
And I kill the Tor Browser 5.565
And the screen keyboard works in Thunderbird 13.405
And the layout of the screen keyboard is set to "us" 0.695
After features/support/hooks.rb:305 1.091
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.013
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.226
When I log in to a new session in Persian (fa) 33.682
Then the keyboard layout is set to "ir" 0.121
When the network is plugged 0.040
And Tor is ready 15.987
Then I successfully start the Unsafe Browser in "fa" 16.367
And I kill the Unsafe Browser 5.915
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 29.917
And DuckDuckGo is the default search engine 17.838
And I kill the Tor Browser 5.528
And the screen keyboard works in Thunderbird 12.712
And the layout of the screen keyboard is set to "ir" 0.543
After features/support/hooks.rb:305 2.235
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.889
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.919
When I log in to a new session in Portuguese (pt) 31.088
Then the keyboard layout is set to "pt" 0.118
When the network is plugged 0.034
And Tor is ready 14.677
Then I successfully start the Unsafe Browser in "pt" 15.499
And I kill the Unsafe Browser 5.883
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 28.377
And DuckDuckGo is the default search engine 10.601
And I kill the Tor Browser 5.559
And the screen keyboard works in Thunderbird 12.393
And the layout of the screen keyboard is set to "us" 0.604
After features/support/hooks.rb:305 1.243
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.595
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.951
When I log in to a new session in Russian (ru) 31.246
Then the keyboard layout is set to "ru" 0.162
When the network is plugged 0.035
And Tor is ready 16.044
Then I successfully start the Unsafe Browser in "ru" 15.560
And I kill the Unsafe Browser 5.859
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 28.698
And DuckDuckGo is the default search engine 10.991
And I kill the Tor Browser 5.526
And the screen keyboard works in Thunderbird 13.814
And the layout of the screen keyboard is set to "ru" 0.577
After features/support/hooks.rb:305 1.632
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.242
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.163
When I log in to a new session in Spanish (es) 31.930
Then the keyboard layout is set to "es" 0.171
When the network is plugged 0.051
And Tor is ready 16.611
Then I successfully start the Unsafe Browser in "es" 16.199
And I kill the Unsafe Browser 5.809
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 28.838
And DuckDuckGo is the default search engine 17.936
And I kill the Tor Browser 5.595
And the screen keyboard works in Thunderbird 13.252
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:305 1.122
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.780
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.962
When I log in to a new session in Turkish (tr) 30.657
Then the keyboard layout is set to "tr" 0.104
When the network is plugged 0.029
And Tor is ready 45.766
Then I successfully start the Unsafe Browser in "tr" 14.800
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 29.453
And DuckDuckGo is the default search engine 10.754
And I kill the Tor Browser 5.564
And the screen keyboard works in Thunderbird 13.212
And the layout of the screen keyboard is set to "us" 0.545
After features/support/hooks.rb:305 2.798
After features/support/hooks.rb:89 0.000