Project Number Date
test_Tails_ISO_stable 4755 28 Mar 2024, 20:27

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:15.702 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.482
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.958
And I prepare Tails for memory erasure tests 0.379
When I start a process allocating 128 MiB of memory with a known pattern 1.351
Then patterns cover at least 128 MiB in the guest's memory 4.854 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.987
Then I find very few patterns in the guest's memory 6.951 
Pattern coverage: 0.000% (0 MiB out of 903 MiB reference memory)
After features/support/hooks.rb:291 1.111
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.195
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.330
And I prepare Tails for memory erasure tests 0.381
And I find very few patterns in the guest's memory 4.599 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.854
Then patterns cover at least 99% of the test FS size in the guest's memory 5.152 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.729
Then I find very few patterns in the guest's memory 5.146 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
After features/support/hooks.rb:291 0.893
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.925
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and logged in 8.028
And I prepare Tails for memory erasure tests 0.422
When I plug and mount a 128 MiB USB drive with a vfat filesystem 9.285
Then I find very few patterns in the guest's memory 6.314 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.458
Then patterns cover at least 86% of the test FS size in the guest's memory 3.914 
Pattern coverage: 87.149% (111 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.945
Then I find very few patterns in the guest's memory 4.850 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# read cache
When I mount the USB drive again 0.264
And I read the content of the test FS 0.998
Then patterns cover at least 99% of the test FS size in the guest's memory 5.294 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.367
Then I find very few patterns in the guest's memory 4.780 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:291 1.820
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.672
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and logged in 8.301
And I prepare Tails for memory erasure tests 0.395
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.774
Then I find very few patterns in the guest's memory 4.065 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.908
Then patterns cover at least 99% of the test FS size in the guest's memory 3.341 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.438
Then I find very few patterns in the guest's memory 3.698 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
# read cache
When I mount the USB drive again 5.233
And I read the content of the test FS 0.473
Then patterns cover at least 99% of the test FS size in the guest's memory 3.721 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.954
Then I find very few patterns in the guest's memory 4.365 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:291 0.782
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.004
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.180
And I prepare Tails for memory erasure tests 0.387
When I fill a 128 MiB file with a known pattern on the root filesystem 16.969
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 0.967
Then patterns cover at least 128 MiB in the guest's memory 2.688 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.016
And I wait 20 seconds 20.008 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.785 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
After features/support/hooks.rb:291 3.572
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:1.207
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:18.333
And I prepare Tails for memory erasure tests 0.416
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.010
When I trigger shutdown 0.015
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.412 
Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)
After features/support/hooks.rb:291 3.573
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:48.599
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.090
And I update APT using apt 16.952
And I install "popularity-contest" using apt 22.471
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.930
When I create a persistent storage and activate the Additional Software feature 22.238
Then Additional Software is correctly configured for package "popularity-contest" 1.526
When I shutdown Tails and wait for the computer to power off 12.403
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:31.912
Then Additional Software is correctly configured for package "popularity-contest" 0.796
And the package "popularity-contest" is installed after Additional Software has been started 0.276
After features/support/hooks.rb:450 38.904
After features/support/hooks.rb:291 1.175
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:13.892
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.190
And I start Tails from USB drive "__internal" and I login with an administration password 1:32.262
And I update APT using apt 15.501
When I install "makepp" using apt 22.609
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 3.246
And the package "makepp" is installed 0.082
After features/support/hooks.rb:450 41.378
After features/support/hooks.rb:291 0.993
After features/support/hooks.rb:75 0.034
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:14.769
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.224
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:27.341
When I uninstall "popularity-contest" using apt 18.764
And I accept removing "popularity-contest" from Additional Software 0.874
Then "popularity-contest" is not in the list of Additional Software 0.670
When I start Synaptic 25.810
And I update APT using Synaptic 22.499
And I install "cowsay" using Synaptic 11.989
And I accept adding "cowsay" to Additional Software 1.084
Then Additional Software is correctly configured for package "cowsay" 0.763
When I uninstall "cowsay" using apt 3.265
And I refuse removing "cowsay" from Additional Software 0.625
Then Additional Software is correctly configured for package "cowsay" 0.767
When I start "Additional Software" via GNOME Activities Overview 9.870
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.749
Then "cowsay" is not in the list of Additional Software 0.876
When I install "cowsay" using apt 3.228
And I refuse adding "cowsay" to Additional Software 0.582
Then "cowsay" is not in the list of Additional Software 0.779
After features/support/hooks.rb:450 1.168
After features/support/hooks.rb:291 0.823
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:43.859
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.198
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:10.236
And I configure APT to prefer an old version of cowsay 0.037
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.402
And I accept adding "cowsay" to Additional Software 4.673
And Additional Software is correctly configured for package "cowsay" 0.854
And I shutdown Tails and wait for the computer to power off 6.801
And I start Tails from USB drive "__internal" with network unplugged 55.857
And I enable persistence 10.463
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 34.657
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.876
And I revert the APT tweaks that made it prefer an old version of cowsay 0.070
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.077
And the network is plugged 0.041
And Tor is ready 16.865
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.557
And available upgrades have been checked 0.089
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.218
And I can open the Additional Software configuration window from the notification 3.399
And I shutdown Tails and wait for the computer to power off 2:2.110
And I start Tails from USB drive "__internal" with network unplugged 56.687
And I enable persistence 12.825
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 36.434
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.335
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
And the network is plugged 0.790
And Tor is ready 50.888
Then the Additional Software upgrade service has started 0.211
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.088
After features/support/hooks.rb:450 2.624
After features/support/hooks.rb:291 1.028
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:4.566
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.198
And I start Tails from USB drive "__internal" with network unplugged 55.640
And I enable persistence 11.291
And I remove the "cowsay" deb files from the APT cache 0.607
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.092
And I log in to a new session 34.596
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 15.767
And I can open the Additional Software log file from the notification 5.746
And the package "cowsay" is not installed 0.625
After features/support/hooks.rb:450 0.125
After features/support/hooks.rb:291 0.970
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.290
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.267
When I log in to a new session in Arabic (ar) 34.698
Then the keyboard layout is set to "us" 0.220
When the network is plugged 0.046
And Tor is ready 15.869
Then I successfully start the Unsafe Browser in "ar" 14.627
And I kill the Unsafe Browser 5.634
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 28.162
And DuckDuckGo is the default search engine 11.726
And I kill the Tor Browser 5.565
And the screen keyboard works in Thunderbird 13.637
And the layout of the screen keyboard is set to "us" 0.724
After features/support/hooks.rb:291 1.947
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.619
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.334
When I log in to a new session in Chinese (zh_CN) 31.159
Then the keyboard layout is set to "cn" 0.288
When the network is plugged 0.053
And Tor is ready 16.297
Then I successfully start the Unsafe Browser in "zh_CN" 15.340
And I kill the Unsafe Browser 5.767
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 26.144
And DuckDuckGo is the default search engine 11.679
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 17.404
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 1.546
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:55.768
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.310
When I log in to a new session in English (en) 15.103
Then the keyboard layout is set to "us" 0.209
When the network is plugged 0.048
And Tor is ready 16.243
Then I successfully start the Unsafe Browser in "en" 14.549
And I kill the Unsafe Browser 5.646
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 27.618
And DuckDuckGo is the default search engine 10.478
And I kill the Tor Browser 5.510
And the screen keyboard works in Thunderbird 11.368
And the layout of the screen keyboard is set to "us" 0.581
After features/support/hooks.rb:291 1.401
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.680
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.520
When I log in to a new session in French (fr) 29.623
Then the keyboard layout is set to "fr" 0.285
When the network is plugged 0.063
And Tor is ready 15.946
Then I successfully start the Unsafe Browser in "fr" 15.240
And I kill the Unsafe Browser 5.899
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 26.272
And DuckDuckGo is the default search engine 22.216
And I kill the Tor Browser 5.521
And the screen keyboard works in Thunderbird 12.426
And the layout of the screen keyboard is set to "fr" 0.564
After features/support/hooks.rb:291 1.362
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.108
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 21.674
When I log in to a new session in German (de) 30.002
Then the keyboard layout is set to "de" 0.411
When the network is plugged 0.041
And Tor is ready 17.296
Then I successfully start the Unsafe Browser in "de" 14.840
And I kill the Unsafe Browser 5.783
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 29.848
And DuckDuckGo is the default search engine 19.242
And I kill the Tor Browser 5.457
And the screen keyboard works in Thunderbird 11.778
And the layout of the screen keyboard is set to "de" 0.635
After features/support/hooks.rb:291 1.386
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.757
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.624
When I log in to a new session in Italian (it) 30.039
Then the keyboard layout is set to "it" 0.329
When the network is plugged 0.039
And Tor is ready 15.100
Then I successfully start the Unsafe Browser in "it" 14.296
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 25.951
And DuckDuckGo is the default search engine 20.063
And I kill the Tor Browser 5.538
And the screen keyboard works in Thunderbird 14.125
And the layout of the screen keyboard is set to "us" 0.727
After features/support/hooks.rb:291 2.585
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.648
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.569
When I log in to a new session in Persian (fa) 29.032
Then the keyboard layout is set to "ir" 0.128
When the network is plugged 0.032
And Tor is ready 15.709
Then I successfully start the Unsafe Browser in "fa" 14.139
And I kill the Unsafe Browser 5.722
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 25.983
And DuckDuckGo is the default search engine 10.500
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 11.698
And the layout of the screen keyboard is set to "ir" 0.540
After features/support/hooks.rb:291 1.346
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.083
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.957
When I log in to a new session in Portuguese (pt) 29.246
Then the keyboard layout is set to "pt" 0.143
When the network is plugged 0.045
And Tor is ready 14.257
Then I successfully start the Unsafe Browser in "pt" 14.491
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 25.039
And DuckDuckGo is the default search engine 11.595
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 12.235
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 2.007
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.716
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.874
When I log in to a new session in Russian (ru) 29.674
Then the keyboard layout is set to "ru" 0.175
When the network is plugged 0.033
And Tor is ready 15.766
Then I successfully start the Unsafe Browser in "ru" 13.917
And I kill the Unsafe Browser 5.768
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 27.771
And DuckDuckGo is the default search engine 10.077
And I kill the Tor Browser 5.270
And the screen keyboard works in Thunderbird 12.723
And the layout of the screen keyboard is set to "ru" 0.573
After features/support/hooks.rb:291 1.062
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.971
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.084
When I log in to a new session in Spanish (es) 28.984
Then the keyboard layout is set to "es" 0.170
When the network is plugged 0.053
And Tor is ready 17.527
Then I successfully start the Unsafe Browser in "es" 14.274
And I kill the Unsafe Browser 5.730
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 26.266
And DuckDuckGo is the default search engine 10.211
And I kill the Tor Browser 5.433
And the screen keyboard works in Thunderbird 12.595
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 2.493
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:6.881
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.748
When I log in to a new session in Turkish (tr) 28.620
Then the keyboard layout is set to "tr" 0.247
When the network is plugged 0.044
And Tor is ready 13.455
Then I successfully start the Unsafe Browser in "tr" 14.875
And I kill the Unsafe Browser 5.815
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 27.190
And DuckDuckGo is the default search engine 10.301
And I kill the Tor Browser 5.460
And the screen keyboard works in Thunderbird 12.438
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 2.615
After features/support/hooks.rb:75 0.000