Project Number Date
test_Tails_ISO_stable 4663 13 Feb 2024, 17:32

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:13:9.306 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.537
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.574
And I prepare Tails for memory erasure tests 0.448
When I start a process allocating 128 MiB of memory with a known pattern 1.236
Then patterns cover at least 128 MiB in the guest's memory 3.352 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.316
Then I find very few patterns in the guest's memory 3.609 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 0.651
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.958
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.688
And I prepare Tails for memory erasure tests 0.523
And I find very few patterns in the guest's memory 3.724 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.942
Then patterns cover at least 99% of the test FS size in the guest's memory 3.238 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.286
Then I find very few patterns in the guest's memory 3.554 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 0.746
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:20.628
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.136
And I prepare Tails for memory erasure tests 0.582
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.793
Then I find very few patterns in the guest's memory 3.646 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:45.539
Then patterns cover at least 86% of the test FS size in the guest's memory 3.007 
Pattern coverage: 91.055% (113 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.568
Then I find very few patterns in the guest's memory 4.193 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 0.247
And I read the content of the test FS 0.562
Then patterns cover at least 99% of the test FS size in the guest's memory 3.306 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.307
Then I find very few patterns in the guest's memory 3.736 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 0.776
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:50.107
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.268
And I prepare Tails for memory erasure tests 0.570
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.312
Then I find very few patterns in the guest's memory 3.937 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:46.329
Then patterns cover at least 99% of the test FS size in the guest's memory 3.403 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.831
Then I find very few patterns in the guest's memory 3.822 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
# read cache
When I mount the USB drive again 3.672
And I read the content of the test FS 1.658
Then patterns cover at least 99% of the test FS size in the guest's memory 3.522 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.230
Then I find very few patterns in the guest's memory 3.546 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
After features/support/hooks.rb:291 0.955
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.210
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.405
And I prepare Tails for memory erasure tests 0.562
When I fill a 128 MiB file with a known pattern on the root filesystem 15.310
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.973
Then patterns cover at least 128 MiB in the guest's memory 3.548 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.514
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.878 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
After features/support/hooks.rb:291 3.635
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:58.477
Before features/support/hooks.rb:245 0.005
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:15.323
And I prepare Tails for memory erasure tests 0.459
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.340
When I trigger shutdown 0.247
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.086 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 3.433
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:55.821
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:14.211
And I update APT using apt 16.962
And I install "popularity-contest" using apt 19.561
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.438
When I create a persistent storage and activate the Additional Software feature 18.422
Then Additional Software is correctly configured for package "popularity-contest" 1.471
When I shutdown Tails and wait for the computer to power off 10.136
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:34.253
Then Additional Software is correctly configured for package "popularity-contest" 1.051
And the package "popularity-contest" is installed after Additional Software has been started 0.313
After features/support/hooks.rb:450 39.969
After features/support/hooks.rb:291 0.955
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:52.274
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.214
And I start Tails from USB drive "__internal" and I login with an administration password 1:20.218
And I update APT using apt 16.690
When I install "makepp" using apt 19.920
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 55.163
And the package "makepp" is installed 0.067
After features/support/hooks.rb:450 44.656
After features/support/hooks.rb:291 0.952
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:10.622
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.167
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:24.746
When I uninstall "popularity-contest" using apt 15.952
And I accept removing "popularity-contest" from Additional Software 2.466
Then "popularity-contest" is not in the list of Additional Software 0.882
When I start Synaptic 24.182
And I update APT using Synaptic 21.874
And I install "cowsay" using Synaptic 9.742
And I accept adding "cowsay" to Additional Software 1.206
Then Additional Software is correctly configured for package "cowsay" 1.054
When I uninstall "cowsay" using apt 3.382
And I refuse removing "cowsay" from Additional Software 0.669
Then Additional Software is correctly configured for package "cowsay" 0.900
When I start "Additional Software" via GNOME Activities Overview 12.535
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.891
Then "cowsay" is not in the list of Additional Software 1.101
When I install "cowsay" using apt 3.319
And I refuse adding "cowsay" to Additional Software 0.763
Then "cowsay" is not in the list of Additional Software 0.783
After features/support/hooks.rb:450 1.322
After features/support/hooks.rb:291 0.766
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:1.099
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.233
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:2.332
And I configure APT to prefer an old version of cowsay 0.035
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.783
And I accept adding "cowsay" to Additional Software 1:9.507
And Additional Software is correctly configured for package "cowsay" 1.424
And I shutdown Tails and wait for the computer to power off 7.076
And I start Tails from USB drive "__internal" with network unplugged 47.651
And I enable persistence 34.741
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 24.137
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.453
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.097
And the network is plugged 0.039
And Tor is ready 17.816
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.989
And available upgrades have been checked 0.154
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.273
And I can open the Additional Software configuration window from the notification 3.307
And I shutdown Tails and wait for the computer to power off 2:2.610
And I start Tails from USB drive "__internal" with network unplugged 45.714
And I enable persistence 31.870
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 22.589
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.466
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
And the network is plugged 0.029
And Tor is ready 48.249
Then the Additional Software upgrade service has started 0.191
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.135
After features/support/hooks.rb:450 2.808
After features/support/hooks.rb:291 0.759
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.587
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.180
And I start Tails from USB drive "__internal" with network unplugged 46.771
And I enable persistence 32.994
And I remove the "cowsay" deb files from the APT cache 0.675
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.078
And I log in to a new session 29.039
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.726
And I can open the Additional Software log file from the notification 1.988
And the package "cowsay" is not installed 0.131
After features/support/hooks.rb:450 0.138
After features/support/hooks.rb:291 1.046
After features/support/hooks.rb:75 0.012
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:57.642
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.024
When I log in to a new session in Arabic (ar) 30.591
Then the keyboard layout is set to "us" 0.153
When the network is plugged 0.063
And Tor is ready 15.056
Then I successfully start the Unsafe Browser in "ar" 29.067
And I kill the Unsafe Browser 6.350
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 33.753
And DuckDuckGo is the default search engine 23.363
And I kill the Tor Browser 5.646
And the screen keyboard works in Thunderbird 24.771
And the layout of the screen keyboard is set to "us" 0.689
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.223
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.128
When I log in to a new session in Chinese (zh_CN) 30.683
Then the keyboard layout is set to "cn" 0.276
When the network is plugged 0.059
And Tor is ready 15.312
Then I successfully start the Unsafe Browser in "zh_CN" 32.009
And I kill the Unsafe Browser 6.181
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 33.807
And DuckDuckGo is the default search engine 11.019
And I kill the Tor Browser 5.578
And the screen keyboard works in Thunderbird 31.417
And the layout of the screen keyboard is set to "us" 0.616
After features/support/hooks.rb:291 1.721
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.586
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.337
When I log in to a new session in English (en) 18.020
Then the keyboard layout is set to "us" 0.286
When the network is plugged 0.114
And Tor is ready 15.000
Then I successfully start the Unsafe Browser in "en" 31.087
And I kill the Unsafe Browser 5.745
When I enable the screen keyboard 0.148
Then the screen keyboard works in Tor Browser 34.488
And DuckDuckGo is the default search engine 5.860
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 22.623
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:291 1.043
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:56.487
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.498
When I log in to a new session in French (fr) 32.068
Then the keyboard layout is set to "fr" 0.205
When the network is plugged 0.052
And Tor is ready 17.258
Then I successfully start the Unsafe Browser in "fr" 33.172
And I kill the Unsafe Browser 6.013
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 36.340
And DuckDuckGo is the default search engine 11.370
And I kill the Tor Browser 5.564
And the screen keyboard works in Thunderbird 25.229
And the layout of the screen keyboard is set to "fr" 0.568
After features/support/hooks.rb:291 1.310
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.170
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.109
When I log in to a new session in German (de) 30.009
Then the keyboard layout is set to "de" 0.138
When the network is plugged 0.356
And Tor is ready 15.090
Then I successfully start the Unsafe Browser in "de" 32.928
And I kill the Unsafe Browser 6.043
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 33.252
And DuckDuckGo is the default search engine 19.387
And I kill the Tor Browser 5.547
And the screen keyboard works in Thunderbird 22.602
And the layout of the screen keyboard is set to "de" 0.597
After features/support/hooks.rb:291 1.140
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.836
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.966
When I log in to a new session in Italian (it) 31.430
Then the keyboard layout is set to "it" 0.171
When the network is plugged 0.035
And Tor is ready 14.845
Then I successfully start the Unsafe Browser in "it" 27.431
And I kill the Unsafe Browser 5.913
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 33.821
And DuckDuckGo is the default search engine 10.827
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 22.146
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.057
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.024
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.734
When I log in to a new session in Persian (fa) 29.620
Then the keyboard layout is set to "ir" 0.179
When the network is plugged 0.059
And Tor is ready 15.064
Then I successfully start the Unsafe Browser in "fa" 29.174
And I kill the Unsafe Browser 5.955
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 33.536
And DuckDuckGo is the default search engine 10.325
And I kill the Tor Browser 5.531
And the screen keyboard works in Thunderbird 26.144
And the layout of the screen keyboard is set to "ir" 0.571
After features/support/hooks.rb:291 0.967
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:0.392
Before features/support/hooks.rb:245 0.018
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.616
When I log in to a new session in Portuguese (pt) 30.004
Then the keyboard layout is set to "pt" 0.125
When the network is plugged 0.038
And Tor is ready 15.317
Then I successfully start the Unsafe Browser in "pt" 25.818
And I kill the Unsafe Browser 6.033
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 31.864
And DuckDuckGo is the default search engine 19.440
And I kill the Tor Browser 5.543
And the screen keyboard works in Thunderbird 24.938
And the layout of the screen keyboard is set to "us" 0.538
After features/support/hooks.rb:291 1.138
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:59.422
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.739
When I log in to a new session in Russian (ru) 29.899
Then the keyboard layout is set to "ru" 0.183
When the network is plugged 0.033
And Tor is ready 14.524
Then I successfully start the Unsafe Browser in "ru" 30.733
And I kill the Unsafe Browser 5.766
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 33.792
And DuckDuckGo is the default search engine 23.487
And I kill the Tor Browser 5.571
And the screen keyboard works in Thunderbird 26.968
And the layout of the screen keyboard is set to "ru" 0.623
After features/support/hooks.rb:291 1.112
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.336
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.109
When I log in to a new session in Spanish (es) 29.369
Then the keyboard layout is set to "es" 0.206
When the network is plugged 0.556
And Tor is ready 14.081
Then I successfully start the Unsafe Browser in "es" 26.174
And I kill the Unsafe Browser 5.995
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 32.171
And DuckDuckGo is the default search engine 11.129
And I kill the Tor Browser 5.586
And the screen keyboard works in Thunderbird 25.265
And the layout of the screen keyboard is set to "us" 0.595
After features/support/hooks.rb:291 1.240
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.857
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.499
When I log in to a new session in Turkish (tr) 27.881
Then the keyboard layout is set to "tr" 0.187
When the network is plugged 0.215
And Tor is ready 15.074
Then I successfully start the Unsafe Browser in "tr" 27.572
And I kill the Unsafe Browser 5.940
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 32.762
And DuckDuckGo is the default search engine 10.422
And I kill the Tor Browser 5.611
And the screen keyboard works in Thunderbird 25.928
And the layout of the screen keyboard is set to "us" 0.658
After features/support/hooks.rb:291 1.199
After features/support/hooks.rb:75 0.000