Project Number Date
test_Tails_ISO_stable 4635 24 Jan 2024, 23:52

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:2.222 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.049
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.919
And I prepare Tails for memory erasure tests 0.532
When I start a process allocating 128 MiB of memory with a known pattern 1.338
Then patterns cover at least 128 MiB in the guest's memory 3.508 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.269
Then I find very few patterns in the guest's memory 3.480 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 0.744
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.112
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.501
And I prepare Tails for memory erasure tests 0.497
And I find very few patterns in the guest's memory 4.320 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.880
Then patterns cover at least 99% of the test FS size in the guest's memory 3.042 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.282
Then I find very few patterns in the guest's memory 3.588 
Pattern coverage: 0.000% (0 MiB out of 1185 MiB reference memory)
After features/support/hooks.rb:291 0.677
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:17.076
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.659
And I prepare Tails for memory erasure tests 0.490
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.778
Then I find very few patterns in the guest's memory 3.598 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:40.995
Then patterns cover at least 86% of the test FS size in the guest's memory 2.987 
Pattern coverage: 93.742% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.881
Then I find very few patterns in the guest's memory 3.754 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# read cache
When I mount the USB drive again 0.311
And I read the content of the test FS 0.972
Then patterns cover at least 99% of the test FS size in the guest's memory 4.125 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.524
Then I find very few patterns in the guest's memory 3.996 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 0.703
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:34.594
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.574
And I prepare Tails for memory erasure tests 0.541
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 25.895
Then I find very few patterns in the guest's memory 3.373 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:41.063
Then patterns cover at least 99% of the test FS size in the guest's memory 2.548 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.598
Then I find very few patterns in the guest's memory 3.417 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 3.015
And I read the content of the test FS 0.436
Then patterns cover at least 99% of the test FS size in the guest's memory 2.530 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.380
Then I find very few patterns in the guest's memory 3.219 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 0.774
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.864
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.872
And I prepare Tails for memory erasure tests 0.521
When I fill a 128 MiB file with a known pattern on the root filesystem 12.344
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 4.394
Then patterns cover at least 128 MiB in the guest's memory 2.443 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.545
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.722 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 3.454
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:59.400
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:16.226
And I prepare Tails for memory erasure tests 0.496
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.311
When I trigger shutdown 0.232
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.113 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 3.477
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:31.266
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.826
And I update APT using apt 17.295
And I install "popularity-contest" using apt 19.728
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.819
When I create a persistent storage and activate the Additional Software feature 18.911
Then Additional Software is correctly configured for package "popularity-contest" 1.403
When I shutdown Tails and wait for the computer to power off 11.101
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:32.992
Then Additional Software is correctly configured for package "popularity-contest" 0.898
And the package "popularity-contest" is installed after Additional Software has been started 0.289
After features/support/hooks.rb:450 38.553
After features/support/hooks.rb:291 1.147
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:50.733
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.358
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.766
And I update APT using apt 16.021
When I install "makepp" using apt 19.665
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 54.816
And the package "makepp" is installed 0.105
After features/support/hooks.rb:450 36.864
After features/support/hooks.rb:291 0.936
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:43.191
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.162
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:57.330
When I uninstall "popularity-contest" using apt 15.957
And I accept removing "popularity-contest" from Additional Software 2.210
Then "popularity-contest" is not in the list of Additional Software 0.801
When I start Synaptic 23.413
And I update APT using Synaptic 21.901
And I install "cowsay" using Synaptic 11.095
And I accept adding "cowsay" to Additional Software 0.843
Then Additional Software is correctly configured for package "cowsay" 0.880
When I uninstall "cowsay" using apt 3.333
And I refuse removing "cowsay" from Additional Software 0.719
Then Additional Software is correctly configured for package "cowsay" 0.878
When I start "Additional Software" via GNOME Activities Overview 12.468
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.559
Then "cowsay" is not in the list of Additional Software 0.884
When I install "cowsay" using apt 3.290
And I refuse adding "cowsay" to Additional Software 0.705
Then "cowsay" is not in the list of Additional Software 0.753
After features/support/hooks.rb:450 1.062
After features/support/hooks.rb:291 0.745
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:54.874
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.145
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:1.397
And I configure APT to prefer an old version of cowsay 0.029
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.200
And I accept adding "cowsay" to Additional Software 1:2.281
And Additional Software is correctly configured for package "cowsay" 1.346
And I shutdown Tails and wait for the computer to power off 5.072
And I start Tails from USB drive "__internal" with network unplugged 45.618
And I enable persistence 32.306
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 22.958
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.365
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.093
And the network is plugged 0.030
And Tor is ready 44.949
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.829
And available upgrades have been checked 0.073
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.001
And I can open the Additional Software configuration window from the notification 2.398
And I shutdown Tails and wait for the computer to power off 2:2.484
And I start Tails from USB drive "__internal" with network unplugged 45.072
And I enable persistence 30.037
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 22.184
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.791
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
And the network is plugged 0.359
And Tor is ready 39.369
Then the Additional Software upgrade service has started 0.217
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.095
After features/support/hooks.rb:450 3.480
After features/support/hooks.rb:291 0.715
After features/support/hooks.rb:75 0.100
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:46.718
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.152
And I start Tails from USB drive "__internal" with network unplugged 45.220
And I enable persistence 32.559
And I remove the "cowsay" deb files from the APT cache 0.659
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.072
And I log in to a new session 21.461
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.024
And I can open the Additional Software log file from the notification 2.400
And the package "cowsay" is not installed 0.166
After features/support/hooks.rb:450 0.117
After features/support/hooks.rb:291 0.792
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:15.148
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.684
When I log in to a new session in Arabic (ar) 27.362
Then the keyboard layout is set to "us" 0.193
When the network is plugged 0.031
And Tor is ready 44.574
Then I successfully start the Unsafe Browser in "ar" 32.367
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 36.528
And DuckDuckGo is the default search engine 10.013
And I kill the Tor Browser 5.311
And the screen keyboard works in Thunderbird 24.547
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 1.070
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:16.435
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.976
When I log in to a new session in Chinese (zh_CN) 29.420
Then the keyboard layout is set to "cn" 0.161
When the network is plugged 0.063
And Tor is ready 45.738
Then I successfully start the Unsafe Browser in "zh_CN" 29.437
And I kill the Unsafe Browser 5.696
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.769
And DuckDuckGo is the default search engine 10.520
And I kill the Tor Browser 5.454
And the screen keyboard works in Thunderbird 26.429
And the layout of the screen keyboard is set to "us" 0.646
After features/support/hooks.rb:291 1.138
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.960
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.789
When I log in to a new session in English (en) 14.020
Then the keyboard layout is set to "us" 0.372
When the network is plugged 0.043
And Tor is ready 42.501
Then I successfully start the Unsafe Browser in "en" 26.303
And I kill the Unsafe Browser 5.894
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 32.845
And DuckDuckGo is the default search engine 5.466
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 21.679
And the layout of the screen keyboard is set to "us" 0.576
After features/support/hooks.rb:291 1.344
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.929
Before features/support/hooks.rb:245 0.018
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.134
When I log in to a new session in French (fr) 29.410
Then the keyboard layout is set to "fr" 0.168
When the network is plugged 0.018
And Tor is ready 14.787
Then I successfully start the Unsafe Browser in "fr" 27.923
And I kill the Unsafe Browser 6.111
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 34.444
And DuckDuckGo is the default search engine 9.643
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 23.202
And the layout of the screen keyboard is set to "fr" 0.620
After features/support/hooks.rb:291 1.213
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:7.019
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.924
When I log in to a new session in German (de) 29.864
Then the keyboard layout is set to "de" 0.379
When the network is plugged 0.027
And Tor is ready 43.215
Then I successfully start the Unsafe Browser in "de" 27.196
And I kill the Unsafe Browser 6.372
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 34.311
And DuckDuckGo is the default search engine 9.974
And I kill the Tor Browser 5.385
And the screen keyboard works in Thunderbird 21.660
And the layout of the screen keyboard is set to "de" 0.588
After features/support/hooks.rb:291 2.197
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.763
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.872
When I log in to a new session in Italian (it) 33.073
Then the keyboard layout is set to "it" 0.131
When the network is plugged 0.026
And Tor is ready 14.521
Then I successfully start the Unsafe Browser in "it" 26.907
And I kill the Unsafe Browser 6.273
When I enable the screen keyboard 0.188
Then the screen keyboard works in Tor Browser 33.565
And DuckDuckGo is the default search engine 9.786
And I kill the Tor Browser 5.283
And the screen keyboard works in Thunderbird 22.554
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 2.502
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.553
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.891
When I log in to a new session in Persian (fa) 28.856
Then the keyboard layout is set to "ir" 0.287
When the network is plugged 0.028
And Tor is ready 14.075
Then I successfully start the Unsafe Browser in "fa" 28.918
And I kill the Unsafe Browser 5.711
When I enable the screen keyboard 0.189
Then the screen keyboard works in Tor Browser 36.118
And DuckDuckGo is the default search engine 9.238
And I kill the Tor Browser 5.251
And the screen keyboard works in Thunderbird 24.435
And the layout of the screen keyboard is set to "ir" 0.548
After features/support/hooks.rb:291 1.118
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.882
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.821
When I log in to a new session in Portuguese (pt) 30.843
Then the keyboard layout is set to "pt" 0.200
When the network is plugged 0.093
And Tor is ready 14.228
Then I successfully start the Unsafe Browser in "pt" 27.142
And I kill the Unsafe Browser 6.095
When I enable the screen keyboard 0.159
Then the screen keyboard works in Tor Browser 33.062
And DuckDuckGo is the default search engine 9.620
And I kill the Tor Browser 5.325
And the screen keyboard works in Thunderbird 21.679
And the layout of the screen keyboard is set to "us" 0.609
After features/support/hooks.rb:291 0.986
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:8.136
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.048
When I log in to a new session in Russian (ru) 29.661
Then the keyboard layout is set to "ru" 0.141
When the network is plugged 0.023
And Tor is ready 42.636
Then I successfully start the Unsafe Browser in "ru" 27.573
And I kill the Unsafe Browser 5.764
When I enable the screen keyboard 0.159
Then the screen keyboard works in Tor Browser 34.737
And DuckDuckGo is the default search engine 10.273
And I kill the Tor Browser 5.553
And the screen keyboard works in Thunderbird 22.991
And the layout of the screen keyboard is set to "ru" 0.570
After features/support/hooks.rb:291 1.079
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.696
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.833
When I log in to a new session in Spanish (es) 28.947
Then the keyboard layout is set to "es" 0.295
When the network is plugged 0.032
And Tor is ready 14.585
Then I successfully start the Unsafe Browser in "es" 29.873
And I kill the Unsafe Browser 5.951
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 34.300
And DuckDuckGo is the default search engine 9.822
And I kill the Tor Browser 5.339
And the screen keyboard works in Thunderbird 20.037
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.122
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.812
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.677
When I log in to a new session in Turkish (tr) 27.608
Then the keyboard layout is set to "tr" 0.120
When the network is plugged 0.084
And Tor is ready 13.901
Then I successfully start the Unsafe Browser in "tr" 25.730
And I kill the Unsafe Browser 6.107
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 33.762
And DuckDuckGo is the default search engine 9.817
And I kill the Tor Browser 5.320
And the screen keyboard works in Thunderbird 21.851
And the layout of the screen keyboard is set to "us" 0.694
After features/support/hooks.rb:291 1.110
After features/support/hooks.rb:75 0.000