Project Number Date
test_Tails_ISO_stable 4601 04 Jan 2024, 12:10

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:3.026 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.818
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.845
And I prepare Tails for memory erasure tests 0.536
When I start a process allocating 128 MiB of memory with a known pattern 2.329
Then patterns cover at least 128 MiB in the guest's memory 3.273 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.258
Then I find very few patterns in the guest's memory 3.575 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 0.932
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.982
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.405
And I prepare Tails for memory erasure tests 0.542
And I find very few patterns in the guest's memory 3.536 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.258
Then patterns cover at least 99% of the test FS size in the guest's memory 3.087 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.261
Then I find very few patterns in the guest's memory 3.889 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
After features/support/hooks.rb:291 0.802
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:49.091
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.641
And I prepare Tails for memory erasure tests 0.608
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.059
Then I find very few patterns in the guest's memory 4.290 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:2.904
Then patterns cover at least 86% of the test FS size in the guest's memory 3.984 
Pattern coverage: 93.369% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.376
Then I find very few patterns in the guest's memory 4.392 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
# read cache
When I mount the USB drive again 0.328
And I read the content of the test FS 0.937
Then patterns cover at least 99% of the test FS size in the guest's memory 3.848 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.387
Then I find very few patterns in the guest's memory 11.329 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
After features/support/hooks.rb:291 0.914
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:39.931
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.904
And I prepare Tails for memory erasure tests 0.665
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.563
Then I find very few patterns in the guest's memory 4.002 
Pattern coverage: 0.000% (0 MiB out of 1174 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:32.611
Then patterns cover at least 99% of the test FS size in the guest's memory 2.567 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.655
Then I find very few patterns in the guest's memory 3.779 
Pattern coverage: 0.000% (0 MiB out of 1174 MiB reference memory)
# read cache
When I mount the USB drive again 15.062
And I read the content of the test FS 0.494
Then patterns cover at least 99% of the test FS size in the guest's memory 3.579 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.953
Then I find very few patterns in the guest's memory 3.092 
Pattern coverage: 0.000% (0 MiB out of 1174 MiB reference memory)
After features/support/hooks.rb:291 0.938
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.684
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.127
And I prepare Tails for memory erasure tests 0.433
When I fill a 128 MiB file with a known pattern on the root filesystem 13.961
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.370
Then patterns cover at least 128 MiB in the guest's memory 3.188 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.644
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.938 
Pattern coverage: 0.000% (0 MiB out of 1182 MiB reference memory)
After features/support/hooks.rb:291 3.462
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:55.202
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:11.703
And I prepare Tails for memory erasure tests 0.424
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.628
When I trigger shutdown 0.343
And I wait 20 seconds 20.007 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.095 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 3.513
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:37.744
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.601
And I update APT using apt 16.859
And I install "popularity-contest" using apt 19.535
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.193
When I create a persistent storage and activate the Additional Software feature 16.935
Then Additional Software is correctly configured for package "popularity-contest" 1.411
When I shutdown Tails and wait for the computer to power off 11.102
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:39.874
Then Additional Software is correctly configured for package "popularity-contest" 0.926
And the package "popularity-contest" is installed after Additional Software has been started 0.304
After features/support/hooks.rb:450 38.134
After features/support/hooks.rb:291 1.425
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:56.098
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with an administration password 1:20.271
And I update APT using apt 16.211
When I install "makepp" using apt 19.718
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.606
And the package "makepp" is installed 0.090
After features/support/hooks.rb:450 43.746
After features/support/hooks.rb:291 0.984
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:57.715
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.199
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:10.593
When I uninstall "popularity-contest" using apt 19.024
And I accept removing "popularity-contest" from Additional Software 0.705
Then "popularity-contest" is not in the list of Additional Software 0.841
When I start Synaptic 23.646
And I update APT using Synaptic 21.874
And I install "cowsay" using Synaptic 8.478
And I accept adding "cowsay" to Additional Software 2.470
Then Additional Software is correctly configured for package "cowsay" 0.953
When I uninstall "cowsay" using apt 3.295
And I refuse removing "cowsay" from Additional Software 0.681
Then Additional Software is correctly configured for package "cowsay" 0.877
When I start "Additional Software" via GNOME Activities Overview 12.431
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.707
Then "cowsay" is not in the list of Additional Software 1.028
When I install "cowsay" using apt 3.272
And I refuse adding "cowsay" to Additional Software 0.826
Then "cowsay" is not in the list of Additional Software 0.806
After features/support/hooks.rb:450 1.061
After features/support/hooks.rb:291 0.709
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:58.902
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.189
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:27.597
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.664
And I accept adding "cowsay" to Additional Software 1:1.984
And Additional Software is correctly configured for package "cowsay" 1.504
And I shutdown Tails and wait for the computer to power off 6.164
And I start Tails from USB drive "__internal" with network unplugged 44.391
And I enable persistence 30.983
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 29.272
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.645
And I revert the APT tweaks that made it prefer an old version of cowsay 0.089
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.115
And the network is plugged 0.047
And Tor is ready 17.668
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.239
And available upgrades have been checked 0.285
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.918
And I can open the Additional Software configuration window from the notification 3.058
And I shutdown Tails and wait for the computer to power off 2:2.481
And I start Tails from USB drive "__internal" with network unplugged 45.098
And I enable persistence 31.539
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 21.423
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.678
And I revert the APT tweaks that made it prefer an old version of cowsay 0.046
And the network is plugged 0.064
And Tor is ready 39.401
Then the Additional Software upgrade service has started 0.174
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.103
After features/support/hooks.rb:450 2.405
After features/support/hooks.rb:291 0.768
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:45.061
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.229
And I start Tails from USB drive "__internal" with network unplugged 45.575
And I enable persistence 32.236
And I remove the "cowsay" deb files from the APT cache 0.573
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.081
And I log in to a new session 19.705
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.326
And I can open the Additional Software log file from the notification 2.152
And the package "cowsay" is not installed 0.180
After features/support/hooks.rb:450 0.113
After features/support/hooks.rb:291 0.833
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.313
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.537
When I log in to a new session in Arabic (ar) 31.194
Then the keyboard layout is set to "us" 0.206
When the network is plugged 0.120
And Tor is ready 14.977
Then I successfully start the Unsafe Browser in "ar" 26.393
And I kill the Unsafe Browser 7.120
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 35.445
And DuckDuckGo is the default search engine 9.392
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 23.850
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:291 1.611
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.387
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.168
When I log in to a new session in Chinese (zh_CN) 28.101
Then the keyboard layout is set to "cn" 0.134
When the network is plugged 0.073
And Tor is ready 14.242
Then I successfully start the Unsafe Browser in "zh_CN" 27.689
And I kill the Unsafe Browser 5.908
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.872
And DuckDuckGo is the default search engine 9.976
And I kill the Tor Browser 5.402
And the screen keyboard works in Thunderbird 27.055
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:291 1.137
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.762
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.802
When I log in to a new session in English (en) 15.382
Then the keyboard layout is set to "us" 0.157
When the network is plugged 0.054
And Tor is ready 13.588
Then I successfully start the Unsafe Browser in "en" 29.233
And I kill the Unsafe Browser 6.020
When I enable the screen keyboard 0.182
Then the screen keyboard works in Tor Browser 34.110
And DuckDuckGo is the default search engine 5.478
And I kill the Tor Browser 5.338
And the screen keyboard works in Thunderbird 21.858
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.171
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:57.313
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.905
When I log in to a new session in French (fr) 29.060
Then the keyboard layout is set to "fr" 0.142
When the network is plugged 0.054
And Tor is ready 33.042
Then I successfully start the Unsafe Browser in "fr" 27.247
And I kill the Unsafe Browser 8.012
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 34.297
And DuckDuckGo is the default search engine 9.515
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 21.964
And the layout of the screen keyboard is set to "fr" 0.589
After features/support/hooks.rb:291 1.645
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.197
Before features/support/hooks.rb:245 0.013
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.869
When I log in to a new session in German (de) 28.366
Then the keyboard layout is set to "de" 0.196
When the network is plugged 0.051
And Tor is ready 15.847
Then I successfully start the Unsafe Browser in "de" 26.889
And I kill the Unsafe Browser 8.915
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 36.028
And DuckDuckGo is the default search engine 10.380
And I kill the Tor Browser 5.600
And the screen keyboard works in Thunderbird 24.312
And the layout of the screen keyboard is set to "de" 0.596
After features/support/hooks.rb:291 1.177
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:10.691
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.909
When I log in to a new session in Italian (it) 29.252
Then the keyboard layout is set to "it" 0.167
When the network is plugged 0.044
And Tor is ready 45.387
Then I successfully start the Unsafe Browser in "it" 30.760
And I kill the Unsafe Browser 5.928
When I enable the screen keyboard 0.157
Then the screen keyboard works in Tor Browser 33.796
And DuckDuckGo is the default search engine 9.820
And I kill the Tor Browser 5.341
And the screen keyboard works in Thunderbird 21.551
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.118
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.197
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.891
When I log in to a new session in Persian (fa) 32.519
Then the keyboard layout is set to "ir" 0.190
When the network is plugged 0.037
And Tor is ready 15.367
Then I successfully start the Unsafe Browser in "fa" 29.169
And I kill the Unsafe Browser 6.429
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 37.571
And DuckDuckGo is the default search engine 9.946
And I kill the Tor Browser 5.298
And the screen keyboard works in Thunderbird 22.976
And the layout of the screen keyboard is set to "ir" 0.658
After features/support/hooks.rb:291 1.084
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.248
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.595
When I log in to a new session in Portuguese (pt) 29.128
Then the keyboard layout is set to "pt" 0.140
When the network is plugged 0.034
And Tor is ready 15.573
Then I successfully start the Unsafe Browser in "pt" 28.731
And I kill the Unsafe Browser 5.851
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 33.793
And DuckDuckGo is the default search engine 17.693
And I kill the Tor Browser 5.521
And the screen keyboard works in Thunderbird 21.380
And the layout of the screen keyboard is set to "us" 0.661
After features/support/hooks.rb:291 1.085
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.993
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.007
When I log in to a new session in Russian (ru) 28.642
Then the keyboard layout is set to "ru" 0.215
When the network is plugged 0.034
And Tor is ready 15.131
Then I successfully start the Unsafe Browser in "ru" 27.822
And I kill the Unsafe Browser 6.051
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 36.584
And DuckDuckGo is the default search engine 10.384
And I kill the Tor Browser 5.490
And the screen keyboard works in Thunderbird 22.924
And the layout of the screen keyboard is set to "ru" 0.540
After features/support/hooks.rb:291 1.143
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.407
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.839
When I log in to a new session in Spanish (es) 28.704
Then the keyboard layout is set to "es" 0.150
When the network is plugged 0.055
And Tor is ready 15.360
Then I successfully start the Unsafe Browser in "es" 26.656
And I kill the Unsafe Browser 8.138
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 35.014
And DuckDuckGo is the default search engine 9.611
And I kill the Tor Browser 5.933
And the screen keyboard works in Thunderbird 21.141
And the layout of the screen keyboard is set to "us" 0.655
After features/support/hooks.rb:291 1.135
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.280
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.100
When I log in to a new session in Turkish (tr) 28.391
Then the keyboard layout is set to "tr" 0.164
When the network is plugged 0.047
And Tor is ready 14.530
Then I successfully start the Unsafe Browser in "tr" 27.605
And I kill the Unsafe Browser 5.940
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 33.651
And DuckDuckGo is the default search engine 9.773
And I kill the Tor Browser 5.315
And the screen keyboard works in Thunderbird 23.072
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.132
After features/support/hooks.rb:75 0.000