Project Number Date
test_Tails_ISO_stable 4596 30 Dec 2023, 12:20

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:5.133 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.022
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.520
And I prepare Tails for memory erasure tests 0.554
When I start a process allocating 128 MiB of memory with a known pattern 1.279
Then patterns cover at least 128 MiB in the guest's memory 3.397 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.255
Then I find very few patterns in the guest's memory 4.014 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
After features/support/hooks.rb:291 0.705
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.945
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.668
And I prepare Tails for memory erasure tests 0.572
And I find very few patterns in the guest's memory 4.512 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.364
Then patterns cover at least 99% of the test FS size in the guest's memory 3.376 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.758
Then I find very few patterns in the guest's memory 3.692 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
After features/support/hooks.rb:291 0.801
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:8.230
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.875
And I prepare Tails for memory erasure tests 0.640
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.840
Then I find very few patterns in the guest's memory 9.078 
Pattern coverage: 0.000% (0 MiB out of 1252 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:27.117
Then patterns cover at least 86% of the test FS size in the guest's memory 3.284 
Pattern coverage: 94.993% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.512
Then I find very few patterns in the guest's memory 3.811 
Pattern coverage: 0.000% (0 MiB out of 1252 MiB reference memory)
# read cache
When I mount the USB drive again 0.196
And I read the content of the test FS 0.645
Then patterns cover at least 99% of the test FS size in the guest's memory 3.254 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.280
Then I find very few patterns in the guest's memory 3.690 
Pattern coverage: 0.000% (0 MiB out of 1252 MiB reference memory)
After features/support/hooks.rb:291 0.816
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:22.748
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 9.020
And I prepare Tails for memory erasure tests 0.579
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.299
Then I find very few patterns in the guest's memory 4.154 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:26.888
Then patterns cover at least 99% of the test FS size in the guest's memory 3.127 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.626
Then I find very few patterns in the guest's memory 3.442 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 3.312
And I read the content of the test FS 0.401
Then patterns cover at least 99% of the test FS size in the guest's memory 3.348 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.424
Then I find very few patterns in the guest's memory 3.123 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 0.768
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
46.142
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.396
And I prepare Tails for memory erasure tests 0.495
When I fill a 128 MiB file with a known pattern on the root filesystem 10.644
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.474
Then patterns cover at least 128 MiB in the guest's memory 2.305 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.979
And I wait 20 seconds 20.014 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.830 
Pattern coverage: 0.000% (0 MiB out of 1240 MiB reference memory)
After features/support/hooks.rb:291 3.441
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:15.473
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:29.461
And I prepare Tails for memory erasure tests 0.568
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.821
When I trigger shutdown 0.357
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.244 
Pattern coverage: 0.000% (0 MiB out of 1170 MiB reference memory)
After features/support/hooks.rb:291 3.485
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:30.198
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.722
And I update APT using apt 16.157
And I install "popularity-contest" using apt 19.671
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.155
When I create a persistent storage and activate the Additional Software feature 19.745
Then Additional Software is correctly configured for package "popularity-contest" 1.409
When I shutdown Tails and wait for the computer to power off 11.195
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.858
Then Additional Software is correctly configured for package "popularity-contest" 0.976
And the package "popularity-contest" is installed after Additional Software has been started 0.306
After features/support/hooks.rb:450 38.711
After features/support/hooks.rb:291 1.374
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:1.993
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.201
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.624
And I update APT using apt 15.529
When I install "makepp" using apt 19.666
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:4.850
And the package "makepp" is installed 0.119
After features/support/hooks.rb:450 39.152
After features/support/hooks.rb:291 1.026
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:53.695
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:10.374
When I uninstall "popularity-contest" using apt 15.938
And I accept removing "popularity-contest" from Additional Software 1.933
Then "popularity-contest" is not in the list of Additional Software 0.720
When I start Synaptic 24.566
And I update APT using Synaptic 22.011
And I install "cowsay" using Synaptic 9.619
And I accept adding "cowsay" to Additional Software 0.948
Then Additional Software is correctly configured for package "cowsay" 0.888
When I uninstall "cowsay" using apt 3.361
And I refuse removing "cowsay" from Additional Software 0.703
Then Additional Software is correctly configured for package "cowsay" 1.004
When I start "Additional Software" via GNOME Activities Overview 10.267
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.956
Then "cowsay" is not in the list of Additional Software 1.200
When I install "cowsay" using apt 3.324
And I refuse adding "cowsay" to Additional Software 0.793
Then "cowsay" is not in the list of Additional Software 0.862
After features/support/hooks.rb:450 0.933
After features/support/hooks.rb:291 0.751
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:20.998
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.007
Given a computer 0.228
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.122
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.149
And I accept adding "cowsay" to Additional Software 1:4.872
And Additional Software is correctly configured for package "cowsay" 1.338
And I shutdown Tails and wait for the computer to power off 6.200
And I start Tails from USB drive "__internal" with network unplugged 46.234
And I enable persistence 32.512
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 30.694
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.405
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.082
And the network is plugged 0.055
And Tor is ready 44.325
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.977
And available upgrades have been checked 0.092
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 4.288
And I can open the Additional Software configuration window from the notification 3.684
And I shutdown Tails and wait for the computer to power off 2:2.528
And I start Tails from USB drive "__internal" with network unplugged 45.663
And I enable persistence 31.213
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 31.297
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.279
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
And the network is plugged 0.054
And Tor is ready 39.147
Then the Additional Software upgrade service has started 0.221
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.134
After features/support/hooks.rb:450 2.323
After features/support/hooks.rb:291 0.683
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.914
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.184
And I start Tails from USB drive "__internal" with network unplugged 45.119
And I enable persistence 34.539
And I remove the "cowsay" deb files from the APT cache 0.584
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.094
And I log in to a new session 23.897
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.827
And I can open the Additional Software log file from the notification 2.487
And the package "cowsay" is not installed 0.177
After features/support/hooks.rb:450 0.099
After features/support/hooks.rb:291 0.843
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.751
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.326
When I log in to a new session in Arabic (ar) 32.851
Then the keyboard layout is set to "us" 0.154
When the network is plugged 0.048
And Tor is ready 16.034
Then I successfully start the Unsafe Browser in "ar" 25.639
And I kill the Unsafe Browser 5.963
When I enable the screen keyboard 0.175
Then the screen keyboard works in Tor Browser 35.190
And DuckDuckGo is the default search engine 10.841
And I kill the Tor Browser 5.758
And the screen keyboard works in Thunderbird 21.215
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:291 1.084
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.040
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.906
When I log in to a new session in Chinese (zh_CN) 30.027
Then the keyboard layout is set to "cn" 0.175
When the network is plugged 0.035
And Tor is ready 14.129
Then I successfully start the Unsafe Browser in "zh_CN" 27.729
And I kill the Unsafe Browser 5.832
When I enable the screen keyboard 0.214
Then the screen keyboard works in Tor Browser 34.902
And DuckDuckGo is the default search engine 9.841
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 28.296
And the layout of the screen keyboard is set to "us" 0.613
After features/support/hooks.rb:291 1.238
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.906
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.082
When I log in to a new session in English (en) 20.113
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.045
And Tor is ready 15.724
Then I successfully start the Unsafe Browser in "en" 29.403
And I kill the Unsafe Browser 5.850
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 33.965
And DuckDuckGo is the default search engine 5.366
And I kill the Tor Browser 5.352
And the screen keyboard works in Thunderbird 21.054
And the layout of the screen keyboard is set to "us" 0.642
After features/support/hooks.rb:291 1.132
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.738
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.970
When I log in to a new session in French (fr) 29.724
Then the keyboard layout is set to "fr" 0.195
When the network is plugged 0.041
And Tor is ready 14.525
Then I successfully start the Unsafe Browser in "fr" 27.345
And I kill the Unsafe Browser 5.956
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 32.885
And DuckDuckGo is the default search engine 9.941
And I kill the Tor Browser 5.336
And the screen keyboard works in Thunderbird 22.107
And the layout of the screen keyboard is set to "fr" 0.552
After features/support/hooks.rb:291 1.533
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.064
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.925
When I log in to a new session in German (de) 29.246
Then the keyboard layout is set to "de" 0.138
When the network is plugged 0.042
And Tor is ready 15.635
Then I successfully start the Unsafe Browser in "de" 26.945
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 33.691
And DuckDuckGo is the default search engine 9.340
And I kill the Tor Browser 5.376
And the screen keyboard works in Thunderbird 22.177
And the layout of the screen keyboard is set to "de" 0.582
After features/support/hooks.rb:291 3.589
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.397
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.201
When I log in to a new session in Italian (it) 30.882
Then the keyboard layout is set to "it" 0.158
When the network is plugged 0.039
And Tor is ready 15.885
Then I successfully start the Unsafe Browser in "it" 26.015
And I kill the Unsafe Browser 5.989
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 35.148
And DuckDuckGo is the default search engine 9.327
And I kill the Tor Browser 5.339
And the screen keyboard works in Thunderbird 21.728
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:291 1.161
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.093
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.871
When I log in to a new session in Persian (fa) 32.101
Then the keyboard layout is set to "ir" 0.152
When the network is plugged 0.042
And Tor is ready 13.961
Then I successfully start the Unsafe Browser in "fa" 27.816
And I kill the Unsafe Browser 5.757
When I enable the screen keyboard 0.184
Then the screen keyboard works in Tor Browser 35.635
And DuckDuckGo is the default search engine 9.978
And I kill the Tor Browser 5.381
And the screen keyboard works in Thunderbird 23.649
And the layout of the screen keyboard is set to "ir" 0.560
After features/support/hooks.rb:291 1.134
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.217
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.659
When I log in to a new session in Portuguese (pt) 31.717
Then the keyboard layout is set to "pt" 0.180
When the network is plugged 0.048
And Tor is ready 14.486
Then I successfully start the Unsafe Browser in "pt" 29.681
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 34.053
And DuckDuckGo is the default search engine 9.898
And I kill the Tor Browser 5.423
And the screen keyboard works in Thunderbird 23.537
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:291 3.659
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.604
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.271
When I log in to a new session in Russian (ru) 28.639
Then the keyboard layout is set to "ru" 0.179
When the network is plugged 0.033
And Tor is ready 14.640
Then I successfully start the Unsafe Browser in "ru" 27.941
And I kill the Unsafe Browser 6.061
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 35.750
And DuckDuckGo is the default search engine 10.290
And I kill the Tor Browser 5.622
And the screen keyboard works in Thunderbird 25.413
And the layout of the screen keyboard is set to "ru" 0.622
After features/support/hooks.rb:291 1.116
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.894
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.727
When I log in to a new session in Spanish (es) 28.554
Then the keyboard layout is set to "es" 0.275
When the network is plugged 0.041
And Tor is ready 16.960
Then I successfully start the Unsafe Browser in "es" 28.885
And I kill the Unsafe Browser 5.932
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.968
And DuckDuckGo is the default search engine 10.471
And I kill the Tor Browser 5.577
And the screen keyboard works in Thunderbird 24.701
And the layout of the screen keyboard is set to "us" 0.645
After features/support/hooks.rb:291 1.083
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.061
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.997
When I log in to a new session in Turkish (tr) 29.301
Then the keyboard layout is set to "tr" 0.135
When the network is plugged 0.051
And Tor is ready 14.081
Then I successfully start the Unsafe Browser in "tr" 29.669
And I kill the Unsafe Browser 5.860
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 35.440
And DuckDuckGo is the default search engine 17.628
And I kill the Tor Browser 5.466
And the screen keyboard works in Thunderbird 22.615
And the layout of the screen keyboard is set to "us" 0.699
After features/support/hooks.rb:291 1.098
After features/support/hooks.rb:75 0.000