Project Number Date
test_Tails_ISO_stable 4543 30 Nov 2023, 19:49

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:18.548 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.351
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.153
And I prepare Tails for memory erasure tests 0.458
When I start a process allocating 128 MiB of memory with a known pattern 1.317
Then patterns cover at least 128 MiB in the guest's memory 3.301 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.234
Then I find very few patterns in the guest's memory 3.886 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 0.701
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:4.943
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.263
And I prepare Tails for memory erasure tests 0.460
And I find very few patterns in the guest's memory 4.245 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.984
Then patterns cover at least 99% of the test FS size in the guest's memory 3.381 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.199
Then I find very few patterns in the guest's memory 4.408 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.875
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:22.796
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.806
And I prepare Tails for memory erasure tests 0.515
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.898
Then I find very few patterns in the guest's memory 3.998 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:35.481
Then patterns cover at least 86% of the test FS size in the guest's memory 6.667 
Pattern coverage: 93.177% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.724
Then I find very few patterns in the guest's memory 6.463 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 0.454
And I read the content of the test FS 0.770
Then patterns cover at least 99% of the test FS size in the guest's memory 6.272 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.528
Then I find very few patterns in the guest's memory 4.213 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 1.145
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:37.584
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.245
And I prepare Tails for memory erasure tests 0.438
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.656
Then I find very few patterns in the guest's memory 3.720 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:41.723
Then patterns cover at least 99% of the test FS size in the guest's memory 3.418 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.198
Then I find very few patterns in the guest's memory 3.324 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
# read cache
When I mount the USB drive again 3.849
And I read the content of the test FS 0.475
Then patterns cover at least 99% of the test FS size in the guest's memory 2.966 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.050
Then I find very few patterns in the guest's memory 3.515 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
After features/support/hooks.rb:291 1.122
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
53.303
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.736
And I prepare Tails for memory erasure tests 0.500
When I fill a 128 MiB file with a known pattern on the root filesystem 17.077
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.847
Then patterns cover at least 128 MiB in the guest's memory 2.478 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.815
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.828 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 3.461
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:15.054
Before features/support/hooks.rb:245 0.004
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:28.596
And I prepare Tails for memory erasure tests 0.517
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.954
When I trigger shutdown 0.406
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.560 
Pattern coverage: 0.000% (0 MiB out of 1176 MiB reference memory)
After features/support/hooks.rb:291 3.463
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:25.647
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.096
And I update APT using apt 15.979
And I install "popularity-contest" using apt 19.743
Then I am proposed to add the "popularity-contest" package to my Additional Software 54.467
When I create a persistent storage and activate the Additional Software feature 16.864
Then Additional Software is correctly configured for package "popularity-contest" 1.343
When I shutdown Tails and wait for the computer to power off 10.083
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:36.914
Then Additional Software is correctly configured for package "popularity-contest" 0.894
And the package "popularity-contest" is installed after Additional Software has been started 0.260
After features/support/hooks.rb:450 34.474
After features/support/hooks.rb:291 1.077
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:48.161
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.195
And I start Tails from USB drive "__internal" and I login with an administration password 1:17.377
And I update APT using apt 15.767
When I install "makepp" using apt 19.625
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 55.109
And the package "makepp" is installed 0.086
After features/support/hooks.rb:450 34.061
After features/support/hooks.rb:291 0.861
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:35.696
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.220
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:55.637
When I uninstall "popularity-contest" using apt 19.053
And I accept removing "popularity-contest" from Additional Software 0.641
Then "popularity-contest" is not in the list of Additional Software 0.730
When I start Synaptic 19.534
And I update APT using Synaptic 22.133
And I install "cowsay" using Synaptic 8.525
And I accept adding "cowsay" to Additional Software 0.875
Then Additional Software is correctly configured for package "cowsay" 0.972
When I uninstall "cowsay" using apt 3.288
And I refuse removing "cowsay" from Additional Software 0.656
Then Additional Software is correctly configured for package "cowsay" 0.849
When I start "Additional Software" via GNOME Activities Overview 12.324
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.380
Then "cowsay" is not in the list of Additional Software 1.025
When I install "cowsay" using apt 3.285
And I refuse adding "cowsay" to Additional Software 0.725
Then "cowsay" is not in the list of Additional Software 0.835
After features/support/hooks.rb:450 0.894
After features/support/hooks.rb:291 0.659
After features/support/hooks.rb:75 0.007
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:7.571
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.185
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:34.145
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.411
And I accept adding "cowsay" to Additional Software 1:4.932
And Additional Software is correctly configured for package "cowsay" 1.451
And I shutdown Tails and wait for the computer to power off 7.100
And I start Tails from USB drive "__internal" with network unplugged 52.318
And I enable persistence 30.761
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.019
And I log in to a new session 20.880
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.454
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.094
And the network is plugged 0.042
And Tor is ready 17.395
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.827
And available upgrades have been checked 0.155
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.001
And I can open the Additional Software configuration window from the notification 2.470
And I shutdown Tails and wait for the computer to power off 2:2.613
And I start Tails from USB drive "__internal" with network unplugged 43.750
And I enable persistence 30.288
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 23.633
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.214
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
And the network is plugged 0.061
And Tor is ready 40.925
Then the Additional Software upgrade service has started 0.193
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.078
After features/support/hooks.rb:450 2.619
After features/support/hooks.rb:291 0.656
After features/support/hooks.rb:75 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:44.948
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.180
And I start Tails from USB drive "__internal" with network unplugged 44.752
And I enable persistence 31.300
And I remove the "cowsay" deb files from the APT cache 0.629
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.086
And I log in to a new session 20.669
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.758
And I can open the Additional Software log file from the notification 2.393
And the package "cowsay" is not installed 0.176
After features/support/hooks.rb:450 0.111
After features/support/hooks.rb:291 0.872
After features/support/hooks.rb:75 0.007
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.192
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.709
When I log in to a new session in Arabic (ar) 34.244
Then the keyboard layout is set to "us" 0.211
When the network is plugged 0.271
And Tor is ready 14.599
Then I successfully start the Unsafe Browser in "ar" 26.147
And I kill the Unsafe Browser 5.935
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 34.689
And DuckDuckGo is the default search engine 10.490
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 23.644
And the layout of the screen keyboard is set to "us" 0.609
After features/support/hooks.rb:291 1.137
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.153
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.269
When I log in to a new session in Chinese (zh_CN) 35.192
Then the keyboard layout is set to "cn" 0.168
When the network is plugged 0.038
And Tor is ready 15.220
Then I successfully start the Unsafe Browser in "zh_CN" 27.577
And I kill the Unsafe Browser 5.659
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 33.811
And DuckDuckGo is the default search engine 9.318
And I kill the Tor Browser 5.278
And the screen keyboard works in Thunderbird 27.920
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 1.413
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.902
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.573
When I log in to a new session in English (en) 16.235
Then the keyboard layout is set to "us" 0.124
When the network is plugged 0.044
And Tor is ready 13.986
Then I successfully start the Unsafe Browser in "en" 26.051
And I kill the Unsafe Browser 5.974
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 33.330
And DuckDuckGo is the default search engine 5.403
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 22.112
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:291 1.034
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.525
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.803
When I log in to a new session in French (fr) 30.577
Then the keyboard layout is set to "fr" 0.201
When the network is plugged 0.046
And Tor is ready 13.723
Then I successfully start the Unsafe Browser in "fr" 26.264
And I kill the Unsafe Browser 6.606
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 34.383
And DuckDuckGo is the default search engine 9.662
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 22.187
And the layout of the screen keyboard is set to "fr" 0.613
After features/support/hooks.rb:291 1.300
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.159
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.560
When I log in to a new session in German (de) 31.460
Then the keyboard layout is set to "de" 0.134
When the network is plugged 0.050
And Tor is ready 15.015
Then I successfully start the Unsafe Browser in "de" 25.423
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 34.074
And DuckDuckGo is the default search engine 9.716
And I kill the Tor Browser 5.296
And the screen keyboard works in Thunderbird 20.956
And the layout of the screen keyboard is set to "de" 0.571
After features/support/hooks.rb:291 1.059
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.817
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.295
When I log in to a new session in Italian (it) 31.032
Then the keyboard layout is set to "it" 0.262
When the network is plugged 0.049
And Tor is ready 17.277
Then I successfully start the Unsafe Browser in "it" 26.651
And I kill the Unsafe Browser 5.974
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 33.316
And DuckDuckGo is the default search engine 10.107
And I kill the Tor Browser 5.568
And the screen keyboard works in Thunderbird 22.562
And the layout of the screen keyboard is set to "us" 0.589
After features/support/hooks.rb:291 1.204
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:17.260
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.431
When I log in to a new session in Persian (fa) 30.443
Then the keyboard layout is set to "ir" 0.135
When the network is plugged 0.036
And Tor is ready 45.038
Then I successfully start the Unsafe Browser in "fa" 28.949
And I kill the Unsafe Browser 7.091
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 37.333
And DuckDuckGo is the default search engine 10.671
And I kill the Tor Browser 5.603
And the screen keyboard works in Thunderbird 22.850
And the layout of the screen keyboard is set to "ir" 0.580
After features/support/hooks.rb:291 1.069
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.168
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.898
When I log in to a new session in Portuguese (pt) 29.064
Then the keyboard layout is set to "pt" 0.188
When the network is plugged 0.042
And Tor is ready 15.330
Then I successfully start the Unsafe Browser in "pt" 25.576
And I kill the Unsafe Browser 5.914
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 34.294
And DuckDuckGo is the default search engine 9.620
And I kill the Tor Browser 5.334
And the screen keyboard works in Thunderbird 22.221
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:291 1.332
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.178
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.536
When I log in to a new session in Russian (ru) 34.358
Then the keyboard layout is set to "ru" 0.237
When the network is plugged 0.046
And Tor is ready 15.869
Then I successfully start the Unsafe Browser in "ru" 28.234
And I kill the Unsafe Browser 5.911
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 36.269
And DuckDuckGo is the default search engine 9.871
And I kill the Tor Browser 5.454
And the screen keyboard works in Thunderbird 25.615
And the layout of the screen keyboard is set to "ru" 0.643
After features/support/hooks.rb:291 1.148
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.297
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.452
When I log in to a new session in Spanish (es) 30.927
Then the keyboard layout is set to "es" 0.321
When the network is plugged 0.059
And Tor is ready 15.109
Then I successfully start the Unsafe Browser in "es" 27.137
And I kill the Unsafe Browser 6.922
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 34.609
And DuckDuckGo is the default search engine 10.477
And I kill the Tor Browser 5.625
And the screen keyboard works in Thunderbird 22.863
And the layout of the screen keyboard is set to "us" 0.677
After features/support/hooks.rb:291 1.174
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.834
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.916
When I log in to a new session in Turkish (tr) 28.672
Then the keyboard layout is set to "tr" 0.151
When the network is plugged 0.053
And Tor is ready 14.615
Then I successfully start the Unsafe Browser in "tr" 27.268
And I kill the Unsafe Browser 6.048
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 34.998
And DuckDuckGo is the default search engine 9.848
And I kill the Tor Browser 5.374
And the screen keyboard works in Thunderbird 23.109
And the layout of the screen keyboard is set to "us" 0.627
After features/support/hooks.rb:291 2.118
After features/support/hooks.rb:75 0.000