Project Number Date
test_Tails_ISO_stable 4562 11 Dec 2023, 12:15

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:14:3.838 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.170
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.782
And I prepare Tails for memory erasure tests 0.453
When I start a process allocating 128 MiB of memory with a known pattern 2.725
Then patterns cover at least 128 MiB in the guest's memory 3.169 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.394
Then I find very few patterns in the guest's memory 3.645 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 0.691
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.090
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.785
And I prepare Tails for memory erasure tests 0.411
And I find very few patterns in the guest's memory 3.633 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 44.224
Then patterns cover at least 99% of the test FS size in the guest's memory 3.125 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.289
Then I find very few patterns in the guest's memory 3.621 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 0.742
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:16.810
Before features/support/hooks.rb:245 0.001
Given I have started Tails from DVD without network and logged in 7.804
And I prepare Tails for memory erasure tests 0.478
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.815
Then I find very few patterns in the guest's memory 3.721 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:40.270
Then patterns cover at least 86% of the test FS size in the guest's memory 3.109 
Pattern coverage: 96.519% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.459
Then I find very few patterns in the guest's memory 3.586 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
# read cache
When I mount the USB drive again 0.716
And I read the content of the test FS 0.826
Then patterns cover at least 99% of the test FS size in the guest's memory 2.937 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 2.378
Then I find very few patterns in the guest's memory 3.705 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 0.961
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:51.311
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.878
And I prepare Tails for memory erasure tests 0.460
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.346
Then I find very few patterns in the guest's memory 3.426 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:55.022
Then patterns cover at least 99% of the test FS size in the guest's memory 2.896 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.913
Then I find very few patterns in the guest's memory 3.570 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
# read cache
When I mount the USB drive again 5.114
And I read the content of the test FS 0.400
Then patterns cover at least 99% of the test FS size in the guest's memory 4.160 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.761
Then I find very few patterns in the guest's memory 3.359 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 0.950
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.961
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.944
And I prepare Tails for memory erasure tests 0.464
When I fill a 128 MiB file with a known pattern on the root filesystem 14.081
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 3.411
Then patterns cover at least 128 MiB in the guest's memory 2.652 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.652
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.734 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 3.438
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:54.397
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:6.125
And I prepare Tails for memory erasure tests 0.479
When I fill a 128 MiB file with a known pattern on the persistent filesystem 25.218
When I trigger shutdown 0.343
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.214 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
After features/support/hooks.rb:291 3.449
After features/support/hooks.rb:75 0.049
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:54.236
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:6.880
And I update APT using apt 16.169
And I install "popularity-contest" using apt 19.829
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:1.332
When I create a persistent storage and activate the Additional Software feature 19.133
Then Additional Software is correctly configured for package "popularity-contest" 1.288
When I shutdown Tails and wait for the computer to power off 10.068
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:38.239
Then Additional Software is correctly configured for package "popularity-contest" 0.991
And the package "popularity-contest" is installed after Additional Software has been started 0.303
After features/support/hooks.rb:450 38.506
After features/support/hooks.rb:291 1.399
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:23.581
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.198
And I start Tails from USB drive "__internal" and I login with an administration password 1:49.019
And I update APT using apt 15.065
When I install "makepp" using apt 19.561
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.662
And the package "makepp" is installed 0.072
After features/support/hooks.rb:450 42.453
After features/support/hooks.rb:291 0.833
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:3.791
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.199
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:19.337
When I uninstall "popularity-contest" using apt 18.974
And I accept removing "popularity-contest" from Additional Software 0.749
Then "popularity-contest" is not in the list of Additional Software 0.812
When I start Synaptic 23.136
And I update APT using Synaptic 21.691
And I install "cowsay" using Synaptic 8.482
And I accept adding "cowsay" to Additional Software 1.073
Then Additional Software is correctly configured for package "cowsay" 0.919
When I uninstall "cowsay" using apt 3.367
And I refuse removing "cowsay" from Additional Software 0.744
Then Additional Software is correctly configured for package "cowsay" 0.916
When I start "Additional Software" via GNOME Activities Overview 12.538
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.942
Then "cowsay" is not in the list of Additional Software 1.040
When I install "cowsay" using apt 3.297
And I refuse adding "cowsay" to Additional Software 0.772
Then "cowsay" is not in the list of Additional Software 0.792
After features/support/hooks.rb:450 1.196
After features/support/hooks.rb:291 0.751
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:6.153
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.203
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:1.130
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.130
And I accept adding "cowsay" to Additional Software 1:9.452
And Additional Software is correctly configured for package "cowsay" 1.395
And I shutdown Tails and wait for the computer to power off 6.073
And I start Tails from USB drive "__internal" with network unplugged 46.120
And I enable persistence 31.391
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 32.225
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.636
And I revert the APT tweaks that made it prefer an old version of cowsay 0.070
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.085
And the network is plugged 0.056
And Tor is ready 18.905
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.962
And available upgrades have been checked 0.348
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.219
And I can open the Additional Software configuration window from the notification 2.587
And I shutdown Tails and wait for the computer to power off 2:2.672
And I start Tails from USB drive "__internal" with network unplugged 45.075
And I enable persistence 32.508
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 21.873
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.159
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.040
And Tor is ready 48.372
Then the Additional Software upgrade service has started 0.205
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.120
After features/support/hooks.rb:450 2.546
After features/support/hooks.rb:291 0.682
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.779
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.185
And I start Tails from USB drive "__internal" with network unplugged 46.462
And I enable persistence 34.043
And I remove the "cowsay" deb files from the APT cache 0.649
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.085
And I log in to a new session 19.475
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.303
And I can open the Additional Software log file from the notification 2.410
And the package "cowsay" is not installed 0.163
After features/support/hooks.rb:450 0.110
After features/support/hooks.rb:291 1.278
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.584
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.299
When I log in to a new session in Arabic (ar) 33.049
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.041
And Tor is ready 15.367
Then I successfully start the Unsafe Browser in "ar" 25.721
And I kill the Unsafe Browser 5.742
When I enable the screen keyboard 0.237
Then the screen keyboard works in Tor Browser 35.279
And DuckDuckGo is the default search engine 9.982
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 22.783
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.021
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.002
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.132
When I log in to a new session in Chinese (zh_CN) 33.279
Then the keyboard layout is set to "cn" 0.293
When the network is plugged 0.046
And Tor is ready 16.429
Then I successfully start the Unsafe Browser in "zh_CN" 28.030
And I kill the Unsafe Browser 5.626
When I enable the screen keyboard 0.167
Then the screen keyboard works in Tor Browser 35.006
And DuckDuckGo is the default search engine 9.406
And I kill the Tor Browser 5.525
And the screen keyboard works in Thunderbird 25.423
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:291 1.130
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.495
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.853
When I log in to a new session in English (en) 18.428
Then the keyboard layout is set to "us" 0.143
When the network is plugged 0.033
And Tor is ready 16.122
Then I successfully start the Unsafe Browser in "en" 27.708
And I kill the Unsafe Browser 6.337
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 34.592
And DuckDuckGo is the default search engine 5.438
And I kill the Tor Browser 5.292
And the screen keyboard works in Thunderbird 24.822
And the layout of the screen keyboard is set to "us" 0.572
After features/support/hooks.rb:291 1.094
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:17.220
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.970
When I log in to a new session in French (fr) 32.939
Then the keyboard layout is set to "fr" 0.333
When the network is plugged 0.048
And Tor is ready 45.289
Then I successfully start the Unsafe Browser in "fr" 28.190
And I kill the Unsafe Browser 6.191
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 36.504
And DuckDuckGo is the default search engine 10.233
And I kill the Tor Browser 5.585
And the screen keyboard works in Thunderbird 23.223
And the layout of the screen keyboard is set to "fr" 0.571
After features/support/hooks.rb:291 1.107
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.015
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.795
When I log in to a new session in German (de) 29.304
Then the keyboard layout is set to "de" 0.169
When the network is plugged 0.041
And Tor is ready 16.141
Then I successfully start the Unsafe Browser in "de" 30.235
And I kill the Unsafe Browser 6.050
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 34.347
And DuckDuckGo is the default search engine 9.537
And I kill the Tor Browser 5.294
And the screen keyboard works in Thunderbird 24.385
And the layout of the screen keyboard is set to "de" 0.589
After features/support/hooks.rb:291 1.182
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:13.771
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.609
When I log in to a new session in Italian (it) 30.840
Then the keyboard layout is set to "it" 0.293
When the network is plugged 0.045
And Tor is ready 44.808
Then I successfully start the Unsafe Browser in "it" 28.660
And I kill the Unsafe Browser 5.998
When I enable the screen keyboard 0.180
Then the screen keyboard works in Tor Browser 35.727
And DuckDuckGo is the default search engine 10.007
And I kill the Tor Browser 5.360
And the screen keyboard works in Thunderbird 22.622
And the layout of the screen keyboard is set to "us" 0.616
After features/support/hooks.rb:291 1.196
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:19.623
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.486
When I log in to a new session in Persian (fa) 31.136
Then the keyboard layout is set to "ir" 0.282
When the network is plugged 0.054
And Tor is ready 47.784
Then I successfully start the Unsafe Browser in "fa" 29.048
And I kill the Unsafe Browser 5.995
When I enable the screen keyboard 0.185
Then the screen keyboard works in Tor Browser 35.713
And DuckDuckGo is the default search engine 9.499
And I kill the Tor Browser 5.285
And the screen keyboard works in Thunderbird 25.574
And the layout of the screen keyboard is set to "ir" 0.576
After features/support/hooks.rb:291 3.662
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.283
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.938
When I log in to a new session in Portuguese (pt) 30.040
Then the keyboard layout is set to "pt" 0.202
When the network is plugged 0.044
And Tor is ready 16.100
Then I successfully start the Unsafe Browser in "pt" 29.931
And I kill the Unsafe Browser 6.011
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.470
And DuckDuckGo is the default search engine 9.471
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 21.046
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.309
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.589
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.280
When I log in to a new session in Russian (ru) 30.013
Then the keyboard layout is set to "ru" 0.202
When the network is plugged 0.056
And Tor is ready 16.067
Then I successfully start the Unsafe Browser in "ru" 28.418
And I kill the Unsafe Browser 6.060
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 34.568
And DuckDuckGo is the default search engine 9.650
And I kill the Tor Browser 5.396
And the screen keyboard works in Thunderbird 25.123
And the layout of the screen keyboard is set to "ru" 0.593
After features/support/hooks.rb:291 1.049
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.649
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.817
When I log in to a new session in Spanish (es) 31.662
Then the keyboard layout is set to "es" 0.214
When the network is plugged 0.047
And Tor is ready 18.262
Then I successfully start the Unsafe Browser in "es" 29.192
And I kill the Unsafe Browser 5.733
When I enable the screen keyboard 0.197
Then the screen keyboard works in Tor Browser 35.214
And DuckDuckGo is the default search engine 10.517
And I kill the Tor Browser 5.594
And the screen keyboard works in Thunderbird 20.560
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:291 2.653
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.317
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.204
When I log in to a new session in Turkish (tr) 30.130
Then the keyboard layout is set to "tr" 0.193
When the network is plugged 0.037
And Tor is ready 16.073
Then I successfully start the Unsafe Browser in "tr" 29.578
And I kill the Unsafe Browser 6.560
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 36.446
And DuckDuckGo is the default search engine 9.960
And I kill the Tor Browser 5.404
And the screen keyboard works in Thunderbird 22.930
And the layout of the screen keyboard is set to "us" 0.632
After features/support/hooks.rb:291 1.175
After features/support/hooks.rb:75 0.000