Project Number Date
test_Tails_ISO_devel 3193 13 Dec 2023, 16:53

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:25:11.538 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.185
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.177
And I prepare Tails for memory erasure tests 0.560
When I start a process allocating 128 MiB of memory with a known pattern 1.266
Then patterns cover at least 128 MiB in the guest's memory 3.765 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.380
Then I find very few patterns in the guest's memory 6.035 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
After features/support/hooks.rb:291 1.097
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.691
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.082
And I prepare Tails for memory erasure tests 0.474
And I find very few patterns in the guest's memory 4.291 
Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.546
Then patterns cover at least 99% of the test FS size in the guest's memory 3.756 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.206
Then I find very few patterns in the guest's memory 4.332 
Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)
After features/support/hooks.rb:291 0.823
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:46.155
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.034
And I prepare Tails for memory erasure tests 0.589
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.904
Then I find very few patterns in the guest's memory 3.618 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3:10.971
Then patterns cover at least 86% of the test FS size in the guest's memory 2.953 
Pattern coverage: 95.033% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.601
Then I find very few patterns in the guest's memory 3.490 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
# read cache
When I mount the USB drive again 0.229
And I read the content of the test FS 0.796
Then patterns cover at least 99% of the test FS size in the guest's memory 3.111 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.311
Then I find very few patterns in the guest's memory 3.543 
Pattern coverage: 0.000% (0 MiB out of 1224 MiB reference memory)
After features/support/hooks.rb:291 0.906
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:52.036
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.189
And I prepare Tails for memory erasure tests 0.436
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.268
Then I find very few patterns in the guest's memory 3.247 
Pattern coverage: 0.000% (0 MiB out of 1219 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:0.695
Then patterns cover at least 99% of the test FS size in the guest's memory 2.287 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.726
Then I find very few patterns in the guest's memory 3.368 
Pattern coverage: 0.000% (0 MiB out of 1219 MiB reference memory)
# read cache
When I mount the USB drive again 3.438
And I read the content of the test FS 0.482
Then patterns cover at least 99% of the test FS size in the guest's memory 2.657 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.184
Then I find very few patterns in the guest's memory 3.052 
Pattern coverage: 0.000% (0 MiB out of 1219 MiB reference memory)
After features/support/hooks.rb:291 0.813
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.148
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.984
And I prepare Tails for memory erasure tests 0.482
When I fill a 128 MiB file with a known pattern on the root filesystem 14.391
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.625
Then patterns cover at least 128 MiB in the guest's memory 2.408 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.609
And I wait 20 seconds 20.002 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.646 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 3.460
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:47.440
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:2.446
And I prepare Tails for memory erasure tests 0.503
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.284
When I trigger shutdown 0.221
And I wait 20 seconds 20.001 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.982 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 3.424
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:13.830
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.004
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:21.134
And I update APT using apt 16.071
When I install "popularity-contest" using apt 19.473
Then I am notified I can not use Additional Software for "popularity-contest" 55.801
And I can open the Additional Software documentation from the notification 21.349
After features/support/hooks.rb:450 36.525
After features/support/hooks.rb:291 1.758
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:36.531
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:4.301
And I update APT using apt 17.283
And I install "popularity-contest" using apt 19.595
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.915
When I create a persistent storage and activate the Additional Software feature 16.850
Then Additional Software is correctly configured for package "popularity-contest" 1.344
When I shutdown Tails and wait for the computer to power off 9.097
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:29.948
Then Additional Software is correctly configured for package "popularity-contest" 0.910
And the package "popularity-contest" is installed after Additional Software has been started 0.285
After features/support/hooks.rb:450 38.241
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:48.021
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.148
And I start Tails from USB drive "__internal" and I login with an administration password 1:15.256
And I update APT using apt 15.739
When I install "makepp" using apt 19.284
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 57.483
And the package "makepp" is installed 0.109
After features/support/hooks.rb:450 37.766
After features/support/hooks.rb:291 0.920
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:31.299
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.161
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:50.708
When I uninstall "popularity-contest" using apt 18.971
And I accept removing "popularity-contest" from Additional Software 0.703
Then "popularity-contest" is not in the list of Additional Software 0.748
When I start Synaptic 20.296
And I update APT using Synaptic 21.549
And I install "cowsay" using Synaptic 7.838
And I accept adding "cowsay" to Additional Software 0.719
Then Additional Software is correctly configured for package "cowsay" 0.867
When I uninstall "cowsay" using apt 3.370
And I refuse removing "cowsay" from Additional Software 0.728
Then Additional Software is correctly configured for package "cowsay" 0.821
When I start "Additional Software" via GNOME Activities Overview 12.496
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.668
Then "cowsay" is not in the list of Additional Software 0.937
When I install "cowsay" using apt 3.292
And I refuse adding "cowsay" to Additional Software 0.712
Then "cowsay" is not in the list of Additional Software 0.707
After features/support/hooks.rb:450 1.038
After features/support/hooks.rb:291 0.663
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:36.391
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.176
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:51.386
And I configure APT to prefer an old version of cowsay 0.034
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.264
And I accept adding "cowsay" to Additional Software 1:4.140
And Additional Software is correctly configured for package "cowsay" 1.202
And I shutdown Tails and wait for the computer to power off 5.064
And I start Tails from USB drive "__internal" with network unplugged 44.561
And I enable persistence 30.247
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 20.729
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.342
And I revert the APT tweaks that made it prefer an old version of cowsay 0.073
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.102
And the network is plugged 0.033
And Tor is ready 43.872
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.491
And available upgrades have been checked 0.070
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.980
And I can open the Additional Software configuration window from the notification 2.506
And I shutdown Tails and wait for the computer to power off 2:2.552
And I start Tails from USB drive "__internal" with network unplugged 43.515
And I enable persistence 30.390
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 22.223
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.533
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.028
And Tor is ready 39.505
Then the Additional Software upgrade service has started 0.167
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.094
After features/support/hooks.rb:450 2.350
After features/support/hooks.rb:291 1.070
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:43.613
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.153
And I start Tails from USB drive "__internal" with network unplugged 44.787
And I enable persistence 30.302
And I remove the "cowsay" deb files from the APT cache 0.619
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.070
And I log in to a new session 22.132
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.425
And I can open the Additional Software log file from the notification 1.944
And the package "cowsay" is not installed 0.178
After features/support/hooks.rb:450 0.095
After features/support/hooks.rb:291 0.692
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.570
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.206
When I log in to a new session in Arabic (ar) 38.577
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.051
And Tor is ready 14.341
Then I successfully start the Unsafe Browser in "ar" 27.241
And I kill the Unsafe Browser 5.921
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 35.719
And DuckDuckGo is the default search engine 9.756
And I kill the Tor Browser 5.299
And the screen keyboard works in Thunderbird 21.658
And the layout of the screen keyboard is set to "us" 0.548
After features/support/hooks.rb:291 2.294
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.035
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.526
When I log in to a new session in Chinese (zh_CN) 27.135
Then the keyboard layout is set to "cn" 0.174
When the network is plugged 0.028
And Tor is ready 15.902
Then I successfully start the Unsafe Browser in "zh_CN" 27.576
And I kill the Unsafe Browser 5.641
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 34.938
And DuckDuckGo is the default search engine 9.326
And I kill the Tor Browser 5.317
And the screen keyboard works in Thunderbird 22.755
And the layout of the screen keyboard is set to "us" 0.596
After features/support/hooks.rb:291 3.479
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.148
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.780
When I log in to a new session in English (en) 15.526
Then the keyboard layout is set to "us" 0.253
When the network is plugged 0.029
And Tor is ready 14.565
Then I successfully start the Unsafe Browser in "en" 25.209
And I kill the Unsafe Browser 5.903
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 33.536
And DuckDuckGo is the default search engine 5.157
And I kill the Tor Browser 5.277
And the screen keyboard works in Thunderbird 21.243
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.362
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.471
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.857
When I log in to a new session in French (fr) 28.379
Then the keyboard layout is set to "fr" 0.124
When the network is plugged 0.026
And Tor is ready 14.748
Then I successfully start the Unsafe Browser in "fr" 24.435
And I kill the Unsafe Browser 6.047
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 32.777
And DuckDuckGo is the default search engine 9.541
And I kill the Tor Browser 5.315
And the screen keyboard works in Thunderbird 21.555
And the layout of the screen keyboard is set to "fr" 0.550
After features/support/hooks.rb:291 2.500
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.432
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.287
When I log in to a new session in German (de) 28.366
Then the keyboard layout is set to "de" 0.127
When the network is plugged 0.022
And Tor is ready 16.551
Then I successfully start the Unsafe Browser in "de" 28.779
And I kill the Unsafe Browser 5.856
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.955
And DuckDuckGo is the default search engine 9.122
And I kill the Tor Browser 5.314
And the screen keyboard works in Thunderbird 20.328
And the layout of the screen keyboard is set to "de" 0.600
After features/support/hooks.rb:291 1.142
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.228
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.726
When I log in to a new session in Italian (it) 27.484
Then the keyboard layout is set to "it" 0.168
When the network is plugged 0.038
And Tor is ready 15.556
Then I successfully start the Unsafe Browser in "it" 26.056
And I kill the Unsafe Browser 5.912
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 34.094
And DuckDuckGo is the default search engine 9.315
And I kill the Tor Browser 5.281
And the screen keyboard works in Thunderbird 23.903
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 1.192
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.809
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.690
When I log in to a new session in Persian (fa) 27.901
Then the keyboard layout is set to "ir" 0.230
When the network is plugged 0.026
And Tor is ready 15.616
Then I successfully start the Unsafe Browser in "fa" 27.227
And I kill the Unsafe Browser 5.917
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 35.712
And DuckDuckGo is the default search engine 9.215
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 22.206
And the layout of the screen keyboard is set to "ir" 0.590
After features/support/hooks.rb:291 1.228
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.795
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.147
When I log in to a new session in Portuguese (pt) 29.435
Then the keyboard layout is set to "pt" 0.156
When the network is plugged 0.024
And Tor is ready 16.012
Then I successfully start the Unsafe Browser in "pt" 24.795
And I kill the Unsafe Browser 6.277
When I enable the screen keyboard 0.081
Then the screen keyboard works in Tor Browser 34.161
And DuckDuckGo is the default search engine 9.566
And I kill the Tor Browser 5.332
And the screen keyboard works in Thunderbird 24.129
And the layout of the screen keyboard is set to "us" 0.674
After features/support/hooks.rb:291 2.670
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.577
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.334
When I log in to a new session in Russian (ru) 28.504
Then the keyboard layout is set to "ru" 0.237
When the network is plugged 0.030
And Tor is ready 15.099
Then I successfully start the Unsafe Browser in "ru" 25.889
And I kill the Unsafe Browser 5.913
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 37.131
And DuckDuckGo is the default search engine 9.490
And I kill the Tor Browser 5.390
And the screen keyboard works in Thunderbird 25.734
And the layout of the screen keyboard is set to "ru" 0.719
After features/support/hooks.rb:291 1.330
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.840
Before features/support/hooks.rb:245 0.013
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.234
When I log in to a new session in Spanish (es) 28.553
Then the keyboard layout is set to "es" 0.213
When the network is plugged 0.036
And Tor is ready 15.329
Then I successfully start the Unsafe Browser in "es" 26.378
And I kill the Unsafe Browser 5.870
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.702
And DuckDuckGo is the default search engine 9.951
And I kill the Tor Browser 5.305
And the screen keyboard works in Thunderbird 22.545
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.988
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.941
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.969
When I log in to a new session in Turkish (tr) 30.289
Then the keyboard layout is set to "tr" 0.160
When the network is plugged 0.032
And Tor is ready 15.693
Then I successfully start the Unsafe Browser in "tr" 28.668
And I kill the Unsafe Browser 5.876
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 33.598
And DuckDuckGo is the default search engine 9.830
And I kill the Tor Browser 5.365
And the screen keyboard works in Thunderbird 22.671
And the layout of the screen keyboard is set to "us" 0.639
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.341
When the network is plugged 0.021
And I wait 720 seconds 12:0.097 
Slept for 720 seconds
Then I successfully configure Tor 10.182
And the time has synced 0.040
After features/support/hooks.rb:291 0.602
After features/support/hooks.rb:75 0.000