Project Number Date
test_Tails_ISO_devel 3192 13 Dec 2023, 12:14

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:23:7.454 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.964
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.095
And I prepare Tails for memory erasure tests 0.537
When I start a process allocating 128 MiB of memory with a known pattern 1.366
Then patterns cover at least 128 MiB in the guest's memory 3.344 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.316
Then I find very few patterns in the guest's memory 4.303 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 1.003
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
58.545
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.297
And I prepare Tails for memory erasure tests 0.490
And I find very few patterns in the guest's memory 3.686 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.161
Then patterns cover at least 99% of the test FS size in the guest's memory 3.093 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.232
Then I find very few patterns in the guest's memory 3.583 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 1.071
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:58.376
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.282
And I prepare Tails for memory erasure tests 0.910
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.912
Then I find very few patterns in the guest's memory 3.736 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:21.431
Then patterns cover at least 86% of the test FS size in the guest's memory 3.181 
Pattern coverage: 93.792% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.377
Then I find very few patterns in the guest's memory 3.602 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 0.360
And I read the content of the test FS 0.893
Then patterns cover at least 99% of the test FS size in the guest's memory 3.089 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.876
Then I find very few patterns in the guest's memory 4.720 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.726
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:21.039
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.209
And I prepare Tails for memory erasure tests 0.511
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.690
Then I find very few patterns in the guest's memory 4.033 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:29.076
Then patterns cover at least 99% of the test FS size in the guest's memory 2.828 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.612
Then I find very few patterns in the guest's memory 3.219 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
# read cache
When I mount the USB drive again 2.936
And I read the content of the test FS 0.775
Then patterns cover at least 99% of the test FS size in the guest's memory 2.355 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.504
Then I find very few patterns in the guest's memory 3.285 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 0.854
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
45.951
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.767
And I prepare Tails for memory erasure tests 0.468
When I fill a 128 MiB file with a known pattern on the root filesystem 10.707
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.492
Then patterns cover at least 128 MiB in the guest's memory 2.338 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.536
And I wait 20 seconds 20.004 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.635 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 3.442
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:48.865
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:3.098
And I prepare Tails for memory erasure tests 0.429
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.053
When I trigger shutdown 0.246
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.020 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 3.468
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:18.815
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:25.463
And I update APT using apt 16.946
When I install "popularity-contest" using apt 19.535
Then I am notified I can not use Additional Software for "popularity-contest" 54.440
And I can open the Additional Software documentation from the notification 22.429
After features/support/hooks.rb:450 35.003
After features/support/hooks.rb:291 2.422
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:22.871
Before features/support/hooks.rb:245 0.022
Before features/support/hooks.rb:442 0.021
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 55.439
And I update APT using apt 16.976
And I install "popularity-contest" using apt 19.506
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.053
When I create a persistent storage and activate the Additional Software feature 18.237
Then Additional Software is correctly configured for package "popularity-contest" 1.149
When I shutdown Tails and wait for the computer to power off 9.272
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:24.998
Then Additional Software is correctly configured for package "popularity-contest" 0.911
And the package "popularity-contest" is installed after Additional Software has been started 0.325
After features/support/hooks.rb:450 38.474
After features/support/hooks.rb:291 0.936
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:47.293
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.191
And I start Tails from USB drive "__internal" and I login with an administration password 1:16.955
And I update APT using apt 15.804
When I install "makepp" using apt 19.595
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 54.656
And the package "makepp" is installed 0.089
After features/support/hooks.rb:450 39.599
After features/support/hooks.rb:291 0.817
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:33.936
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.188
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:53.240
When I uninstall "popularity-contest" using apt 15.909
And I accept removing "popularity-contest" from Additional Software 0.655
Then "popularity-contest" is not in the list of Additional Software 0.796
When I start Synaptic 22.913
And I update APT using Synaptic 21.709
And I install "cowsay" using Synaptic 7.965
And I accept adding "cowsay" to Additional Software 0.999
Then Additional Software is correctly configured for package "cowsay" 0.840
When I uninstall "cowsay" using apt 3.308
And I refuse removing "cowsay" from Additional Software 0.593
Then Additional Software is correctly configured for package "cowsay" 0.921
When I start "Additional Software" via GNOME Activities Overview 12.392
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.633
Then "cowsay" is not in the list of Additional Software 1.057
When I install "cowsay" using apt 3.334
And I refuse adding "cowsay" to Additional Software 0.720
Then "cowsay" is not in the list of Additional Software 0.755
After features/support/hooks.rb:450 1.050
After features/support/hooks.rb:291 0.798
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:18.223
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.255
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:54.913
And I configure APT to prefer an old version of cowsay 0.043
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.886
And I accept adding "cowsay" to Additional Software 1:4.027
And Additional Software is correctly configured for package "cowsay" 1.433
And I shutdown Tails and wait for the computer to power off 5.142
And I start Tails from USB drive "__internal" with network unplugged 44.097
And I enable persistence 30.417
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 21.589
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.068
And I revert the APT tweaks that made it prefer an old version of cowsay 0.093
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.076
And the network is plugged 0.133
And Tor is ready 18.556
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.025
And available upgrades have been checked 0.096
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.009
And I can open the Additional Software configuration window from the notification 2.266
And I shutdown Tails and wait for the computer to power off 2:2.634
And I start Tails from USB drive "__internal" with network unplugged 44.726
And I enable persistence 29.965
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 22.000
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.890
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
And the network is plugged 0.116
And Tor is ready 40.293
Then the Additional Software upgrade service has started 0.207
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.140
After features/support/hooks.rb:450 2.396
After features/support/hooks.rb:291 0.822
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:43.588
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.213
And I start Tails from USB drive "__internal" with network unplugged 43.248
And I enable persistence 30.839
And I remove the "cowsay" deb files from the APT cache 0.643
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.072
And I log in to a new session 22.618
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.712
And I can open the Additional Software log file from the notification 2.058
And the package "cowsay" is not installed 0.181
After features/support/hooks.rb:450 0.114
After features/support/hooks.rb:291 0.801
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.522
Before features/support/hooks.rb:245 0.022
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.957
When I log in to a new session in Arabic (ar) 29.064
Then the keyboard layout is set to "us" 0.132
When the network is plugged 0.044
And Tor is ready 16.731
Then I successfully start the Unsafe Browser in "ar" 25.688
And I kill the Unsafe Browser 5.892
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.698
And DuckDuckGo is the default search engine 9.863
And I kill the Tor Browser 5.360
And the screen keyboard works in Thunderbird 24.356
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.804
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.310
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.288
When I log in to a new session in Chinese (zh_CN) 27.873
Then the keyboard layout is set to "cn" 0.146
When the network is plugged 0.048
And Tor is ready 15.041
Then I successfully start the Unsafe Browser in "zh_CN" 29.143
And I kill the Unsafe Browser 5.965
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 33.082
And DuckDuckGo is the default search engine 9.785
And I kill the Tor Browser 5.382
And the screen keyboard works in Thunderbird 25.787
And the layout of the screen keyboard is set to "us" 0.633
After features/support/hooks.rb:291 1.484
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.285
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.249
When I log in to a new session in English (en) 16.316
Then the keyboard layout is set to "us" 0.135
When the network is plugged 0.043
And Tor is ready 13.442
Then I successfully start the Unsafe Browser in "en" 25.535
And I kill the Unsafe Browser 5.848
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 32.599
And DuckDuckGo is the default search engine 5.601
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 21.474
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 0.966
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.042
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.036
When I log in to a new session in French (fr) 28.843
Then the keyboard layout is set to "fr" 0.172
When the network is plugged 0.040
And Tor is ready 15.376
Then I successfully start the Unsafe Browser in "fr" 26.774
And I kill the Unsafe Browser 5.938
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 33.372
And DuckDuckGo is the default search engine 9.447
And I kill the Tor Browser 5.367
And the screen keyboard works in Thunderbird 21.957
And the layout of the screen keyboard is set to "fr" 0.607
After features/support/hooks.rb:291 1.307
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.918
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.990
When I log in to a new session in German (de) 33.890
Then the keyboard layout is set to "de" 0.201
When the network is plugged 0.042
And Tor is ready 17.074
Then I successfully start the Unsafe Browser in "de" 24.960
And I kill the Unsafe Browser 6.086
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.707
And DuckDuckGo is the default search engine 9.152
And I kill the Tor Browser 5.356
And the screen keyboard works in Thunderbird 21.731
And the layout of the screen keyboard is set to "de" 0.586
After features/support/hooks.rb:291 1.169
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.136
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.849
When I log in to a new session in Italian (it) 28.857
Then the keyboard layout is set to "it" 0.200
When the network is plugged 0.034
And Tor is ready 14.997
Then I successfully start the Unsafe Browser in "it" 25.928
And I kill the Unsafe Browser 6.201
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.066
And DuckDuckGo is the default search engine 9.783
And I kill the Tor Browser 5.269
And the screen keyboard works in Thunderbird 21.235
And the layout of the screen keyboard is set to "us" 0.604
After features/support/hooks.rb:291 1.170
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.118
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.976
When I log in to a new session in Persian (fa) 28.979
Then the keyboard layout is set to "ir" 0.129
When the network is plugged 0.063
And Tor is ready 15.093
Then I successfully start the Unsafe Browser in "fa" 26.030
And I kill the Unsafe Browser 5.916
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 35.708
And DuckDuckGo is the default search engine 9.736
And I kill the Tor Browser 5.418
And the screen keyboard works in Thunderbird 21.357
And the layout of the screen keyboard is set to "ir" 0.577
After features/support/hooks.rb:291 1.249
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.046
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.034
When I log in to a new session in Portuguese (pt) 29.075
Then the keyboard layout is set to "pt" 0.158
When the network is plugged 0.040
And Tor is ready 15.144
Then I successfully start the Unsafe Browser in "pt" 24.481
And I kill the Unsafe Browser 5.672
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 33.721
And DuckDuckGo is the default search engine 9.402
And I kill the Tor Browser 5.344
And the screen keyboard works in Thunderbird 22.279
And the layout of the screen keyboard is set to "us" 0.606
After features/support/hooks.rb:291 1.140
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.563
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.464
When I log in to a new session in Russian (ru) 29.673
Then the keyboard layout is set to "ru" 0.153
When the network is plugged 0.038
And Tor is ready 15.225
Then I successfully start the Unsafe Browser in "ru" 27.285
And I kill the Unsafe Browser 5.748
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 35.874
And DuckDuckGo is the default search engine 9.770
And I kill the Tor Browser 5.364
And the screen keyboard works in Thunderbird 26.177
And the layout of the screen keyboard is set to "ru" 0.680
After features/support/hooks.rb:291 1.151
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.755
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.128
When I log in to a new session in Spanish (es) 29.551
Then the keyboard layout is set to "es" 0.253
When the network is plugged 0.041
And Tor is ready 15.793
Then I successfully start the Unsafe Browser in "es" 27.296
And I kill the Unsafe Browser 5.981
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 34.094
And DuckDuckGo is the default search engine 9.083
And I kill the Tor Browser 5.377
And the screen keyboard works in Thunderbird 21.389
And the layout of the screen keyboard is set to "us" 0.617
After features/support/hooks.rb:291 1.200
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.719
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.131
When I log in to a new session in Turkish (tr) 29.670
Then the keyboard layout is set to "tr" 0.225
When the network is plugged 0.062
And Tor is ready 15.874
Then I successfully start the Unsafe Browser in "tr" 25.986
And I kill the Unsafe Browser 5.808
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 33.288
And DuckDuckGo is the default search engine 9.025
And I kill the Tor Browser 5.439
And the screen keyboard works in Thunderbird 22.497
And the layout of the screen keyboard is set to "us" 0.598
After features/support/hooks.rb:291 1.139
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:9.562
When the network is plugged 0.048
And I wait 720 seconds 12:0.094 
Slept for 720 seconds
Then I successfully configure Tor 9.350
And the time has synced 0.069
After features/support/hooks.rb:291 0.699
After features/support/hooks.rb:75 0.000