Project Number Date
test_Tails_ISO_devel 3246 22 Jan 2024, 16:09

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:25:51.794 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.456
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.801
And I prepare Tails for memory erasure tests 0.613
When I start a process allocating 128 MiB of memory with a known pattern 1.213
Then patterns cover at least 128 MiB in the guest's memory 4.675 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.413
Then I find very few patterns in the guest's memory 3.738 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.690
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.029
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.881
And I prepare Tails for memory erasure tests 0.493
And I find very few patterns in the guest's memory 3.687 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 41.001
Then patterns cover at least 99% of the test FS size in the guest's memory 3.942 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.250
Then I find very few patterns in the guest's memory 4.771 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
After features/support/hooks.rb:291 2.596
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:38.325
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.394
And I prepare Tails for memory erasure tests 0.748
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.045
Then I find very few patterns in the guest's memory 3.944 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:56.746
Then patterns cover at least 86% of the test FS size in the guest's memory 4.318 
Pattern coverage: 94.823% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.051
Then I find very few patterns in the guest's memory 4.323 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
# read cache
When I mount the USB drive again 0.237
And I read the content of the test FS 1.338
Then patterns cover at least 99% of the test FS size in the guest's memory 4.268 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.536
Then I find very few patterns in the guest's memory 4.370 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 0.821
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:38.102
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.882
And I prepare Tails for memory erasure tests 0.583
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.577
Then I find very few patterns in the guest's memory 3.354 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:42.335
Then patterns cover at least 99% of the test FS size in the guest's memory 3.032 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.575
Then I find very few patterns in the guest's memory 3.409 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
# read cache
When I mount the USB drive again 4.640
And I read the content of the test FS 0.460
Then patterns cover at least 99% of the test FS size in the guest's memory 3.887 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.450
Then I find very few patterns in the guest's memory 3.912 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 0.777
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.490
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.969
And I prepare Tails for memory erasure tests 0.476
When I fill a 128 MiB file with a known pattern on the root filesystem 11.753
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.253
Then patterns cover at least 128 MiB in the guest's memory 3.416 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.670
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.933 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 3.458
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:6.656
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:23.261
And I prepare Tails for memory erasure tests 0.427
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.385
When I trigger shutdown 0.331
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.230 
Pattern coverage: 0.000% (0 MiB out of 1176 MiB reference memory)
After features/support/hooks.rb:291 3.476
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:40.205
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.004
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:33.518
And I update APT using apt 17.233
When I install "popularity-contest" using apt 23.493
Then I am notified I can not use Additional Software for "popularity-contest" 1:0.463
And I can open the Additional Software documentation from the notification 25.496
After features/support/hooks.rb:450 39.313
After features/support/hooks.rb:291 3.044
After features/support/hooks.rb:75 0.006
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:46.684
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.881
And I update APT using apt 16.278
And I install "popularity-contest" using apt 19.798
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:3.159
When I create a persistent storage and activate the Additional Software feature 17.562
Then Additional Software is correctly configured for package "popularity-contest" 1.411
When I shutdown Tails and wait for the computer to power off 11.097
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:39.386
Then Additional Software is correctly configured for package "popularity-contest" 0.846
And the package "popularity-contest" is installed after Additional Software has been started 0.261
After features/support/hooks.rb:450 37.326
After features/support/hooks.rb:291 1.455
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:52.763
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.228
And I start Tails from USB drive "__internal" and I login with an administration password 1:20.524
And I update APT using apt 15.959
When I install "makepp" using apt 19.672
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.292
And the package "makepp" is installed 0.084
After features/support/hooks.rb:450 38.215
After features/support/hooks.rb:291 0.946
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:54.291
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:7.609
When I uninstall "popularity-contest" using apt 18.998
And I accept removing "popularity-contest" from Additional Software 0.643
Then "popularity-contest" is not in the list of Additional Software 0.814
When I start Synaptic 23.723
And I update APT using Synaptic 21.769
And I install "cowsay" using Synaptic 9.239
And I accept adding "cowsay" to Additional Software 2.141
Then Additional Software is correctly configured for package "cowsay" 0.932
When I uninstall "cowsay" using apt 3.320
And I refuse removing "cowsay" from Additional Software 0.698
Then Additional Software is correctly configured for package "cowsay" 0.965
When I start "Additional Software" via GNOME Activities Overview 12.583
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.588
Then "cowsay" is not in the list of Additional Software 1.219
When I install "cowsay" using apt 3.373
And I refuse adding "cowsay" to Additional Software 0.728
Then "cowsay" is not in the list of Additional Software 0.740
After features/support/hooks.rb:450 1.021
After features/support/hooks.rb:291 0.704
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:24.435
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:1.942
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.064
And I accept adding "cowsay" to Additional Software 1:2.414
And Additional Software is correctly configured for package "cowsay" 1.388
And I shutdown Tails and wait for the computer to power off 5.065
And I start Tails from USB drive "__internal" with network unplugged 45.854
And I enable persistence 30.914
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 22.836
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.591
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.100
And the network is plugged 0.026
And Tor is ready 19.641
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 36.130
And available upgrades have been checked 0.318
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.087
And I can open the Additional Software configuration window from the notification 3.317
And I shutdown Tails and wait for the computer to power off 13.120
And I start Tails from USB drive "__internal" with network unplugged 45.409
And I enable persistence 30.741
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 25.553
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.918
And I revert the APT tweaks that made it prefer an old version of cowsay 0.067
And the network is plugged 0.038
And Tor is ready 39.231
Then the Additional Software upgrade service has started 0.198
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.133
After features/support/hooks.rb:450 2.307
After features/support/hooks.rb:291 1.101
After features/support/hooks.rb:75 0.038
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.798
Before features/support/hooks.rb:245 0.009
Before features/support/hooks.rb:442 0.009
Given a computer 0.230
And I start Tails from USB drive "__internal" with network unplugged 46.746
And I enable persistence 31.812
And I remove the "cowsay" deb files from the APT cache 0.675
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.078
And I log in to a new session 26.624
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.423
And I can open the Additional Software log file from the notification 4.032
And the package "cowsay" is not installed 0.172
After features/support/hooks.rb:450 0.122
After features/support/hooks.rb:291 0.861
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.884
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.121
When I log in to a new session in Arabic (ar) 30.575
Then the keyboard layout is set to "us" 0.166
When the network is plugged 0.033
And Tor is ready 16.002
Then I successfully start the Unsafe Browser in "ar" 26.718
And I kill the Unsafe Browser 5.981
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 34.824
And DuckDuckGo is the default search engine 10.377
And I kill the Tor Browser 5.747
And the screen keyboard works in Thunderbird 21.557
And the layout of the screen keyboard is set to "us" 0.614
After features/support/hooks.rb:291 1.137
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.454
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.245
When I log in to a new session in Chinese (zh_CN) 33.416
Then the keyboard layout is set to "cn" 0.142
When the network is plugged 0.035
And Tor is ready 16.399
Then I successfully start the Unsafe Browser in "zh_CN" 27.547
And I kill the Unsafe Browser 6.296
When I enable the screen keyboard 0.197
Then the screen keyboard works in Tor Browser 35.780
And DuckDuckGo is the default search engine 10.331
And I kill the Tor Browser 5.477
And the screen keyboard works in Thunderbird 24.948
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:291 1.355
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.756
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.435
When I log in to a new session in English (en) 18.112
Then the keyboard layout is set to "us" 0.172
When the network is plugged 0.038
And Tor is ready 15.341
Then I successfully start the Unsafe Browser in "en" 29.323
And I kill the Unsafe Browser 5.834
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 34.545
And DuckDuckGo is the default search engine 11.064
And I kill the Tor Browser 5.587
And the screen keyboard works in Thunderbird 22.600
And the layout of the screen keyboard is set to "us" 0.586
After features/support/hooks.rb:291 2.207
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.257
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.010
When I log in to a new session in French (fr) 29.033
Then the keyboard layout is set to "fr" 0.287
When the network is plugged 0.040
And Tor is ready 15.175
Then I successfully start the Unsafe Browser in "fr" 30.983
And I kill the Unsafe Browser 5.765
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 33.850
And DuckDuckGo is the default search engine 9.736
And I kill the Tor Browser 5.304
And the screen keyboard works in Thunderbird 22.273
And the layout of the screen keyboard is set to "fr" 0.647
After features/support/hooks.rb:291 1.242
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.013
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.246
When I log in to a new session in German (de) 31.945
Then the keyboard layout is set to "de" 0.249
When the network is plugged 0.036
And Tor is ready 13.423
Then I successfully start the Unsafe Browser in "de" 28.774
And I kill the Unsafe Browser 7.099
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 36.047
And DuckDuckGo is the default search engine 9.964
And I kill the Tor Browser 5.334
And the screen keyboard works in Thunderbird 22.162
And the layout of the screen keyboard is set to "de" 0.584
After features/support/hooks.rb:291 1.128
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.097
Before features/support/hooks.rb:245 0.014
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.133
When I log in to a new session in Italian (it) 31.372
Then the keyboard layout is set to "it" 0.199
When the network is plugged 0.041
And Tor is ready 14.873
Then I successfully start the Unsafe Browser in "it" 26.080
And I kill the Unsafe Browser 6.107
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 35.125
And DuckDuckGo is the default search engine 9.488
And I kill the Tor Browser 5.421
And the screen keyboard works in Thunderbird 20.446
And the layout of the screen keyboard is set to "us" 0.652
After features/support/hooks.rb:291 1.171
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.577
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.764
When I log in to a new session in Persian (fa) 29.328
Then the keyboard layout is set to "ir" 0.144
When the network is plugged 0.051
And Tor is ready 16.883
Then I successfully start the Unsafe Browser in "fa" 26.651
And I kill the Unsafe Browser 5.878
When I enable the screen keyboard 0.184
Then the screen keyboard works in Tor Browser 35.743
And DuckDuckGo is the default search engine 9.245
And I kill the Tor Browser 5.374
And the screen keyboard works in Thunderbird 23.748
And the layout of the screen keyboard is set to "ir" 0.578
After features/support/hooks.rb:291 1.225
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.288
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.146
When I log in to a new session in Portuguese (pt) 28.815
Then the keyboard layout is set to "pt" 0.230
When the network is plugged 0.040
And Tor is ready 14.823
Then I successfully start the Unsafe Browser in "pt" 25.120
And I kill the Unsafe Browser 7.049
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 34.675
And DuckDuckGo is the default search engine 10.396
And I kill the Tor Browser 5.499
And the screen keyboard works in Thunderbird 22.781
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 0.989
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.033
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.855
When I log in to a new session in Russian (ru) 29.577
Then the keyboard layout is set to "ru" 0.146
When the network is plugged 0.045
And Tor is ready 15.407
Then I successfully start the Unsafe Browser in "ru" 28.567
And I kill the Unsafe Browser 5.788
When I enable the screen keyboard 0.173
Then the screen keyboard works in Tor Browser 34.060
And DuckDuckGo is the default search engine 9.809
And I kill the Tor Browser 5.472
And the screen keyboard works in Thunderbird 24.515
And the layout of the screen keyboard is set to "ru" 0.614
After features/support/hooks.rb:291 1.532
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.625
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.842
When I log in to a new session in Spanish (es) 31.448
Then the keyboard layout is set to "es" 0.156
When the network is plugged 0.059
And Tor is ready 16.440
Then I successfully start the Unsafe Browser in "es" 25.619
And I kill the Unsafe Browser 6.211
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 34.811
And DuckDuckGo is the default search engine 9.812
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 23.111
And the layout of the screen keyboard is set to "us" 0.618
After features/support/hooks.rb:291 1.489
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.702
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.109
When I log in to a new session in Turkish (tr) 29.533
Then the keyboard layout is set to "tr" 0.187
When the network is plugged 0.025
And Tor is ready 15.229
Then I successfully start the Unsafe Browser in "tr" 28.694
And I kill the Unsafe Browser 6.081
When I enable the screen keyboard 0.170
Then the screen keyboard works in Tor Browser 34.239
And DuckDuckGo is the default search engine 17.587
And I kill the Tor Browser 5.562
And the screen keyboard works in Thunderbird 21.740
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:291 1.189
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:9.864
When the network is plugged 0.026
And I wait 720 seconds 12:0.100 
Slept for 720 seconds
Then I successfully configure Tor 9.661
And the time has synced 0.076
After features/support/hooks.rb:291 0.809
After features/support/hooks.rb:75 0.000