Project Number Date
test_Tails_ISO_devel 3241 18 Jan 2024, 12:25

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:23:54.880 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.653
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.013
And I prepare Tails for memory erasure tests 0.453
When I start a process allocating 128 MiB of memory with a known pattern 2.296
Then patterns cover at least 128 MiB in the guest's memory 3.074 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.257
Then I find very few patterns in the guest's memory 3.558 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
After features/support/hooks.rb:291 0.790
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
56.440
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.187
And I prepare Tails for memory erasure tests 0.484
And I find very few patterns in the guest's memory 3.643 
Pattern coverage: 0.000% (0 MiB out of 1228 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 36.982
Then patterns cover at least 99% of the test FS size in the guest's memory 2.918 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.266
Then I find very few patterns in the guest's memory 3.958 
Pattern coverage: 0.000% (0 MiB out of 1228 MiB reference memory)
After features/support/hooks.rb:291 0.678
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:32.157
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.725
And I prepare Tails for memory erasure tests 0.477
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.911
Then I find very few patterns in the guest's memory 4.283 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:55.407
Then patterns cover at least 86% of the test FS size in the guest's memory 2.763 
Pattern coverage: 96.782% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 2.375
Then I find very few patterns in the guest's memory 3.368 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
# read cache
When I mount the USB drive again 0.561
And I read the content of the test FS 0.607
Then patterns cover at least 99% of the test FS size in the guest's memory 2.840 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.486
Then I find very few patterns in the guest's memory 3.347 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 0.717
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:10.105
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.619
And I prepare Tails for memory erasure tests 0.467
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 21.999
Then I find very few patterns in the guest's memory 3.161 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:19.912
Then patterns cover at least 99% of the test FS size in the guest's memory 2.387 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.885
Then I find very few patterns in the guest's memory 3.214 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
# read cache
When I mount the USB drive again 3.038
And I read the content of the test FS 0.339
Then patterns cover at least 99% of the test FS size in the guest's memory 2.247 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.537
Then I find very few patterns in the guest's memory 3.296 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
After features/support/hooks.rb:291 3.485
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.621
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.359
And I prepare Tails for memory erasure tests 0.457
When I fill a 128 MiB file with a known pattern on the root filesystem 13.490
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.347
Then patterns cover at least 128 MiB in the guest's memory 2.276 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.985
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.684 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
After features/support/hooks.rb:291 3.424
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:43.254
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 4:57.415
And I prepare Tails for memory erasure tests 0.436
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.808
When I trigger shutdown 0.487
And I wait 20 seconds 20.010 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.096 
Pattern coverage: 0.000% (0 MiB out of 1166 MiB reference memory)
After features/support/hooks.rb:291 3.470
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:10.990
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.032
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:20.095
And I update APT using apt 16.775
When I install "popularity-contest" using apt 19.576
Then I am notified I can not use Additional Software for "popularity-contest" 51.254
And I can open the Additional Software documentation from the notification 23.289
After features/support/hooks.rb:450 37.571
After features/support/hooks.rb:291 1.949
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:11.133
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 47.666
And I update APT using apt 16.536
And I install "popularity-contest" using apt 19.655
Then I am proposed to add the "popularity-contest" package to my Additional Software 52.230
When I create a persistent storage and activate the Additional Software feature 15.127
Then Additional Software is correctly configured for package "popularity-contest" 1.358
When I shutdown Tails and wait for the computer to power off 10.059
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:27.298
Then Additional Software is correctly configured for package "popularity-contest" 0.907
And the package "popularity-contest" is installed after Additional Software has been started 0.293
After features/support/hooks.rb:450 37.100
After features/support/hooks.rb:291 1.108
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:44.061
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.159
And I start Tails from USB drive "__internal" and I login with an administration password 1:15.956
And I update APT using apt 16.036
When I install "makepp" using apt 19.501
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 52.311
And the package "makepp" is installed 0.096
After features/support/hooks.rb:450 36.428
After features/support/hooks.rb:291 0.730
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:32.820
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.158
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:53.819
When I uninstall "popularity-contest" using apt 15.897
And I accept removing "popularity-contest" from Additional Software 0.636
Then "popularity-contest" is not in the list of Additional Software 0.714
When I start Synaptic 22.863
And I update APT using Synaptic 21.675
And I install "cowsay" using Synaptic 7.506
And I accept adding "cowsay" to Additional Software 0.980
Then Additional Software is correctly configured for package "cowsay" 0.920
When I uninstall "cowsay" using apt 3.409
And I refuse removing "cowsay" from Additional Software 0.691
Then Additional Software is correctly configured for package "cowsay" 0.890
When I start "Additional Software" via GNOME Activities Overview 12.351
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.473
Then "cowsay" is not in the list of Additional Software 1.094
When I install "cowsay" using apt 3.284
And I refuse adding "cowsay" to Additional Software 0.675
Then "cowsay" is not in the list of Additional Software 0.775
After features/support/hooks.rb:450 0.970
After features/support/hooks.rb:291 0.662
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:59.633
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.147
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:2.941
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.148
And I accept adding "cowsay" to Additional Software 59.982
And Additional Software is correctly configured for package "cowsay" 1.389
And I shutdown Tails and wait for the computer to power off 6.065
And I start Tails from USB drive "__internal" with network unplugged 51.380
And I enable persistence 29.640
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 22.742
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.295
And I revert the APT tweaks that made it prefer an old version of cowsay 0.049
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.081
And the network is plugged 0.026
And Tor is ready 45.896
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.542
And available upgrades have been checked 0.095
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.512
And I can open the Additional Software configuration window from the notification 2.534
And I shutdown Tails and wait for the computer to power off 2:2.616
And I start Tails from USB drive "__internal" with network unplugged 43.710
And I enable persistence 30.266
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 27.814
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.731
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.030
And Tor is ready 37.629
Then the Additional Software upgrade service has started 0.161
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.074
After features/support/hooks.rb:450 2.270
After features/support/hooks.rb:291 0.680
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.798
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.148
And I start Tails from USB drive "__internal" with network unplugged 44.004
And I enable persistence 32.634
And I remove the "cowsay" deb files from the APT cache 0.679
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.075
And I log in to a new session 27.620
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.207
And I can open the Additional Software log file from the notification 2.250
And the package "cowsay" is not installed 0.177
After features/support/hooks.rb:450 0.111
After features/support/hooks.rb:291 0.737
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.595
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.648
When I log in to a new session in Arabic (ar) 26.337
Then the keyboard layout is set to "us" 0.338
When the network is plugged 0.035
And Tor is ready 14.449
Then I successfully start the Unsafe Browser in "ar" 27.493
And I kill the Unsafe Browser 6.700
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 32.860
And DuckDuckGo is the default search engine 9.012
And I kill the Tor Browser 5.317
And the screen keyboard works in Thunderbird 20.717
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.449
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.492
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.796
When I log in to a new session in Chinese (zh_CN) 27.760
Then the keyboard layout is set to "cn" 0.176
When the network is plugged 0.025
And Tor is ready 14.902
Then I successfully start the Unsafe Browser in "zh_CN" 28.942
And I kill the Unsafe Browser 5.803
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 33.478
And DuckDuckGo is the default search engine 8.899
And I kill the Tor Browser 5.248
And the screen keyboard works in Thunderbird 22.761
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 1.092
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.367
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.578
When I log in to a new session in English (en) 14.577
Then the keyboard layout is set to "us" 0.140
When the network is plugged 0.026
And Tor is ready 14.369
Then I successfully start the Unsafe Browser in "en" 29.323
And I kill the Unsafe Browser 5.822
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 32.057
And DuckDuckGo is the default search engine 5.179
And I kill the Tor Browser 5.294
And the screen keyboard works in Thunderbird 25.322
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.354
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.648
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.488
When I log in to a new session in French (fr) 26.783
Then the keyboard layout is set to "fr" 0.206
When the network is plugged 0.024
And Tor is ready 14.651
Then I successfully start the Unsafe Browser in "fr" 26.517
And I kill the Unsafe Browser 5.898
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 32.646
And DuckDuckGo is the default search engine 9.441
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 20.956
And the layout of the screen keyboard is set to "fr" 0.538
After features/support/hooks.rb:291 1.024
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.567
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.560
When I log in to a new session in German (de) 27.659
Then the keyboard layout is set to "de" 0.212
When the network is plugged 0.023
And Tor is ready 14.705
Then I successfully start the Unsafe Browser in "de" 28.405
And I kill the Unsafe Browser 5.758
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 32.625
And DuckDuckGo is the default search engine 9.313
And I kill the Tor Browser 5.277
And the screen keyboard works in Thunderbird 21.359
And the layout of the screen keyboard is set to "de" 0.540
After features/support/hooks.rb:291 1.357
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.243
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.506
When I log in to a new session in Italian (it) 27.483
Then the keyboard layout is set to "it" 0.129
When the network is plugged 0.018
And Tor is ready 13.736
Then I successfully start the Unsafe Browser in "it" 27.288
And I kill the Unsafe Browser 5.806
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 32.840
And DuckDuckGo is the default search engine 9.683
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 21.707
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 1.407
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.660
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.614
When I log in to a new session in Persian (fa) 27.293
Then the keyboard layout is set to "ir" 0.301
When the network is plugged 0.022
And Tor is ready 14.189
Then I successfully start the Unsafe Browser in "fa" 27.424
And I kill the Unsafe Browser 6.128
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 34.378
And DuckDuckGo is the default search engine 9.275
And I kill the Tor Browser 5.275
And the screen keyboard works in Thunderbird 22.073
And the layout of the screen keyboard is set to "ir" 0.545
After features/support/hooks.rb:291 1.016
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.961
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.569
When I log in to a new session in Portuguese (pt) 27.142
Then the keyboard layout is set to "pt" 0.240
When the network is plugged 0.034
And Tor is ready 15.917
Then I successfully start the Unsafe Browser in "pt" 25.517
And I kill the Unsafe Browser 5.892
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 31.775
And DuckDuckGo is the default search engine 9.065
And I kill the Tor Browser 5.348
And the screen keyboard works in Thunderbird 23.773
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.000
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.716
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.582
When I log in to a new session in Russian (ru) 26.361
Then the keyboard layout is set to "ru" 0.414
When the network is plugged 0.037
And Tor is ready 14.269
Then I successfully start the Unsafe Browser in "ru" 25.807
And I kill the Unsafe Browser 5.789
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 33.649
And DuckDuckGo is the default search engine 9.645
And I kill the Tor Browser 5.370
And the screen keyboard works in Thunderbird 24.121
And the layout of the screen keyboard is set to "ru" 0.560
After features/support/hooks.rb:291 1.904
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.612
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.562
When I log in to a new session in Spanish (es) 27.891
Then the keyboard layout is set to "es" 0.142
When the network is plugged 0.034
And Tor is ready 15.006
Then I successfully start the Unsafe Browser in "es" 24.377
And I kill the Unsafe Browser 6.052
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 32.494
And DuckDuckGo is the default search engine 9.357
And I kill the Tor Browser 5.279
And the screen keyboard works in Thunderbird 20.745
And the layout of the screen keyboard is set to "us" 0.536
After features/support/hooks.rb:291 1.106
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.045
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.457
When I log in to a new session in Turkish (tr) 27.069
Then the keyboard layout is set to "tr" 0.151
When the network is plugged 0.024
And Tor is ready 14.024
Then I successfully start the Unsafe Browser in "tr" 28.827
And I kill the Unsafe Browser 5.820
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 32.810
And DuckDuckGo is the default search engine 9.037
And I kill the Tor Browser 5.235
And the screen keyboard works in Thunderbird 20.905
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:291 1.142
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:9.298
When the network is plugged 0.023
And I wait 720 seconds 12:0.085 
Slept for 720 seconds
Then I successfully configure Tor 9.121
And the time has synced 0.067
After features/support/hooks.rb:291 0.681
After features/support/hooks.rb:75 0.000