Project Number Date
test_Tails_ISO_devel 3304 29 Feb 2024, 17:57

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:20:48.204 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.838
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.642
And I prepare Tails for memory erasure tests 0.460
When I start a process allocating 128 MiB of memory with a known pattern 1.211
Then patterns cover at least 128 MiB in the guest's memory 4.112 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.553
Then I find very few patterns in the guest's memory 3.856 
Pattern coverage: 0.000% (0 MiB out of 923 MiB reference memory)
After features/support/hooks.rb:291 0.761
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.717
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.770
And I prepare Tails for memory erasure tests 0.431
And I find very few patterns in the guest's memory 4.257 
Pattern coverage: 0.000% (0 MiB out of 906 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.472
Then patterns cover at least 99% of the test FS size in the guest's memory 4.084 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.290
Then I find very few patterns in the guest's memory 5.410 
Pattern coverage: 0.000% (0 MiB out of 906 MiB reference memory)
After features/support/hooks.rb:291 0.764
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
42.007
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.317
And I prepare Tails for memory erasure tests 0.392
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.967
Then I find very few patterns in the guest's memory 4.084 
Pattern coverage: 0.000% (0 MiB out of 930 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.011
Then patterns cover at least 86% of the test FS size in the guest's memory 3.461 
Pattern coverage: 95.552% (121 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.927
Then I find very few patterns in the guest's memory 4.163 
Pattern coverage: 0.000% (0 MiB out of 930 MiB reference memory)
# read cache
When I mount the USB drive again 0.430
And I read the content of the test FS 1.072
Then patterns cover at least 99% of the test FS size in the guest's memory 4.340 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.549
Then I find very few patterns in the guest's memory 4.289 
Pattern coverage: 0.000% (0 MiB out of 930 MiB reference memory)
After features/support/hooks.rb:291 0.994
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.815
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.487
And I prepare Tails for memory erasure tests 0.422
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.773
Then I find very few patterns in the guest's memory 3.562 
Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.570
Then patterns cover at least 99% of the test FS size in the guest's memory 2.962 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.609
Then I find very few patterns in the guest's memory 3.552 
Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)
# read cache
When I mount the USB drive again 4.144
And I read the content of the test FS 0.414
Then patterns cover at least 99% of the test FS size in the guest's memory 2.954 
Pattern coverage: 106.115% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.664
Then I find very few patterns in the guest's memory 3.697 
Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)
After features/support/hooks.rb:291 0.751
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.734
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.574
And I prepare Tails for memory erasure tests 0.446
When I fill a 128 MiB file with a known pattern on the root filesystem 16.234
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.368
Then patterns cover at least 128 MiB in the guest's memory 3.203 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.874 
Pattern coverage: 0.000% (0 MiB out of 922 MiB reference memory)
After features/support/hooks.rb:291 3.519
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:46.925
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:2.418
And I prepare Tails for memory erasure tests 0.377
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.862
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.233 
Pattern coverage: 0.000% (0 MiB out of 946 MiB reference memory)
After features/support/hooks.rb:291 3.546
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
2:46.083
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.004
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:31.311
And I update APT using apt 19.394
When I install "popularity-contest" using apt 22.422
Then I am notified I can not use Additional Software for "popularity-contest" 5.854
And I can open the Additional Software documentation from the notification 27.100
After features/support/hooks.rb:450 38.677
After features/support/hooks.rb:291 2.489
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:22.390
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:19.838
And I update APT using apt 17.700
And I install "popularity-contest" using apt 19.157
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.407
When I create a persistent storage and activate the Additional Software feature 20.940
Then Additional Software is correctly configured for package "popularity-contest" 1.292
When I shutdown Tails and wait for the computer to power off 10.205
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:44.722
Then Additional Software is correctly configured for package "popularity-contest" 0.847
And the package "popularity-contest" is installed after Additional Software has been started 0.278
After features/support/hooks.rb:450 40.155
After features/support/hooks.rb:291 0.927
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:16.229
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.007
Given a computer 0.236
And I start Tails from USB drive "__internal" and I login with an administration password 1:34.107
And I update APT using apt 16.129
When I install "makepp" using apt 19.260
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.411
And the package "makepp" is installed 0.083
After features/support/hooks.rb:450 39.112
After features/support/hooks.rb:291 1.024
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:1.495
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.010
Given a computer 0.260
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:21.417
When I uninstall "popularity-contest" using apt 15.557
And I accept removing "popularity-contest" from Additional Software 1.670
Then "popularity-contest" is not in the list of Additional Software 0.778
When I start Synaptic 23.209
And I update APT using Synaptic 22.211
And I install "cowsay" using Synaptic 9.795
And I accept adding "cowsay" to Additional Software 1.118
Then Additional Software is correctly configured for package "cowsay" 0.818
When I uninstall "cowsay" using apt 3.228
And I refuse removing "cowsay" from Additional Software 0.660
Then Additional Software is correctly configured for package "cowsay" 0.819
When I start "Additional Software" via GNOME Activities Overview 9.979
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.696
Then "cowsay" is not in the list of Additional Software 0.867
When I install "cowsay" using apt 3.206
And I refuse adding "cowsay" to Additional Software 0.542
Then "cowsay" is not in the list of Additional Software 0.657
After features/support/hooks.rb:450 1.229
After features/support/hooks.rb:291 0.740
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:46.327
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.205
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:29.137
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.438
And I accept adding "cowsay" to Additional Software 6.979
And Additional Software is correctly configured for package "cowsay" 0.905
And I shutdown Tails and wait for the computer to power off 6.024
And I start Tails from USB drive "__internal" with network unplugged 54.699
And I enable persistence 31.548
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.034
And I log in to a new session 35.064
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.372
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.072
And the network is plugged 0.033
And Tor is ready 18.949
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.006
And available upgrades have been checked 0.125
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 5.438
And I can open the Additional Software configuration window from the notification 3.327
And I shutdown Tails and wait for the computer to power off 2:7.476
And I start Tails from USB drive "__internal" with network unplugged 55.616
And I enable persistence 32.031
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 33.393
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.492
And I revert the APT tweaks that made it prefer an old version of cowsay 0.049
And the network is plugged 0.038
And Tor is ready 52.474
Then the Additional Software upgrade service has started 0.201
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.087
After features/support/hooks.rb:450 2.850
After features/support/hooks.rb:291 0.832
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:23.555
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.211
And I start Tails from USB drive "__internal" with network unplugged 54.473
And I enable persistence 31.396
And I remove the "cowsay" deb files from the APT cache 0.687
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.089
And I log in to a new session 36.278
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.907
And I can open the Additional Software log file from the notification 5.873
And the package "cowsay" is not installed 0.637
After features/support/hooks.rb:450 0.108
After features/support/hooks.rb:291 1.044
After features/support/hooks.rb:75 0.012
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.761
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.322
When I log in to a new session in Arabic (ar) 32.939
Then the keyboard layout is set to "us" 0.132
When the network is plugged 0.050
And Tor is ready 17.086
Then I successfully start the Unsafe Browser in "ar" 14.406
And I kill the Unsafe Browser 5.848
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 39.810
And DuckDuckGo is the default search engine 24.603
And I kill the Tor Browser 5.664
And the screen keyboard works in Thunderbird 22.228
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 1.670
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.621
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.657
When I log in to a new session in Chinese (zh_CN) 30.646
Then the keyboard layout is set to "cn" 0.241
When the network is plugged 0.040
And Tor is ready 15.521
Then I successfully start the Unsafe Browser in "zh_CN" 16.001
And I kill the Unsafe Browser 5.775
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 35.130
And DuckDuckGo is the default search engine 11.258
And I kill the Tor Browser 5.606
And the screen keyboard works in Thunderbird 26.041
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 1.293
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.474
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.784
When I log in to a new session in English (en) 18.022
Then the keyboard layout is set to "us" 0.228
When the network is plugged 0.057
And Tor is ready 42.729
Then I successfully start the Unsafe Browser in "en" 14.031
And I kill the Unsafe Browser 6.108
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 34.588
And DuckDuckGo is the default search engine 10.939
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 21.773
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.515
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.931
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.327
When I log in to a new session in French (fr) 30.244
Then the keyboard layout is set to "fr" 0.156
When the network is plugged 0.053
And Tor is ready 44.865
Then I successfully start the Unsafe Browser in "fr" 12.948
And I kill the Unsafe Browser 5.795
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 32.370
And DuckDuckGo is the default search engine 10.523
And I kill the Tor Browser 5.430
And the screen keyboard works in Thunderbird 21.398
And the layout of the screen keyboard is set to "fr" 0.690
After features/support/hooks.rb:291 2.539
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.120
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.509
When I log in to a new session in German (de) 32.909
Then the keyboard layout is set to "de" 0.154
When the network is plugged 0.039
And Tor is ready 14.878
Then I successfully start the Unsafe Browser in "de" 14.743
And I kill the Unsafe Browser 5.833
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 33.885
And DuckDuckGo is the default search engine 10.780
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 20.238
And the layout of the screen keyboard is set to "de" 0.563
After features/support/hooks.rb:291 1.019
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.842
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.312
When I log in to a new session in Italian (it) 33.839
Then the keyboard layout is set to "it" 0.152
When the network is plugged 0.058
And Tor is ready 15.658
Then I successfully start the Unsafe Browser in "it" 13.810
And I kill the Unsafe Browser 5.744
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 33.604
And DuckDuckGo is the default search engine 11.672
And I kill the Tor Browser 5.483
And the screen keyboard works in Thunderbird 20.839
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.113
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.842
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.207
When I log in to a new session in Persian (fa) 35.955
Then the keyboard layout is set to "ir" 0.118
When the network is plugged 0.036
And Tor is ready 14.428
Then I successfully start the Unsafe Browser in "fa" 14.773
And I kill the Unsafe Browser 5.879
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 35.146
And DuckDuckGo is the default search engine 11.258
And I kill the Tor Browser 5.498
And the screen keyboard works in Thunderbird 22.701
And the layout of the screen keyboard is set to "ir" 0.705
After features/support/hooks.rb:291 1.365
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.460
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.423
When I log in to a new session in Portuguese (pt) 32.430
Then the keyboard layout is set to "pt" 0.271
When the network is plugged 0.041
And Tor is ready 14.015
Then I successfully start the Unsafe Browser in "pt" 14.589
And I kill the Unsafe Browser 5.928
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.826
And DuckDuckGo is the default search engine 11.174
And I kill the Tor Browser 5.472
And the screen keyboard works in Thunderbird 21.595
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:291 0.828
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.331
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.121
When I log in to a new session in Russian (ru) 29.856
Then the keyboard layout is set to "ru" 0.183
When the network is plugged 0.041
And Tor is ready 13.612
Then I successfully start the Unsafe Browser in "ru" 14.531
And I kill the Unsafe Browser 5.818
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 33.875
And DuckDuckGo is the default search engine 24.633
And I kill the Tor Browser 5.569
And the screen keyboard works in Thunderbird 23.398
And the layout of the screen keyboard is set to "ru" 0.590
After features/support/hooks.rb:291 1.170
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.110
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.487
When I log in to a new session in Spanish (es) 29.971
Then the keyboard layout is set to "es" 0.140
When the network is plugged 0.051
And Tor is ready 16.018
Then I successfully start the Unsafe Browser in "es" 14.810
And I kill the Unsafe Browser 5.672
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 34.418
And DuckDuckGo is the default search engine 11.856
And I kill the Tor Browser 5.455
And the screen keyboard works in Thunderbird 21.490
And the layout of the screen keyboard is set to "us" 0.626
After features/support/hooks.rb:291 1.661
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.602
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.537
When I log in to a new session in Turkish (tr) 31.837
Then the keyboard layout is set to "tr" 0.198
When the network is plugged 0.046
And Tor is ready 13.832
Then I successfully start the Unsafe Browser in "tr" 15.156
And I kill the Unsafe Browser 5.869
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 33.220
And DuckDuckGo is the default search engine 22.969
And I kill the Tor Browser 5.508
And the screen keyboard works in Thunderbird 21.610
And the layout of the screen keyboard is set to "us" 0.730
After features/support/hooks.rb:291 2.187
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.983
When the network is plugged 0.045
And I wait 720 seconds 12:0.100 
Slept for 720 seconds
Then I successfully configure Tor 10.785
And the time has synced 0.052
After features/support/hooks.rb:291 0.721
After features/support/hooks.rb:75 0.000