Project Number Date
test_Tails_ISO_devel 3217 30 Dec 2023, 12:32

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:26:9.473 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.783
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.190
And I prepare Tails for memory erasure tests 0.489
When I start a process allocating 128 MiB of memory with a known pattern 2.403
Then patterns cover at least 128 MiB in the guest's memory 4.206 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.218
Then I find very few patterns in the guest's memory 5.275 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 1.334
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:4.748
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.209
And I prepare Tails for memory erasure tests 0.609
And I find very few patterns in the guest's memory 5.634 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.158
Then patterns cover at least 99% of the test FS size in the guest's memory 4.050 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.613
Then I find very few patterns in the guest's memory 4.472 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 1.173
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:59.263
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 8.486
And I prepare Tails for memory erasure tests 0.485
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.995
Then I find very few patterns in the guest's memory 4.619 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:22.906
Then patterns cover at least 86% of the test FS size in the guest's memory 2.896 
Pattern coverage: 93.011% (115 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.552
Then I find very few patterns in the guest's memory 3.480 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# read cache
When I mount the USB drive again 0.237
And I read the content of the test FS 0.599
Then patterns cover at least 99% of the test FS size in the guest's memory 2.977 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.424
Then I find very few patterns in the guest's memory 3.600 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 0.804
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:19.892
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.276
And I prepare Tails for memory erasure tests 0.563
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.293
Then I find very few patterns in the guest's memory 3.563 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:26.039
Then patterns cover at least 99% of the test FS size in the guest's memory 2.760 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.602
Then I find very few patterns in the guest's memory 3.571 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 3.387
And I read the content of the test FS 0.430
Then patterns cover at least 99% of the test FS size in the guest's memory 2.609 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.425
Then I find very few patterns in the guest's memory 3.369 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 1.136
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.653
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.474
And I prepare Tails for memory erasure tests 0.560
When I fill a 128 MiB file with a known pattern on the root filesystem 13.016
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.608
Then patterns cover at least 128 MiB in the guest's memory 4.876 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.006
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.088 
Pattern coverage: 0.000% (0 MiB out of 1195 MiB reference memory)
After features/support/hooks.rb:291 3.486
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:7.218
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:22.813
And I prepare Tails for memory erasure tests 0.540
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.328
When I trigger shutdown 0.409
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.106 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
After features/support/hooks.rb:291 3.461
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:31.187
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.010
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:27.357
And I update APT using apt 17.755
When I install "popularity-contest" using apt 19.905
Then I am notified I can not use Additional Software for "popularity-contest" 1:2.470
And I can open the Additional Software documentation from the notification 23.698
After features/support/hooks.rb:450 37.943
After features/support/hooks.rb:291 2.867
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:44.910
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.495
And I update APT using apt 16.608
And I install "popularity-contest" using apt 19.667
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.667
When I create a persistent storage and activate the Additional Software feature 19.825
Then Additional Software is correctly configured for package "popularity-contest" 1.418
When I shutdown Tails and wait for the computer to power off 11.093
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:39.939
Then Additional Software is correctly configured for package "popularity-contest" 0.882
And the package "popularity-contest" is installed after Additional Software has been started 0.312
After features/support/hooks.rb:450 38.455
After features/support/hooks.rb:291 1.343
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:53.340
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.224
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.216
And I update APT using apt 15.718
When I install "makepp" using apt 19.637
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.473
And the package "makepp" is installed 0.070
After features/support/hooks.rb:450 39.767
After features/support/hooks.rb:291 0.799
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:51.433
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.009
Given a computer 0.245
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:6.927
When I uninstall "popularity-contest" using apt 19.005
And I accept removing "popularity-contest" from Additional Software 0.565
Then "popularity-contest" is not in the list of Additional Software 0.740
When I start Synaptic 20.802
And I update APT using Synaptic 21.881
And I install "cowsay" using Synaptic 9.072
And I accept adding "cowsay" to Additional Software 0.826
Then Additional Software is correctly configured for package "cowsay" 0.946
When I uninstall "cowsay" using apt 3.337
And I refuse removing "cowsay" from Additional Software 0.669
Then Additional Software is correctly configured for package "cowsay" 0.921
When I start "Additional Software" via GNOME Activities Overview 12.570
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.606
Then "cowsay" is not in the list of Additional Software 1.071
When I install "cowsay" using apt 3.417
And I refuse adding "cowsay" to Additional Software 0.840
Then "cowsay" is not in the list of Additional Software 0.987
After features/support/hooks.rb:450 1.240
After features/support/hooks.rb:291 0.870
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:14.877
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 2.048
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.812
And I configure APT to prefer an old version of cowsay 0.033
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.852
And I accept adding "cowsay" to Additional Software 1:5.021
And Additional Software is correctly configured for package "cowsay" 1.533
And I shutdown Tails and wait for the computer to power off 5.067
And I start Tails from USB drive "__internal" with network unplugged 46.682
And I enable persistence 31.269
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 23.755
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.048
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.106
And the network is plugged 0.043
And Tor is ready 17.917
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.893
And available upgrades have been checked 0.341
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.541
And I can open the Additional Software configuration window from the notification 3.026
And I shutdown Tails and wait for the computer to power off 2:3.732
And I start Tails from USB drive "__internal" with network unplugged 45.756
And I enable persistence 31.930
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 32.307
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.850
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
And the network is plugged 0.042
And Tor is ready 47.793
Then the Additional Software upgrade service has started 0.213
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.097
After features/support/hooks.rb:450 2.548
After features/support/hooks.rb:291 0.946
After features/support/hooks.rb:75 0.033
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.412
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.215
And I start Tails from USB drive "__internal" with network unplugged 45.279
And I enable persistence 32.263
And I remove the "cowsay" deb files from the APT cache 0.715
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.085
And I log in to a new session 20.608
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.135
And I can open the Additional Software log file from the notification 2.914
And the package "cowsay" is not installed 0.194
After features/support/hooks.rb:450 0.130
After features/support/hooks.rb:291 0.974
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.259
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.512
When I log in to a new session in Arabic (ar) 27.728
Then the keyboard layout is set to "us" 0.314
When the network is plugged 0.037
And Tor is ready 14.130
Then I successfully start the Unsafe Browser in "ar" 29.569
And I kill the Unsafe Browser 5.800
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 35.136
And DuckDuckGo is the default search engine 9.921
And I kill the Tor Browser 5.317
And the screen keyboard works in Thunderbird 24.096
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.036
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.247
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.093
When I log in to a new session in Chinese (zh_CN) 29.765
Then the keyboard layout is set to "cn" 0.140
When the network is plugged 0.056
And Tor is ready 16.932
Then I successfully start the Unsafe Browser in "zh_CN" 27.378
And I kill the Unsafe Browser 5.821
When I enable the screen keyboard 0.159
Then the screen keyboard works in Tor Browser 34.628
And DuckDuckGo is the default search engine 10.773
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 26.281
And the layout of the screen keyboard is set to "us" 0.721
After features/support/hooks.rb:291 1.404
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.257
Before features/support/hooks.rb:245 0.015
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.939
When I log in to a new session in English (en) 14.840
Then the keyboard layout is set to "us" 0.188
When the network is plugged 0.034
And Tor is ready 14.209
Then I successfully start the Unsafe Browser in "en" 27.013
And I kill the Unsafe Browser 5.774
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 33.908
And DuckDuckGo is the default search engine 5.219
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 21.144
And the layout of the screen keyboard is set to "us" 0.554
After features/support/hooks.rb:291 1.465
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.959
Before features/support/hooks.rb:245 0.016
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.019
When I log in to a new session in French (fr) 32.855
Then the keyboard layout is set to "fr" 0.175
When the network is plugged 0.035
And Tor is ready 14.210
Then I successfully start the Unsafe Browser in "fr" 29.599
And I kill the Unsafe Browser 5.946
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 33.112
And DuckDuckGo is the default search engine 9.267
And I kill the Tor Browser 5.250
And the screen keyboard works in Thunderbird 21.776
And the layout of the screen keyboard is set to "fr" 0.560
After features/support/hooks.rb:291 1.079
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.010
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.803
When I log in to a new session in German (de) 30.274
Then the keyboard layout is set to "de" 0.255
When the network is plugged 0.046
And Tor is ready 16.221
Then I successfully start the Unsafe Browser in "de" 27.382
And I kill the Unsafe Browser 6.457
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 34.161
And DuckDuckGo is the default search engine 9.471
And I kill the Tor Browser 5.309
And the screen keyboard works in Thunderbird 21.884
And the layout of the screen keyboard is set to "de" 0.589
After features/support/hooks.rb:291 1.322
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.555
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.098
When I log in to a new session in Italian (it) 29.981
Then the keyboard layout is set to "it" 0.164
When the network is plugged 0.038
And Tor is ready 14.661
Then I successfully start the Unsafe Browser in "it" 30.272
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 34.346
And DuckDuckGo is the default search engine 9.977
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 21.126
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 1.129
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.626
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.276
When I log in to a new session in Persian (fa) 28.440
Then the keyboard layout is set to "ir" 0.227
When the network is plugged 0.045
And Tor is ready 17.758
Then I successfully start the Unsafe Browser in "fa" 29.446
And I kill the Unsafe Browser 5.788
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 35.907
And DuckDuckGo is the default search engine 9.594
And I kill the Tor Browser 5.322
And the screen keyboard works in Thunderbird 22.118
And the layout of the screen keyboard is set to "ir" 0.574
After features/support/hooks.rb:291 1.042
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.127
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.954
When I log in to a new session in Portuguese (pt) 28.934
Then the keyboard layout is set to "pt" 0.311
When the network is plugged 0.112
And Tor is ready 14.215
Then I successfully start the Unsafe Browser in "pt" 27.038
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 33.229
And DuckDuckGo is the default search engine 9.523
And I kill the Tor Browser 5.364
And the screen keyboard works in Thunderbird 22.899
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.489
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.435
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.822
When I log in to a new session in Russian (ru) 28.600
Then the keyboard layout is set to "ru" 0.143
When the network is plugged 0.033
And Tor is ready 14.567
Then I successfully start the Unsafe Browser in "ru" 29.812
And I kill the Unsafe Browser 6.706
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 38.185
And DuckDuckGo is the default search engine 9.983
And I kill the Tor Browser 5.326
And the screen keyboard works in Thunderbird 25.565
And the layout of the screen keyboard is set to "ru" 0.562
After features/support/hooks.rb:291 1.074
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.763
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.132
When I log in to a new session in Spanish (es) 30.011
Then the keyboard layout is set to "es" 0.133
When the network is plugged 0.033
And Tor is ready 15.685
Then I successfully start the Unsafe Browser in "es" 25.455
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.279
And DuckDuckGo is the default search engine 9.639
And I kill the Tor Browser 5.293
And the screen keyboard works in Thunderbird 21.538
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.073
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.361
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.910
When I log in to a new session in Turkish (tr) 29.469
Then the keyboard layout is set to "tr" 0.136
When the network is plugged 0.035
And Tor is ready 14.142
Then I successfully start the Unsafe Browser in "tr" 28.920
And I kill the Unsafe Browser 5.846
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 34.230
And DuckDuckGo is the default search engine 10.923
And I kill the Tor Browser 5.732
And the screen keyboard works in Thunderbird 22.296
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.889
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.146
When the network is plugged 0.032
And I wait 720 seconds 12:0.073 
Slept for 720 seconds
Then I successfully configure Tor 9.986
And the time has synced 0.053
After features/support/hooks.rb:291 0.704
After features/support/hooks.rb:75 0.000