Project Number Date
test_Tails_ISO_devel 3208 23 Dec 2023, 12:24

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:25:44.903 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.824
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.509
And I prepare Tails for memory erasure tests 0.682
When I start a process allocating 128 MiB of memory with a known pattern 1.252
Then patterns cover at least 128 MiB in the guest's memory 3.268 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.300
Then I find very few patterns in the guest's memory 3.810 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
After features/support/hooks.rb:291 0.767
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.763
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.555
And I prepare Tails for memory erasure tests 0.691
And I find very few patterns in the guest's memory 3.776 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.994
Then patterns cover at least 99% of the test FS size in the guest's memory 3.244 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.640
Then I find very few patterns in the guest's memory 4.860 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 0.805
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:33.533
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 10.493
And I prepare Tails for memory erasure tests 0.420
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.439
Then I find very few patterns in the guest's memory 3.710 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:55.602
Then patterns cover at least 86% of the test FS size in the guest's memory 3.046 
Pattern coverage: 97.068% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.488
Then I find very few patterns in the guest's memory 3.490 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
# read cache
When I mount the USB drive again 0.234
And I read the content of the test FS 0.538
Then patterns cover at least 99% of the test FS size in the guest's memory 2.931 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.418
Then I find very few patterns in the guest's memory 3.717 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 0.957
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:48.344
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.819
And I prepare Tails for memory erasure tests 0.608
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 32.221
Then I find very few patterns in the guest's memory 3.344 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:44.027
Then patterns cover at least 99% of the test FS size in the guest's memory 3.301 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.713
Then I find very few patterns in the guest's memory 3.825 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
# read cache
When I mount the USB drive again 3.455
And I read the content of the test FS 0.585
Then patterns cover at least 99% of the test FS size in the guest's memory 2.900 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.470
Then I find very few patterns in the guest's memory 4.071 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
After features/support/hooks.rb:291 1.238
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.300
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and logged in 8.531
And I prepare Tails for memory erasure tests 0.681
When I fill a 128 MiB file with a known pattern on the root filesystem 16.499
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.253
Then patterns cover at least 128 MiB in the guest's memory 3.032 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.516
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.772 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 3.421
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:51.835
Before features/support/hooks.rb:245 0.005
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:9.018
And I prepare Tails for memory erasure tests 0.470
When I fill a 128 MiB file with a known pattern on the persistent filesystem 19.809
When I trigger shutdown 0.347
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.171 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 3.465
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:18.261
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.011
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:22.359
And I update APT using apt 17.818
When I install "popularity-contest" using apt 19.731
Then I am notified I can not use Additional Software for "popularity-contest" 54.820
And I can open the Additional Software documentation from the notification 23.530
After features/support/hooks.rb:450 36.293
After features/support/hooks.rb:291 1.842
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:27.172
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.476
And I update APT using apt 16.785
And I install "popularity-contest" using apt 19.495
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.080
When I create a persistent storage and activate the Additional Software feature 17.217
Then Additional Software is correctly configured for package "popularity-contest" 1.310
When I shutdown Tails and wait for the computer to power off 10.111
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:29.529
Then Additional Software is correctly configured for package "popularity-contest" 0.903
And the package "popularity-contest" is installed after Additional Software has been started 0.263
After features/support/hooks.rb:450 36.557
After features/support/hooks.rb:291 0.960
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:50.802
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.182
And I start Tails from USB drive "__internal" and I login with an administration password 1:17.565
And I update APT using apt 16.742
When I install "makepp" using apt 19.623
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.609
And the package "makepp" is installed 0.077
After features/support/hooks.rb:450 37.568
After features/support/hooks.rb:291 0.921
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:8.281
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:28.457
When I uninstall "popularity-contest" using apt 15.862
And I accept removing "popularity-contest" from Additional Software 1.954
Then "popularity-contest" is not in the list of Additional Software 0.790
When I start Synaptic 20.617
And I update APT using Synaptic 21.825
And I install "cowsay" using Synaptic 8.656
And I accept adding "cowsay" to Additional Software 0.960
Then Additional Software is correctly configured for package "cowsay" 1.031
When I uninstall "cowsay" using apt 3.320
And I refuse removing "cowsay" from Additional Software 0.573
Then Additional Software is correctly configured for package "cowsay" 0.900
When I start "Additional Software" via GNOME Activities Overview 12.557
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.718
Then "cowsay" is not in the list of Additional Software 1.024
When I install "cowsay" using apt 3.292
And I refuse adding "cowsay" to Additional Software 0.711
Then "cowsay" is not in the list of Additional Software 0.833
After features/support/hooks.rb:450 1.179
After features/support/hooks.rb:291 0.673
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:20.441
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.005
Given a computer 0.187
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:56.139
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.971
And I accept adding "cowsay" to Additional Software 1:1.353
And Additional Software is correctly configured for package "cowsay" 1.200
And I shutdown Tails and wait for the computer to power off 6.083
And I start Tails from USB drive "__internal" with network unplugged 44.247
And I enable persistence 30.798
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 22.066
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.669
And I revert the APT tweaks that made it prefer an old version of cowsay 0.068
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.105
And the network is plugged 0.048
And Tor is ready 16.012
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.329
And available upgrades have been checked 0.114
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.439
And I can open the Additional Software configuration window from the notification 2.244
And I shutdown Tails and wait for the computer to power off 2:3.548
And I start Tails from USB drive "__internal" with network unplugged 45.241
And I enable persistence 31.451
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 25.341
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.646
And I revert the APT tweaks that made it prefer an old version of cowsay 0.061
And the network is plugged 0.034
And Tor is ready 37.660
Then the Additional Software upgrade service has started 0.167
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.140
After features/support/hooks.rb:450 2.509
After features/support/hooks.rb:291 0.701
After features/support/hooks.rb:75 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:45.014
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.015
Given a computer 0.263
And I start Tails from USB drive "__internal" with network unplugged 45.424
And I enable persistence 33.062
And I remove the "cowsay" deb files from the APT cache 0.649
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.078
And I log in to a new session 21.481
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.449
And I can open the Additional Software log file from the notification 2.376
And the package "cowsay" is not installed 0.228
After features/support/hooks.rb:450 0.103
After features/support/hooks.rb:291 0.663
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.842
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.791
When I log in to a new session in Arabic (ar) 27.596
Then the keyboard layout is set to "us" 0.230
When the network is plugged 0.043
And Tor is ready 14.763
Then I successfully start the Unsafe Browser in "ar" 30.824
And I kill the Unsafe Browser 6.186
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 33.346
And DuckDuckGo is the default search engine 9.456
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 21.618
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 1.067
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:9.923
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.851
When I log in to a new session in Chinese (zh_CN) 29.489
Then the keyboard layout is set to "cn" 0.115
When the network is plugged 0.036
And Tor is ready 42.653
Then I successfully start the Unsafe Browser in "zh_CN" 28.816
And I kill the Unsafe Browser 5.779
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 34.650
And DuckDuckGo is the default search engine 9.876
And I kill the Tor Browser 5.288
And the screen keyboard works in Thunderbird 24.627
And the layout of the screen keyboard is set to "us" 0.593
After features/support/hooks.rb:291 1.529
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.143
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.745
When I log in to a new session in English (en) 14.050
Then the keyboard layout is set to "us" 0.208
When the network is plugged 0.047
And Tor is ready 15.954
Then I successfully start the Unsafe Browser in "en" 24.623
And I kill the Unsafe Browser 5.903
When I enable the screen keyboard 0.074
Then the screen keyboard works in Tor Browser 32.234
And DuckDuckGo is the default search engine 5.163
And I kill the Tor Browser 5.295
And the screen keyboard works in Thunderbird 22.297
And the layout of the screen keyboard is set to "us" 0.544
After features/support/hooks.rb:291 1.004
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.763
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.966
When I log in to a new session in French (fr) 27.216
Then the keyboard layout is set to "fr" 0.209
When the network is plugged 0.037
And Tor is ready 15.018
Then I successfully start the Unsafe Browser in "fr" 24.648
And I kill the Unsafe Browser 6.414
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 33.342
And DuckDuckGo is the default search engine 9.526
And I kill the Tor Browser 5.376
And the screen keyboard works in Thunderbird 21.279
And the layout of the screen keyboard is set to "fr" 0.623
After features/support/hooks.rb:291 1.244
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:58.861
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.935
When I log in to a new session in German (de) 27.547
Then the keyboard layout is set to "de" 0.208
When the network is plugged 0.038
And Tor is ready 42.765
Then I successfully start the Unsafe Browser in "de" 24.456
And I kill the Unsafe Browser 5.909
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 32.852
And DuckDuckGo is the default search engine 9.801
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 21.304
And the layout of the screen keyboard is set to "de" 0.596
After features/support/hooks.rb:291 1.271
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.316
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.533
When I log in to a new session in Italian (it) 27.926
Then the keyboard layout is set to "it" 0.131
When the network is plugged 0.032
And Tor is ready 16.597
Then I successfully start the Unsafe Browser in "it" 24.887
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 34.948
And DuckDuckGo is the default search engine 9.340
And I kill the Tor Browser 5.334
And the screen keyboard works in Thunderbird 24.029
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 0.968
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.835
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.849
When I log in to a new session in Persian (fa) 29.591
Then the keyboard layout is set to "ir" 0.129
When the network is plugged 0.043
And Tor is ready 15.628
Then I successfully start the Unsafe Browser in "fa" 26.026
And I kill the Unsafe Browser 5.833
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 34.104
And DuckDuckGo is the default search engine 9.290
And I kill the Tor Browser 5.337
And the screen keyboard works in Thunderbird 24.264
And the layout of the screen keyboard is set to "ir" 0.600
After features/support/hooks.rb:291 17.377
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.070
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.436
When I log in to a new session in Portuguese (pt) 29.224
Then the keyboard layout is set to "pt" 0.178
When the network is plugged 0.037
And Tor is ready 16.431
Then I successfully start the Unsafe Browser in "pt" 26.819
And I kill the Unsafe Browser 5.841
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 33.369
And DuckDuckGo is the default search engine 9.794
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 22.917
And the layout of the screen keyboard is set to "us" 0.559
After features/support/hooks.rb:291 1.133
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.772
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.881
When I log in to a new session in Russian (ru) 28.939
Then the keyboard layout is set to "ru" 0.224
When the network is plugged 0.058
And Tor is ready 15.990
Then I successfully start the Unsafe Browser in "ru" 29.639
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 34.047
And DuckDuckGo is the default search engine 9.466
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 23.629
And the layout of the screen keyboard is set to "ru" 0.594
After features/support/hooks.rb:291 1.235
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.104
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.711
When I log in to a new session in Spanish (es) 27.561
Then the keyboard layout is set to "es" 0.157
When the network is plugged 0.034
And Tor is ready 14.630
Then I successfully start the Unsafe Browser in "es" 26.354
And I kill the Unsafe Browser 6.545
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 34.366
And DuckDuckGo is the default search engine 9.541
And I kill the Tor Browser 5.347
And the screen keyboard works in Thunderbird 21.152
And the layout of the screen keyboard is set to "us" 0.565
After features/support/hooks.rb:291 3.026
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.658
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.822
When I log in to a new session in Turkish (tr) 28.328
Then the keyboard layout is set to "tr" 0.240
When the network is plugged 0.046
And Tor is ready 16.527
Then I successfully start the Unsafe Browser in "tr" 25.949
And I kill the Unsafe Browser 6.553
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.597
And DuckDuckGo is the default search engine 9.282
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 20.309
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.103
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.033
When the network is plugged 0.048
And I wait 720 seconds 12:0.046 
Slept for 720 seconds
Then I successfully configure Tor 9.888
And the time has synced 0.049
After features/support/hooks.rb:291 0.599
After features/support/hooks.rb:75 0.000