Project Number Date
test_Tails_ISO_devel 3233 12 Jan 2024, 12:32

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:27:51.077 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.908
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.377
And I prepare Tails for memory erasure tests 0.521
When I start a process allocating 128 MiB of memory with a known pattern 1.232
Then patterns cover at least 128 MiB in the guest's memory 3.826 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.293
Then I find very few patterns in the guest's memory 4.657 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 0.951
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.430
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.097
And I prepare Tails for memory erasure tests 0.483
And I find very few patterns in the guest's memory 4.456 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.460
Then patterns cover at least 99% of the test FS size in the guest's memory 4.455 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.214
Then I find very few patterns in the guest's memory 4.262 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 0.920
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:3.254
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.308
And I prepare Tails for memory erasure tests 0.480
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.981
Then I find very few patterns in the guest's memory 5.007 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:20.960
Then patterns cover at least 86% of the test FS size in the guest's memory 4.078 
Pattern coverage: 94.513% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.149
Then I find very few patterns in the guest's memory 4.434 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 0.229
And I read the content of the test FS 2.180
Then patterns cover at least 99% of the test FS size in the guest's memory 3.603 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.262
Then I find very few patterns in the guest's memory 4.576 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 0.958
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:47.489
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.873
And I prepare Tails for memory erasure tests 0.516
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.189
Then I find very few patterns in the guest's memory 4.101 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:49.082
Then patterns cover at least 99% of the test FS size in the guest's memory 3.504 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.694
Then I find very few patterns in the guest's memory 4.693 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# read cache
When I mount the USB drive again 4.441
And I read the content of the test FS 0.424
Then patterns cover at least 99% of the test FS size in the guest's memory 3.074 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.394
Then I find very few patterns in the guest's memory 3.497 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 0.821
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.169
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.046
And I prepare Tails for memory erasure tests 0.540
When I fill a 128 MiB file with a known pattern on the root filesystem 15.479
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 4.784
Then patterns cover at least 128 MiB in the guest's memory 3.032 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.557
And I wait 20 seconds 20.003 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.725 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:291 3.444
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:10.663
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:26.202
And I prepare Tails for memory erasure tests 0.517
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.293
When I trigger shutdown 0.319
And I wait 20 seconds 20.012 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.317 
Pattern coverage: 0.000% (0 MiB out of 1181 MiB reference memory)
After features/support/hooks.rb:291 3.493
After features/support/hooks.rb:75 0.022
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:26.145
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:24.953
And I update APT using apt 17.627
When I install "popularity-contest" using apt 19.722
Then I am notified I can not use Additional Software for "popularity-contest" 1:0.094
And I can open the Additional Software documentation from the notification 23.747
After features/support/hooks.rb:450 38.270
After features/support/hooks.rb:291 2.407
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:26.066
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:25.260
And I update APT using apt 17.841
And I install "popularity-contest" using apt 19.481
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.722
When I create a persistent storage and activate the Additional Software feature 16.882
Then Additional Software is correctly configured for package "popularity-contest" 1.521
When I shutdown Tails and wait for the computer to power off 10.081
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:53.968
Then Additional Software is correctly configured for package "popularity-contest" 1.009
And the package "popularity-contest" is installed after Additional Software has been started 0.297
After features/support/hooks.rb:450 39.889
After features/support/hooks.rb:291 0.964
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:0.917
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.195
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.762
And I update APT using apt 16.098
When I install "makepp" using apt 19.526
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:1.228
And the package "makepp" is installed 0.105
After features/support/hooks.rb:450 41.917
After features/support/hooks.rb:291 0.949
After features/support/hooks.rb:75 0.063
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:57.724
Before features/support/hooks.rb:245 0.010
Before features/support/hooks.rb:442 0.009
Given a computer 0.218
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.178
When I uninstall "popularity-contest" using apt 19.057
And I accept removing "popularity-contest" from Additional Software 0.691
Then "popularity-contest" is not in the list of Additional Software 0.794
When I start Synaptic 24.152
And I update APT using Synaptic 22.019
And I install "cowsay" using Synaptic 8.039
And I accept adding "cowsay" to Additional Software 1.221
Then Additional Software is correctly configured for package "cowsay" 0.892
When I uninstall "cowsay" using apt 3.334
And I refuse removing "cowsay" from Additional Software 0.666
Then Additional Software is correctly configured for package "cowsay" 0.905
When I start "Additional Software" via GNOME Activities Overview 12.451
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.064
Then "cowsay" is not in the list of Additional Software 1.143
When I install "cowsay" using apt 3.294
And I refuse adding "cowsay" to Additional Software 0.776
Then "cowsay" is not in the list of Additional Software 0.822
After features/support/hooks.rb:450 1.577
After features/support/hooks.rb:291 0.776
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:55.859
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:5.230
And I configure APT to prefer an old version of cowsay 0.037
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.367
And I accept adding "cowsay" to Additional Software 1:6.684
And Additional Software is correctly configured for package "cowsay" 1.497
And I shutdown Tails and wait for the computer to power off 5.071
And I start Tails from USB drive "__internal" with network unplugged 47.313
And I enable persistence 31.991
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 32.623
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.635
And I revert the APT tweaks that made it prefer an old version of cowsay 0.089
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.114
And the network is plugged 0.050
And Tor is ready 19.810
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.123
And available upgrades have been checked 0.071
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.053
And I can open the Additional Software configuration window from the notification 2.529
And I shutdown Tails and wait for the computer to power off 2:2.558
And I start Tails from USB drive "__internal" with network unplugged 46.248
And I enable persistence 32.382
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 25.956
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.035
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
And the network is plugged 0.047
And Tor is ready 39.733
Then the Additional Software upgrade service has started 0.189
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.076
After features/support/hooks.rb:450 2.415
After features/support/hooks.rb:291 0.951
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:48.449
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.222
And I start Tails from USB drive "__internal" with network unplugged 45.810
And I enable persistence 32.252
And I remove the "cowsay" deb files from the APT cache 0.649
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.084
And I log in to a new session 21.313
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.439
And I can open the Additional Software log file from the notification 2.471
And the package "cowsay" is not installed 0.206
After features/support/hooks.rb:450 0.122
After features/support/hooks.rb:291 1.232
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.658
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.938
When I log in to a new session in Arabic (ar) 28.905
Then the keyboard layout is set to "us" 0.215
When the network is plugged 0.082
And Tor is ready 14.465
Then I successfully start the Unsafe Browser in "ar" 27.872
And I kill the Unsafe Browser 5.970
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 35.341
And DuckDuckGo is the default search engine 17.084
And I kill the Tor Browser 5.612
And the screen keyboard works in Thunderbird 21.457
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:291 1.100
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:12.869
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.814
When I log in to a new session in Chinese (zh_CN) 28.728
Then the keyboard layout is set to "cn" 0.134
When the network is plugged 0.040
And Tor is ready 44.409
Then I successfully start the Unsafe Browser in "zh_CN" 29.896
And I kill the Unsafe Browser 5.880
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 33.552
And DuckDuckGo is the default search engine 9.567
And I kill the Tor Browser 5.433
And the screen keyboard works in Thunderbird 26.726
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.415
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.467
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.635
When I log in to a new session in English (en) 15.847
Then the keyboard layout is set to "us" 0.182
When the network is plugged 0.050
And Tor is ready 16.513
Then I successfully start the Unsafe Browser in "en" 28.954
And I kill the Unsafe Browser 5.748
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 33.062
And DuckDuckGo is the default search engine 5.359
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 21.058
And the layout of the screen keyboard is set to "us" 0.546
After features/support/hooks.rb:291 0.925
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.508
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.747
When I log in to a new session in French (fr) 27.347
Then the keyboard layout is set to "fr" 0.117
When the network is plugged 0.032
And Tor is ready 15.149
Then I successfully start the Unsafe Browser in "fr" 27.405
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.159
Then the screen keyboard works in Tor Browser 33.861
And DuckDuckGo is the default search engine 9.973
And I kill the Tor Browser 5.322
And the screen keyboard works in Thunderbird 20.971
And the layout of the screen keyboard is set to "fr" 0.581
After features/support/hooks.rb:291 1.596
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.025
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.800
When I log in to a new session in German (de) 27.946
Then the keyboard layout is set to "de" 0.254
When the network is plugged 0.039
And Tor is ready 15.638
Then I successfully start the Unsafe Browser in "de" 29.395
And I kill the Unsafe Browser 6.185
When I enable the screen keyboard 0.148
Then the screen keyboard works in Tor Browser 33.905
And DuckDuckGo is the default search engine 17.731
And I kill the Tor Browser 5.517
And the screen keyboard works in Thunderbird 20.891
And the layout of the screen keyboard is set to "de" 0.571
After features/support/hooks.rb:291 3.779
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.452
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.766
When I log in to a new session in Italian (it) 27.616
Then the keyboard layout is set to "it" 0.206
When the network is plugged 0.051
And Tor is ready 15.806
Then I successfully start the Unsafe Browser in "it" 26.362
And I kill the Unsafe Browser 6.202
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 33.448
And DuckDuckGo is the default search engine 9.586
And I kill the Tor Browser 5.330
And the screen keyboard works in Thunderbird 20.302
And the layout of the screen keyboard is set to "us" 0.626
After features/support/hooks.rb:291 1.101
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.397
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.783
When I log in to a new session in Persian (fa) 26.803
Then the keyboard layout is set to "ir" 0.267
When the network is plugged 0.060
And Tor is ready 43.929
Then I successfully start the Unsafe Browser in "fa" 26.533
And I kill the Unsafe Browser 5.638
When I enable the screen keyboard 0.173
Then the screen keyboard works in Tor Browser 35.336
And DuckDuckGo is the default search engine 9.616
And I kill the Tor Browser 5.271
And the screen keyboard works in Thunderbird 22.410
And the layout of the screen keyboard is set to "ir" 0.573
After features/support/hooks.rb:291 1.324
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.205
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.904
When I log in to a new session in Portuguese (pt) 27.525
Then the keyboard layout is set to "pt" 0.279
When the network is plugged 0.043
And Tor is ready 15.317
Then I successfully start the Unsafe Browser in "pt" 26.291
And I kill the Unsafe Browser 6.185
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 35.024
And DuckDuckGo is the default search engine 9.660
And I kill the Tor Browser 5.400
And the screen keyboard works in Thunderbird 21.895
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 2.095
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.199
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.733
When I log in to a new session in Russian (ru) 30.982
Then the keyboard layout is set to "ru" 0.142
When the network is plugged 0.045
And Tor is ready 13.566
Then I successfully start the Unsafe Browser in "ru" 27.428
And I kill the Unsafe Browser 5.933
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 35.269
And DuckDuckGo is the default search engine 9.712
And I kill the Tor Browser 5.284
And the screen keyboard works in Thunderbird 24.373
And the layout of the screen keyboard is set to "ru" 0.571
After features/support/hooks.rb:291 1.059
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.396
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.365
When I log in to a new session in Spanish (es) 28.570
Then the keyboard layout is set to "es" 0.177
When the network is plugged 0.121
And Tor is ready 15.239
Then I successfully start the Unsafe Browser in "es" 29.338
And I kill the Unsafe Browser 5.930
When I enable the screen keyboard 0.168
Then the screen keyboard works in Tor Browser 32.976
And DuckDuckGo is the default search engine 9.571
And I kill the Tor Browser 5.338
And the screen keyboard works in Thunderbird 23.038
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.320
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.859
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.424
When I log in to a new session in Turkish (tr) 27.823
Then the keyboard layout is set to "tr" 0.293
When the network is plugged 0.040
And Tor is ready 16.830
Then I successfully start the Unsafe Browser in "tr" 26.401
And I kill the Unsafe Browser 5.873
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 33.789
And DuckDuckGo is the default search engine 9.390
And I kill the Tor Browser 5.311
And the screen keyboard works in Thunderbird 20.736
And the layout of the screen keyboard is set to "us" 0.803
After features/support/hooks.rb:291 1.256
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:8.958
When the network is plugged 0.039
And I wait 720 seconds 12:0.080 
Slept for 720 seconds
Then I successfully configure Tor 8.767
And the time has synced 0.070
After features/support/hooks.rb:291 0.708
After features/support/hooks.rb:75 0.000