Project Number Date
test_Tails_ISO_stable 4723 18 Mar 2024, 12:10

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:21.224 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.645
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.720
And I prepare Tails for memory erasure tests 0.463
When I start a process allocating 128 MiB of memory with a known pattern 1.289
Then patterns cover at least 128 MiB in the guest's memory 4.523 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.785
Then I find very few patterns in the guest's memory 4.863 
Pattern coverage: 0.000% (0 MiB out of 934 MiB reference memory)
After features/support/hooks.rb:291 0.875
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.109
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.436
And I prepare Tails for memory erasure tests 0.415
And I find very few patterns in the guest's memory 4.523 
Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.550
Then patterns cover at least 99% of the test FS size in the guest's memory 4.080 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.434
Then I find very few patterns in the guest's memory 4.668 
Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)
After features/support/hooks.rb:291 0.692
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
44.519
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.199
And I prepare Tails for memory erasure tests 0.380
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.876
Then I find very few patterns in the guest's memory 4.203 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.280
Then patterns cover at least 86% of the test FS size in the guest's memory 4.334 
Pattern coverage: 96.804% (123 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.143
Then I find very few patterns in the guest's memory 4.404 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
# read cache
When I mount the USB drive again 0.549
And I read the content of the test FS 0.902
Then patterns cover at least 99% of the test FS size in the guest's memory 4.373 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.612
Then I find very few patterns in the guest's memory 4.259 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
After features/support/hooks.rb:291 0.858
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.875
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.692
And I prepare Tails for memory erasure tests 0.555
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.497
Then I find very few patterns in the guest's memory 4.121 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.581
Then patterns cover at least 99% of the test FS size in the guest's memory 3.542 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.633
Then I find very few patterns in the guest's memory 4.117 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
# read cache
When I mount the USB drive again 4.225
And I read the content of the test FS 0.599
Then patterns cover at least 99% of the test FS size in the guest's memory 2.874 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 3.093
Then I find very few patterns in the guest's memory 3.339 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
After features/support/hooks.rb:291 0.836
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.436
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.167
And I prepare Tails for memory erasure tests 0.432
When I fill a 128 MiB file with a known pattern on the root filesystem 12.884
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.413
Then patterns cover at least 128 MiB in the guest's memory 2.678 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.017
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.821 
Pattern coverage: 0.000% (0 MiB out of 937 MiB reference memory)
After features/support/hooks.rb:291 3.484
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:41.352
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:57.717
And I prepare Tails for memory erasure tests 0.418
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.008
When I trigger shutdown 0.015
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.172 
Pattern coverage: 0.000% (0 MiB out of 953 MiB reference memory)
After features/support/hooks.rb:291 3.541
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:17.226
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:21.170
And I update APT using apt 16.222
And I install "popularity-contest" using apt 19.275
Then I am proposed to add the "popularity-contest" package to my Additional Software 9.746
When I create a persistent storage and activate the Additional Software feature 20.944
Then Additional Software is correctly configured for package "popularity-contest" 1.340
When I shutdown Tails and wait for the computer to power off 9.130
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:38.325
Then Additional Software is correctly configured for package "popularity-contest" 0.796
And the package "popularity-contest" is installed after Additional Software has been started 0.274
After features/support/hooks.rb:450 42.594
After features/support/hooks.rb:291 1.220
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:23.665
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.237
And I start Tails from USB drive "__internal" and I login with an administration password 1:39.101
And I update APT using apt 18.453
When I install "makepp" using apt 19.371
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.429
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 41.466
After features/support/hooks.rb:291 0.954
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:34.340
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.204
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:52.719
When I uninstall "popularity-contest" using apt 18.805
And I accept removing "popularity-contest" from Additional Software 0.571
Then "popularity-contest" is not in the list of Additional Software 0.687
When I start Synaptic 22.846
And I update APT using Synaptic 21.945
And I install "cowsay" using Synaptic 9.183
And I accept adding "cowsay" to Additional Software 1.370
Then Additional Software is correctly configured for package "cowsay" 0.780
When I uninstall "cowsay" using apt 3.208
And I refuse removing "cowsay" from Additional Software 0.590
Then Additional Software is correctly configured for package "cowsay" 0.836
When I start "Additional Software" via GNOME Activities Overview 10.062
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.038
Then "cowsay" is not in the list of Additional Software 0.916
When I install "cowsay" using apt 3.210
And I refuse adding "cowsay" to Additional Software 0.639
Then "cowsay" is not in the list of Additional Software 0.723
After features/support/hooks.rb:450 1.325
After features/support/hooks.rb:291 0.695
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:1.441
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.210
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:12.870
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.691
And I accept adding "cowsay" to Additional Software 4.132
And Additional Software is correctly configured for package "cowsay" 0.853
And I shutdown Tails and wait for the computer to power off 6.022
And I start Tails from USB drive "__internal" with network unplugged 54.478
And I enable persistence 16.868
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 35.128
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.229
And I revert the APT tweaks that made it prefer an old version of cowsay 0.067
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.061
And the network is plugged 0.050
And Tor is ready 19.837
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.249
And available upgrades have been checked 0.068
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.975
And I can open the Additional Software configuration window from the notification 3.781
And I shutdown Tails and wait for the computer to power off 13.040
And I start Tails from USB drive "__internal" with network unplugged 56.820
And I enable persistence 12.806
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 35.728
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.312
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
And the network is plugged 0.050
And Tor is ready 50.689
Then the Additional Software upgrade service has started 0.193
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.095
After features/support/hooks.rb:450 2.530
After features/support/hooks.rb:291 0.914
After features/support/hooks.rb:75 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:9.508
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.229
And I start Tails from USB drive "__internal" with network unplugged 59.173
And I enable persistence 13.689
And I remove the "cowsay" deb files from the APT cache 0.754
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.114
And I log in to a new session 35.719
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 13.477
And I can open the Additional Software log file from the notification 5.763
And the package "cowsay" is not installed 0.585
After features/support/hooks.rb:450 0.117
After features/support/hooks.rb:291 0.919
After features/support/hooks.rb:75 0.022
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.752
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.455
When I log in to a new session in Arabic (ar) 30.894
Then the keyboard layout is set to "us" 0.204
When the network is plugged 0.049
And Tor is ready 14.731
Then I successfully start the Unsafe Browser in "ar" 15.043
And I kill the Unsafe Browser 5.796
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 35.117
And DuckDuckGo is the default search engine 10.541
And I kill the Tor Browser 5.572
And the screen keyboard works in Thunderbird 21.729
And the layout of the screen keyboard is set to "us" 0.526
After features/support/hooks.rb:291 3.513
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.811
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.276
When I log in to a new session in Chinese (zh_CN) 30.160
Then the keyboard layout is set to "cn" 0.214
When the network is plugged 0.038
And Tor is ready 16.443
Then I successfully start the Unsafe Browser in "zh_CN" 15.072
And I kill the Unsafe Browser 5.954
When I enable the screen keyboard 0.198
Then the screen keyboard works in Tor Browser 34.707
And DuckDuckGo is the default search engine 10.635
And I kill the Tor Browser 5.696
And the screen keyboard works in Thunderbird 23.824
And the layout of the screen keyboard is set to "us" 0.588
After features/support/hooks.rb:291 1.218
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.486
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.104
When I log in to a new session in English (en) 17.788
Then the keyboard layout is set to "us" 0.153
When the network is plugged 0.041
And Tor is ready 13.335
Then I successfully start the Unsafe Browser in "en" 12.861
And I kill the Unsafe Browser 5.876
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 33.053
And DuckDuckGo is the default search engine 10.023
And I kill the Tor Browser 5.343
And the screen keyboard works in Thunderbird 22.254
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.514
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.507
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.224
When I log in to a new session in French (fr) 29.577
Then the keyboard layout is set to "fr" 0.229
When the network is plugged 0.035
And Tor is ready 16.046
Then I successfully start the Unsafe Browser in "fr" 12.856
And I kill the Unsafe Browser 5.888
When I enable the screen keyboard 0.081
Then the screen keyboard works in Tor Browser 33.239
And DuckDuckGo is the default search engine 10.338
And I kill the Tor Browser 5.424
And the screen keyboard works in Thunderbird 21.918
And the layout of the screen keyboard is set to "fr" 0.647
After features/support/hooks.rb:291 1.220
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.167
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.528
When I log in to a new session in German (de) 33.762
Then the keyboard layout is set to "de" 0.136
When the network is plugged 0.048
And Tor is ready 15.404
Then I successfully start the Unsafe Browser in "de" 13.431
And I kill the Unsafe Browser 5.639
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 34.501
And DuckDuckGo is the default search engine 10.814
And I kill the Tor Browser 5.629
And the screen keyboard works in Thunderbird 22.606
And the layout of the screen keyboard is set to "de" 0.576
After features/support/hooks.rb:291 1.182
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.991
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.980
When I log in to a new session in Italian (it) 30.393
Then the keyboard layout is set to "it" 0.133
When the network is plugged 0.045
And Tor is ready 14.133
Then I successfully start the Unsafe Browser in "it" 13.615
And I kill the Unsafe Browser 5.885
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 33.659
And DuckDuckGo is the default search engine 10.284
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 21.746
And the layout of the screen keyboard is set to "us" 0.539
After features/support/hooks.rb:291 1.136
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.107
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.848
When I log in to a new session in Persian (fa) 28.116
Then the keyboard layout is set to "ir" 0.167
When the network is plugged 0.051
And Tor is ready 14.156
Then I successfully start the Unsafe Browser in "fa" 13.280
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 35.575
And DuckDuckGo is the default search engine 10.231
And I kill the Tor Browser 5.554
And the screen keyboard works in Thunderbird 23.643
And the layout of the screen keyboard is set to "ir" 0.591
After features/support/hooks.rb:291 1.037
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.080
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.212
When I log in to a new session in Portuguese (pt) 35.455
Then the keyboard layout is set to "pt" 0.131
When the network is plugged 0.063
And Tor is ready 15.191
Then I successfully start the Unsafe Browser in "pt" 12.617
And I kill the Unsafe Browser 5.751
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 32.093
And DuckDuckGo is the default search engine 10.864
And I kill the Tor Browser 6.316
And the screen keyboard works in Thunderbird 22.708
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.488
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.232
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.020
When I log in to a new session in Russian (ru) 29.984
Then the keyboard layout is set to "ru" 0.147
When the network is plugged 0.043
And Tor is ready 14.194
Then I successfully start the Unsafe Browser in "ru" 13.354
And I kill the Unsafe Browser 5.782
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 34.029
And DuckDuckGo is the default search engine 22.734
And I kill the Tor Browser 5.585
And the screen keyboard works in Thunderbird 23.655
And the layout of the screen keyboard is set to "ru" 0.589
After features/support/hooks.rb:291 2.915
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.648
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.247
When I log in to a new session in Spanish (es) 29.215
Then the keyboard layout is set to "es" 0.141
When the network is plugged 0.037
And Tor is ready 13.308
Then I successfully start the Unsafe Browser in "es" 13.778
And I kill the Unsafe Browser 5.842
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 33.529
And DuckDuckGo is the default search engine 10.747
And I kill the Tor Browser 5.455
And the screen keyboard works in Thunderbird 21.680
And the layout of the screen keyboard is set to "us" 0.566
After features/support/hooks.rb:291 3.277
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.317
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.039
When I log in to a new session in Turkish (tr) 31.379
Then the keyboard layout is set to "tr" 0.164
When the network is plugged 0.076
And Tor is ready 13.790
Then I successfully start the Unsafe Browser in "tr" 13.430
And I kill the Unsafe Browser 5.782
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 33.017
And DuckDuckGo is the default search engine 10.836
And I kill the Tor Browser 5.615
And the screen keyboard works in Thunderbird 21.495
And the layout of the screen keyboard is set to "us" 0.606
After features/support/hooks.rb:291 2.537
After features/support/hooks.rb:75 0.000