Project Number Date
test_Tails_ISO_stable 4660 10 Feb 2024, 14:57

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:27.951 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.182
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.463
And I prepare Tails for memory erasure tests 0.527
When I start a process allocating 128 MiB of memory with a known pattern 1.215
Then patterns cover at least 128 MiB in the guest's memory 3.850 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.077
Then I find very few patterns in the guest's memory 5.047 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 0.761
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.705
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.841
And I prepare Tails for memory erasure tests 0.510
And I find very few patterns in the guest's memory 3.702 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.954
Then patterns cover at least 99% of the test FS size in the guest's memory 3.416 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.375
Then I find very few patterns in the guest's memory 3.904 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 0.892
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:51.718
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.794
And I prepare Tails for memory erasure tests 0.710
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.079
Then I find very few patterns in the guest's memory 3.808 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:12.268
Then patterns cover at least 86% of the test FS size in the guest's memory 3.711 
Pattern coverage: 94.676% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.508
Then I find very few patterns in the guest's memory 3.823 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# read cache
When I mount the USB drive again 0.275
And I read the content of the test FS 1.021
Then patterns cover at least 99% of the test FS size in the guest's memory 4.009 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.265
Then I find very few patterns in the guest's memory 4.440 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
After features/support/hooks.rb:291 0.933
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:28.093
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.405
And I prepare Tails for memory erasure tests 0.521
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.454
Then I find very few patterns in the guest's memory 3.994 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:34.085
Then patterns cover at least 99% of the test FS size in the guest's memory 2.716 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.725
Then I find very few patterns in the guest's memory 3.242 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
# read cache
When I mount the USB drive again 3.403
And I read the content of the test FS 0.582
Then patterns cover at least 99% of the test FS size in the guest's memory 2.692 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.437
Then I find very few patterns in the guest's memory 3.831 
Pattern coverage: 0.000% (0 MiB out of 1210 MiB reference memory)
After features/support/hooks.rb:291 0.973
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.523
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.402
And I prepare Tails for memory erasure tests 0.608
When I fill a 128 MiB file with a known pattern on the root filesystem 12.820
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.430
Then patterns cover at least 128 MiB in the guest's memory 3.497 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.771
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.972 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 3.640
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:3.938
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:19.822
And I prepare Tails for memory erasure tests 0.484
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.009
When I trigger shutdown 0.408
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.193 
Pattern coverage: 0.000% (0 MiB out of 1163 MiB reference memory)
After features/support/hooks.rb:291 3.553
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:29.361
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.010
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.109
And I update APT using apt 16.548
And I install "popularity-contest" using apt 22.978
Then I am proposed to add the "popularity-contest" package to my Additional Software 54.666
When I create a persistent storage and activate the Additional Software feature 17.596
Then Additional Software is correctly configured for package "popularity-contest" 1.459
When I shutdown Tails and wait for the computer to power off 10.272
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.378
Then Additional Software is correctly configured for package "popularity-contest" 1.051
And the package "popularity-contest" is installed after Additional Software has been started 0.301
After features/support/hooks.rb:450 37.955
After features/support/hooks.rb:291 1.310
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:26.308
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.191
And I start Tails from USB drive "__internal" and I login with an administration password 1:50.216
And I update APT using apt 16.304
When I install "makepp" using apt 19.727
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.779
And the package "makepp" is installed 0.088
After features/support/hooks.rb:450 41.204
After features/support/hooks.rb:291 0.882
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:57.255
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.008
Given a computer 0.167
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:11.692
When I uninstall "popularity-contest" using apt 18.946
And I accept removing "popularity-contest" from Additional Software 0.808
Then "popularity-contest" is not in the list of Additional Software 0.852
When I start Synaptic 23.375
And I update APT using Synaptic 22.091
And I install "cowsay" using Synaptic 8.898
And I accept adding "cowsay" to Additional Software 1.203
Then Additional Software is correctly configured for package "cowsay" 0.814
When I uninstall "cowsay" using apt 3.352
And I refuse removing "cowsay" from Additional Software 0.680
Then Additional Software is correctly configured for package "cowsay" 0.865
When I start "Additional Software" via GNOME Activities Overview 12.500
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.280
Then "cowsay" is not in the list of Additional Software 0.992
When I install "cowsay" using apt 3.269
And I refuse adding "cowsay" to Additional Software 0.676
Then "cowsay" is not in the list of Additional Software 0.785
After features/support/hooks.rb:450 1.133
After features/support/hooks.rb:291 0.682
After features/support/hooks.rb:75 0.019
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:24.550
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.202
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.457
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.299
And I accept adding "cowsay" to Additional Software 1:8.676
And Additional Software is correctly configured for package "cowsay" 1.810
And I shutdown Tails and wait for the computer to power off 6.091
And I start Tails from USB drive "__internal" with network unplugged 46.113
And I enable persistence 32.128
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 29.432
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.008
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.108
And the network is plugged 0.055
And Tor is ready 18.529
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.608
And available upgrades have been checked 0.401
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.285
And I can open the Additional Software configuration window from the notification 3.520
And I shutdown Tails and wait for the computer to power off 2:2.972
And I start Tails from USB drive "__internal" with network unplugged 1:6.020
And I enable persistence 31.090
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 23.968
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.789
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
And the network is plugged 0.028
And Tor is ready 39.434
Then the Additional Software upgrade service has started 0.220
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.093
After features/support/hooks.rb:450 2.933
After features/support/hooks.rb:291 0.937
After features/support/hooks.rb:75 0.039
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.674
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.209
And I start Tails from USB drive "__internal" with network unplugged 46.816
And I enable persistence 33.403
And I remove the "cowsay" deb files from the APT cache 0.765
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.076
And I log in to a new session 23.381
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.311
And I can open the Additional Software log file from the notification 2.494
And the package "cowsay" is not installed 0.215
After features/support/hooks.rb:450 0.146
After features/support/hooks.rb:291 0.864
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.270
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.053
When I log in to a new session in Arabic (ar) 29.442
Then the keyboard layout is set to "us" 0.138
When the network is plugged 0.052
And Tor is ready 15.267
Then I successfully start the Unsafe Browser in "ar" 26.848
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 34.309
And DuckDuckGo is the default search engine 10.917
And I kill the Tor Browser 5.608
And the screen keyboard works in Thunderbird 23.027
And the layout of the screen keyboard is set to "us" 0.664
After features/support/hooks.rb:291 1.093
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:54.155
Before features/support/hooks.rb:245 0.011
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.042
When I log in to a new session in Chinese (zh_CN) 34.222
Then the keyboard layout is set to "cn" 0.200
When the network is plugged 0.204
And Tor is ready 15.669
Then I successfully start the Unsafe Browser in "zh_CN" 26.472
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 32.577
And DuckDuckGo is the default search engine 17.346
And I kill the Tor Browser 5.677
And the screen keyboard works in Thunderbird 27.165
And the layout of the screen keyboard is set to "us" 0.597
After features/support/hooks.rb:291 1.658
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.404
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.679
When I log in to a new session in English (en) 16.790
Then the keyboard layout is set to "us" 0.131
When the network is plugged 0.047
And Tor is ready 14.057
Then I successfully start the Unsafe Browser in "en" 27.635
And I kill the Unsafe Browser 5.843
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 32.202
And DuckDuckGo is the default search engine 5.497
And I kill the Tor Browser 5.361
And the screen keyboard works in Thunderbird 23.465
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 1.882
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.676
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.151
When I log in to a new session in French (fr) 29.453
Then the keyboard layout is set to "fr" 0.216
When the network is plugged 0.068
And Tor is ready 14.740
Then I successfully start the Unsafe Browser in "fr" 27.756
And I kill the Unsafe Browser 5.773
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 33.452
And DuckDuckGo is the default search engine 10.779
And I kill the Tor Browser 5.557
And the screen keyboard works in Thunderbird 23.962
And the layout of the screen keyboard is set to "fr" 0.652
After features/support/hooks.rb:291 1.099
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.467
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.787
When I log in to a new session in German (de) 30.980
Then the keyboard layout is set to "de" 0.163
When the network is plugged 0.057
And Tor is ready 15.687
Then I successfully start the Unsafe Browser in "de" 26.059
And I kill the Unsafe Browser 7.135
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 32.626
And DuckDuckGo is the default search engine 10.437
And I kill the Tor Browser 5.627
And the screen keyboard works in Thunderbird 23.119
And the layout of the screen keyboard is set to "de" 0.642
After features/support/hooks.rb:291 1.132
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.058
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.112
When I log in to a new session in Italian (it) 30.424
Then the keyboard layout is set to "it" 0.241
When the network is plugged 0.057
And Tor is ready 15.640
Then I successfully start the Unsafe Browser in "it" 27.211
And I kill the Unsafe Browser 7.127
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 34.121
And DuckDuckGo is the default search engine 10.771
And I kill the Tor Browser 5.589
And the screen keyboard works in Thunderbird 22.026
And the layout of the screen keyboard is set to "us" 0.621
After features/support/hooks.rb:291 2.363
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.781
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.267
When I log in to a new session in Persian (fa) 28.994
Then the keyboard layout is set to "ir" 0.156
When the network is plugged 0.040
And Tor is ready 16.230
Then I successfully start the Unsafe Browser in "fa" 29.380
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 35.771
And DuckDuckGo is the default search engine 10.933
And I kill the Tor Browser 5.690
And the screen keyboard works in Thunderbird 22.775
And the layout of the screen keyboard is set to "ir" 0.558
After features/support/hooks.rb:291 1.087
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.296
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.375
When I log in to a new session in Portuguese (pt) 28.441
Then the keyboard layout is set to "pt" 0.378
When the network is plugged 0.047
And Tor is ready 14.471
Then I successfully start the Unsafe Browser in "pt" 28.061
And I kill the Unsafe Browser 6.974
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 34.285
And DuckDuckGo is the default search engine 11.005
And I kill the Tor Browser 5.575
And the screen keyboard works in Thunderbird 23.895
And the layout of the screen keyboard is set to "us" 0.672
After features/support/hooks.rb:291 1.045
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.510
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.327
When I log in to a new session in Russian (ru) 29.161
Then the keyboard layout is set to "ru" 0.164
When the network is plugged 0.041
And Tor is ready 15.207
Then I successfully start the Unsafe Browser in "ru" 29.365
And I kill the Unsafe Browser 5.873
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 36.459
And DuckDuckGo is the default search engine 11.329
And I kill the Tor Browser 5.585
And the screen keyboard works in Thunderbird 25.306
And the layout of the screen keyboard is set to "ru" 0.569
After features/support/hooks.rb:291 1.138
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.914
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.914
When I log in to a new session in Spanish (es) 29.365
Then the keyboard layout is set to "es" 0.199
When the network is plugged 0.040
And Tor is ready 16.766
Then I successfully start the Unsafe Browser in "es" 27.980
And I kill the Unsafe Browser 5.759
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 32.896
And DuckDuckGo is the default search engine 10.730
And I kill the Tor Browser 5.549
And the screen keyboard works in Thunderbird 21.961
And the layout of the screen keyboard is set to "us" 0.618
After features/support/hooks.rb:291 1.186
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.103
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.989
When I log in to a new session in Turkish (tr) 29.565
Then the keyboard layout is set to "tr" 0.166
When the network is plugged 0.027
And Tor is ready 14.911
Then I successfully start the Unsafe Browser in "tr" 28.554
And I kill the Unsafe Browser 5.816
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 34.324
And DuckDuckGo is the default search engine 20.071
And I kill the Tor Browser 5.705
And the screen keyboard works in Thunderbird 22.231
And the layout of the screen keyboard is set to "us" 0.626
After features/support/hooks.rb:291 0.918
After features/support/hooks.rb:75 0.000