Project Number Date
test_Tails_ISO_stable 4559 08 Dec 2023, 12:12

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:33.295 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.520
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.937
And I prepare Tails for memory erasure tests 0.624
When I start a process allocating 128 MiB of memory with a known pattern 2.327
Then patterns cover at least 128 MiB in the guest's memory 3.523 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.262
Then I find very few patterns in the guest's memory 3.845 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 0.669
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:4.130
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and logged in 7.874
And I prepare Tails for memory erasure tests 0.519
And I find very few patterns in the guest's memory 5.244 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 42.914
Then patterns cover at least 99% of the test FS size in the guest's memory 3.382 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.269
Then I find very few patterns in the guest's memory 3.925 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 1.371
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:11.124
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.119
And I prepare Tails for memory erasure tests 0.486
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.863
Then I find very few patterns in the guest's memory 3.824 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:35.351
Then patterns cover at least 86% of the test FS size in the guest's memory 3.065 
Pattern coverage: 94.541% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.645
Then I find very few patterns in the guest's memory 3.680 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
# read cache
When I mount the USB drive again 0.233
And I read the content of the test FS 0.609
Then patterns cover at least 99% of the test FS size in the guest's memory 3.169 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.316
Then I find very few patterns in the guest's memory 3.759 
Pattern coverage: 0.000% (0 MiB out of 1200 MiB reference memory)
After features/support/hooks.rb:291 0.946
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:39.432
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.778
And I prepare Tails for memory erasure tests 0.531
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 25.063
Then I find very few patterns in the guest's memory 3.603 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:44.876
Then patterns cover at least 99% of the test FS size in the guest's memory 2.980 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.601
Then I find very few patterns in the guest's memory 3.345 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
# read cache
When I mount the USB drive again 3.239
And I read the content of the test FS 0.390
Then patterns cover at least 99% of the test FS size in the guest's memory 2.496 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.279
Then I find very few patterns in the guest's memory 3.246 
Pattern coverage: 0.000% (0 MiB out of 1196 MiB reference memory)
After features/support/hooks.rb:291 1.240
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.362
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.875
And I prepare Tails for memory erasure tests 0.536
When I fill a 128 MiB file with a known pattern on the root filesystem 13.216
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.547
Then patterns cover at least 128 MiB in the guest's memory 2.696 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.608
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.861 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 3.483
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:59.758
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:14.046
And I prepare Tails for memory erasure tests 0.465
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.577
When I trigger shutdown 0.394
And I wait 20 seconds 20.009 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.265 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:291 3.449
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:45.567
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.010
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 59.665
And I update APT using apt 16.721
And I install "popularity-contest" using apt 19.646
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.107
When I create a persistent storage and activate the Additional Software feature 19.830
Then Additional Software is correctly configured for package "popularity-contest" 1.442
When I shutdown Tails and wait for the computer to power off 10.079
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:37.946
Then Additional Software is correctly configured for package "popularity-contest" 0.879
And the package "popularity-contest" is installed after Additional Software has been started 0.247
After features/support/hooks.rb:450 39.113
After features/support/hooks.rb:291 1.303
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:59.411
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.250
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.319
And I update APT using apt 17.033
When I install "makepp" using apt 19.641
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:1.083
And the package "makepp" is installed 0.083
After features/support/hooks.rb:450 37.722
After features/support/hooks.rb:291 0.952
After features/support/hooks.rb:75 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:16.008
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.225
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:23.433
When I uninstall "popularity-contest" using apt 19.115
And I accept removing "popularity-contest" from Additional Software 0.598
Then "popularity-contest" is not in the list of Additional Software 0.925
When I start Synaptic 24.215
And I update APT using Synaptic 21.970
And I install "cowsay" using Synaptic 13.788
And I accept adding "cowsay" to Additional Software 1.053
Then Additional Software is correctly configured for package "cowsay" 0.983
When I uninstall "cowsay" using apt 3.556
And I refuse removing "cowsay" from Additional Software 0.764
Then Additional Software is correctly configured for package "cowsay" 0.990
When I start "Additional Software" via GNOME Activities Overview 12.594
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.028
Then "cowsay" is not in the list of Additional Software 0.952
When I install "cowsay" using apt 3.286
And I refuse adding "cowsay" to Additional Software 0.643
Then "cowsay" is not in the list of Additional Software 0.880
After features/support/hooks.rb:450 0.981
After features/support/hooks.rb:291 0.850
After features/support/hooks.rb:75 0.007
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:8.226
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.208
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.582
And I configure APT to prefer an old version of cowsay 0.031
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.799
And I accept adding "cowsay" to Additional Software 1:9.000
And Additional Software is correctly configured for package "cowsay" 1.468
And I shutdown Tails and wait for the computer to power off 6.068
And I start Tails from USB drive "__internal" with network unplugged 45.862
And I enable persistence 34.665
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 29.555
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.179
And I revert the APT tweaks that made it prefer an old version of cowsay 0.090
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.104
And the network is plugged 0.078
And Tor is ready 16.580
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.192
And available upgrades have been checked 0.223
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.823
And I can open the Additional Software configuration window from the notification 2.774
And I shutdown Tails and wait for the computer to power off 2:2.533
And I start Tails from USB drive "__internal" with network unplugged 45.986
And I enable persistence 32.215
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 25.341
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.885
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.034
And Tor is ready 40.515
Then the Additional Software upgrade service has started 0.182
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.138
After features/support/hooks.rb:450 2.261
After features/support/hooks.rb:291 1.187
After features/support/hooks.rb:75 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:53.692
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.202
And I start Tails from USB drive "__internal" with network unplugged 46.322
And I enable persistence 32.058
And I remove the "cowsay" deb files from the APT cache 0.582
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.091
And I log in to a new session 26.505
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.999
And I can open the Additional Software log file from the notification 2.790
And the package "cowsay" is not installed 0.140
After features/support/hooks.rb:450 0.100
After features/support/hooks.rb:291 0.913
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.954
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.105
When I log in to a new session in Arabic (ar) 32.007
Then the keyboard layout is set to "us" 0.118
When the network is plugged 0.042
And Tor is ready 15.203
Then I successfully start the Unsafe Browser in "ar" 25.687
And I kill the Unsafe Browser 7.477
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 34.573
And DuckDuckGo is the default search engine 9.701
And I kill the Tor Browser 5.367
And the screen keyboard works in Thunderbird 22.908
And the layout of the screen keyboard is set to "us" 0.628
After features/support/hooks.rb:291 2.710
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:13.713
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.211
When I log in to a new session in Chinese (zh_CN) 29.343
Then the keyboard layout is set to "cn" 0.170
When the network is plugged 0.056
And Tor is ready 43.545
Then I successfully start the Unsafe Browser in "zh_CN" 28.299
And I kill the Unsafe Browser 5.783
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 34.355
And DuckDuckGo is the default search engine 9.350
And I kill the Tor Browser 5.380
And the screen keyboard works in Thunderbird 27.492
And the layout of the screen keyboard is set to "us" 0.606
After features/support/hooks.rb:291 2.003
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.841
Before features/support/hooks.rb:245 0.028
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.299
When I log in to a new session in English (en) 16.868
Then the keyboard layout is set to "us" 0.165
When the network is plugged 0.048
And Tor is ready 14.934
Then I successfully start the Unsafe Browser in "en" 26.985
And I kill the Unsafe Browser 6.961
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 33.767
And DuckDuckGo is the default search engine 5.198
And I kill the Tor Browser 5.262
And the screen keyboard works in Thunderbird 22.597
And the layout of the screen keyboard is set to "us" 0.612
After features/support/hooks.rb:291 1.037
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.060
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.765
When I log in to a new session in French (fr) 30.734
Then the keyboard layout is set to "fr" 0.170
When the network is plugged 0.040
And Tor is ready 15.434
Then I successfully start the Unsafe Browser in "fr" 26.660
And I kill the Unsafe Browser 6.901
When I enable the screen keyboard 0.168
Then the screen keyboard works in Tor Browser 34.982
And DuckDuckGo is the default search engine 10.171
And I kill the Tor Browser 5.625
And the screen keyboard works in Thunderbird 21.837
And the layout of the screen keyboard is set to "fr" 0.566
After features/support/hooks.rb:291 1.228
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.133
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.962
When I log in to a new session in German (de) 31.795
Then the keyboard layout is set to "de" 0.139
When the network is plugged 0.035
And Tor is ready 15.564
Then I successfully start the Unsafe Browser in "de" 26.448
And I kill the Unsafe Browser 5.928
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 33.119
And DuckDuckGo is the default search engine 9.698
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 22.253
And the layout of the screen keyboard is set to "de" 0.560
After features/support/hooks.rb:291 1.080
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.660
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.741
When I log in to a new session in Italian (it) 30.517
Then the keyboard layout is set to "it" 0.212
When the network is plugged 0.035
And Tor is ready 16.035
Then I successfully start the Unsafe Browser in "it" 27.350
And I kill the Unsafe Browser 5.867
When I enable the screen keyboard 0.161
Then the screen keyboard works in Tor Browser 33.316
And DuckDuckGo is the default search engine 9.695
And I kill the Tor Browser 5.358
And the screen keyboard works in Thunderbird 22.733
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:291 1.275
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.143
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.289
When I log in to a new session in Persian (fa) 27.912
Then the keyboard layout is set to "ir" 0.107
When the network is plugged 0.043
And Tor is ready 16.732
Then I successfully start the Unsafe Browser in "fa" 25.914
And I kill the Unsafe Browser 6.285
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 35.756
And DuckDuckGo is the default search engine 9.824
And I kill the Tor Browser 5.343
And the screen keyboard works in Thunderbird 22.241
And the layout of the screen keyboard is set to "ir" 0.556
After features/support/hooks.rb:291 1.108
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.947
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.571
When I log in to a new session in Portuguese (pt) 28.489
Then the keyboard layout is set to "pt" 0.279
When the network is plugged 0.048
And Tor is ready 15.600
Then I successfully start the Unsafe Browser in "pt" 28.730
And I kill the Unsafe Browser 5.827
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 35.008
And DuckDuckGo is the default search engine 9.743
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 20.605
And the layout of the screen keyboard is set to "us" 0.589
After features/support/hooks.rb:291 1.090
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.610
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.205
When I log in to a new session in Russian (ru) 29.528
Then the keyboard layout is set to "ru" 0.134
When the network is plugged 0.046
And Tor is ready 16.795
Then I successfully start the Unsafe Browser in "ru" 28.009
And I kill the Unsafe Browser 5.934
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 35.816
And DuckDuckGo is the default search engine 18.962
And I kill the Tor Browser 5.671
And the screen keyboard works in Thunderbird 25.744
And the layout of the screen keyboard is set to "ru" 0.585
After features/support/hooks.rb:291 2.794
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:10.766
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.813
When I log in to a new session in Spanish (es) 31.778
Then the keyboard layout is set to "es" 0.165
When the network is plugged 0.043
And Tor is ready 45.397
Then I successfully start the Unsafe Browser in "es" 26.285
And I kill the Unsafe Browser 5.949
When I enable the screen keyboard 0.193
Then the screen keyboard works in Tor Browser 34.225
And DuckDuckGo is the default search engine 9.680
And I kill the Tor Browser 5.363
And the screen keyboard works in Thunderbird 22.279
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:291 1.251
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.229
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.299
When I log in to a new session in Turkish (tr) 32.379
Then the keyboard layout is set to "tr" 0.187
When the network is plugged 0.049
And Tor is ready 14.093
Then I successfully start the Unsafe Browser in "tr" 28.221
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 35.181
And DuckDuckGo is the default search engine 9.912
And I kill the Tor Browser 5.383
And the screen keyboard works in Thunderbird 22.976
And the layout of the screen keyboard is set to "us" 0.608
After features/support/hooks.rb:291 1.118
After features/support/hooks.rb:75 0.000