Project Number Date
test_Tails_ISO_stable 4681 25 Feb 2024, 12:17

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:7.560 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.122
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.844
And I prepare Tails for memory erasure tests 0.512
When I start a process allocating 128 MiB of memory with a known pattern 2.325
Then patterns cover at least 128 MiB in the guest's memory 3.811 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.310
Then I find very few patterns in the guest's memory 4.318 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 1.365
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.232
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.722
And I prepare Tails for memory erasure tests 0.558
And I find very few patterns in the guest's memory 4.384 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.030
Then patterns cover at least 99% of the test FS size in the guest's memory 3.577 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.178
Then I find very few patterns in the guest's memory 3.780 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 0.905
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:10.953
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.063
And I prepare Tails for memory erasure tests 0.602
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.944
Then I find very few patterns in the guest's memory 4.610 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:32.138
Then patterns cover at least 86% of the test FS size in the guest's memory 3.257 
Pattern coverage: 94.046% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.616
Then I find very few patterns in the guest's memory 3.708 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# read cache
When I mount the USB drive again 0.263
And I read the content of the test FS 0.755
Then patterns cover at least 99% of the test FS size in the guest's memory 4.600 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.319
Then I find very few patterns in the guest's memory 4.070 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
After features/support/hooks.rb:291 1.662
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:26.425
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.716
And I prepare Tails for memory erasure tests 0.663
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 25.481
Then I find very few patterns in the guest's memory 3.714 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:28.601
Then patterns cover at least 99% of the test FS size in the guest's memory 2.879 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.614
Then I find very few patterns in the guest's memory 3.276 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
# read cache
When I mount the USB drive again 5.048
And I read the content of the test FS 0.474
Then patterns cover at least 99% of the test FS size in the guest's memory 2.678 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.474
Then I find very few patterns in the guest's memory 3.801 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 1.240
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.205
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.078
And I prepare Tails for memory erasure tests 0.603
When I fill a 128 MiB file with a known pattern on the root filesystem 12.324
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.604
Then patterns cover at least 128 MiB in the guest's memory 3.197 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.474
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.901 
Pattern coverage: 0.000% (0 MiB out of 1189 MiB reference memory)
After features/support/hooks.rb:291 3.532
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:15.001
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:30.960
And I prepare Tails for memory erasure tests 0.490
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.023
When I trigger shutdown 0.375
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.130 
Pattern coverage: 0.000% (0 MiB out of 1182 MiB reference memory)
After features/support/hooks.rb:291 3.509
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
6:2.012
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:20.787
And I update APT using apt 17.125
And I install "popularity-contest" using apt 19.425
Then I am proposed to add the "popularity-contest" package to my Additional Software 57.330
When I create a persistent storage and activate the Additional Software feature 19.144
Then Additional Software is correctly configured for package "popularity-contest" 1.577
When I shutdown Tails and wait for the computer to power off 10.171
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:35.243
Then Additional Software is correctly configured for package "popularity-contest" 0.865
And the package "popularity-contest" is installed after Additional Software has been started 0.339
After features/support/hooks.rb:450 39.773
After features/support/hooks.rb:291 1.118
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:56.437
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.207
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.806
And I update APT using apt 16.870
When I install "makepp" using apt 19.686
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.752
And the package "makepp" is installed 0.114
After features/support/hooks.rb:450 39.172
After features/support/hooks.rb:291 0.854
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:1.043
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.007
Given a computer 0.244
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:15.192
When I uninstall "popularity-contest" using apt 18.966
And I accept removing "popularity-contest" from Additional Software 0.716
Then "popularity-contest" is not in the list of Additional Software 0.831
When I start Synaptic 24.171
And I update APT using Synaptic 21.946
And I install "cowsay" using Synaptic 8.349
And I accept adding "cowsay" to Additional Software 0.871
Then Additional Software is correctly configured for package "cowsay" 1.032
When I uninstall "cowsay" using apt 3.416
And I refuse removing "cowsay" from Additional Software 0.694
Then Additional Software is correctly configured for package "cowsay" 1.037
When I start "Additional Software" via GNOME Activities Overview 12.660
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.951
Then "cowsay" is not in the list of Additional Software 1.116
When I install "cowsay" using apt 3.292
And I refuse adding "cowsay" to Additional Software 0.712
Then "cowsay" is not in the list of Additional Software 0.839
After features/support/hooks.rb:450 1.483
After features/support/hooks.rb:291 0.699
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:23.023
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.190
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.866
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.136
And I accept adding "cowsay" to Additional Software 1:7.437
And Additional Software is correctly configured for package "cowsay" 1.452
And I shutdown Tails and wait for the computer to power off 7.143
And I start Tails from USB drive "__internal" with network unplugged 47.017
And I enable persistence 32.735
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 22.212
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.022
And I revert the APT tweaks that made it prefer an old version of cowsay 0.059
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.114
And the network is plugged 0.049
And Tor is ready 19.104
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.226
And available upgrades have been checked 0.240
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.165
And I can open the Additional Software configuration window from the notification 2.901
And I shutdown Tails and wait for the computer to power off 2:2.583
And I start Tails from USB drive "__internal" with network unplugged 47.416
And I enable persistence 35.478
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 21.109
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.040
And I revert the APT tweaks that made it prefer an old version of cowsay 0.074
And the network is plugged 0.045
And Tor is ready 49.846
Then the Additional Software upgrade service has started 0.150
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.124
After features/support/hooks.rb:450 2.494
After features/support/hooks.rb:291 0.770
After features/support/hooks.rb:75 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:53.844
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.204
And I start Tails from USB drive "__internal" with network unplugged 46.877
And I enable persistence 30.809
And I remove the "cowsay" deb files from the APT cache 0.786
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.109
And I log in to a new session 29.709
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.392
And I can open the Additional Software log file from the notification 2.830
And the package "cowsay" is not installed 0.124
After features/support/hooks.rb:450 0.126
After features/support/hooks.rb:291 0.828
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:54.094
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.312
When I log in to a new session in Arabic (ar) 29.551
Then the keyboard layout is set to "us" 0.131
When the network is plugged 0.063
And Tor is ready 14.340
Then I successfully start the Unsafe Browser in "ar" 26.700
And I kill the Unsafe Browser 5.866
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 34.525
And DuckDuckGo is the default search engine 24.986
And I kill the Tor Browser 5.561
And the screen keyboard works in Thunderbird 23.377
And the layout of the screen keyboard is set to "us" 0.536
After features/support/hooks.rb:291 1.070
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.384
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.582
When I log in to a new session in Chinese (zh_CN) 35.065
Then the keyboard layout is set to "cn" 0.201
When the network is plugged 0.034
And Tor is ready 13.995
Then I successfully start the Unsafe Browser in "zh_CN" 27.479
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 35.634
And DuckDuckGo is the default search engine 10.860
And I kill the Tor Browser 5.569
And the screen keyboard works in Thunderbird 24.358
And the layout of the screen keyboard is set to "us" 0.609
After features/support/hooks.rb:291 2.591
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.221
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.337
When I log in to a new session in English (en) 15.729
Then the keyboard layout is set to "us" 0.313
When the network is plugged 0.038
And Tor is ready 15.638
Then I successfully start the Unsafe Browser in "en" 27.262
And I kill the Unsafe Browser 6.566
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 32.848
And DuckDuckGo is the default search engine 5.507
And I kill the Tor Browser 5.384
And the screen keyboard works in Thunderbird 21.876
And the layout of the screen keyboard is set to "us" 0.589
After features/support/hooks.rb:291 2.141
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.916
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.046
When I log in to a new session in French (fr) 29.543
Then the keyboard layout is set to "fr" 0.246
When the network is plugged 0.037
And Tor is ready 16.398
Then I successfully start the Unsafe Browser in "fr" 27.677
And I kill the Unsafe Browser 5.868
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 31.593
And DuckDuckGo is the default search engine 11.098
And I kill the Tor Browser 5.607
And the screen keyboard works in Thunderbird 23.047
And the layout of the screen keyboard is set to "fr" 0.639
After features/support/hooks.rb:291 1.221
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.533
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.024
When I log in to a new session in German (de) 30.946
Then the keyboard layout is set to "de" 0.129
When the network is plugged 0.034
And Tor is ready 14.760
Then I successfully start the Unsafe Browser in "de" 25.718
And I kill the Unsafe Browser 6.758
When I enable the screen keyboard 0.148
Then the screen keyboard works in Tor Browser 33.907
And DuckDuckGo is the default search engine 10.740
And I kill the Tor Browser 5.552
And the screen keyboard works in Thunderbird 22.231
And the layout of the screen keyboard is set to "de" 0.581
After features/support/hooks.rb:291 1.155
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.794
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.007
When I log in to a new session in Italian (it) 30.484
Then the keyboard layout is set to "it" 0.175
When the network is plugged 0.045
And Tor is ready 15.016
Then I successfully start the Unsafe Browser in "it" 27.878
And I kill the Unsafe Browser 5.931
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 33.493
And DuckDuckGo is the default search engine 11.092
And I kill the Tor Browser 5.579
And the screen keyboard works in Thunderbird 22.368
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 2.056
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.744
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.009
When I log in to a new session in Persian (fa) 32.377
Then the keyboard layout is set to "ir" 0.396
When the network is plugged 0.036
And Tor is ready 16.784
Then I successfully start the Unsafe Browser in "fa" 28.648
And I kill the Unsafe Browser 5.986
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 34.966
And DuckDuckGo is the default search engine 11.120
And I kill the Tor Browser 5.400
And the screen keyboard works in Thunderbird 23.317
And the layout of the screen keyboard is set to "ir" 0.574
After features/support/hooks.rb:291 3.657
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.763
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.882
When I log in to a new session in Portuguese (pt) 35.008
Then the keyboard layout is set to "pt" 0.182
When the network is plugged 0.242
And Tor is ready 17.102
Then I successfully start the Unsafe Browser in "pt" 26.322
And I kill the Unsafe Browser 6.361
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 33.470
And DuckDuckGo is the default search engine 10.814
And I kill the Tor Browser 5.539
And the screen keyboard works in Thunderbird 22.135
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:291 3.580
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.025
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.900
When I log in to a new session in Russian (ru) 29.099
Then the keyboard layout is set to "ru" 0.135
When the network is plugged 0.034
And Tor is ready 15.183
Then I successfully start the Unsafe Browser in "ru" 30.420
And I kill the Unsafe Browser 7.056
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 35.325
And DuckDuckGo is the default search engine 10.954
And I kill the Tor Browser 5.565
And the screen keyboard works in Thunderbird 28.619
And the layout of the screen keyboard is set to "ru" 0.615
After features/support/hooks.rb:291 1.146
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.937
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.943
When I log in to a new session in Spanish (es) 30.380
Then the keyboard layout is set to "es" 0.178
When the network is plugged 0.043
And Tor is ready 15.041
Then I successfully start the Unsafe Browser in "es" 29.728
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 34.571
And DuckDuckGo is the default search engine 11.359
And I kill the Tor Browser 5.641
And the screen keyboard works in Thunderbird 22.421
And the layout of the screen keyboard is set to "us" 0.666
After features/support/hooks.rb:291 1.366
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.843
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.059
When I log in to a new session in Turkish (tr) 28.207
Then the keyboard layout is set to "tr" 0.150
When the network is plugged 0.060
And Tor is ready 15.280
Then I successfully start the Unsafe Browser in "tr" 27.705
And I kill the Unsafe Browser 5.863
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 34.293
And DuckDuckGo is the default search engine 10.900
And I kill the Tor Browser 5.649
And the screen keyboard works in Thunderbird 22.858
And the layout of the screen keyboard is set to "us" 0.679
After features/support/hooks.rb:291 1.009
After features/support/hooks.rb:75 0.000