Project Number Date
test_Tails_ISO_stable 4620 16 Jan 2024, 12:09

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:8:58.685 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.737
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.241
And I prepare Tails for memory erasure tests 0.515
When I start a process allocating 128 MiB of memory with a known pattern 2.312
Then patterns cover at least 128 MiB in the guest's memory 3.475 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.427
Then I find very few patterns in the guest's memory 3.764 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 0.771
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.124
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.665
And I prepare Tails for memory erasure tests 0.752
And I find very few patterns in the guest's memory 3.892 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.345
Then patterns cover at least 99% of the test FS size in the guest's memory 3.640 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.186
Then I find very few patterns in the guest's memory 3.642 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 0.787
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:18.702
Before features/support/hooks.rb:245 0.012
Given I have started Tails from DVD without network and logged in 8.289
And I prepare Tails for memory erasure tests 0.478
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.827
Then I find very few patterns in the guest's memory 3.408 
Pattern coverage: 0.000% (0 MiB out of 1219 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:43.680
Then patterns cover at least 86% of the test FS size in the guest's memory 3.177 
Pattern coverage: 94.532% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.489
Then I find very few patterns in the guest's memory 3.619 
Pattern coverage: 0.000% (0 MiB out of 1219 MiB reference memory)
# read cache
When I mount the USB drive again 0.194
And I read the content of the test FS 0.627
Then patterns cover at least 99% of the test FS size in the guest's memory 2.920 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.265
Then I find very few patterns in the guest's memory 3.723 
Pattern coverage: 0.000% (0 MiB out of 1219 MiB reference memory)
After features/support/hooks.rb:291 0.787
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:43.772
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.105
And I prepare Tails for memory erasure tests 0.493
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.546
Then I find very few patterns in the guest's memory 3.006 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:52.341
Then patterns cover at least 99% of the test FS size in the guest's memory 2.676 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.573
Then I find very few patterns in the guest's memory 3.249 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
# read cache
When I mount the USB drive again 3.131
And I read the content of the test FS 0.426
Then patterns cover at least 99% of the test FS size in the guest's memory 2.354 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.558
Then I find very few patterns in the guest's memory 3.307 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 0.978
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.416
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.624
And I prepare Tails for memory erasure tests 0.439
When I fill a 128 MiB file with a known pattern on the root filesystem 18.156
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.414
Then patterns cover at least 128 MiB in the guest's memory 2.353 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.658
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.750 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 3.426
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:53.592
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:8.037
And I prepare Tails for memory erasure tests 0.461
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.625
When I trigger shutdown 0.353
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.093 
Pattern coverage: 0.000% (0 MiB out of 1168 MiB reference memory)
After features/support/hooks.rb:291 3.496
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:18.242
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.394
And I update APT using apt 16.549
And I install "popularity-contest" using apt 19.688
Then I am proposed to add the "popularity-contest" package to my Additional Software 52.835
When I create a persistent storage and activate the Additional Software feature 17.054
Then Additional Software is correctly configured for package "popularity-contest" 1.307
When I shutdown Tails and wait for the computer to power off 9.080
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:26.985
Then Additional Software is correctly configured for package "popularity-contest" 0.996
And the package "popularity-contest" is installed after Additional Software has been started 0.349
After features/support/hooks.rb:450 37.869
After features/support/hooks.rb:291 1.112
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:53.600
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.207
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.453
And I update APT using apt 16.509
When I install "makepp" using apt 19.591
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 57.734
And the package "makepp" is installed 0.104
After features/support/hooks.rb:450 35.647
After features/support/hooks.rb:291 0.960
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:44.171
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.236
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:1.729
When I uninstall "popularity-contest" using apt 15.857
And I accept removing "popularity-contest" from Additional Software 1.051
Then "popularity-contest" is not in the list of Additional Software 0.708
When I start Synaptic 22.092
And I update APT using Synaptic 22.055
And I install "cowsay" using Synaptic 9.466
And I accept adding "cowsay" to Additional Software 0.744
Then Additional Software is correctly configured for package "cowsay" 0.948
When I uninstall "cowsay" using apt 3.299
And I refuse removing "cowsay" from Additional Software 0.647
Then Additional Software is correctly configured for package "cowsay" 0.870
When I start "Additional Software" via GNOME Activities Overview 12.427
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.313
Then "cowsay" is not in the list of Additional Software 0.918
When I install "cowsay" using apt 3.309
And I refuse adding "cowsay" to Additional Software 0.694
Then "cowsay" is not in the list of Additional Software 0.798
After features/support/hooks.rb:450 0.966
After features/support/hooks.rb:291 0.689
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:31.249
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.224
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:0.258
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.013
And I accept adding "cowsay" to Additional Software 1:2.217
And Additional Software is correctly configured for package "cowsay" 1.409
And I shutdown Tails and wait for the computer to power off 6.055
And I start Tails from USB drive "__internal" with network unplugged 45.254
And I enable persistence 35.152
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 21.254
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.695
And I revert the APT tweaks that made it prefer an old version of cowsay 0.045
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.096
And the network is plugged 0.033
And Tor is ready 17.897
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.655
And available upgrades have been checked 0.258
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.496
And I can open the Additional Software configuration window from the notification 2.553
And I shutdown Tails and wait for the computer to power off 2:2.612
And I start Tails from USB drive "__internal" with network unplugged 45.152
And I enable persistence 31.185
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 23.853
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.244
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
And the network is plugged 0.040
And Tor is ready 39.126
Then the Additional Software upgrade service has started 0.236
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.090
After features/support/hooks.rb:450 2.322
After features/support/hooks.rb:291 0.754
After features/support/hooks.rb:75 0.046
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:46.406
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.196
And I start Tails from USB drive "__internal" with network unplugged 45.821
And I enable persistence 33.025
And I remove the "cowsay" deb files from the APT cache 0.633
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.075
And I log in to a new session 23.180
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.494
And I can open the Additional Software log file from the notification 1.784
And the package "cowsay" is not installed 0.194
After features/support/hooks.rb:450 0.103
After features/support/hooks.rb:291 0.812
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.831
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.737
When I log in to a new session in Arabic (ar) 27.722
Then the keyboard layout is set to "us" 0.228
When the network is plugged 0.039
And Tor is ready 16.325
Then I successfully start the Unsafe Browser in "ar" 27.817
And I kill the Unsafe Browser 6.485
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 33.198
And DuckDuckGo is the default search engine 9.242
And I kill the Tor Browser 5.430
And the screen keyboard works in Thunderbird 20.873
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 1.050
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.953
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.710
When I log in to a new session in Chinese (zh_CN) 27.602
Then the keyboard layout is set to "cn" 0.187
When the network is plugged 0.032
And Tor is ready 14.107
Then I successfully start the Unsafe Browser in "zh_CN" 26.714
And I kill the Unsafe Browser 5.821
When I enable the screen keyboard 0.157
Then the screen keyboard works in Tor Browser 34.438
And DuckDuckGo is the default search engine 9.627
And I kill the Tor Browser 5.379
And the screen keyboard works in Thunderbird 25.575
And the layout of the screen keyboard is set to "us" 0.597
After features/support/hooks.rb:291 1.181
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.182
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.730
When I log in to a new session in English (en) 14.846
Then the keyboard layout is set to "us" 0.129
When the network is plugged 0.037
And Tor is ready 13.308
Then I successfully start the Unsafe Browser in "en" 28.675
And I kill the Unsafe Browser 5.704
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 33.792
And DuckDuckGo is the default search engine 5.413
And I kill the Tor Browser 5.319
And the screen keyboard works in Thunderbird 21.498
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:291 1.134
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.816
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.589
When I log in to a new session in French (fr) 28.111
Then the keyboard layout is set to "fr" 0.177
When the network is plugged 0.039
And Tor is ready 14.565
Then I successfully start the Unsafe Browser in "fr" 27.983
And I kill the Unsafe Browser 5.859
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 34.211
And DuckDuckGo is the default search engine 9.531
And I kill the Tor Browser 5.262
And the screen keyboard works in Thunderbird 21.697
And the layout of the screen keyboard is set to "fr" 0.622
After features/support/hooks.rb:291 1.393
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.852
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.752
When I log in to a new session in German (de) 28.321
Then the keyboard layout is set to "de" 0.130
When the network is plugged 0.043
And Tor is ready 14.940
Then I successfully start the Unsafe Browser in "de" 24.625
And I kill the Unsafe Browser 6.273
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 32.027
And DuckDuckGo is the default search engine 9.714
And I kill the Tor Browser 5.435
And the screen keyboard works in Thunderbird 22.832
And the layout of the screen keyboard is set to "de" 0.613
After features/support/hooks.rb:291 1.035
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.559
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.274
When I log in to a new session in Italian (it) 30.199
Then the keyboard layout is set to "it" 0.139
When the network is plugged 0.032
And Tor is ready 14.661
Then I successfully start the Unsafe Browser in "it" 27.261
And I kill the Unsafe Browser 5.813
When I enable the screen keyboard 0.141
Then the screen keyboard works in Tor Browser 33.401
And DuckDuckGo is the default search engine 9.556
And I kill the Tor Browser 5.325
And the screen keyboard works in Thunderbird 23.207
And the layout of the screen keyboard is set to "us" 0.544
After features/support/hooks.rb:291 1.260
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.064
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.695
When I log in to a new session in Persian (fa) 27.307
Then the keyboard layout is set to "ir" 0.129
When the network is plugged 0.041
And Tor is ready 14.833
Then I successfully start the Unsafe Browser in "fa" 25.852
And I kill the Unsafe Browser 6.095
When I enable the screen keyboard 0.166
Then the screen keyboard works in Tor Browser 33.854
And DuckDuckGo is the default search engine 9.403
And I kill the Tor Browser 5.314
And the screen keyboard works in Thunderbird 23.841
And the layout of the screen keyboard is set to "ir" 0.530
After features/support/hooks.rb:291 2.046
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.550
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.607
When I log in to a new session in Portuguese (pt) 29.506
Then the keyboard layout is set to "pt" 0.151
When the network is plugged 0.046
And Tor is ready 15.236
Then I successfully start the Unsafe Browser in "pt" 24.289
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 32.582
And DuckDuckGo is the default search engine 8.896
And I kill the Tor Browser 5.244
And the screen keyboard works in Thunderbird 21.500
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.115
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.616
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.687
When I log in to a new session in Russian (ru) 28.228
Then the keyboard layout is set to "ru" 0.150
When the network is plugged 0.057
And Tor is ready 16.707
Then I successfully start the Unsafe Browser in "ru" 26.452
And I kill the Unsafe Browser 5.949
When I enable the screen keyboard 0.143
Then the screen keyboard works in Tor Browser 34.407
And DuckDuckGo is the default search engine 9.379
And I kill the Tor Browser 5.350
And the screen keyboard works in Thunderbird 22.523
And the layout of the screen keyboard is set to "ru" 0.576
After features/support/hooks.rb:291 1.096
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.772
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.546
When I log in to a new session in Spanish (es) 34.788
Then the keyboard layout is set to "es" 0.183
When the network is plugged 0.054
And Tor is ready 14.576
Then I successfully start the Unsafe Browser in "es" 25.520
And I kill the Unsafe Browser 5.913
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 33.002
And DuckDuckGo is the default search engine 9.326
And I kill the Tor Browser 5.262
And the screen keyboard works in Thunderbird 23.881
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:291 1.063
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.469
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.561
When I log in to a new session in Turkish (tr) 27.554
Then the keyboard layout is set to "tr" 0.137
When the network is plugged 0.033
And Tor is ready 18.885
Then I successfully start the Unsafe Browser in "tr" 27.659
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 33.716
And DuckDuckGo is the default search engine 9.168
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 23.907
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.153
After features/support/hooks.rb:75 0.000