Project Number Date
test_Tails_ISO_stable 4649 01 Feb 2024, 12:19

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:13:57.861 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
16.589
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.596
And I prepare Tails for memory erasure tests 0.466
When I start a process allocating 128 MiB of memory with a known pattern 1.221
Then patterns cover at least 128 MiB in the guest's memory 3.329 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.380
Then I find very few patterns in the guest's memory 3.594 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 0.716
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.522
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.693
And I prepare Tails for memory erasure tests 0.461
And I find very few patterns in the guest's memory 4.528 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 40.342
Then patterns cover at least 99% of the test FS size in the guest's memory 3.444 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.273
Then I find very few patterns in the guest's memory 3.778 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 1.132
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:40.609
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.746
And I prepare Tails for memory erasure tests 0.438
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.260
Then I find very few patterns in the guest's memory 6.021 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:58.069
Then patterns cover at least 86% of the test FS size in the guest's memory 3.315 
Pattern coverage: 92.008% (114 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.599
Then I find very few patterns in the guest's memory 4.604 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
# read cache
When I mount the USB drive again 0.206
And I read the content of the test FS 2.361
Then patterns cover at least 99% of the test FS size in the guest's memory 3.633 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.926
Then I find very few patterns in the guest's memory 4.425 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 0.797
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:36.312
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.176
And I prepare Tails for memory erasure tests 0.501
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.564
Then I find very few patterns in the guest's memory 3.152 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:38.758
Then patterns cover at least 99% of the test FS size in the guest's memory 3.466 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.591
Then I find very few patterns in the guest's memory 3.819 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
# read cache
When I mount the USB drive again 3.250
And I read the content of the test FS 3.340
Then patterns cover at least 99% of the test FS size in the guest's memory 3.137 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.837
Then I find very few patterns in the guest's memory 3.713 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
After features/support/hooks.rb:291 1.033
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.299
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.906
And I prepare Tails for memory erasure tests 0.462
When I fill a 128 MiB file with a known pattern on the root filesystem 13.529
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.552
Then patterns cover at least 128 MiB in the guest's memory 3.314 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.593
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.921 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 3.433
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:53.102
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:7.972
And I prepare Tails for memory erasure tests 0.530
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.061
When I trigger shutdown 0.389
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.129 
Pattern coverage: 0.000% (0 MiB out of 1159 MiB reference memory)
After features/support/hooks.rb:291 3.462
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:47.641
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.573
And I update APT using apt 16.911
And I install "popularity-contest" using apt 19.643
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:2.201
When I create a persistent storage and activate the Additional Software feature 18.029
Then Additional Software is correctly configured for package "popularity-contest" 1.417
When I shutdown Tails and wait for the computer to power off 11.086
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:44.451
Then Additional Software is correctly configured for package "popularity-contest" 0.966
And the package "popularity-contest" is installed after Additional Software has been started 0.358
After features/support/hooks.rb:450 40.331
After features/support/hooks.rb:291 1.037
After features/support/hooks.rb:75 0.026
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:3.031
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.181
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.447
And I update APT using apt 17.334
When I install "makepp" using apt 19.673
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:2.291
And the package "makepp" is installed 0.102
After features/support/hooks.rb:450 42.172
After features/support/hooks.rb:291 0.817
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:31.927
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.170
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:45.184
When I uninstall "popularity-contest" using apt 19.031
And I accept removing "popularity-contest" from Additional Software 0.696
Then "popularity-contest" is not in the list of Additional Software 0.862
When I start Synaptic 23.840
And I update APT using Synaptic 22.274
And I install "cowsay" using Synaptic 8.622
And I accept adding "cowsay" to Additional Software 1.135
Then Additional Software is correctly configured for package "cowsay" 0.969
When I uninstall "cowsay" using apt 3.412
And I refuse removing "cowsay" from Additional Software 0.698
Then Additional Software is correctly configured for package "cowsay" 0.979
When I start "Additional Software" via GNOME Activities Overview 12.460
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.733
Then "cowsay" is not in the list of Additional Software 1.072
When I install "cowsay" using apt 3.309
And I refuse adding "cowsay" to Additional Software 0.681
Then "cowsay" is not in the list of Additional Software 0.791
After features/support/hooks.rb:450 1.119
After features/support/hooks.rb:291 0.699
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:29.778
Before features/support/hooks.rb:245 0.010
Before features/support/hooks.rb:442 0.015
Given a computer 0.239
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:6.114
And I configure APT to prefer an old version of cowsay 0.027
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.946
And I accept adding "cowsay" to Additional Software 1:9.215
And Additional Software is correctly configured for package "cowsay" 2.846
And I shutdown Tails and wait for the computer to power off 7.114
And I start Tails from USB drive "__internal" with network unplugged 45.650
And I enable persistence 34.482
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.034
And I log in to a new session 22.140
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.487
And I revert the APT tweaks that made it prefer an old version of cowsay 0.074
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.107
And the network is plugged 0.040
And Tor is ready 18.820
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.233
And available upgrades have been checked 0.413
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.253
And I can open the Additional Software configuration window from the notification 3.778
And I shutdown Tails and wait for the computer to power off 2:3.481
And I start Tails from USB drive "__internal" with network unplugged 46.983
And I enable persistence 31.427
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 26.352
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.277
And I revert the APT tweaks that made it prefer an old version of cowsay 0.090
And the network is plugged 0.199
And Tor is ready 51.648
Then the Additional Software upgrade service has started 0.162
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.108
After features/support/hooks.rb:450 2.612
After features/support/hooks.rb:291 0.805
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.112
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.011
Given a computer 0.177
And I start Tails from USB drive "__internal" with network unplugged 47.644
And I enable persistence 31.625
And I remove the "cowsay" deb files from the APT cache 0.763
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.084
And I log in to a new session 21.113
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.155
And I can open the Additional Software log file from the notification 2.396
And the package "cowsay" is not installed 0.150
After features/support/hooks.rb:450 0.111
After features/support/hooks.rb:291 0.896
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.474
Before features/support/hooks.rb:245 0.015
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.518
When I log in to a new session in Arabic (ar) 30.951
Then the keyboard layout is set to "us" 0.162
When the network is plugged 0.031
And Tor is ready 16.074
Then I successfully start the Unsafe Browser in "ar" 26.713
And I kill the Unsafe Browser 6.022
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 35.145
And DuckDuckGo is the default search engine 10.744
And I kill the Tor Browser 5.599
And the screen keyboard works in Thunderbird 24.740
And the layout of the screen keyboard is set to "us" 0.650
After features/support/hooks.rb:291 1.905
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.582
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.367
When I log in to a new session in Chinese (zh_CN) 30.366
Then the keyboard layout is set to "cn" 0.152
When the network is plugged 0.026
And Tor is ready 15.911
Then I successfully start the Unsafe Browser in "zh_CN" 29.514
And I kill the Unsafe Browser 6.729
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 35.437
And DuckDuckGo is the default search engine 10.882
And I kill the Tor Browser 5.580
And the screen keyboard works in Thunderbird 27.834
And the layout of the screen keyboard is set to "us" 0.631
After features/support/hooks.rb:291 1.436
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.714
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.338
When I log in to a new session in English (en) 16.604
Then the keyboard layout is set to "us" 0.234
When the network is plugged 0.059
And Tor is ready 15.821
Then I successfully start the Unsafe Browser in "en" 28.675
And I kill the Unsafe Browser 5.828
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.907
And DuckDuckGo is the default search engine 5.814
And I kill the Tor Browser 5.412
And the screen keyboard works in Thunderbird 22.343
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.704
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.050
When I log in to a new session in French (fr) 28.705
Then the keyboard layout is set to "fr" 0.291
When the network is plugged 0.051
And Tor is ready 15.637
Then I successfully start the Unsafe Browser in "fr" 27.365
And I kill the Unsafe Browser 5.878
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 33.960
And DuckDuckGo is the default search engine 10.232
And I kill the Tor Browser 5.739
And the screen keyboard works in Thunderbird 21.024
And the layout of the screen keyboard is set to "fr" 0.650
After features/support/hooks.rb:291 0.991
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.190
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.122
When I log in to a new session in German (de) 28.788
Then the keyboard layout is set to "de" 0.180
When the network is plugged 0.252
And Tor is ready 16.605
Then I successfully start the Unsafe Browser in "de" 26.973
And I kill the Unsafe Browser 6.465
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 36.193
And DuckDuckGo is the default search engine 10.892
And I kill the Tor Browser 5.803
And the screen keyboard works in Thunderbird 21.164
And the layout of the screen keyboard is set to "de" 0.607
After features/support/hooks.rb:291 1.227
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:7.674
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.187
When I log in to a new session in Italian (it) 29.172
Then the keyboard layout is set to "it" 0.167
When the network is plugged 0.044
And Tor is ready 42.816
Then I successfully start the Unsafe Browser in "it" 28.708
And I kill the Unsafe Browser 5.630
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 33.650
And DuckDuckGo is the default search engine 10.584
And I kill the Tor Browser 5.772
And the screen keyboard works in Thunderbird 22.134
And the layout of the screen keyboard is set to "us" 0.689
After features/support/hooks.rb:291 1.098
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.798
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.043
When I log in to a new session in Persian (fa) 31.465
Then the keyboard layout is set to "ir" 0.145
When the network is plugged 0.040
And Tor is ready 14.307
Then I successfully start the Unsafe Browser in "fa" 27.205
And I kill the Unsafe Browser 6.022
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 36.047
And DuckDuckGo is the default search engine 10.567
And I kill the Tor Browser 5.549
And the screen keyboard works in Thunderbird 23.659
And the layout of the screen keyboard is set to "ir" 0.616
After features/support/hooks.rb:291 2.235
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.407
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.219
When I log in to a new session in Portuguese (pt) 28.891
Then the keyboard layout is set to "pt" 0.194
When the network is plugged 0.042
And Tor is ready 15.854
Then I successfully start the Unsafe Browser in "pt" 26.482
And I kill the Unsafe Browser 6.508
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 34.433
And DuckDuckGo is the default search engine 10.058
And I kill the Tor Browser 5.750
And the screen keyboard works in Thunderbird 21.117
And the layout of the screen keyboard is set to "us" 0.703
After features/support/hooks.rb:291 1.191
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.638
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.944
When I log in to a new session in Russian (ru) 28.659
Then the keyboard layout is set to "ru" 0.232
When the network is plugged 0.043
And Tor is ready 17.140
Then I successfully start the Unsafe Browser in "ru" 27.031
And I kill the Unsafe Browser 5.911
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 32.709
And DuckDuckGo is the default search engine 9.604
And I kill the Tor Browser 5.263
And the screen keyboard works in Thunderbird 25.381
And the layout of the screen keyboard is set to "ru" 0.581
After features/support/hooks.rb:291 3.647
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.612
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.876
When I log in to a new session in Spanish (es) 27.818
Then the keyboard layout is set to "es" 0.231
When the network is plugged 0.025
And Tor is ready 16.025
Then I successfully start the Unsafe Browser in "es" 26.772
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 31.428
And DuckDuckGo is the default search engine 10.021
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 22.577
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 2.471
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:54.133
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.972
When I log in to a new session in Turkish (tr) 33.571
Then the keyboard layout is set to "tr" 0.140
When the network is plugged 0.040
And Tor is ready 16.097
Then I successfully start the Unsafe Browser in "tr" 27.508
And I kill the Unsafe Browser 5.772
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 31.664
And DuckDuckGo is the default search engine 9.754
And I kill the Tor Browser 5.361
And the screen keyboard works in Thunderbird 22.533
And the layout of the screen keyboard is set to "us" 0.618
After features/support/hooks.rb:291 1.174
After features/support/hooks.rb:75 0.000