Project Number Date
test_Tails_ISO_stable 4526 23 Nov 2023, 19:16

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:51.217 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.922
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.502
And I prepare Tails for memory erasure tests 0.524
When I start a process allocating 128 MiB of memory with a known pattern 2.326
Then patterns cover at least 128 MiB in the guest's memory 5.082 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.299
Then I find very few patterns in the guest's memory 4.186 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:290 0.815
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.652
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.792
And I prepare Tails for memory erasure tests 0.515
And I find very few patterns in the guest's memory 4.084 
Pattern coverage: 0.000% (0 MiB out of 1246 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 44.507
Then patterns cover at least 99% of the test FS size in the guest's memory 3.446 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.379
Then I find very few patterns in the guest's memory 3.926 
Pattern coverage: 0.000% (0 MiB out of 1246 MiB reference memory)
After features/support/hooks.rb:290 0.779
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:5.451
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.815
And I prepare Tails for memory erasure tests 0.495
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.909
Then I find very few patterns in the guest's memory 4.400 
Pattern coverage: 0.000% (0 MiB out of 1235 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:25.484
Then patterns cover at least 86% of the test FS size in the guest's memory 3.240 
Pattern coverage: 93.165% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.586
Then I find very few patterns in the guest's memory 4.394 
Pattern coverage: 0.000% (0 MiB out of 1235 MiB reference memory)
# read cache
When I mount the USB drive again 0.266
And I read the content of the test FS 0.922
Then patterns cover at least 99% of the test FS size in the guest's memory 4.359 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.296
Then I find very few patterns in the guest's memory 4.280 
Pattern coverage: 0.000% (0 MiB out of 1235 MiB reference memory)
After features/support/hooks.rb:290 1.320
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:44.054
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.363
And I prepare Tails for memory erasure tests 0.461
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 21.938
Then I find very few patterns in the guest's memory 3.792 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:48.812
Then patterns cover at least 99% of the test FS size in the guest's memory 3.841 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.600
Then I find very few patterns in the guest's memory 3.395 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
# read cache
When I mount the USB drive again 3.957
And I read the content of the test FS 0.439
Then patterns cover at least 99% of the test FS size in the guest's memory 3.588 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.897
Then I find very few patterns in the guest's memory 3.967 
Pattern coverage: 0.000% (0 MiB out of 1221 MiB reference memory)
After features/support/hooks.rb:290 0.934
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.832
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.614
And I prepare Tails for memory erasure tests 0.469
When I fill a 128 MiB file with a known pattern on the root filesystem 13.317
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.908
Then patterns cover at least 128 MiB in the guest's memory 3.312 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.309
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.880 
Pattern coverage: 0.000% (0 MiB out of 1233 MiB reference memory)
After features/support/hooks.rb:290 3.454
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:19.377
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:29.437
And I prepare Tails for memory erasure tests 0.438
When I fill a 128 MiB file with a known pattern on the persistent filesystem 26.774
When I trigger shutdown 0.425
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.282 
Pattern coverage: 0.000% (0 MiB out of 1170 MiB reference memory)
After features/support/hooks.rb:290 3.473
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:59.372
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:438 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.592
And I update APT using apt 16.976
And I install "popularity-contest" using apt 19.951
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:4.234
When I create a persistent storage and activate the Additional Software feature 20.253
Then Additional Software is correctly configured for package "popularity-contest" 1.562
When I shutdown Tails and wait for the computer to power off 11.089
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:52.396
Then Additional Software is correctly configured for package "popularity-contest" 0.921
And the package "popularity-contest" is installed after Additional Software has been started 0.393
After features/support/hooks.rb:446 37.593
After features/support/hooks.rb:290 0.964
After features/support/hooks.rb:75 0.039
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:2.152
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.006
Given a computer 0.250
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.789
And I update APT using apt 15.607
When I install "makepp" using apt 19.717
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:6.672
And the package "makepp" is installed 0.114
After features/support/hooks.rb:446 40.021
After features/support/hooks.rb:290 0.863
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:2.861
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:438 0.006
Given a computer 0.212
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:21.144
When I uninstall "popularity-contest" using apt 15.703
And I accept removing "popularity-contest" from Additional Software 1.082
Then "popularity-contest" is not in the list of Additional Software 0.788
When I start Synaptic 20.765
And I update APT using Synaptic 21.692
And I install "cowsay" using Synaptic 8.057
And I accept adding "cowsay" to Additional Software 2.550
Then Additional Software is correctly configured for package "cowsay" 1.019
When I uninstall "cowsay" using apt 3.399
And I refuse removing "cowsay" from Additional Software 0.768
Then Additional Software is correctly configured for package "cowsay" 0.993
When I start "Additional Software" via GNOME Activities Overview 12.727
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.003
Then "cowsay" is not in the list of Additional Software 1.122
When I install "cowsay" using apt 3.279
And I refuse adding "cowsay" to Additional Software 0.707
Then "cowsay" is not in the list of Additional Software 0.843
After features/support/hooks.rb:446 1.127
After features/support/hooks.rb:290 0.887
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:53.942
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.006
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:4.160
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.256
And I accept adding "cowsay" to Additional Software 1:13.813
And Additional Software is correctly configured for package "cowsay" 1.253
And I shutdown Tails and wait for the computer to power off 6.093
And I start Tails from USB drive "__internal" with network unplugged 45.598
And I enable persistence 31.454
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 23.772
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.504
And I revert the APT tweaks that made it prefer an old version of cowsay 0.057
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.078
And the network is plugged 0.040
And Tor is ready 17.215
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.028
And available upgrades have been checked 0.112
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.475
And I can open the Additional Software configuration window from the notification 3.757
And I shutdown Tails and wait for the computer to power off 2:2.511
And I start Tails from USB drive "__internal" with network unplugged 47.777
And I enable persistence 36.317
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 26.512
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.228
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
And the network is plugged 0.039
And Tor is ready 1:16.239
Then the Additional Software upgrade service has started 0.192
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.114
After features/support/hooks.rb:446 2.658
After features/support/hooks.rb:290 0.755
After features/support/hooks.rb:75 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:52.507
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:438 0.005
Given a computer 0.191
And I start Tails from USB drive "__internal" with network unplugged 47.100
And I enable persistence 32.606
And I remove the "cowsay" deb files from the APT cache 0.832
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.103
And I log in to a new session 23.317
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.032
And I can open the Additional Software log file from the notification 3.176
And the package "cowsay" is not installed 0.145
After features/support/hooks.rb:446 0.156
After features/support/hooks.rb:290 0.733
After features/support/hooks.rb:75 0.007
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.996
Before features/support/hooks.rb:245 0.082
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.798
When I log in to a new session in Arabic (ar) 30.289
Then the keyboard layout is set to "us" 0.316
When the network is plugged 0.040
And Tor is ready 17.417
Then I successfully start the Unsafe Browser in "ar" 29.454
And I kill the Unsafe Browser 5.862
When I enable the screen keyboard 0.167
Then the screen keyboard works in Tor Browser 34.308
And DuckDuckGo is the default search engine 5.252
And I kill the Tor Browser 5.448
And the screen keyboard works in Thunderbird 23.925
And the layout of the screen keyboard is set to "us" 0.716
After features/support/hooks.rb:290 2.388
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.735
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.657
When I log in to a new session in Chinese (zh_CN) 33.106
Then the keyboard layout is set to "cn" 0.191
When the network is plugged 0.035
And Tor is ready 14.958
Then I successfully start the Unsafe Browser in "zh_CN" 31.467
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 36.543
And DuckDuckGo is the default search engine 5.101
And I kill the Tor Browser 5.365
And the screen keyboard works in Thunderbird 27.624
And the layout of the screen keyboard is set to "us" 0.688
After features/support/hooks.rb:290 1.658
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.359
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.140
When I log in to a new session in English (en) 19.058
Then the keyboard layout is set to "us" 0.151
When the network is plugged 0.035
And Tor is ready 17.987
Then I successfully start the Unsafe Browser in "en" 28.060
And I kill the Unsafe Browser 5.703
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 33.475
And DuckDuckGo is the default search engine 4.680
And I kill the Tor Browser 5.385
And the screen keyboard works in Thunderbird 24.002
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:290 2.081
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.472
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.987
When I log in to a new session in French (fr) 29.208
Then the keyboard layout is set to "fr" 0.231
When the network is plugged 0.052
And Tor is ready 17.667
Then I successfully start the Unsafe Browser in "fr" 28.218
And I kill the Unsafe Browser 6.386
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.348
And DuckDuckGo is the default search engine 5.376
And I kill the Tor Browser 5.399
And the screen keyboard works in Thunderbird 20.845
And the layout of the screen keyboard is set to "fr" 0.614
After features/support/hooks.rb:290 3.605
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.737
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.239
When I log in to a new session in German (de) 30.732
Then the keyboard layout is set to "de" 0.173
When the network is plugged 0.077
And Tor is ready 14.941
Then I successfully start the Unsafe Browser in "de" 26.463
And I kill the Unsafe Browser 6.279
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 34.187
And DuckDuckGo is the default search engine 4.948
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 22.677
And the layout of the screen keyboard is set to "de" 0.576
After features/support/hooks.rb:290 1.149
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.224
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.122
When I log in to a new session in Italian (it) 29.831
Then the keyboard layout is set to "it" 0.151
When the network is plugged 0.052
And Tor is ready 14.688
Then I successfully start the Unsafe Browser in "it" 30.169
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.114
Then the screen keyboard works in Tor Browser 34.181
And DuckDuckGo is the default search engine 4.831
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 21.242
And the layout of the screen keyboard is set to "us" 0.613
After features/support/hooks.rb:290 1.192
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:14.091
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.724
When I log in to a new session in Persian (fa) 31.472
Then the keyboard layout is set to "ir" 0.150
When the network is plugged 0.041
And Tor is ready 44.733
Then I successfully start the Unsafe Browser in "fa" 29.273
And I kill the Unsafe Browser 5.863
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 36.810
And DuckDuckGo is the default search engine 4.944
And I kill the Tor Browser 5.370
And the screen keyboard works in Thunderbird 25.955
And the layout of the screen keyboard is set to "ir" 0.637
After features/support/hooks.rb:290 2.268
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.059
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.101
When I log in to a new session in Portuguese (pt) 32.498
Then the keyboard layout is set to "pt" 0.209
When the network is plugged 0.069
And Tor is ready 15.066
Then I successfully start the Unsafe Browser in "pt" 28.127
And I kill the Unsafe Browser 6.111
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 35.396
And DuckDuckGo is the default search engine 4.818
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 22.506
And the layout of the screen keyboard is set to "us" 0.679
After features/support/hooks.rb:290 1.295
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.870
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.665
When I log in to a new session in Russian (ru) 31.290
Then the keyboard layout is set to "ru" 0.142
When the network is plugged 0.051
And Tor is ready 15.707
Then I successfully start the Unsafe Browser in "ru" 30.918
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.170
Then the screen keyboard works in Tor Browser 37.068
And DuckDuckGo is the default search engine 4.923
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 26.019
And the layout of the screen keyboard is set to "ru" 0.731
After features/support/hooks.rb:290 1.130
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.687
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.783
When I log in to a new session in Spanish (es) 29.867
Then the keyboard layout is set to "es" 0.138
When the network is plugged 0.059
And Tor is ready 17.537
Then I successfully start the Unsafe Browser in "es" 25.256
And I kill the Unsafe Browser 5.857
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.301
And DuckDuckGo is the default search engine 4.738
And I kill the Tor Browser 5.366
And the screen keyboard works in Thunderbird 22.018
And the layout of the screen keyboard is set to "us" 0.632
After features/support/hooks.rb:290 1.160
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.855
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.091
When I log in to a new session in Turkish (tr) 29.355
Then the keyboard layout is set to "tr" 0.256
When the network is plugged 0.060
And Tor is ready 16.539
Then I successfully start the Unsafe Browser in "tr" 27.008
And I kill the Unsafe Browser 5.895
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 34.019
And DuckDuckGo is the default search engine 4.912
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 21.653
And the layout of the screen keyboard is set to "us" 0.610
After features/support/hooks.rb:290 1.394
After features/support/hooks.rb:75 0.000