Project Number Date
test_Tails_ISO_devel 3199 18 Dec 2023, 14:48

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:27:57.294 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.283
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.808
And I prepare Tails for memory erasure tests 0.566
When I start a process allocating 128 MiB of memory with a known pattern 2.455
Then patterns cover at least 128 MiB in the guest's memory 3.546 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.260
Then I find very few patterns in the guest's memory 3.644 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 0.730
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.409
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.633
And I prepare Tails for memory erasure tests 0.565
And I find very few patterns in the guest's memory 3.517 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 41.116
Then patterns cover at least 99% of the test FS size in the guest's memory 3.221 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.333
Then I find very few patterns in the guest's memory 4.020 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 1.060
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:8.857
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.021
And I prepare Tails for memory erasure tests 0.619
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.433
Then I find very few patterns in the guest's memory 4.109 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:25.766
Then patterns cover at least 86% of the test FS size in the guest's memory 3.472 
Pattern coverage: 92.453% (115 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.467
Then I find very few patterns in the guest's memory 3.786 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 0.285
And I read the content of the test FS 4.571
Then patterns cover at least 99% of the test FS size in the guest's memory 3.770 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.343
Then I find very few patterns in the guest's memory 4.208 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 1.352
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:57.373
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 9.024
And I prepare Tails for memory erasure tests 0.601
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.748
Then I find very few patterns in the guest's memory 7.465 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:51.443
Then patterns cover at least 99% of the test FS size in the guest's memory 2.627 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.629
Then I find very few patterns in the guest's memory 3.417 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
# read cache
When I mount the USB drive again 4.054
And I read the content of the test FS 3.030
Then patterns cover at least 99% of the test FS size in the guest's memory 3.003 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.624
Then I find very few patterns in the guest's memory 3.703 
Pattern coverage: 0.000% (0 MiB out of 1198 MiB reference memory)
After features/support/hooks.rb:291 0.755
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
56.896
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.181
And I prepare Tails for memory erasure tests 0.525
When I fill a 128 MiB file with a known pattern on the root filesystem 20.918
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.686
Then patterns cover at least 128 MiB in the guest's memory 2.947 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.793
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.828 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 3.472
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:19.554
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:33.285
And I prepare Tails for memory erasure tests 0.466
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.255
When I trigger shutdown 0.358
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.167 
Pattern coverage: 0.000% (0 MiB out of 1188 MiB reference memory)
After features/support/hooks.rb:291 3.496
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:26.190
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:21.828
And I update APT using apt 18.401
When I install "popularity-contest" using apt 23.287
Then I am notified I can not use Additional Software for "popularity-contest" 58.470
And I can open the Additional Software documentation from the notification 24.203
After features/support/hooks.rb:450 36.598
After features/support/hooks.rb:291 2.166
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:57.576
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:18.253
And I update APT using apt 18.735
And I install "popularity-contest" using apt 19.574
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.263
When I create a persistent storage and activate the Additional Software feature 16.831
Then Additional Software is correctly configured for package "popularity-contest" 1.409
When I shutdown Tails and wait for the computer to power off 10.165
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.018
Then Additional Software is correctly configured for package "popularity-contest" 1.031
And the package "popularity-contest" is installed after Additional Software has been started 0.293
After features/support/hooks.rb:450 39.813
After features/support/hooks.rb:291 1.006
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:55.756
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.160
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.199
And I update APT using apt 15.394
When I install "makepp" using apt 19.784
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 59.108
And the package "makepp" is installed 0.108
After features/support/hooks.rb:450 40.675
After features/support/hooks.rb:291 0.926
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:54.408
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:9.045
When I uninstall "popularity-contest" using apt 19.020
And I accept removing "popularity-contest" from Additional Software 0.751
Then "popularity-contest" is not in the list of Additional Software 0.823
When I start Synaptic 23.531
And I update APT using Synaptic 22.181
And I install "cowsay" using Synaptic 9.311
And I accept adding "cowsay" to Additional Software 0.832
Then Additional Software is correctly configured for package "cowsay" 0.862
When I uninstall "cowsay" using apt 3.380
And I refuse removing "cowsay" from Additional Software 0.580
Then Additional Software is correctly configured for package "cowsay" 0.830
When I start "Additional Software" via GNOME Activities Overview 12.544
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.727
Then "cowsay" is not in the list of Additional Software 1.031
When I install "cowsay" using apt 3.257
And I refuse adding "cowsay" to Additional Software 0.730
Then "cowsay" is not in the list of Additional Software 0.781
After features/support/hooks.rb:450 1.016
After features/support/hooks.rb:291 0.640
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:51.472
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.178
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:58.862
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.981
And I accept adding "cowsay" to Additional Software 1:6.249
And Additional Software is correctly configured for package "cowsay" 1.528
And I shutdown Tails and wait for the computer to power off 5.061
And I start Tails from USB drive "__internal" with network unplugged 46.259
And I enable persistence 34.602
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 28.894
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.592
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.116
And the network is plugged 0.034
And Tor is ready 21.051
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 4.915
And available upgrades have been checked 0.178
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.503
And I can open the Additional Software configuration window from the notification 2.669
And I shutdown Tails and wait for the computer to power off 2:2.494
And I start Tails from USB drive "__internal" with network unplugged 45.563
And I enable persistence 31.399
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 31.829
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.716
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.030
And Tor is ready 39.231
Then the Additional Software upgrade service has started 0.196
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.129
After features/support/hooks.rb:450 2.478
After features/support/hooks.rb:291 1.074
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:55.877
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.378
And I start Tails from USB drive "__internal" with network unplugged 46.254
And I enable persistence 32.607
And I remove the "cowsay" deb files from the APT cache 0.623
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.071
And I log in to a new session 29.323
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 3.999
And I can open the Additional Software log file from the notification 2.319
And the package "cowsay" is not installed 0.300
After features/support/hooks.rb:450 0.113
After features/support/hooks.rb:291 1.117
After features/support/hooks.rb:75 0.008
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:56.011
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.980
When I log in to a new session in Arabic (ar) 34.222
Then the keyboard layout is set to "us" 0.153
When the network is plugged 0.042
And Tor is ready 14.806
Then I successfully start the Unsafe Browser in "ar" 27.073
And I kill the Unsafe Browser 6.025
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 34.829
And DuckDuckGo is the default search engine 9.863
And I kill the Tor Browser 5.391
And the screen keyboard works in Thunderbird 21.833
And the layout of the screen keyboard is set to "us" 0.633
After features/support/hooks.rb:291 1.364
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.456
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.251
When I log in to a new session in Chinese (zh_CN) 30.309
Then the keyboard layout is set to "cn" 0.148
When the network is plugged 0.032
And Tor is ready 15.016
Then I successfully start the Unsafe Browser in "zh_CN" 27.774
And I kill the Unsafe Browser 5.887
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 33.511
And DuckDuckGo is the default search engine 9.390
And I kill the Tor Browser 5.376
And the screen keyboard works in Thunderbird 26.000
And the layout of the screen keyboard is set to "us" 0.605
After features/support/hooks.rb:291 1.339
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.979
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.497
When I log in to a new session in English (en) 17.726
Then the keyboard layout is set to "us" 0.280
When the network is plugged 0.037
And Tor is ready 16.188
Then I successfully start the Unsafe Browser in "en" 29.679
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 32.914
And DuckDuckGo is the default search engine 5.283
And I kill the Tor Browser 5.406
And the screen keyboard works in Thunderbird 23.207
And the layout of the screen keyboard is set to "us" 0.714
After features/support/hooks.rb:291 1.109
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:56.926
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.226
When I log in to a new session in French (fr) 34.725
Then the keyboard layout is set to "fr" 0.376
When the network is plugged 0.043
And Tor is ready 15.904
Then I successfully start the Unsafe Browser in "fr" 30.964
And I kill the Unsafe Browser 6.043
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.545
And DuckDuckGo is the default search engine 17.534
And I kill the Tor Browser 5.606
And the screen keyboard works in Thunderbird 22.212
And the layout of the screen keyboard is set to "fr" 0.611
After features/support/hooks.rb:291 1.682
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.547
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.105
When I log in to a new session in German (de) 31.021
Then the keyboard layout is set to "de" 0.169
When the network is plugged 0.058
And Tor is ready 16.097
Then I successfully start the Unsafe Browser in "de" 30.802
And I kill the Unsafe Browser 5.891
When I enable the screen keyboard 0.178
Then the screen keyboard works in Tor Browser 33.740
And DuckDuckGo is the default search engine 9.292
And I kill the Tor Browser 5.341
And the screen keyboard works in Thunderbird 21.221
And the layout of the screen keyboard is set to "de" 0.626
After features/support/hooks.rb:291 1.151
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.704
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.237
When I log in to a new session in Italian (it) 28.463
Then the keyboard layout is set to "it" 0.153
When the network is plugged 0.031
And Tor is ready 14.512
Then I successfully start the Unsafe Browser in "it" 27.457
And I kill the Unsafe Browser 5.997
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 33.123
And DuckDuckGo is the default search engine 9.401
And I kill the Tor Browser 5.285
And the screen keyboard works in Thunderbird 22.337
And the layout of the screen keyboard is set to "us" 0.556
After features/support/hooks.rb:291 1.170
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.655
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.898
When I log in to a new session in Persian (fa) 28.626
Then the keyboard layout is set to "ir" 0.152
When the network is plugged 0.031
And Tor is ready 15.779
Then I successfully start the Unsafe Browser in "fa" 27.146
And I kill the Unsafe Browser 5.757
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 34.975
And DuckDuckGo is the default search engine 9.310
And I kill the Tor Browser 5.338
And the screen keyboard works in Thunderbird 23.928
And the layout of the screen keyboard is set to "ir" 0.566
After features/support/hooks.rb:291 3.214
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:11.288
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.070
When I log in to a new session in Portuguese (pt) 28.662
Then the keyboard layout is set to "pt" 0.166
When the network is plugged 0.025
And Tor is ready 45.443
Then I successfully start the Unsafe Browser in "pt" 27.494
And I kill the Unsafe Browser 5.762
When I enable the screen keyboard 0.175
Then the screen keyboard works in Tor Browser 34.147
And DuckDuckGo is the default search engine 10.835
And I kill the Tor Browser 5.537
And the screen keyboard works in Thunderbird 24.373
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.108
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.084
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.913
When I log in to a new session in Russian (ru) 29.572
Then the keyboard layout is set to "ru" 0.272
When the network is plugged 0.027
And Tor is ready 14.134
Then I successfully start the Unsafe Browser in "ru" 28.373
And I kill the Unsafe Browser 5.948
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 33.826
And DuckDuckGo is the default search engine 9.340
And I kill the Tor Browser 5.235
And the screen keyboard works in Thunderbird 25.727
And the layout of the screen keyboard is set to "ru" 0.601
After features/support/hooks.rb:291 1.439
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.446
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.200
When I log in to a new session in Spanish (es) 30.138
Then the keyboard layout is set to "es" 0.176
When the network is plugged 0.025
And Tor is ready 15.527
Then I successfully start the Unsafe Browser in "es" 26.910
And I kill the Unsafe Browser 5.776
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 33.257
And DuckDuckGo is the default search engine 9.307
And I kill the Tor Browser 5.274
And the screen keyboard works in Thunderbird 20.152
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 1.183
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.963
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.851
When I log in to a new session in Turkish (tr) 28.678
Then the keyboard layout is set to "tr" 0.321
When the network is plugged 0.021
And Tor is ready 15.269
Then I successfully start the Unsafe Browser in "tr" 26.946
And I kill the Unsafe Browser 5.840
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 32.970
And DuckDuckGo is the default search engine 9.417
And I kill the Tor Browser 5.373
And the screen keyboard works in Thunderbird 24.551
And the layout of the screen keyboard is set to "us" 0.588
After features/support/hooks.rb:291 1.324
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:8.572
When the network is plugged 0.065
And I wait 720 seconds 12:0.100 
Slept for 720 seconds
Then I successfully configure Tor 8.344
And the time has synced 0.062
After features/support/hooks.rb:291 0.630
After features/support/hooks.rb:75 0.000