Project Number Date
test_Tails_ISO_stable 4538 28 Nov 2023, 00:16

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:25:11.124 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.210
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.261
And I prepare Tails for memory erasure tests 0.488
When I start a process allocating 128 MiB of memory with a known pattern 2.298
Then patterns cover at least 128 MiB in the guest's memory 3.071 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.355
Then I find very few patterns in the guest's memory 3.733 
Pattern coverage: 0.000% (0 MiB out of 1229 MiB reference memory)
After features/support/hooks.rb:291 0.759
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:1.724
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.030
And I prepare Tails for memory erasure tests 0.416
And I find very few patterns in the guest's memory 3.688 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 42.362
Then patterns cover at least 99% of the test FS size in the guest's memory 3.269 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.354
Then I find very few patterns in the guest's memory 3.603 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:291 0.746
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:41.199
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.985
And I prepare Tails for memory erasure tests 0.480
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.848
Then I find very few patterns in the guest's memory 4.165 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:57.429
Then patterns cover at least 86% of the test FS size in the guest's memory 4.068 
Pattern coverage: 101.243% (126 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.320
Then I find very few patterns in the guest's memory 4.603 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
# read cache
When I mount the USB drive again 0.261
And I read the content of the test FS 0.770
Then patterns cover at least 99% of the test FS size in the guest's memory 6.844 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.282
Then I find very few patterns in the guest's memory 6.138 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
After features/support/hooks.rb:291 1.351
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:43.401
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.129
And I prepare Tails for memory erasure tests 0.432
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.066
Then I find very few patterns in the guest's memory 3.448 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:49.636
Then patterns cover at least 99% of the test FS size in the guest's memory 2.662 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.580
Then I find very few patterns in the guest's memory 3.175 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
# read cache
When I mount the USB drive again 3.176
And I read the content of the test FS 0.373
Then patterns cover at least 99% of the test FS size in the guest's memory 3.086 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.457
Then I find very few patterns in the guest's memory 3.175 
Pattern coverage: 0.000% (0 MiB out of 1227 MiB reference memory)
After features/support/hooks.rb:291 1.784
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.184
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and logged in 9.362
And I prepare Tails for memory erasure tests 0.508
When I fill a 128 MiB file with a known pattern on the root filesystem 12.476
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.636
Then patterns cover at least 128 MiB in the guest's memory 2.347 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.744
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.090 
Pattern coverage: 0.000% (0 MiB out of 1226 MiB reference memory)
After features/support/hooks.rb:291 3.552
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:22.938
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:38.139
And I prepare Tails for memory erasure tests 0.454
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.514
When I trigger shutdown 0.472
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.336 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 3.462
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:16.696
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:22.853
And I update APT using apt 16.567
When I install "popularity-contest" using apt 19.788
Then I am notified I can not use Additional Software for "popularity-contest" 54.969
And I can open the Additional Software documentation from the notification 22.517
After features/support/hooks.rb:450 37.820
After features/support/hooks.rb:291 2.032
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:35.588
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.229
And I update APT using apt 16.547
And I install "popularity-contest" using apt 19.392
Then I am proposed to add the "popularity-contest" package to my Additional Software 55.186
When I create a persistent storage and activate the Additional Software feature 17.570
Then Additional Software is correctly configured for package "popularity-contest" 1.321
When I shutdown Tails and wait for the computer to power off 11.227
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:39.938
Then Additional Software is correctly configured for package "popularity-contest" 0.875
And the package "popularity-contest" is installed after Additional Software has been started 0.298
After features/support/hooks.rb:450 37.269
After features/support/hooks.rb:291 1.716
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:48.486
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.250
And I start Tails from USB drive "__internal" and I login with an administration password 1:16.299
And I update APT using apt 15.821
When I install "makepp" using apt 19.556
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.470
And the package "makepp" is installed 0.088
After features/support/hooks.rb:450 38.511
After features/support/hooks.rb:291 0.865
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:50.994
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.202
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:10.654
When I uninstall "popularity-contest" using apt 15.847
And I accept removing "popularity-contest" from Additional Software 2.312
Then "popularity-contest" is not in the list of Additional Software 0.665
When I start Synaptic 19.752
And I update APT using Synaptic 21.867
And I install "cowsay" using Synaptic 10.501
And I accept adding "cowsay" to Additional Software 0.692
Then Additional Software is correctly configured for package "cowsay" 0.852
When I uninstall "cowsay" using apt 3.316
And I refuse removing "cowsay" from Additional Software 0.677
Then Additional Software is correctly configured for package "cowsay" 0.854
When I start "Additional Software" via GNOME Activities Overview 12.400
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.733
Then "cowsay" is not in the list of Additional Software 1.055
When I install "cowsay" using apt 3.275
And I refuse adding "cowsay" to Additional Software 0.572
Then "cowsay" is not in the list of Additional Software 0.760
After features/support/hooks.rb:450 1.612
After features/support/hooks.rb:291 0.681
After features/support/hooks.rb:75 0.043
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:29.909
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.006
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:55.858
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.380
And I accept adding "cowsay" to Additional Software 1:2.270
And Additional Software is correctly configured for package "cowsay" 1.317
And I shutdown Tails and wait for the computer to power off 6.192
And I start Tails from USB drive "__internal" with network unplugged 44.866
And I enable persistence 30.754
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 23.351
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.468
And I revert the APT tweaks that made it prefer an old version of cowsay 0.105
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.162
And the network is plugged 0.060
And Tor is ready 16.938
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.843
And available upgrades have been checked 0.210
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.124
And I can open the Additional Software configuration window from the notification 2.613
And I shutdown Tails and wait for the computer to power off 2:2.818
And I start Tails from USB drive "__internal" with network unplugged 43.911
And I enable persistence 33.482
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 20.442
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.393
And I revert the APT tweaks that made it prefer an old version of cowsay 0.051
And the network is plugged 0.074
And Tor is ready 37.652
Then the Additional Software upgrade service has started 0.186
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.089
After features/support/hooks.rb:450 2.398
After features/support/hooks.rb:291 1.323
After features/support/hooks.rb:75 0.035
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.685
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.007
Given a computer 0.201
And I start Tails from USB drive "__internal" with network unplugged 44.472
And I enable persistence 36.055
And I remove the "cowsay" deb files from the APT cache 0.686
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.072
And I log in to a new session 29.430
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.661
And I can open the Additional Software log file from the notification 1.926
And the package "cowsay" is not installed 0.178
After features/support/hooks.rb:450 0.135
After features/support/hooks.rb:291 1.021
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.173
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.691
When I log in to a new session in Arabic (ar) 28.757
Then the keyboard layout is set to "us" 0.340
When the network is plugged 0.042
And Tor is ready 14.080
Then I successfully start the Unsafe Browser in "ar" 25.324
And I kill the Unsafe Browser 5.918
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 33.676
And DuckDuckGo is the default search engine 9.292
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 22.030
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:291 1.234
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.342
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.902
When I log in to a new session in Chinese (zh_CN) 32.805
Then the keyboard layout is set to "cn" 0.177
When the network is plugged 0.032
And Tor is ready 14.808
Then I successfully start the Unsafe Browser in "zh_CN" 27.340
And I kill the Unsafe Browser 6.063
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 34.056
And DuckDuckGo is the default search engine 9.601
And I kill the Tor Browser 5.280
And the screen keyboard works in Thunderbird 26.517
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.235
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.070
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.501
When I log in to a new session in English (en) 14.369
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.048
And Tor is ready 14.145
Then I successfully start the Unsafe Browser in "en" 26.049
And I kill the Unsafe Browser 5.792
When I enable the screen keyboard 0.157
Then the screen keyboard works in Tor Browser 32.848
And DuckDuckGo is the default search engine 5.357
And I kill the Tor Browser 5.320
And the screen keyboard works in Thunderbird 20.774
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:291 1.743
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.277
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.707
When I log in to a new session in French (fr) 28.705
Then the keyboard layout is set to "fr" 0.119
When the network is plugged 0.043
And Tor is ready 16.522
Then I successfully start the Unsafe Browser in "fr" 26.696
And I kill the Unsafe Browser 5.948
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 33.465
And DuckDuckGo is the default search engine 9.202
And I kill the Tor Browser 5.265
And the screen keyboard works in Thunderbird 21.901
And the layout of the screen keyboard is set to "fr" 0.544
After features/support/hooks.rb:291 1.195
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.377
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.774
When I log in to a new session in German (de) 28.735
Then the keyboard layout is set to "de" 0.305
When the network is plugged 0.037
And Tor is ready 15.136
Then I successfully start the Unsafe Browser in "de" 26.356
And I kill the Unsafe Browser 5.862
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 32.965
And DuckDuckGo is the default search engine 9.250
And I kill the Tor Browser 5.326
And the screen keyboard works in Thunderbird 20.901
And the layout of the screen keyboard is set to "de" 0.574
After features/support/hooks.rb:291 1.359
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.073
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.839
When I log in to a new session in Italian (it) 28.652
Then the keyboard layout is set to "it" 0.251
When the network is plugged 0.046
And Tor is ready 14.764
Then I successfully start the Unsafe Browser in "it" 24.829
And I kill the Unsafe Browser 5.763
When I enable the screen keyboard 0.139
Then the screen keyboard works in Tor Browser 32.767
And DuckDuckGo is the default search engine 9.353
And I kill the Tor Browser 5.350
And the screen keyboard works in Thunderbird 21.735
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.129
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.724
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.649
When I log in to a new session in Persian (fa) 28.259
Then the keyboard layout is set to "ir" 0.320
When the network is plugged 0.136
And Tor is ready 16.149
Then I successfully start the Unsafe Browser in "fa" 25.403
And I kill the Unsafe Browser 5.888
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 34.178
And DuckDuckGo is the default search engine 9.125
And I kill the Tor Browser 5.291
And the screen keyboard works in Thunderbird 21.666
And the layout of the screen keyboard is set to "ir" 0.542
After features/support/hooks.rb:291 1.042
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.997
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.713
When I log in to a new session in Portuguese (pt) 28.161
Then the keyboard layout is set to "pt" 0.170
When the network is plugged 0.070
And Tor is ready 14.267
Then I successfully start the Unsafe Browser in "pt" 25.720
And I kill the Unsafe Browser 5.907
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 32.640
And DuckDuckGo is the default search engine 9.043
And I kill the Tor Browser 5.260
And the screen keyboard works in Thunderbird 21.334
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 1.165
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.078
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.781
When I log in to a new session in Russian (ru) 28.183
Then the keyboard layout is set to "ru" 0.281
When the network is plugged 0.052
And Tor is ready 15.677
Then I successfully start the Unsafe Browser in "ru" 26.983
And I kill the Unsafe Browser 5.791
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 33.491
And DuckDuckGo is the default search engine 9.578
And I kill the Tor Browser 5.315
And the screen keyboard works in Thunderbird 23.220
And the layout of the screen keyboard is set to "ru" 0.611
After features/support/hooks.rb:291 1.323
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.024
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.833
When I log in to a new session in Spanish (es) 28.081
Then the keyboard layout is set to "es" 0.155
When the network is plugged 0.036
And Tor is ready 15.826
Then I successfully start the Unsafe Browser in "es" 25.418
And I kill the Unsafe Browser 5.853
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 33.405
And DuckDuckGo is the default search engine 9.271
And I kill the Tor Browser 5.263
And the screen keyboard works in Thunderbird 22.173
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.064
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.842
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.398
When I log in to a new session in Turkish (tr) 27.804
Then the keyboard layout is set to "tr" 0.352
When the network is plugged 0.051
And Tor is ready 16.667
Then I successfully start the Unsafe Browser in "tr" 26.107
And I kill the Unsafe Browser 5.792
When I enable the screen keyboard 0.166
Then the screen keyboard works in Tor Browser 32.983
And DuckDuckGo is the default search engine 9.385
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 21.261
And the layout of the screen keyboard is set to "us" 0.570
After features/support/hooks.rb:291 1.108
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:11.122
When the network is plugged 0.057
And I wait 720 seconds 12:0.011 
Slept for 720 seconds
Then I successfully configure Tor 10.995
And the time has synced 0.057
After features/support/hooks.rb:291 0.666
After features/support/hooks.rb:75 0.000