Project Number Date
test_Tails_ISO_devel 3240 17 Jan 2024, 12:37

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:26:53.566 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.960
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.260
And I prepare Tails for memory erasure tests 0.518
When I start a process allocating 128 MiB of memory with a known pattern 2.298
Then patterns cover at least 128 MiB in the guest's memory 3.089 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.321
Then I find very few patterns in the guest's memory 3.472 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
After features/support/hooks.rb:291 0.838
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.834
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.298
And I prepare Tails for memory erasure tests 0.479
And I find very few patterns in the guest's memory 3.577 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.949
Then patterns cover at least 99% of the test FS size in the guest's memory 3.165 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.248
Then I find very few patterns in the guest's memory 4.115 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
After features/support/hooks.rb:291 0.948
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:23.075
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.112
And I prepare Tails for memory erasure tests 0.483
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.846
Then I find very few patterns in the guest's memory 3.569 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:48.557
Then patterns cover at least 86% of the test FS size in the guest's memory 2.963 
Pattern coverage: 96.234% (119 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.480
Then I find very few patterns in the guest's memory 3.692 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
# read cache
When I mount the USB drive again 0.506
And I read the content of the test FS 0.567
Then patterns cover at least 99% of the test FS size in the guest's memory 3.150 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.292
Then I find very few patterns in the guest's memory 3.851 
Pattern coverage: 0.000% (0 MiB out of 1205 MiB reference memory)
After features/support/hooks.rb:291 0.797
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:56.153
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.223
And I prepare Tails for memory erasure tests 0.476
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.277
Then I find very few patterns in the guest's memory 3.310 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:4.403
Then patterns cover at least 99% of the test FS size in the guest's memory 2.510 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.639
Then I find very few patterns in the guest's memory 3.244 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# read cache
When I mount the USB drive again 3.403
And I read the content of the test FS 0.345
Then patterns cover at least 99% of the test FS size in the guest's memory 2.532 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.587
Then I find very few patterns in the guest's memory 3.198 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
After features/support/hooks.rb:291 1.734
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.877
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.816
And I prepare Tails for memory erasure tests 0.451
When I fill a 128 MiB file with a known pattern on the root filesystem 12.379
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 3.295
Then patterns cover at least 128 MiB in the guest's memory 2.509 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.746
And I wait 20 seconds 20.006 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.672 
Pattern coverage: 0.000% (0 MiB out of 1216 MiB reference memory)
After features/support/hooks.rb:291 3.442
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:6.631
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:23.157
And I prepare Tails for memory erasure tests 0.467
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.483
When I trigger shutdown 0.330
And I wait 20 seconds 20.018 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.173 
Pattern coverage: 0.000% (0 MiB out of 1173 MiB reference memory)
After features/support/hooks.rb:291 3.432
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
4:2.912
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:55.338
And I update APT using apt 19.049
When I install "popularity-contest" using apt 19.849
Then I am notified I can not use Additional Software for "popularity-contest" 1:1.397
And I can open the Additional Software documentation from the notification 27.276
After features/support/hooks.rb:450 42.031
After features/support/hooks.rb:291 2.622
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:42.444
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:5.609
And I update APT using apt 16.945
And I install "popularity-contest" using apt 19.608
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.579
When I create a persistent storage and activate the Additional Software feature 16.230
Then Additional Software is correctly configured for package "popularity-contest" 1.383
When I shutdown Tails and wait for the computer to power off 10.092
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:34.667
Then Additional Software is correctly configured for package "popularity-contest" 1.041
And the package "popularity-contest" is installed after Additional Software has been started 0.286
After features/support/hooks.rb:450 36.770
After features/support/hooks.rb:291 1.017
After features/support/hooks.rb:75 0.037
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:53.378
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.159
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.300
And I update APT using apt 16.569
When I install "makepp" using apt 19.597
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 55.668
And the package "makepp" is installed 0.083
After features/support/hooks.rb:450 38.274
After features/support/hooks.rb:291 0.969
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:55.234
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given a computer 0.185
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.258
When I uninstall "popularity-contest" using apt 19.086
And I accept removing "popularity-contest" from Additional Software 0.692
Then "popularity-contest" is not in the list of Additional Software 0.890
When I start Synaptic 20.810
And I update APT using Synaptic 22.159
And I install "cowsay" using Synaptic 7.655
And I accept adding "cowsay" to Additional Software 2.280
Then Additional Software is correctly configured for package "cowsay" 0.906
When I uninstall "cowsay" using apt 3.336
And I refuse removing "cowsay" from Additional Software 0.688
Then Additional Software is correctly configured for package "cowsay" 0.955
When I start "Additional Software" via GNOME Activities Overview 12.431
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.816
Then "cowsay" is not in the list of Additional Software 1.092
When I install "cowsay" using apt 3.345
And I refuse adding "cowsay" to Additional Software 0.785
Then "cowsay" is not in the list of Additional Software 0.856
After features/support/hooks.rb:450 1.111
After features/support/hooks.rb:291 0.825
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:39.752
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.008
Given a computer 0.177
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:1.124
And I configure APT to prefer an old version of cowsay 0.029
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.266
And I accept adding "cowsay" to Additional Software 1:6.026
And Additional Software is correctly configured for package "cowsay" 1.293
And I shutdown Tails and wait for the computer to power off 5.192
And I start Tails from USB drive "__internal" with network unplugged 44.829
And I enable persistence 29.861
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 29.952
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.650
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.109
And the network is plugged 0.020
And Tor is ready 16.710
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.634
And available upgrades have been checked 0.160
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.268
And I can open the Additional Software configuration window from the notification 2.882
And I shutdown Tails and wait for the computer to power off 2:2.505
And I start Tails from USB drive "__internal" with network unplugged 44.607
And I enable persistence 29.642
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 29.213
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 40.883
And I revert the APT tweaks that made it prefer an old version of cowsay 0.046
And the network is plugged 0.029
And Tor is ready 39.253
Then the Additional Software upgrade service has started 0.170
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.100
After features/support/hooks.rb:450 2.275
After features/support/hooks.rb:291 0.674
After features/support/hooks.rb:75 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:48.261
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.173
And I start Tails from USB drive "__internal" with network unplugged 44.125
And I enable persistence 32.517
And I remove the "cowsay" deb files from the APT cache 0.643
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.079
And I log in to a new session 22.036
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.079
And I can open the Additional Software log file from the notification 3.488
And the package "cowsay" is not installed 0.117
After features/support/hooks.rb:450 0.126
After features/support/hooks.rb:291 0.732
After features/support/hooks.rb:75 0.083
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.829
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.731
When I log in to a new session in Arabic (ar) 29.143
Then the keyboard layout is set to "us" 0.192
When the network is plugged 0.036
And Tor is ready 15.298
Then I successfully start the Unsafe Browser in "ar" 28.321
And I kill the Unsafe Browser 5.852
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 34.068
And DuckDuckGo is the default search engine 9.361
And I kill the Tor Browser 5.315
And the screen keyboard works in Thunderbird 24.723
And the layout of the screen keyboard is set to "us" 0.632
After features/support/hooks.rb:291 3.177
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.072
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.674
When I log in to a new session in Chinese (zh_CN) 28.795
Then the keyboard layout is set to "cn" 0.156
When the network is plugged 0.027
And Tor is ready 17.708
Then I successfully start the Unsafe Browser in "zh_CN" 26.501
And I kill the Unsafe Browser 5.801
When I enable the screen keyboard 0.145
Then the screen keyboard works in Tor Browser 35.123
And DuckDuckGo is the default search engine 9.388
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 27.874
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.325
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.584
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.274
When I log in to a new session in English (en) 14.319
Then the keyboard layout is set to "us" 0.154
When the network is plugged 0.021
And Tor is ready 13.868
Then I successfully start the Unsafe Browser in "en" 28.109
And I kill the Unsafe Browser 5.793
When I enable the screen keyboard 0.178
Then the screen keyboard works in Tor Browser 33.019
And DuckDuckGo is the default search engine 5.535
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 21.389
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 1.086
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.569
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.648
When I log in to a new session in French (fr) 28.524
Then the keyboard layout is set to "fr" 0.108
When the network is plugged 0.032
And Tor is ready 15.504
Then I successfully start the Unsafe Browser in "fr" 28.766
And I kill the Unsafe Browser 5.845
When I enable the screen keyboard 0.169
Then the screen keyboard works in Tor Browser 34.213
And DuckDuckGo is the default search engine 9.548
And I kill the Tor Browser 5.277
And the screen keyboard works in Thunderbird 21.337
And the layout of the screen keyboard is set to "fr" 0.591
After features/support/hooks.rb:291 1.143
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:4.876
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.656
When I log in to a new session in German (de) 28.847
Then the keyboard layout is set to "de" 0.144
When the network is plugged 0.019
And Tor is ready 44.461
Then I successfully start the Unsafe Browser in "de" 25.954
And I kill the Unsafe Browser 6.846
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 33.115
And DuckDuckGo is the default search engine 10.079
And I kill the Tor Browser 5.354
And the screen keyboard works in Thunderbird 21.634
And the layout of the screen keyboard is set to "de" 0.614
After features/support/hooks.rb:291 1.100
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.377
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.635
When I log in to a new session in Italian (it) 28.488
Then the keyboard layout is set to "it" 0.157
When the network is plugged 0.028
And Tor is ready 16.042
Then I successfully start the Unsafe Browser in "it" 29.415
And I kill the Unsafe Browser 7.379
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 33.305
And DuckDuckGo is the default search engine 9.634
And I kill the Tor Browser 5.389
And the screen keyboard works in Thunderbird 22.208
And the layout of the screen keyboard is set to "us" 0.579
After features/support/hooks.rb:291 2.365
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.890
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.785
When I log in to a new session in Persian (fa) 28.289
Then the keyboard layout is set to "ir" 0.137
When the network is plugged 0.020
And Tor is ready 15.255
Then I successfully start the Unsafe Browser in "fa" 28.558
And I kill the Unsafe Browser 6.845
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 34.565
And DuckDuckGo is the default search engine 9.641
And I kill the Tor Browser 5.360
And the screen keyboard works in Thunderbird 22.688
And the layout of the screen keyboard is set to "ir" 0.593
After features/support/hooks.rb:291 2.637
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.491
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.747
When I log in to a new session in Portuguese (pt) 28.938
Then the keyboard layout is set to "pt" 0.209
When the network is plugged 0.035
And Tor is ready 14.160
Then I successfully start the Unsafe Browser in "pt" 28.346
And I kill the Unsafe Browser 5.888
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 32.452
And DuckDuckGo is the default search engine 9.722
And I kill the Tor Browser 5.306
And the screen keyboard works in Thunderbird 22.971
And the layout of the screen keyboard is set to "us" 0.550
After features/support/hooks.rb:291 1.061
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.637
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.642
When I log in to a new session in Russian (ru) 29.449
Then the keyboard layout is set to "ru" 0.152
When the network is plugged 0.022
And Tor is ready 15.035
Then I successfully start the Unsafe Browser in "ru" 26.706
And I kill the Unsafe Browser 5.878
When I enable the screen keyboard 0.217
Then the screen keyboard works in Tor Browser 33.638
And DuckDuckGo is the default search engine 9.688
And I kill the Tor Browser 5.419
And the screen keyboard works in Thunderbird 23.159
And the layout of the screen keyboard is set to "ru" 0.626
After features/support/hooks.rb:291 0.954
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.268
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.108
When I log in to a new session in Spanish (es) 28.153
Then the keyboard layout is set to "es" 0.250
When the network is plugged 0.038
And Tor is ready 15.899
Then I successfully start the Unsafe Browser in "es" 25.593
And I kill the Unsafe Browser 6.419
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 33.353
And DuckDuckGo is the default search engine 9.463
And I kill the Tor Browser 5.290
And the screen keyboard works in Thunderbird 21.014
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:291 1.103
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.060
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.716
When I log in to a new session in Turkish (tr) 27.811
Then the keyboard layout is set to "tr" 0.213
When the network is plugged 0.019
And Tor is ready 18.065
Then I successfully start the Unsafe Browser in "tr" 26.596
And I kill the Unsafe Browser 5.782
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 32.821
And DuckDuckGo is the default search engine 10.045
And I kill the Tor Browser 5.382
And the screen keyboard works in Thunderbird 21.930
And the layout of the screen keyboard is set to "us" 0.537
After features/support/hooks.rb:291 1.198
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.390
When the network is plugged 0.032
And I wait 720 seconds 12:0.003 
Slept for 720 seconds
Then I successfully configure Tor 10.302
And the time has synced 0.051
After features/support/hooks.rb:291 0.631
After features/support/hooks.rb:75 0.000