Project Number Date
test_Tails_ISO_devel 3256 28 Jan 2024, 12:31

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:29:33.420 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.326
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.725
And I prepare Tails for memory erasure tests 0.658
When I start a process allocating 128 MiB of memory with a known pattern 2.245
Then patterns cover at least 128 MiB in the guest's memory 4.570 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.274
Then I find very few patterns in the guest's memory 3.851 
Pattern coverage: 0.000% (0 MiB out of 1165 MiB reference memory)
After features/support/hooks.rb:291 0.773
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.130
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.636
And I prepare Tails for memory erasure tests 0.714
And I find very few patterns in the guest's memory 3.760 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.069
Then patterns cover at least 99% of the test FS size in the guest's memory 3.142 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.231
Then I find very few patterns in the guest's memory 3.573 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 0.743
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:8.222
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.334
And I prepare Tails for memory erasure tests 0.688
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.865
Then I find very few patterns in the guest's memory 4.013 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:32.899
Then patterns cover at least 86% of the test FS size in the guest's memory 3.051 
Pattern coverage: 93.742% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.681
Then I find very few patterns in the guest's memory 3.500 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# read cache
When I mount the USB drive again 0.252
And I read the content of the test FS 0.555
Then patterns cover at least 99% of the test FS size in the guest's memory 3.129 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.379
Then I find very few patterns in the guest's memory 3.871 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 1.385
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:50.893
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.494
And I prepare Tails for memory erasure tests 0.679
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.421
Then I find very few patterns in the guest's memory 4.197 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:50.820
Then patterns cover at least 99% of the test FS size in the guest's memory 2.677 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.719
Then I find very few patterns in the guest's memory 3.237 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
# read cache
When I mount the USB drive again 4.407
And I read the content of the test FS 0.741
Then patterns cover at least 99% of the test FS size in the guest's memory 2.527 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.623
Then I find very few patterns in the guest's memory 3.344 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.780
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.131
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.198
And I prepare Tails for memory erasure tests 0.726
When I fill a 128 MiB file with a known pattern on the root filesystem 11.707
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.846
Then patterns cover at least 128 MiB in the guest's memory 2.447 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 2.432
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.756 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 3.475
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:3.538
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:19.354
And I prepare Tails for memory erasure tests 0.507
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.183
When I trigger shutdown 0.324
And I wait 20 seconds 20.011 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.157 
Pattern coverage: 0.000% (0 MiB out of 1178 MiB reference memory)
After features/support/hooks.rb:291 3.485
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:33.643
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.013
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:32.269
And I update APT using apt 17.678
When I install "popularity-contest" using apt 19.815
Then I am notified I can not use Additional Software for "popularity-contest" 59.594
And I can open the Additional Software documentation from the notification 24.286
After features/support/hooks.rb:450 38.673
After features/support/hooks.rb:291 2.944
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:39.766
Before features/support/hooks.rb:245 0.027
Before features/support/hooks.rb:442 0.046
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.359
And I update APT using apt 16.646
And I install "popularity-contest" using apt 22.771
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.327
When I create a persistent storage and activate the Additional Software feature 18.620
Then Additional Software is correctly configured for package "popularity-contest" 1.518
When I shutdown Tails and wait for the computer to power off 11.541
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:37.694
Then Additional Software is correctly configured for package "popularity-contest" 0.956
And the package "popularity-contest" is installed after Additional Software has been started 0.328
After features/support/hooks.rb:450 43.264
After features/support/hooks.rb:291 1.039
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:57.060
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.268
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.532
And I update APT using apt 16.779
When I install "makepp" using apt 19.597
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.796
And the package "makepp" is installed 0.087
After features/support/hooks.rb:450 45.835
After features/support/hooks.rb:291 1.083
After features/support/hooks.rb:75 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:25.652
Before features/support/hooks.rb:245 0.010
Before features/support/hooks.rb:442 0.015
Given a computer 0.247
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:40.372
When I uninstall "popularity-contest" using apt 15.827
And I accept removing "popularity-contest" from Additional Software 2.305
Then "popularity-contest" is not in the list of Additional Software 0.808
When I start Synaptic 23.808
And I update APT using Synaptic 21.868
And I install "cowsay" using Synaptic 9.784
And I accept adding "cowsay" to Additional Software 0.986
Then Additional Software is correctly configured for package "cowsay" 0.949
When I uninstall "cowsay" using apt 3.424
And I refuse removing "cowsay" from Additional Software 0.743
Then Additional Software is correctly configured for package "cowsay" 0.984
When I start "Additional Software" via GNOME Activities Overview 12.792
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.814
Then "cowsay" is not in the list of Additional Software 1.077
When I install "cowsay" using apt 3.280
And I refuse adding "cowsay" to Additional Software 0.739
Then "cowsay" is not in the list of Additional Software 0.835
After features/support/hooks.rb:450 1.562
After features/support/hooks.rb:291 0.741
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:25.458
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.209
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.475
And I configure APT to prefer an old version of cowsay 0.033
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.725
And I accept adding "cowsay" to Additional Software 1:5.176
And Additional Software is correctly configured for package "cowsay" 1.704
And I shutdown Tails and wait for the computer to power off 6.074
And I start Tails from USB drive "__internal" with network unplugged 45.387
And I enable persistence 33.490
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 26.556
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.574
And I revert the APT tweaks that made it prefer an old version of cowsay 0.048
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.097
And the network is plugged 0.034
And Tor is ready 19.688
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.429
And available upgrades have been checked 0.142
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.930
And I can open the Additional Software configuration window from the notification 2.913
And I shutdown Tails and wait for the computer to power off 2:2.710
And I start Tails from USB drive "__internal" with network unplugged 46.487
And I enable persistence 33.697
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 28.207
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.191
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.049
And Tor is ready 50.010
Then the Additional Software upgrade service has started 0.188
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.113
After features/support/hooks.rb:450 2.576
After features/support/hooks.rb:291 1.096
After features/support/hooks.rb:75 0.065
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:51.620
Before features/support/hooks.rb:245 0.011
Before features/support/hooks.rb:442 0.012
Given a computer 0.442
And I start Tails from USB drive "__internal" with network unplugged 47.093
And I enable persistence 33.527
And I remove the "cowsay" deb files from the APT cache 0.755
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.134
And I log in to a new session 22.608
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.128
And I can open the Additional Software log file from the notification 2.794
And the package "cowsay" is not installed 0.134
After features/support/hooks.rb:450 0.116
After features/support/hooks.rb:291 0.813
After features/support/hooks.rb:75 0.022
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.817
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.630
When I log in to a new session in Arabic (ar) 31.165
Then the keyboard layout is set to "us" 0.214
When the network is plugged 0.041
And Tor is ready 17.610
Then I successfully start the Unsafe Browser in "ar" 28.590
And I kill the Unsafe Browser 6.174
When I enable the screen keyboard 0.171
Then the screen keyboard works in Tor Browser 35.708
And DuckDuckGo is the default search engine 9.820
And I kill the Tor Browser 5.483
And the screen keyboard works in Thunderbird 21.640
And the layout of the screen keyboard is set to "us" 0.566
After features/support/hooks.rb:291 1.057
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:53.561
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.103
When I log in to a new session in Chinese (zh_CN) 32.024
Then the keyboard layout is set to "cn" 0.173
When the network is plugged 0.033
And Tor is ready 16.421
Then I successfully start the Unsafe Browser in "zh_CN" 31.560
And I kill the Unsafe Browser 6.122
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 34.449
And DuckDuckGo is the default search engine 9.943
And I kill the Tor Browser 5.351
And the screen keyboard works in Thunderbird 28.616
And the layout of the screen keyboard is set to "us" 0.604
After features/support/hooks.rb:291 1.490
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.973
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.997
When I log in to a new session in English (en) 21.128
Then the keyboard layout is set to "us" 0.118
When the network is plugged 0.041
And Tor is ready 16.017
Then I successfully start the Unsafe Browser in "en" 30.854
And I kill the Unsafe Browser 5.946
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 34.620
And DuckDuckGo is the default search engine 5.617
And I kill the Tor Browser 5.369
And the screen keyboard works in Thunderbird 21.527
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.166
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.722
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.145
When I log in to a new session in French (fr) 31.350
Then the keyboard layout is set to "fr" 0.320
When the network is plugged 0.041
And Tor is ready 19.163
Then I successfully start the Unsafe Browser in "fr" 29.039
And I kill the Unsafe Browser 5.945
When I enable the screen keyboard 0.175
Then the screen keyboard works in Tor Browser 34.142
And DuckDuckGo is the default search engine 9.333
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 23.130
And the layout of the screen keyboard is set to "fr" 0.598
After features/support/hooks.rb:291 1.093
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:52.845
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.506
When I log in to a new session in German (de) 31.074
Then the keyboard layout is set to "de" 0.284
When the network is plugged 0.115
And Tor is ready 15.170
Then I successfully start the Unsafe Browser in "de" 33.443
And I kill the Unsafe Browser 7.532
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 36.064
And DuckDuckGo is the default search engine 10.336
And I kill the Tor Browser 5.579
And the screen keyboard works in Thunderbird 22.982
And the layout of the screen keyboard is set to "de" 0.607
After features/support/hooks.rb:291 2.062
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.857
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.978
When I log in to a new session in Italian (it) 30.003
Then the keyboard layout is set to "it" 0.265
When the network is plugged 0.028
And Tor is ready 16.002
Then I successfully start the Unsafe Browser in "it" 29.015
And I kill the Unsafe Browser 5.850
When I enable the screen keyboard 0.172
Then the screen keyboard works in Tor Browser 35.815
And DuckDuckGo is the default search engine 10.069
And I kill the Tor Browser 5.591
And the screen keyboard works in Thunderbird 21.358
And the layout of the screen keyboard is set to "us" 0.705
After features/support/hooks.rb:291 1.216
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.561
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.125
When I log in to a new session in Persian (fa) 31.045
Then the keyboard layout is set to "ir" 0.149
When the network is plugged 0.052
And Tor is ready 16.267
Then I successfully start the Unsafe Browser in "fa" 29.913
And I kill the Unsafe Browser 5.801
When I enable the screen keyboard 0.183
Then the screen keyboard works in Tor Browser 36.076
And DuckDuckGo is the default search engine 9.894
And I kill the Tor Browser 5.249
And the screen keyboard works in Thunderbird 24.159
And the layout of the screen keyboard is set to "ir" 0.641
After features/support/hooks.rb:291 1.167
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:23.554
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.563
When I log in to a new session in Portuguese (pt) 32.569
Then the keyboard layout is set to "pt" 0.149
When the network is plugged 0.036
And Tor is ready 47.842
Then I successfully start the Unsafe Browser in "pt" 33.655
And I kill the Unsafe Browser 6.353
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 34.026
And DuckDuckGo is the default search engine 10.100
And I kill the Tor Browser 5.320
And the screen keyboard works in Thunderbird 23.202
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 1.285
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:56.491
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.959
When I log in to a new session in Russian (ru) 29.527
Then the keyboard layout is set to "ru" 0.384
When the network is plugged 0.037
And Tor is ready 14.927
Then I successfully start the Unsafe Browser in "ru" 31.128
And I kill the Unsafe Browser 6.075
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 36.773
And DuckDuckGo is the default search engine 18.559
And I kill the Tor Browser 5.629
And the screen keyboard works in Thunderbird 24.720
And the layout of the screen keyboard is set to "ru" 0.615
After features/support/hooks.rb:291 1.234
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.508
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.057
When I log in to a new session in Spanish (es) 31.863
Then the keyboard layout is set to "es" 0.233
When the network is plugged 0.040
And Tor is ready 16.324
Then I successfully start the Unsafe Browser in "es" 29.547
And I kill the Unsafe Browser 6.041
When I enable the screen keyboard 0.178
Then the screen keyboard works in Tor Browser 35.913
And DuckDuckGo is the default search engine 10.151
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 23.184
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.269
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.659
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.065
When I log in to a new session in Turkish (tr) 32.367
Then the keyboard layout is set to "tr" 0.202
When the network is plugged 0.044
And Tor is ready 16.188
Then I successfully start the Unsafe Browser in "tr" 28.026
And I kill the Unsafe Browser 5.826
When I enable the screen keyboard 0.164
Then the screen keyboard works in Tor Browser 35.694
And DuckDuckGo is the default search engine 9.580
And I kill the Tor Browser 5.363
And the screen keyboard works in Thunderbird 24.560
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.924
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:10.419
When the network is plugged 0.037
And I wait 720 seconds 12:0.086 
Slept for 720 seconds
Then I successfully configure Tor 10.195
And the time has synced 0.100
After features/support/hooks.rb:291 0.758
After features/support/hooks.rb:75 0.000