Project Number Date
test_Tails_ISO_stable 4565 12 Dec 2023, 17:35

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:9:16.675 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.303
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.913
And I prepare Tails for memory erasure tests 0.549
When I start a process allocating 128 MiB of memory with a known pattern 1.359
Then patterns cover at least 128 MiB in the guest's memory 3.363 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.382
Then I find very few patterns in the guest's memory 3.736 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 0.755
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:7.892
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.267
And I prepare Tails for memory erasure tests 0.477
And I find very few patterns in the guest's memory 3.664 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.895
Then patterns cover at least 99% of the test FS size in the guest's memory 6.900 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.248
Then I find very few patterns in the guest's memory 4.438 
Pattern coverage: 0.000% (0 MiB out of 1193 MiB reference memory)
After features/support/hooks.rb:291 0.873
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:7.057
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.650
And I prepare Tails for memory erasure tests 0.493
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.104
Then I find very few patterns in the guest's memory 4.738 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:29.670
Then patterns cover at least 86% of the test FS size in the guest's memory 3.113 
Pattern coverage: 95.112% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.983
Then I find very few patterns in the guest's memory 3.862 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
# read cache
When I mount the USB drive again 0.639
And I read the content of the test FS 0.657
Then patterns cover at least 99% of the test FS size in the guest's memory 3.414 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.294
Then I find very few patterns in the guest's memory 4.432 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 0.957
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:47.862
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.544
And I prepare Tails for memory erasure tests 0.630
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.267
Then I find very few patterns in the guest's memory 3.965 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:52.903
Then patterns cover at least 99% of the test FS size in the guest's memory 2.686 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.920
Then I find very few patterns in the guest's memory 3.248 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
# read cache
When I mount the USB drive again 3.199
And I read the content of the test FS 0.385
Then patterns cover at least 99% of the test FS size in the guest's memory 2.658 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 2.189
Then I find very few patterns in the guest's memory 3.262 
Pattern coverage: 0.000% (0 MiB out of 1169 MiB reference memory)
After features/support/hooks.rb:291 0.860
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.747
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.452
And I prepare Tails for memory erasure tests 0.520
When I fill a 128 MiB file with a known pattern on the root filesystem 13.393
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.388
Then patterns cover at least 128 MiB in the guest's memory 2.218 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.999
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.754 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
After features/support/hooks.rb:291 3.485
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:29.953
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:41.642
And I prepare Tails for memory erasure tests 0.440
When I fill a 128 MiB file with a known pattern on the persistent filesystem 25.266
When I trigger shutdown 0.391
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.192 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
After features/support/hooks.rb:291 3.471
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:24.372
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.002
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 48.570
And I update APT using apt 16.920
And I install "popularity-contest" using apt 19.691
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.526
When I create a persistent storage and activate the Additional Software feature 17.033
Then Additional Software is correctly configured for package "popularity-contest" 1.339
When I shutdown Tails and wait for the computer to power off 11.157
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:28.962
Then Additional Software is correctly configured for package "popularity-contest" 0.921
And the package "popularity-contest" is installed after Additional Software has been started 0.249
After features/support/hooks.rb:450 33.969
After features/support/hooks.rb:291 1.192
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:49.591
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.178
And I start Tails from USB drive "__internal" and I login with an administration password 1:16.828
And I update APT using apt 16.169
When I install "makepp" using apt 19.857
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.481
And the package "makepp" is installed 0.075
After features/support/hooks.rb:450 36.057
After features/support/hooks.rb:291 1.033
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:58.048
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.213
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:16.046
When I uninstall "popularity-contest" using apt 15.769
And I accept removing "popularity-contest" from Additional Software 0.993
Then "popularity-contest" is not in the list of Additional Software 0.762
When I start Synaptic 23.151
And I update APT using Synaptic 22.157
And I install "cowsay" using Synaptic 8.868
And I accept adding "cowsay" to Additional Software 1.210
Then Additional Software is correctly configured for package "cowsay" 0.857
When I uninstall "cowsay" using apt 3.362
And I refuse removing "cowsay" from Additional Software 0.717
Then Additional Software is correctly configured for package "cowsay" 0.960
When I start "Additional Software" via GNOME Activities Overview 12.451
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.691
Then "cowsay" is not in the list of Additional Software 1.019
When I install "cowsay" using apt 3.281
And I refuse adding "cowsay" to Additional Software 0.726
Then "cowsay" is not in the list of Additional Software 0.807
After features/support/hooks.rb:450 1.003
After features/support/hooks.rb:291 0.634
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:27.850
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.173
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:56.878
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.734
And I accept adding "cowsay" to Additional Software 1:2.289
And Additional Software is correctly configured for package "cowsay" 1.343
And I shutdown Tails and wait for the computer to power off 6.261
And I start Tails from USB drive "__internal" with network unplugged 44.601
And I enable persistence 31.185
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 26.284
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.792
And I revert the APT tweaks that made it prefer an old version of cowsay 0.062
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.087
And the network is plugged 0.040
And Tor is ready 16.759
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.483
And available upgrades have been checked 0.132
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.083
And I can open the Additional Software configuration window from the notification 2.448
And I shutdown Tails and wait for the computer to power off 2:2.533
And I start Tails from USB drive "__internal" with network unplugged 45.288
And I enable persistence 32.821
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 22.423
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.613
And I revert the APT tweaks that made it prefer an old version of cowsay 0.207
And the network is plugged 0.054
And Tor is ready 39.915
Then the Additional Software upgrade service has started 0.169
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.107
After features/support/hooks.rb:450 2.277
After features/support/hooks.rb:291 0.630
After features/support/hooks.rb:75 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.285
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.183
And I start Tails from USB drive "__internal" with network unplugged 44.695
And I enable persistence 32.280
And I remove the "cowsay" deb files from the APT cache 0.595
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.075
And I log in to a new session 23.914
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.808
And I can open the Additional Software log file from the notification 2.412
And the package "cowsay" is not installed 0.319
After features/support/hooks.rb:450 0.114
After features/support/hooks.rb:291 0.693
After features/support/hooks.rb:75 0.007
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.324
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.015
When I log in to a new session in Arabic (ar) 28.622
Then the keyboard layout is set to "us" 0.134
When the network is plugged 0.044
And Tor is ready 15.772
Then I successfully start the Unsafe Browser in "ar" 25.650
And I kill the Unsafe Browser 5.915
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 32.527
And DuckDuckGo is the default search engine 9.216
And I kill the Tor Browser 5.269
And the screen keyboard works in Thunderbird 21.497
And the layout of the screen keyboard is set to "us" 0.537
After features/support/hooks.rb:291 1.264
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.005
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.555
When I log in to a new session in Chinese (zh_CN) 28.310
Then the keyboard layout is set to "cn" 0.136
When the network is plugged 0.041
And Tor is ready 13.733
Then I successfully start the Unsafe Browser in "zh_CN" 27.037
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.166
Then the screen keyboard works in Tor Browser 33.144
And DuckDuckGo is the default search engine 8.862
And I kill the Tor Browser 5.350
And the screen keyboard works in Thunderbird 27.280
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:291 1.210
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:13.935
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.222
When I log in to a new session in English (en) 14.244
Then the keyboard layout is set to "us" 0.246
When the network is plugged 0.034
And Tor is ready 13.437
Then I successfully start the Unsafe Browser in "en" 27.875
And I kill the Unsafe Browser 5.767
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 31.776
And DuckDuckGo is the default search engine 5.530
And I kill the Tor Browser 5.326
And the screen keyboard works in Thunderbird 20.805
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:291 1.429
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.594
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.624
When I log in to a new session in French (fr) 28.707
Then the keyboard layout is set to "fr" 0.243
When the network is plugged 0.047
And Tor is ready 14.482
Then I successfully start the Unsafe Browser in "fr" 27.686
And I kill the Unsafe Browser 5.826
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 31.891
And DuckDuckGo is the default search engine 9.473
And I kill the Tor Browser 5.301
And the screen keyboard works in Thunderbird 23.555
And the layout of the screen keyboard is set to "fr" 0.594
After features/support/hooks.rb:291 1.097
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.979
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.698
When I log in to a new session in German (de) 27.506
Then the keyboard layout is set to "de" 0.128
When the network is plugged 0.032
And Tor is ready 15.821
Then I successfully start the Unsafe Browser in "de" 25.976
And I kill the Unsafe Browser 6.193
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 32.131
And DuckDuckGo is the default search engine 9.276
And I kill the Tor Browser 5.280
And the screen keyboard works in Thunderbird 21.236
And the layout of the screen keyboard is set to "de" 0.560
After features/support/hooks.rb:291 6.992
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.042
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.291
When I log in to a new session in Italian (it) 30.348
Then the keyboard layout is set to "it" 0.149
When the network is plugged 0.039
And Tor is ready 14.593
Then I successfully start the Unsafe Browser in "it" 26.094
And I kill the Unsafe Browser 5.784
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 30.727
And DuckDuckGo is the default search engine 9.247
And I kill the Tor Browser 5.326
And the screen keyboard works in Thunderbird 20.761
And the layout of the screen keyboard is set to "us" 0.545
After features/support/hooks.rb:291 1.106
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.992
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.689
When I log in to a new session in Persian (fa) 30.120
Then the keyboard layout is set to "ir" 0.130
When the network is plugged 0.053
And Tor is ready 14.866
Then I successfully start the Unsafe Browser in "fa" 27.317
And I kill the Unsafe Browser 6.591
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 34.914
And DuckDuckGo is the default search engine 8.888
And I kill the Tor Browser 5.296
And the screen keyboard works in Thunderbird 21.464
And the layout of the screen keyboard is set to "ir" 0.542
After features/support/hooks.rb:291 0.954
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.654
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.528
When I log in to a new session in Portuguese (pt) 28.536
Then the keyboard layout is set to "pt" 0.264
When the network is plugged 0.321
And Tor is ready 15.430
Then I successfully start the Unsafe Browser in "pt" 26.723
And I kill the Unsafe Browser 5.818
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 31.396
And DuckDuckGo is the default search engine 8.995
And I kill the Tor Browser 5.341
And the screen keyboard works in Thunderbird 21.578
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.786
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.944
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.508
When I log in to a new session in Russian (ru) 28.255
Then the keyboard layout is set to "ru" 0.225
When the network is plugged 0.044
And Tor is ready 14.251
Then I successfully start the Unsafe Browser in "ru" 27.230
And I kill the Unsafe Browser 5.876
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 32.671
And DuckDuckGo is the default search engine 16.427
And I kill the Tor Browser 5.538
And the screen keyboard works in Thunderbird 25.204
And the layout of the screen keyboard is set to "ru" 0.579
After features/support/hooks.rb:291 2.171
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.109
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.688
When I log in to a new session in Spanish (es) 27.730
Then the keyboard layout is set to "es" 0.261
When the network is plugged 0.037
And Tor is ready 15.549
Then I successfully start the Unsafe Browser in "es" 26.164
And I kill the Unsafe Browser 5.774
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 32.378
And DuckDuckGo is the default search engine 9.060
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 19.516
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:291 1.247
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.128
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.523
When I log in to a new session in Turkish (tr) 37.987
Then the keyboard layout is set to "tr" 0.344
When the network is plugged 0.062
And Tor is ready 13.309
Then I successfully start the Unsafe Browser in "tr" 26.023
And I kill the Unsafe Browser 5.870
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 32.147
And DuckDuckGo is the default search engine 9.412
And I kill the Tor Browser 5.328
And the screen keyboard works in Thunderbird 21.435
And the layout of the screen keyboard is set to "us" 0.537
After features/support/hooks.rb:291 1.295
After features/support/hooks.rb:75 0.000