Project Number Date
test_Tails_ISO_stable 4753 27 Mar 2024, 19:45

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 59:14.598 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.934
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.136
And I prepare Tails for memory erasure tests 0.438
When I start a process allocating 128 MiB of memory with a known pattern 1.412
Then patterns cover at least 128 MiB in the guest's memory 3.845 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.205
Then I find very few patterns in the guest's memory 3.895 
Pattern coverage: 0.000% (0 MiB out of 909 MiB reference memory)
After features/support/hooks.rb:291 1.146
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.291
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.086
And I prepare Tails for memory erasure tests 0.401
And I find very few patterns in the guest's memory 3.791 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.636
Then patterns cover at least 99% of the test FS size in the guest's memory 3.306 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.323
Then I find very few patterns in the guest's memory 3.745 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
After features/support/hooks.rb:291 0.820
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
44.683
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.096
And I prepare Tails for memory erasure tests 0.429
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.802
Then I find very few patterns in the guest's memory 3.932 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.595
Then patterns cover at least 86% of the test FS size in the guest's memory 3.365 
Pattern coverage: 93.810% (119 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.871
Then I find very few patterns in the guest's memory 4.628 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
# read cache
When I mount the USB drive again 0.235
And I read the content of the test FS 2.355
Then patterns cover at least 99% of the test FS size in the guest's memory 3.899 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.791
Then I find very few patterns in the guest's memory 4.680 
Pattern coverage: 0.000% (0 MiB out of 904 MiB reference memory)
After features/support/hooks.rb:291 0.835
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:15.885
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.470
And I prepare Tails for memory erasure tests 0.464
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.525
Then I find very few patterns in the guest's memory 4.765 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.002
Then patterns cover at least 99% of the test FS size in the guest's memory 2.597 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.768
Then I find very few patterns in the guest's memory 4.403 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# read cache
When I mount the USB drive again 6.293
And I read the content of the test FS 0.488
Then patterns cover at least 99% of the test FS size in the guest's memory 6.031 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.739
Then I find very few patterns in the guest's memory 8.332 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
After features/support/hooks.rb:291 0.711
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.491
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.156
And I prepare Tails for memory erasure tests 0.417
When I fill a 128 MiB file with a known pattern on the root filesystem 14.739
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.714
Then patterns cover at least 128 MiB in the guest's memory 2.615 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.014
And I wait 20 seconds 20.010 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.823 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
After features/support/hooks.rb:291 3.547
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:34.628
Before features/support/hooks.rb:245 0.007
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:51.532
And I prepare Tails for memory erasure tests 0.430
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.349
When I trigger shutdown 0.010
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.289 
Pattern coverage: 0.000% (0 MiB out of 890 MiB reference memory)
After features/support/hooks.rb:291 3.580
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:50.446
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:5.199
And I update APT using apt 18.013
And I install "popularity-contest" using apt 19.574
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.897
When I create a persistent storage and activate the Additional Software feature 21.250
Then Additional Software is correctly configured for package "popularity-contest" 1.521
When I shutdown Tails and wait for the computer to power off 10.771
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:25.164
Then Additional Software is correctly configured for package "popularity-contest" 0.808
And the package "popularity-contest" is installed after Additional Software has been started 0.243
After features/support/hooks.rb:450 37.192
After features/support/hooks.rb:291 1.139
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:10.970
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with an administration password 1:30.385
And I update APT using apt 16.550
When I install "makepp" using apt 19.228
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.512
And the package "makepp" is installed 0.073
After features/support/hooks.rb:450 40.798
After features/support/hooks.rb:291 0.924
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:31.179
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.219
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:46.139
When I uninstall "popularity-contest" using apt 18.853
And I accept removing "popularity-contest" from Additional Software 0.530
Then "popularity-contest" is not in the list of Additional Software 0.743
When I start Synaptic 24.176
And I update APT using Synaptic 22.479
And I install "cowsay" using Synaptic 11.766
And I accept adding "cowsay" to Additional Software 0.624
Then Additional Software is correctly configured for package "cowsay" 0.897
When I uninstall "cowsay" using apt 3.273
And I refuse removing "cowsay" from Additional Software 0.563
Then Additional Software is correctly configured for package "cowsay" 0.792
When I start "Additional Software" via GNOME Activities Overview 10.625
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.267
Then "cowsay" is not in the list of Additional Software 0.887
When I install "cowsay" using apt 3.206
And I refuse adding "cowsay" to Additional Software 0.519
Then "cowsay" is not in the list of Additional Software 0.614
After features/support/hooks.rb:450 0.947
After features/support/hooks.rb:291 0.632
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:23.376
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.178
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:4.140
And I configure APT to prefer an old version of cowsay 0.033
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.149
And I accept adding "cowsay" to Additional Software 5.398
And Additional Software is correctly configured for package "cowsay" 0.812
And I shutdown Tails and wait for the computer to power off 6.373
And I start Tails from USB drive "__internal" with network unplugged 53.776
And I enable persistence 10.561
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 35.003
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.293
And I revert the APT tweaks that made it prefer an old version of cowsay 0.044
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.064
And the network is plugged 0.043
And Tor is ready 19.493
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.139
And available upgrades have been checked 0.080
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.008
And I can open the Additional Software configuration window from the notification 2.944
And I shutdown Tails and wait for the computer to power off 2:8.267
And I start Tails from USB drive "__internal" with network unplugged 54.548
And I enable persistence 11.585
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 34.510
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.754
And I revert the APT tweaks that made it prefer an old version of cowsay 0.069
And the network is plugged 0.039
And Tor is ready 39.751
Then the Additional Software upgrade service has started 0.170
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.085
After features/support/hooks.rb:450 2.432
After features/support/hooks.rb:291 1.009
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:48.968
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.225
And I start Tails from USB drive "__internal" with network unplugged 54.463
And I enable persistence 10.250
And I remove the "cowsay" deb files from the APT cache 0.635
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.101
And I log in to a new session 32.768
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 5.692
And I can open the Additional Software log file from the notification 4.377
And the package "cowsay" is not installed 0.452
After features/support/hooks.rb:450 0.107
After features/support/hooks.rb:291 0.927
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.017
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.930
When I log in to a new session in Arabic (ar) 29.165
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.031
And Tor is ready 16.706
Then I successfully start the Unsafe Browser in "ar" 13.532
And I kill the Unsafe Browser 5.817
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 26.415
And DuckDuckGo is the default search engine 18.227
And I kill the Tor Browser 5.451
And the screen keyboard works in Thunderbird 13.957
And the layout of the screen keyboard is set to "us" 0.521
After features/support/hooks.rb:291 1.372
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.476
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.245
When I log in to a new session in Chinese (zh_CN) 29.979
Then the keyboard layout is set to "cn" 0.200
When the network is plugged 0.038
And Tor is ready 15.465
Then I successfully start the Unsafe Browser in "zh_CN" 16.165
And I kill the Unsafe Browser 5.697
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 25.773
And DuckDuckGo is the default search engine 22.324
And I kill the Tor Browser 5.460
And the screen keyboard works in Thunderbird 16.397
And the layout of the screen keyboard is set to "us" 0.616
After features/support/hooks.rb:291 1.456
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:50.482
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.175
When I log in to a new session in English (en) 14.850
Then the keyboard layout is set to "us" 0.183
When the network is plugged 0.034
And Tor is ready 13.692
Then I successfully start the Unsafe Browser in "en" 14.686
And I kill the Unsafe Browser 5.612
When I enable the screen keyboard 0.088
Then the screen keyboard works in Tor Browser 25.222
And DuckDuckGo is the default search engine 9.836
And I kill the Tor Browser 5.265
And the screen keyboard works in Thunderbird 12.202
And the layout of the screen keyboard is set to "us" 0.633
After features/support/hooks.rb:291 0.966
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.190
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.610
When I log in to a new session in French (fr) 28.930
Then the keyboard layout is set to "fr" 0.234
When the network is plugged 0.049
And Tor is ready 14.667
Then I successfully start the Unsafe Browser in "fr" 15.186
And I kill the Unsafe Browser 5.688
When I enable the screen keyboard 0.088
Then the screen keyboard works in Tor Browser 24.678
And DuckDuckGo is the default search engine 22.223
And I kill the Tor Browser 5.471
And the screen keyboard works in Thunderbird 13.803
And the layout of the screen keyboard is set to "fr" 0.556
After features/support/hooks.rb:291 0.975
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.834
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.933
When I log in to a new session in German (de) 29.599
Then the keyboard layout is set to "de" 0.126
When the network is plugged 0.036
And Tor is ready 16.076
Then I successfully start the Unsafe Browser in "de" 14.243
And I kill the Unsafe Browser 5.699
When I enable the screen keyboard 0.079
Then the screen keyboard works in Tor Browser 25.981
And DuckDuckGo is the default search engine 19.353
And I kill the Tor Browser 5.477
And the screen keyboard works in Thunderbird 11.678
And the layout of the screen keyboard is set to "de" 0.548
After features/support/hooks.rb:291 1.272
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.050
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.775
When I log in to a new session in Italian (it) 31.468
Then the keyboard layout is set to "it" 0.411
When the network is plugged 0.036
And Tor is ready 16.683
Then I successfully start the Unsafe Browser in "it" 14.695
And I kill the Unsafe Browser 5.825
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 26.670
And DuckDuckGo is the default search engine 22.416
And I kill the Tor Browser 5.453
And the screen keyboard works in Thunderbird 12.890
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:291 4.409
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.717
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.996
When I log in to a new session in Persian (fa) 29.098
Then the keyboard layout is set to "ir" 0.199
When the network is plugged 0.107
And Tor is ready 17.884
Then I successfully start the Unsafe Browser in "fa" 14.536
And I kill the Unsafe Browser 5.919
When I enable the screen keyboard 0.101
Then the screen keyboard works in Tor Browser 26.220
And DuckDuckGo is the default search engine 19.347
And I kill the Tor Browser 5.498
And the screen keyboard works in Thunderbird 12.245
And the layout of the screen keyboard is set to "ir" 0.560
After features/support/hooks.rb:291 1.291
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.061
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.839
When I log in to a new session in Portuguese (pt) 31.421
Then the keyboard layout is set to "pt" 0.195
When the network is plugged 0.034
And Tor is ready 14.180
Then I successfully start the Unsafe Browser in "pt" 16.698
And I kill the Unsafe Browser 5.798
When I enable the screen keyboard 0.097
Then the screen keyboard works in Tor Browser 25.770
And DuckDuckGo is the default search engine 21.193
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 11.754
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 1.392
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.690
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 21.427
When I log in to a new session in Russian (ru) 29.808
Then the keyboard layout is set to "ru" 0.367
When the network is plugged 0.036
And Tor is ready 16.648
Then I successfully start the Unsafe Browser in "ru" 14.673
And I kill the Unsafe Browser 5.743
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 24.699
And DuckDuckGo is the default search engine 20.597
And I kill the Tor Browser 5.564
And the screen keyboard works in Thunderbird 13.424
And the layout of the screen keyboard is set to "ru" 0.577
After features/support/hooks.rb:291 1.105
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.219
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.982
When I log in to a new session in Spanish (es) 31.477
Then the keyboard layout is set to "es" 0.113
When the network is plugged 0.064
And Tor is ready 16.063
Then I successfully start the Unsafe Browser in "es" 13.429
And I kill the Unsafe Browser 5.739
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 26.525
And DuckDuckGo is the default search engine 18.248
And I kill the Tor Browser 5.456
And the screen keyboard works in Thunderbird 11.473
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.329
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.999
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.908
When I log in to a new session in Turkish (tr) 28.350
Then the keyboard layout is set to "tr" 0.155
When the network is plugged 0.050
And Tor is ready 14.386
Then I successfully start the Unsafe Browser in "tr" 15.606
And I kill the Unsafe Browser 5.915
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 26.677
And DuckDuckGo is the default search engine 19.020
And I kill the Tor Browser 5.551
And the screen keyboard works in Thunderbird 11.664
And the layout of the screen keyboard is set to "us" 0.605
After features/support/hooks.rb:291 1.021
After features/support/hooks.rb:75 0.000