Project Number Date
test_Tails_ISO_stable 4561 10 Dec 2023, 12:12

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:48.440 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.338
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.336
And I prepare Tails for memory erasure tests 0.460
When I start a process allocating 128 MiB of memory with a known pattern 1.245
Then patterns cover at least 128 MiB in the guest's memory 4.360 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.234
Then I find very few patterns in the guest's memory 3.700 
Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)
After features/support/hooks.rb:291 0.747
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.657
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.377
And I prepare Tails for memory erasure tests 0.504
And I find very few patterns in the guest's memory 4.045 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.119
Then patterns cover at least 99% of the test FS size in the guest's memory 3.337 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.280
Then I find very few patterns in the guest's memory 3.991 
Pattern coverage: 0.000% (0 MiB out of 1230 MiB reference memory)
After features/support/hooks.rb:291 0.830
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:8.859
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.159
And I prepare Tails for memory erasure tests 0.456
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.819
Then I find very few patterns in the guest's memory 3.825 
Pattern coverage: 0.000% (0 MiB out of 1234 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:29.491
Then patterns cover at least 86% of the test FS size in the guest's memory 4.065 
Pattern coverage: 97.980% (122 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.848
Then I find very few patterns in the guest's memory 4.187 
Pattern coverage: 0.000% (0 MiB out of 1234 MiB reference memory)
# read cache
When I mount the USB drive again 0.238
And I read the content of the test FS 0.667
Then patterns cover at least 99% of the test FS size in the guest's memory 4.040 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.333
Then I find very few patterns in the guest's memory 4.724 
Pattern coverage: 0.000% (0 MiB out of 1234 MiB reference memory)
After features/support/hooks.rb:291 1.071
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:44.295
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.358
And I prepare Tails for memory erasure tests 0.516
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 23.588
Then I find very few patterns in the guest's memory 4.225 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:42.735
Then patterns cover at least 99% of the test FS size in the guest's memory 3.745 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.618
Then I find very few patterns in the guest's memory 3.312 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
# read cache
When I mount the USB drive again 3.605
And I read the content of the test FS 0.477
Then patterns cover at least 99% of the test FS size in the guest's memory 2.870 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 6.943
Then I find very few patterns in the guest's memory 3.296 
Pattern coverage: 0.000% (0 MiB out of 1232 MiB reference memory)
After features/support/hooks.rb:291 1.799
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.713
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.178
And I prepare Tails for memory erasure tests 0.510
When I fill a 128 MiB file with a known pattern on the root filesystem 13.254
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.546
Then patterns cover at least 128 MiB in the guest's memory 2.724 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.677
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.802 
Pattern coverage: 0.000% (0 MiB out of 1231 MiB reference memory)
After features/support/hooks.rb:291 3.512
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:1.614
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:15.461
And I prepare Tails for memory erasure tests 0.475
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.953
When I trigger shutdown 0.398
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.305 
Pattern coverage: 0.000% (0 MiB out of 1182 MiB reference memory)
After features/support/hooks.rb:291 3.462
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:40.258
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.876
And I update APT using apt 15.971
And I install "popularity-contest" using apt 19.332
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.269
When I create a persistent storage and activate the Additional Software feature 18.708
Then Additional Software is correctly configured for package "popularity-contest" 1.582
When I shutdown Tails and wait for the computer to power off 10.216
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:40.107
Then Additional Software is correctly configured for package "popularity-contest" 0.922
And the package "popularity-contest" is installed after Additional Software has been started 0.271
After features/support/hooks.rb:450 39.743
After features/support/hooks.rb:291 1.138
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:52.207
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.245
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.191
And I update APT using apt 15.354
When I install "makepp" using apt 19.768
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 57.425
And the package "makepp" is installed 0.223
After features/support/hooks.rb:450 37.253
After features/support/hooks.rb:291 1.058
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:48.666
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.206
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:6.057
When I uninstall "popularity-contest" using apt 16.067
And I accept removing "popularity-contest" from Additional Software 1.034
Then "popularity-contest" is not in the list of Additional Software 0.888
When I start Synaptic 23.356
And I update APT using Synaptic 22.126
And I install "cowsay" using Synaptic 9.124
And I accept adding "cowsay" to Additional Software 0.812
Then Additional Software is correctly configured for package "cowsay" 0.902
When I uninstall "cowsay" using apt 3.326
And I refuse removing "cowsay" from Additional Software 0.671
Then Additional Software is correctly configured for package "cowsay" 0.918
When I start "Additional Software" via GNOME Activities Overview 12.440
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.740
Then "cowsay" is not in the list of Additional Software 1.138
When I install "cowsay" using apt 3.277
And I refuse adding "cowsay" to Additional Software 0.704
Then "cowsay" is not in the list of Additional Software 0.873
After features/support/hooks.rb:450 1.481
After features/support/hooks.rb:291 0.912
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:3.371
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:7.544
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.869
And I accept adding "cowsay" to Additional Software 1:6.525
And Additional Software is correctly configured for package "cowsay" 1.361
And I shutdown Tails and wait for the computer to power off 6.089
And I start Tails from USB drive "__internal" with network unplugged 46.041
And I enable persistence 34.303
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 29.942
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.454
And I revert the APT tweaks that made it prefer an old version of cowsay 0.061
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.074
And the network is plugged 0.051
And Tor is ready 18.309
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.931
And available upgrades have been checked 0.134
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.063
And I can open the Additional Software configuration window from the notification 2.948
And I shutdown Tails and wait for the computer to power off 2:2.622
And I start Tails from USB drive "__internal" with network unplugged 46.217
And I enable persistence 33.084
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 31.989
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.396
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
And the network is plugged 0.032
And Tor is ready 41.670
Then the Additional Software upgrade service has started 0.200
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.115
After features/support/hooks.rb:450 2.860
After features/support/hooks.rb:291 0.900
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.396
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.207
And I start Tails from USB drive "__internal" with network unplugged 46.989
And I enable persistence 31.145
And I remove the "cowsay" deb files from the APT cache 0.672
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.085
And I log in to a new session 23.504
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.172
And I can open the Additional Software log file from the notification 2.391
And the package "cowsay" is not installed 0.228
After features/support/hooks.rb:450 0.102
After features/support/hooks.rb:291 0.806
After features/support/hooks.rb:75 0.012
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.214
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.608
When I log in to a new session in Arabic (ar) 31.059
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.034
And Tor is ready 15.796
Then I successfully start the Unsafe Browser in "ar" 26.965
And I kill the Unsafe Browser 5.877
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 33.883
And DuckDuckGo is the default search engine 9.820
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 22.967
And the layout of the screen keyboard is set to "us" 0.577
After features/support/hooks.rb:291 1.214
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.455
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.705
When I log in to a new session in Chinese (zh_CN) 29.289
Then the keyboard layout is set to "cn" 0.190
When the network is plugged 0.046
And Tor is ready 16.131
Then I successfully start the Unsafe Browser in "zh_CN" 27.086
And I kill the Unsafe Browser 5.907
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 34.413
And DuckDuckGo is the default search engine 9.514
And I kill the Tor Browser 5.308
And the screen keyboard works in Thunderbird 25.123
And the layout of the screen keyboard is set to "us" 0.608
After features/support/hooks.rb:291 3.858
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.866
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.999
When I log in to a new session in English (en) 15.469
Then the keyboard layout is set to "us" 0.200
When the network is plugged 0.034
And Tor is ready 14.502
Then I successfully start the Unsafe Browser in "en" 26.456
And I kill the Unsafe Browser 6.898
When I enable the screen keyboard 0.158
Then the screen keyboard works in Tor Browser 34.042
And DuckDuckGo is the default search engine 5.285
And I kill the Tor Browser 5.286
And the screen keyboard works in Thunderbird 21.957
And the layout of the screen keyboard is set to "us" 0.575
After features/support/hooks.rb:291 1.139
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.407
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.462
When I log in to a new session in French (fr) 30.350
Then the keyboard layout is set to "fr" 0.205
When the network is plugged 0.039
And Tor is ready 16.760
Then I successfully start the Unsafe Browser in "fr" 25.210
And I kill the Unsafe Browser 6.087
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 33.989
And DuckDuckGo is the default search engine 9.408
And I kill the Tor Browser 5.293
And the screen keyboard works in Thunderbird 22.885
And the layout of the screen keyboard is set to "fr" 0.610
After features/support/hooks.rb:291 2.232
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.033
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.645
When I log in to a new session in German (de) 31.177
Then the keyboard layout is set to "de" 0.128
When the network is plugged 0.037
And Tor is ready 15.314
Then I successfully start the Unsafe Browser in "de" 24.663
And I kill the Unsafe Browser 6.389
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 35.747
And DuckDuckGo is the default search engine 9.786
And I kill the Tor Browser 5.392
And the screen keyboard works in Thunderbird 21.026
And the layout of the screen keyboard is set to "de" 0.597
After features/support/hooks.rb:291 2.657
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.577
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.041
When I log in to a new session in Italian (it) 29.812
Then the keyboard layout is set to "it" 0.153
When the network is plugged 0.034
And Tor is ready 16.524
Then I successfully start the Unsafe Browser in "it" 27.086
And I kill the Unsafe Browser 5.733
When I enable the screen keyboard 0.150
Then the screen keyboard works in Tor Browser 34.493
And DuckDuckGo is the default search engine 10.196
And I kill the Tor Browser 5.392
And the screen keyboard works in Thunderbird 22.332
And the layout of the screen keyboard is set to "us" 0.624
After features/support/hooks.rb:291 1.056
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.449
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.921
When I log in to a new session in Persian (fa) 32.210
Then the keyboard layout is set to "ir" 0.121
When the network is plugged 0.032
And Tor is ready 14.490
Then I successfully start the Unsafe Browser in "fa" 27.645
And I kill the Unsafe Browser 6.268
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 35.646
And DuckDuckGo is the default search engine 9.923
And I kill the Tor Browser 5.410
And the screen keyboard works in Thunderbird 24.096
And the layout of the screen keyboard is set to "ir" 0.567
After features/support/hooks.rb:291 1.464
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.519
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.774
When I log in to a new session in Portuguese (pt) 30.830
Then the keyboard layout is set to "pt" 0.205
When the network is plugged 0.034
And Tor is ready 15.843
Then I successfully start the Unsafe Browser in "pt" 26.453
And I kill the Unsafe Browser 7.524
When I enable the screen keyboard 0.164
Then the screen keyboard works in Tor Browser 34.931
And DuckDuckGo is the default search engine 10.516
And I kill the Tor Browser 5.547
And the screen keyboard works in Thunderbird 22.108
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:291 0.977
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.955
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.869
When I log in to a new session in Russian (ru) 31.596
Then the keyboard layout is set to "ru" 0.209
When the network is plugged 0.050
And Tor is ready 15.296
Then I successfully start the Unsafe Browser in "ru" 29.285
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 36.037
And DuckDuckGo is the default search engine 10.142
And I kill the Tor Browser 5.399
And the screen keyboard works in Thunderbird 25.547
And the layout of the screen keyboard is set to "ru" 0.656
After features/support/hooks.rb:291 1.262
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.519
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.976
When I log in to a new session in Spanish (es) 29.951
Then the keyboard layout is set to "es" 0.154
When the network is plugged 0.051
And Tor is ready 15.936
Then I successfully start the Unsafe Browser in "es" 25.993
And I kill the Unsafe Browser 5.914
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 35.434
And DuckDuckGo is the default search engine 10.311
And I kill the Tor Browser 5.594
And the screen keyboard works in Thunderbird 23.388
And the layout of the screen keyboard is set to "us" 0.649
After features/support/hooks.rb:291 1.210
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.061
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.050
When I log in to a new session in Turkish (tr) 30.851
Then the keyboard layout is set to "tr" 0.146
When the network is plugged 0.053
And Tor is ready 16.271
Then I successfully start the Unsafe Browser in "tr" 28.808
And I kill the Unsafe Browser 7.754
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 35.362
And DuckDuckGo is the default search engine 10.030
And I kill the Tor Browser 5.386
And the screen keyboard works in Thunderbird 22.568
And the layout of the screen keyboard is set to "us" 0.623
After features/support/hooks.rb:291 3.716
After features/support/hooks.rb:75 0.000