Project Number Date
test_Tails_ISO_stable 4787 14 Apr 2024, 11:54

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 275 0 0 0 0 275 22 0 22 57:5.017 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.353
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.005
And I prepare Tails for memory erasure tests 0.441
When I start a process allocating 128 MiB of memory with a known pattern 1.197
Then patterns cover at least 128 MiB in the guest's memory 4.469 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.047
Then I find very few patterns in the guest's memory 4.191 
Pattern coverage: 0.000% (0 MiB out of 900 MiB reference memory)
After features/support/hooks.rb:305 0.691
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.942
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.158
And I prepare Tails for memory erasure tests 0.398
And I find very few patterns in the guest's memory 4.557 
Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.942
Then patterns cover at least 99% of the test FS size in the guest's memory 4.207 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.538
Then I find very few patterns in the guest's memory 4.139 
Pattern coverage: 0.000% (0 MiB out of 877 MiB reference memory)
After features/support/hooks.rb:305 0.753
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
39.606
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.257
And I prepare Tails for memory erasure tests 0.377
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.068
Then I find very few patterns in the guest's memory 3.767 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.856
Then patterns cover at least 86% of the test FS size in the guest's memory 3.356 
Pattern coverage: 86.594% (110 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.095
Then I find very few patterns in the guest's memory 3.526 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
# read cache
When I mount the USB drive again 0.303
And I read the content of the test FS 0.846
Then patterns cover at least 99% of the test FS size in the guest's memory 3.533 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.308
Then I find very few patterns in the guest's memory 4.309 
Pattern coverage: 0.000% (0 MiB out of 897 MiB reference memory)
After features/support/hooks.rb:305 0.686
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:11.534
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 7.915
And I prepare Tails for memory erasure tests 0.383
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 31.509
Then I find very few patterns in the guest's memory 3.843 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.020
Then patterns cover at least 99% of the test FS size in the guest's memory 3.545 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.704
Then I find very few patterns in the guest's memory 3.973 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# read cache
When I mount the USB drive again 9.469
And I read the content of the test FS 0.353
Then patterns cover at least 99% of the test FS size in the guest's memory 3.391 
Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.500
Then I find very few patterns in the guest's memory 3.924 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:305 1.048
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.714
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.187
And I prepare Tails for memory erasure tests 0.391
When I fill a 128 MiB file with a known pattern on the root filesystem 14.971
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 0.997
Then patterns cover at least 128 MiB in the guest's memory 2.366 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.767 
Pattern coverage: 0.000% (0 MiB out of 878 MiB reference memory)
After features/support/hooks.rb:305 3.542
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:33.104
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:51.163
And I prepare Tails for memory erasure tests 0.389
When I fill a 128 MiB file with a known pattern on the persistent filesystem 19.322
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.197 
Pattern coverage: 0.000% (0 MiB out of 907 MiB reference memory)
After features/support/hooks.rb:305 3.500
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:29.878
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 51.712
And I update APT using apt 17.792
And I install "popularity-contest" using apt 19.642
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.337
When I create a persistent storage and activate the Additional Software feature 20.296
Then Additional Software is correctly configured for package "popularity-contest" 1.309
When I shutdown Tails and wait for the computer to power off 10.425
And I start Tails from USB drive "__internal" with network unplugged 54.101
And I enable persistence 19.520
And I log in to a new session 33.414
And the Additional Software installation service has started 31.225
Then I am notified that the installation succeeded 2.117
And Additional Software is correctly configured for package "popularity-contest" 0.745
And the package "popularity-contest" is installed after Additional Software has been started 0.237
After features/support/hooks.rb:464 38.142
After features/support/hooks.rb:305 0.963
After features/support/hooks.rb:89 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:15.554
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.007
Given a computer 0.216
And I start Tails from USB drive "__internal" and I login with an administration password 1:33.882
And I update APT using apt 16.582
When I install "makepp" using apt 19.339
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.447
And the package "makepp" is installed 0.085
After features/support/hooks.rb:464 40.022
After features/support/hooks.rb:305 1.108
After features/support/hooks.rb:89 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:31.040
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.006
Given a computer 0.204
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:46.263
When I uninstall "popularity-contest" using apt 18.745
And I accept removing "popularity-contest" from Additional Software 0.542
Then "popularity-contest" is not in the list of Additional Software 0.733
When I start Synaptic 24.114
And I update APT using Synaptic 22.224
And I install "cowsay" using Synaptic 9.432
And I accept adding "cowsay" to Additional Software 3.359
Then Additional Software is correctly configured for package "cowsay" 0.783
When I uninstall "cowsay" using apt 3.261
And I refuse removing "cowsay" from Additional Software 0.541
Then Additional Software is correctly configured for package "cowsay" 0.746
When I start "Additional Software" via GNOME Activities Overview 10.501
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.378
Then "cowsay" is not in the list of Additional Software 0.864
When I install "cowsay" using apt 3.201
And I refuse adding "cowsay" to Additional Software 0.491
Then "cowsay" is not in the list of Additional Software 0.651
After features/support/hooks.rb:464 0.988
After features/support/hooks.rb:305 0.667
After features/support/hooks.rb:89 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:37.916
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.005
Given a computer 0.187
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:14.533
And I configure APT to prefer an old version of cowsay 0.024
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.518
And I accept adding "cowsay" to Additional Software 5.442
And Additional Software is correctly configured for package "cowsay" 0.951
And I shutdown Tails and wait for the computer to power off 6.344
And I start Tails from USB drive "__internal" with network unplugged 53.829
And I enable persistence 11.419
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.050
And I log in to a new session 32.920
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.954
And I revert the APT tweaks that made it prefer an old version of cowsay 0.046
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.067
And the network is plugged 0.058
And Tor is ready 18.059
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.025
And available upgrades have been checked 0.095
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.023
And I can open the Additional Software configuration window from the notification 2.971
And I shutdown Tails and wait for the computer to power off 2:6.650
And I start Tails from USB drive "__internal" with network unplugged 53.983
And I enable persistence 10.876
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 33.632
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.547
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
And the network is plugged 0.325
And Tor is ready 50.025
Then the Additional Software upgrade service has started 0.183
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.087
After features/support/hooks.rb:464 2.423
After features/support/hooks.rb:305 0.826
After features/support/hooks.rb:89 0.024
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:57.789
Before features/support/hooks.rb:259 0.005
Before features/support/hooks.rb:456 0.004
Given a computer 0.330
And I start Tails from USB drive "__internal" with network unplugged 53.693
And I enable persistence 9.739
And I remove the "cowsay" deb files from the APT cache 0.313
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.081
And I log in to a new session 32.997
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.571
And I can open the Additional Software log file from the notification 5.602
And the package "cowsay" is not installed 0.459
After features/support/hooks.rb:464 0.159
After features/support/hooks.rb:305 0.980
After features/support/hooks.rb:89 0.007
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:6.607
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.737
When I log in to a new session in Arabic (ar) 30.441
Then the keyboard layout is set to "us" 0.133
When the network is plugged 0.045
And Tor is ready 14.383
Then I successfully start the Unsafe Browser in "ar" 14.199
And I kill the Unsafe Browser 5.659
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 26.230
And DuckDuckGo is the default search engine 10.052
And I kill the Tor Browser 5.236
And the screen keyboard works in Thunderbird 11.861
And the layout of the screen keyboard is set to "us" 0.541
After features/support/hooks.rb:305 1.173
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.225
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.888
When I log in to a new session in Chinese (zh_CN) 29.988
Then the keyboard layout is set to "cn" 0.259
When the network is plugged 0.050
And Tor is ready 17.326
Then I successfully start the Unsafe Browser in "zh_CN" 15.832
And I kill the Unsafe Browser 5.723
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 23.314
And DuckDuckGo is the default search engine 10.128
And I kill the Tor Browser 5.266
And the screen keyboard works in Thunderbird 15.824
And the layout of the screen keyboard is set to "us" 0.519
After features/support/hooks.rb:305 1.722
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:44.968
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.710
When I log in to a new session in English (en) 14.745
Then the keyboard layout is set to "us" 0.135
When the network is plugged 0.059
And Tor is ready 14.951
Then I successfully start the Unsafe Browser in "en" 14.919
And I kill the Unsafe Browser 5.699
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 24.296
And DuckDuckGo is the default search engine 4.941
And I kill the Tor Browser 5.378
And the screen keyboard works in Thunderbird 11.488
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:305 1.058
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.398
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.776
When I log in to a new session in French (fr) 28.891
Then the keyboard layout is set to "fr" 0.221
When the network is plugged 0.047
And Tor is ready 15.927
Then I successfully start the Unsafe Browser in "fr" 13.861
And I kill the Unsafe Browser 5.858
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 25.306
And DuckDuckGo is the default search engine 18.344
And I kill the Tor Browser 5.429
And the screen keyboard works in Thunderbird 12.091
And the layout of the screen keyboard is set to "fr" 0.547
After features/support/hooks.rb:305 2.239
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.317
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.830
When I log in to a new session in German (de) 29.284
Then the keyboard layout is set to "de" 0.159
When the network is plugged 0.043
And Tor is ready 16.216
Then I successfully start the Unsafe Browser in "de" 14.463
And I kill the Unsafe Browser 5.664
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 25.173
And DuckDuckGo is the default search engine 17.765
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 11.546
And the layout of the screen keyboard is set to "de" 0.565
After features/support/hooks.rb:305 3.694
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:6.419
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.441
When I log in to a new session in Italian (it) 30.613
Then the keyboard layout is set to "it" 0.200
When the network is plugged 0.033
And Tor is ready 15.099
Then I successfully start the Unsafe Browser in "it" 13.982
And I kill the Unsafe Browser 5.633
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 25.151
And DuckDuckGo is the default search engine 10.048
And I kill the Tor Browser 5.213
And the screen keyboard works in Thunderbird 11.337
And the layout of the screen keyboard is set to "us" 0.552
After features/support/hooks.rb:305 1.032
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.827
Before features/support/hooks.rb:259 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.649
When I log in to a new session in Persian (fa) 28.411
Then the keyboard layout is set to "ir" 0.119
When the network is plugged 0.056
And Tor is ready 14.681
Then I successfully start the Unsafe Browser in "fa" 14.075
And I kill the Unsafe Browser 5.655
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 26.013
And DuckDuckGo is the default search engine 18.206
And I kill the Tor Browser 5.469
And the screen keyboard works in Thunderbird 11.843
And the layout of the screen keyboard is set to "ir" 0.548
After features/support/hooks.rb:305 1.236
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.573
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.619
When I log in to a new session in Portuguese (pt) 28.560
Then the keyboard layout is set to "pt" 0.246
When the network is plugged 0.044
And Tor is ready 14.797
Then I successfully start the Unsafe Browser in "pt" 13.736
And I kill the Unsafe Browser 5.707
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 25.334
And DuckDuckGo is the default search engine 18.101
And I kill the Tor Browser 5.380
And the screen keyboard works in Thunderbird 11.388
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:305 1.568
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:6.254
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.672
When I log in to a new session in Russian (ru) 29.320
Then the keyboard layout is set to "ru" 0.418
When the network is plugged 0.060
And Tor is ready 13.287
Then I successfully start the Unsafe Browser in "ru" 15.372
And I kill the Unsafe Browser 5.771
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 25.001
And DuckDuckGo is the default search engine 10.126
And I kill the Tor Browser 5.423
And the screen keyboard works in Thunderbird 13.177
And the layout of the screen keyboard is set to "ru" 0.534
After features/support/hooks.rb:305 1.227
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:3.426
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.669
When I log in to a new session in Spanish (es) 28.778
Then the keyboard layout is set to "es" 0.193
When the network is plugged 0.037
And Tor is ready 13.703
Then I successfully start the Unsafe Browser in "es" 14.675
And I kill the Unsafe Browser 5.852
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 24.736
And DuckDuckGo is the default search engine 10.038
And I kill the Tor Browser 5.213
And the screen keyboard works in Thunderbird 11.898
And the layout of the screen keyboard is set to "us" 0.537
After features/support/hooks.rb:305 1.291
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:2.559
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.749
When I log in to a new session in Turkish (tr) 28.758
Then the keyboard layout is set to "tr" 0.212
When the network is plugged 0.055
And Tor is ready 13.627
Then I successfully start the Unsafe Browser in "tr" 14.399
And I kill the Unsafe Browser 5.678
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 24.093
And DuckDuckGo is the default search engine 10.257
And I kill the Tor Browser 5.527
And the screen keyboard works in Thunderbird 11.563
And the layout of the screen keyboard is set to "us" 0.528
After features/support/hooks.rb:305 1.911
After features/support/hooks.rb:89 0.000