Project Number Date
test_Tails_ISO_devel 3289 20 Feb 2024, 12:36

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:24:2.454 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.159
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.712
And I prepare Tails for memory erasure tests 0.457
When I start a process allocating 128 MiB of memory with a known pattern 1.259
Then patterns cover at least 128 MiB in the guest's memory 3.610 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.210
Then I find very few patterns in the guest's memory 3.909 
Pattern coverage: 0.000% (0 MiB out of 818 MiB reference memory)
After features/support/hooks.rb:291 0.881
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.308
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.712
And I prepare Tails for memory erasure tests 0.410
And I find very few patterns in the guest's memory 4.528 
Pattern coverage: 0.000% (0 MiB out of 820 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.714
Then patterns cover at least 99% of the test FS size in the guest's memory 4.157 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.465
Then I find very few patterns in the guest's memory 4.319 
Pattern coverage: 0.000% (0 MiB out of 820 MiB reference memory)
After features/support/hooks.rb:291 1.196
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
45.849
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.252
And I prepare Tails for memory erasure tests 0.664
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.073
Then I find very few patterns in the guest's memory 4.824 
Pattern coverage: 0.000% (0 MiB out of 825 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.787
Then patterns cover at least 86% of the test FS size in the guest's memory 4.801 
Pattern coverage: 92.062% (117 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.009
Then I find very few patterns in the guest's memory 4.487 
Pattern coverage: 0.000% (0 MiB out of 825 MiB reference memory)
# read cache
When I mount the USB drive again 0.353
And I read the content of the test FS 0.574
Then patterns cover at least 99% of the test FS size in the guest's memory 4.228 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.549
Then I find very few patterns in the guest's memory 4.240 
Pattern coverage: 0.000% (0 MiB out of 825 MiB reference memory)
After features/support/hooks.rb:291 1.303
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:13.086
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.038
And I prepare Tails for memory erasure tests 0.431
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 30.806
Then I find very few patterns in the guest's memory 4.073 
Pattern coverage: 0.000% (0 MiB out of 817 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.708
Then patterns cover at least 99% of the test FS size in the guest's memory 3.602 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 4.019
Then I find very few patterns in the guest's memory 3.962 
Pattern coverage: 0.000% (0 MiB out of 817 MiB reference memory)
# read cache
When I mount the USB drive again 6.389
And I read the content of the test FS 0.770
Then patterns cover at least 99% of the test FS size in the guest's memory 3.591 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.605
Then I find very few patterns in the guest's memory 5.086 
Pattern coverage: 0.000% (0 MiB out of 817 MiB reference memory)
After features/support/hooks.rb:291 0.760
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.959
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.732
And I prepare Tails for memory erasure tests 0.470
When I fill a 128 MiB file with a known pattern on the root filesystem 14.943
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.088
Then patterns cover at least 128 MiB in the guest's memory 3.243 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.537
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.922 
Pattern coverage: 0.000% (0 MiB out of 823 MiB reference memory)
After features/support/hooks.rb:291 3.490
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:40.892
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:57.060
And I prepare Tails for memory erasure tests 0.404
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.196
When I trigger shutdown 0.051
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.159 
Pattern coverage: 0.000% (0 MiB out of 845 MiB reference memory)
After features/support/hooks.rb:291 3.544
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
2:34.041
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.012
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:33.442
And I update APT using apt 13.251
When I install "popularity-contest" using apt 21.333
Then I am notified I can not use Additional Software for "popularity-contest" 4.857
And I can open the Additional Software documentation from the notification 21.156
After features/support/hooks.rb:450 26.801
After features/support/hooks.rb:291 2.264
After features/support/hooks.rb:75 0.003
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:37.354
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 58.278
And I update APT using apt 11.706
And I install "popularity-contest" using apt 19.422
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.318
When I create a persistent storage and activate the Additional Software feature 21.481
Then Additional Software is correctly configured for package "popularity-contest" 1.656
When I shutdown Tails and wait for the computer to power off 11.086
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 3:26.372
Then Additional Software is correctly configured for package "popularity-contest" 0.785
And the package "popularity-contest" is installed after Additional Software has been started 0.247
After features/support/hooks.rb:450 27.094
After features/support/hooks.rb:291 1.221
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:44.232
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.009
Given a computer 0.305
And I start Tails from USB drive "__internal" and I login with an administration password 2:8.902
And I update APT using apt 11.036
When I install "makepp" using apt 19.241
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.641
And the package "makepp" is installed 0.105
After features/support/hooks.rb:450 30.037
After features/support/hooks.rb:291 1.016
After features/support/hooks.rb:75 0.033
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:34.627
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.206
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:52.668
When I uninstall "popularity-contest" using apt 18.718
And I accept removing "popularity-contest" from Additional Software 0.579
Then "popularity-contest" is not in the list of Additional Software 0.759
When I start Synaptic 21.785
And I update APT using Synaptic 22.161
And I install "cowsay" using Synaptic 10.240
And I accept adding "cowsay" to Additional Software 1.780
Then Additional Software is correctly configured for package "cowsay" 0.863
When I uninstall "cowsay" using apt 3.274
And I refuse removing "cowsay" from Additional Software 0.613
Then Additional Software is correctly configured for package "cowsay" 0.813
When I start "Additional Software" via GNOME Activities Overview 10.311
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.322
Then "cowsay" is not in the list of Additional Software 1.094
When I install "cowsay" using apt 3.214
And I refuse adding "cowsay" to Additional Software 0.565
Then "cowsay" is not in the list of Additional Software 0.653
After features/support/hooks.rb:450 1.373
After features/support/hooks.rb:291 0.722
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:7.689
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.004
Given a computer 0.205
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.838
And I configure APT to prefer an old version of cowsay 0.027
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 22.487
And I accept adding "cowsay" to Additional Software 6.120
And Additional Software is correctly configured for package "cowsay" 1.051
And I shutdown Tails and wait for the computer to power off 6.092
And I start Tails from USB drive "__internal" with network unplugged 1:8.351
And I enable persistence 34.948
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 1:13.147
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.252
And I revert the APT tweaks that made it prefer an old version of cowsay 0.074
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.096
And the network is plugged 0.049
And Tor is ready 19.184
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.756
And available upgrades have been checked 0.070
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.386
And I can open the Additional Software configuration window from the notification 5.715
And I shutdown Tails and wait for the computer to power off 18.122
And I start Tails from USB drive "__internal" with network unplugged 1:0.041
And I enable persistence 32.054
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 1:7.262
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.114
And I revert the APT tweaks that made it prefer an old version of cowsay 0.087
And the network is plugged 0.044
And Tor is ready 47.756
Then the Additional Software upgrade service has started 0.198
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.101
After features/support/hooks.rb:450 2.361
After features/support/hooks.rb:291 0.689
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:54.871
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.181
And I start Tails from USB drive "__internal" with network unplugged 59.840
And I enable persistence 38.217
And I remove the "cowsay" deb files from the APT cache 0.638
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.088
And I log in to a new session 1:1.281
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 9.784
And I can open the Additional Software log file from the notification 4.350
And the package "cowsay" is not installed 0.487
After features/support/hooks.rb:450 0.110
After features/support/hooks.rb:291 0.915
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.186
Before features/support/hooks.rb:245 0.015
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.751
When I log in to a new session in Arabic (ar) 32.733
Then the keyboard layout is set to "us" 0.131
When the network is plugged 0.034
And Tor is ready 15.518
Then I successfully start the Unsafe Browser in "ar" 14.471
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 34.329
And DuckDuckGo is the default search engine 32.267
And I kill the Tor Browser 5.516
And the screen keyboard works in Thunderbird 20.856
And the layout of the screen keyboard is set to "us" 0.619
After features/support/hooks.rb:291 3.708
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.200
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.977
When I log in to a new session in Chinese (zh_CN) 31.370
Then the keyboard layout is set to "cn" 0.118
When the network is plugged 0.039
And Tor is ready 18.788
Then I successfully start the Unsafe Browser in "zh_CN" 15.955
And I kill the Unsafe Browser 5.772
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 33.917
And DuckDuckGo is the default search engine 10.857
And I kill the Tor Browser 5.583
And the screen keyboard works in Thunderbird 24.068
And the layout of the screen keyboard is set to "us" 0.635
After features/support/hooks.rb:291 1.722
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.419
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.983
When I log in to a new session in English (en) 19.729
Then the keyboard layout is set to "us" 0.161
When the network is plugged 0.187
And Tor is ready 17.391
Then I successfully start the Unsafe Browser in "en" 15.600
And I kill the Unsafe Browser 5.712
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 34.243
And DuckDuckGo is the default search engine 5.245
And I kill the Tor Browser 5.238
And the screen keyboard works in Thunderbird 20.207
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.140
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.389
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.233
When I log in to a new session in French (fr) 32.770
Then the keyboard layout is set to "fr" 0.162
When the network is plugged 0.041
And Tor is ready 16.663
Then I successfully start the Unsafe Browser in "fr" 15.235
And I kill the Unsafe Browser 5.778
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 34.245
And DuckDuckGo is the default search engine 22.992
And I kill the Tor Browser 5.553
And the screen keyboard works in Thunderbird 21.003
And the layout of the screen keyboard is set to "fr" 0.591
After features/support/hooks.rb:291 1.503
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.854
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.483
When I log in to a new session in German (de) 30.781
Then the keyboard layout is set to "de" 0.113
When the network is plugged 0.042
And Tor is ready 16.953
Then I successfully start the Unsafe Browser in "de" 14.264
And I kill the Unsafe Browser 5.797
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 33.050
And DuckDuckGo is the default search engine 18.830
And I kill the Tor Browser 5.496
And the screen keyboard works in Thunderbird 20.361
And the layout of the screen keyboard is set to "de" 0.542
After features/support/hooks.rb:291 1.345
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.179
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.841
When I log in to a new session in Italian (it) 30.806
Then the keyboard layout is set to "it" 0.120
When the network is plugged 0.259
And Tor is ready 18.721
Then I successfully start the Unsafe Browser in "it" 16.051
And I kill the Unsafe Browser 5.819
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 32.285
And DuckDuckGo is the default search engine 10.896
And I kill the Tor Browser 5.487
And the screen keyboard works in Thunderbird 23.197
And the layout of the screen keyboard is set to "us" 0.579
After features/support/hooks.rb:291 2.003
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.302
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.141
When I log in to a new session in Persian (fa) 32.188
Then the keyboard layout is set to "ir" 0.130
When the network is plugged 0.036
And Tor is ready 18.203
Then I successfully start the Unsafe Browser in "fa" 15.021
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 35.203
And DuckDuckGo is the default search engine 10.534
And I kill the Tor Browser 5.722
And the screen keyboard works in Thunderbird 22.516
And the layout of the screen keyboard is set to "ir" 0.666
After features/support/hooks.rb:291 1.777
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.988
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.271
When I log in to a new session in Portuguese (pt) 32.859
Then the keyboard layout is set to "pt" 0.153
When the network is plugged 0.048
And Tor is ready 16.378
Then I successfully start the Unsafe Browser in "pt" 15.028
And I kill the Unsafe Browser 5.923
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 35.343
And DuckDuckGo is the default search engine 21.027
And I kill the Tor Browser 5.905
And the screen keyboard works in Thunderbird 20.324
And the layout of the screen keyboard is set to "us" 0.601
After features/support/hooks.rb:291 1.761
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:47.529
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.535
When I log in to a new session in Russian (ru) 32.192
Then the keyboard layout is set to "ru" 0.171
When the network is plugged 0.050
And Tor is ready 18.228
Then I successfully start the Unsafe Browser in "ru" 14.952
And I kill the Unsafe Browser 5.884
When I enable the screen keyboard 0.115
Then the screen keyboard works in Tor Browser 34.794
And DuckDuckGo is the default search engine 23.160
And I kill the Tor Browser 5.574
And the screen keyboard works in Thunderbird 23.082
And the layout of the screen keyboard is set to "ru" 0.786
After features/support/hooks.rb:291 1.846
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.367
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.496
When I log in to a new session in Spanish (es) 33.065
Then the keyboard layout is set to "es" 0.213
When the network is plugged 0.860
And Tor is ready 16.705
Then I successfully start the Unsafe Browser in "es" 15.355
And I kill the Unsafe Browser 5.886
When I enable the screen keyboard 0.193
Then the screen keyboard works in Tor Browser 32.714
And DuckDuckGo is the default search engine 27.479
And I kill the Tor Browser 5.629
And the screen keyboard works in Thunderbird 22.095
And the layout of the screen keyboard is set to "us" 0.671
After features/support/hooks.rb:291 1.721
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.597
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.488
When I log in to a new session in Turkish (tr) 34.321
Then the keyboard layout is set to "tr" 0.156
When the network is plugged 0.039
And Tor is ready 14.962
Then I successfully start the Unsafe Browser in "tr" 15.565
And I kill the Unsafe Browser 5.995
When I enable the screen keyboard 0.155
Then the screen keyboard works in Tor Browser 35.917
And DuckDuckGo is the default search engine 19.494
And I kill the Tor Browser 5.530
And the screen keyboard works in Thunderbird 20.390
And the layout of the screen keyboard is set to "us" 0.578
After features/support/hooks.rb:291 1.682
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:13.366
When the network is plugged 0.037
And I wait 720 seconds 12:0.085 
Slept for 720 seconds
Then I successfully configure Tor 13.199
And the time has synced 0.043
After features/support/hooks.rb:291 0.691
After features/support/hooks.rb:75 0.000