Project Number Date
test_Tails_ISO_devel 3182 28 Nov 2023, 16:11

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:24:14.758 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.011
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.291
And I prepare Tails for memory erasure tests 0.560
When I start a process allocating 128 MiB of memory with a known pattern 2.342
Then patterns cover at least 128 MiB in the guest's memory 3.490 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.494
Then I find very few patterns in the guest's memory 3.832 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 0.724
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:4.032
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.236
And I prepare Tails for memory erasure tests 0.455
And I find very few patterns in the guest's memory 4.044 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.854
Then patterns cover at least 99% of the test FS size in the guest's memory 3.345 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.190
Then I find very few patterns in the guest's memory 3.904 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 0.762
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:12.219
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.596
And I prepare Tails for memory erasure tests 0.623
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.796
Then I find very few patterns in the guest's memory 3.812 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:36.760
Then patterns cover at least 86% of the test FS size in the guest's memory 3.067 
Pattern coverage: 93.930% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.872
Then I find very few patterns in the guest's memory 3.626 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
# read cache
When I mount the USB drive again 0.372
And I read the content of the test FS 0.559
Then patterns cover at least 99% of the test FS size in the guest's memory 3.060 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.362
Then I find very few patterns in the guest's memory 3.708 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
After features/support/hooks.rb:291 2.592
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:34.112
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.316
And I prepare Tails for memory erasure tests 0.610
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.192
Then I find very few patterns in the guest's memory 3.909 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:37.236
Then patterns cover at least 99% of the test FS size in the guest's memory 2.863 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.571
Then I find very few patterns in the guest's memory 3.487 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
# read cache
When I mount the USB drive again 3.156
And I read the content of the test FS 0.650
Then patterns cover at least 99% of the test FS size in the guest's memory 2.560 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.197
Then I find very few patterns in the guest's memory 3.359 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 0.940
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.290
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.538
And I prepare Tails for memory erasure tests 0.541
When I fill a 128 MiB file with a known pattern on the root filesystem 12.852
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.605
Then patterns cover at least 128 MiB in the guest's memory 2.774 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.219
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.740 
Pattern coverage: 0.000% (0 MiB out of 1237 MiB reference memory)
After features/support/hooks.rb:291 3.449
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:3.658
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:16.885
And I prepare Tails for memory erasure tests 0.435
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.143
When I trigger shutdown 0.261
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.912 
Pattern coverage: 0.000% (0 MiB out of 1172 MiB reference memory)
After features/support/hooks.rb:291 3.416
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:20.472
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.002
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:23.969
And I update APT using apt 17.698
When I install "popularity-contest" using apt 19.550
Then I am notified I can not use Additional Software for "popularity-contest" 55.670
And I can open the Additional Software documentation from the notification 23.584
After features/support/hooks.rb:450 36.032
After features/support/hooks.rb:291 2.068
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:31.869
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.635
And I update APT using apt 17.099
And I install "popularity-contest" using apt 19.616
Then I am proposed to add the "popularity-contest" package to my Additional Software 55.797
When I create a persistent storage and activate the Additional Software feature 18.278
Then Additional Software is correctly configured for package "popularity-contest" 1.329
When I shutdown Tails and wait for the computer to power off 10.074
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:37.767
Then Additional Software is correctly configured for package "popularity-contest" 0.919
And the package "popularity-contest" is installed after Additional Software has been started 0.351
After features/support/hooks.rb:450 35.691
After features/support/hooks.rb:291 1.465
After features/support/hooks.rb:75 0.018
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:48.719
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.181
And I start Tails from USB drive "__internal" and I login with an administration password 1:16.318
And I update APT using apt 15.961
When I install "makepp" using apt 19.599
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 56.585
And the package "makepp" is installed 0.072
After features/support/hooks.rb:450 37.027
After features/support/hooks.rb:291 0.949
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.130
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.222
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:9.409
When I uninstall "popularity-contest" using apt 15.872
And I accept removing "popularity-contest" from Additional Software 0.683
Then "popularity-contest" is not in the list of Additional Software 0.731
When I start Synaptic 22.810
And I update APT using Synaptic 22.119
And I install "cowsay" using Synaptic 11.372
And I accept adding "cowsay" to Additional Software 0.837
Then Additional Software is correctly configured for package "cowsay" 0.881
When I uninstall "cowsay" using apt 3.339
And I refuse removing "cowsay" from Additional Software 0.705
Then Additional Software is correctly configured for package "cowsay" 0.855
When I start "Additional Software" via GNOME Activities Overview 12.384
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.310
Then "cowsay" is not in the list of Additional Software 0.897
When I install "cowsay" using apt 3.287
And I refuse adding "cowsay" to Additional Software 0.702
Then "cowsay" is not in the list of Additional Software 0.706
After features/support/hooks.rb:450 0.933
After features/support/hooks.rb:291 0.875
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:28.416
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.192
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 1:58.464
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.007
And I accept adding "cowsay" to Additional Software 1:2.690
And Additional Software is correctly configured for package "cowsay" 1.321
And I shutdown Tails and wait for the computer to power off 5.071
And I start Tails from USB drive "__internal" with network unplugged 43.871
And I enable persistence 31.420
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 20.963
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.010
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.094
And the network is plugged 0.041
And Tor is ready 18.094
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.267
And available upgrades have been checked 0.073
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.051
And I can open the Additional Software configuration window from the notification 2.208
And I shutdown Tails and wait for the computer to power off 2:3.757
And I start Tails from USB drive "__internal" with network unplugged 44.028
And I enable persistence 31.963
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 29.591
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.313
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
And the network is plugged 0.032
And Tor is ready 39.448
Then the Additional Software upgrade service has started 0.166
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.093
After features/support/hooks.rb:450 2.354
After features/support/hooks.rb:291 0.764
After features/support/hooks.rb:75 0.028
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:49.376
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.197
And I start Tails from USB drive "__internal" with network unplugged 43.828
And I enable persistence 31.890
And I remove the "cowsay" deb files from the APT cache 0.636
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.069
And I log in to a new session 28.059
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.525
And I can open the Additional Software log file from the notification 2.001
And the package "cowsay" is not installed 0.166
After features/support/hooks.rb:450 0.091
After features/support/hooks.rb:291 0.861
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.813
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.224
When I log in to a new session in Arabic (ar) 30.127
Then the keyboard layout is set to "us" 0.142
When the network is plugged 0.054
And Tor is ready 14.405
Then I successfully start the Unsafe Browser in "ar" 25.616
And I kill the Unsafe Browser 5.883
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 33.416
And DuckDuckGo is the default search engine 9.110
And I kill the Tor Browser 5.248
And the screen keyboard works in Thunderbird 20.883
And the layout of the screen keyboard is set to "us" 0.544
After features/support/hooks.rb:291 0.914
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.808
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.762
When I log in to a new session in Chinese (zh_CN) 30.752
Then the keyboard layout is set to "cn" 0.163
When the network is plugged 0.044
And Tor is ready 14.751
Then I successfully start the Unsafe Browser in "zh_CN" 27.271
And I kill the Unsafe Browser 6.273
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 33.257
And DuckDuckGo is the default search engine 9.181
And I kill the Tor Browser 5.318
And the screen keyboard works in Thunderbird 22.278
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:291 1.196
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.676
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.837
When I log in to a new session in English (en) 16.286
Then the keyboard layout is set to "us" 0.283
When the network is plugged 0.058
And Tor is ready 16.821
Then I successfully start the Unsafe Browser in "en" 25.819
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 31.387
And DuckDuckGo is the default search engine 5.231
And I kill the Tor Browser 5.309
And the screen keyboard works in Thunderbird 20.988
And the layout of the screen keyboard is set to "us" 0.707
After features/support/hooks.rb:291 1.277
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.108
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.598
When I log in to a new session in French (fr) 28.302
Then the keyboard layout is set to "fr" 0.236
When the network is plugged 0.038
And Tor is ready 16.919
Then I successfully start the Unsafe Browser in "fr" 26.119
And I kill the Unsafe Browser 6.020
When I enable the screen keyboard 0.149
Then the screen keyboard works in Tor Browser 32.420
And DuckDuckGo is the default search engine 8.982
And I kill the Tor Browser 5.279
And the screen keyboard works in Thunderbird 21.470
And the layout of the screen keyboard is set to "fr" 0.569
After features/support/hooks.rb:291 1.049
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.890
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.699
When I log in to a new session in German (de) 29.587
Then the keyboard layout is set to "de" 0.138
When the network is plugged 0.035
And Tor is ready 15.157
Then I successfully start the Unsafe Browser in "de" 24.488
And I kill the Unsafe Browser 5.921
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 31.709
And DuckDuckGo is the default search engine 9.475
And I kill the Tor Browser 5.300
And the screen keyboard works in Thunderbird 20.703
And the layout of the screen keyboard is set to "de" 0.540
After features/support/hooks.rb:291 1.240
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.358
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.634
When I log in to a new session in Italian (it) 30.045
Then the keyboard layout is set to "it" 1.237
When the network is plugged 0.053
And Tor is ready 16.045
Then I successfully start the Unsafe Browser in "it" 24.966
And I kill the Unsafe Browser 5.881
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 31.696
And DuckDuckGo is the default search engine 9.253
And I kill the Tor Browser 5.355
And the screen keyboard works in Thunderbird 21.532
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.025
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.050
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.600
When I log in to a new session in Persian (fa) 28.105
Then the keyboard layout is set to "ir" 0.134
When the network is plugged 0.053
And Tor is ready 15.530
Then I successfully start the Unsafe Browser in "fa" 28.048
And I kill the Unsafe Browser 5.699
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.316
And DuckDuckGo is the default search engine 9.043
And I kill the Tor Browser 5.292
And the screen keyboard works in Thunderbird 23.557
And the layout of the screen keyboard is set to "ir" 0.545
After features/support/hooks.rb:291 1.199
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.082
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.641
When I log in to a new session in Portuguese (pt) 30.026
Then the keyboard layout is set to "pt" 0.124
When the network is plugged 0.040
And Tor is ready 16.133
Then I successfully start the Unsafe Browser in "pt" 26.446
And I kill the Unsafe Browser 5.739
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 32.379
And DuckDuckGo is the default search engine 9.591
And I kill the Tor Browser 5.312
And the screen keyboard works in Thunderbird 20.971
And the layout of the screen keyboard is set to "us" 0.529
After features/support/hooks.rb:291 1.171
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.425
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.600
When I log in to a new session in Russian (ru) 33.322
Then the keyboard layout is set to "ru" 0.279
When the network is plugged 0.037
And Tor is ready 15.391
Then I successfully start the Unsafe Browser in "ru" 27.225
And I kill the Unsafe Browser 5.845
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 33.544
And DuckDuckGo is the default search engine 9.429
And I kill the Tor Browser 5.335
And the screen keyboard works in Thunderbird 22.756
And the layout of the screen keyboard is set to "ru" 0.576
After features/support/hooks.rb:291 1.149
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.794
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.646
When I log in to a new session in Spanish (es) 28.721
Then the keyboard layout is set to "es" 0.251
When the network is plugged 0.057
And Tor is ready 16.049
Then I successfully start the Unsafe Browser in "es" 26.187
And I kill the Unsafe Browser 5.694
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 32.213
And DuckDuckGo is the default search engine 9.220
And I kill the Tor Browser 5.364
And the screen keyboard works in Thunderbird 22.731
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:291 1.303
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.023
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.660
When I log in to a new session in Turkish (tr) 29.119
Then the keyboard layout is set to "tr" 0.145
When the network is plugged 0.063
And Tor is ready 16.577
Then I successfully start the Unsafe Browser in "tr" 26.157
And I kill the Unsafe Browser 5.829
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 31.739
And DuckDuckGo is the default search engine 10.267
And I kill the Tor Browser 5.639
And the screen keyboard works in Thunderbird 20.140
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:291 1.145
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:11.416
When the network is plugged 0.060
And I wait 720 seconds 12:0.098 
Slept for 720 seconds
Then I successfully configure Tor 11.207
And the time has synced 0.049
After features/support/hooks.rb:291 0.641
After features/support/hooks.rb:75 0.000