Project Number Date
test_Tails_ISO_stable 4718 14 Mar 2024, 12:19

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:3:14.086 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.062
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.517
And I prepare Tails for memory erasure tests 0.531
When I start a process allocating 128 MiB of memory with a known pattern 1.198
Then patterns cover at least 128 MiB in the guest's memory 3.407 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.209
Then I find very few patterns in the guest's memory 4.198 
Pattern coverage: 0.000% (0 MiB out of 938 MiB reference memory)
After features/support/hooks.rb:291 0.971
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.296
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.226
And I prepare Tails for memory erasure tests 0.399
And I find very few patterns in the guest's memory 3.763 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.679
Then patterns cover at least 99% of the test FS size in the guest's memory 3.324 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.449
Then I find very few patterns in the guest's memory 4.452 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
After features/support/hooks.rb:291 1.037
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
43.975
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.074
And I prepare Tails for memory erasure tests 0.437
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.837
Then I find very few patterns in the guest's memory 4.085 
Pattern coverage: 0.000% (0 MiB out of 943 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.343
Then patterns cover at least 86% of the test FS size in the guest's memory 5.212 
Pattern coverage: 93.326% (119 MiB out of 127 MiB reference memory)
When I umount the USB drive 2.512
Then I find very few patterns in the guest's memory 4.252 
Pattern coverage: 0.000% (0 MiB out of 943 MiB reference memory)
# read cache
When I mount the USB drive again 0.402
And I read the content of the test FS 0.701
Then patterns cover at least 99% of the test FS size in the guest's memory 3.287 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.954
Then I find very few patterns in the guest's memory 3.875 
Pattern coverage: 0.000% (0 MiB out of 943 MiB reference memory)
After features/support/hooks.rb:291 1.341
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:15.115
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.055
And I prepare Tails for memory erasure tests 0.371
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 31.557
Then I find very few patterns in the guest's memory 3.164 
Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.620
Then patterns cover at least 99% of the test FS size in the guest's memory 3.559 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.898
Then I find very few patterns in the guest's memory 4.656 
Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)
# read cache
When I mount the USB drive again 12.967
And I read the content of the test FS 0.431
Then patterns cover at least 99% of the test FS size in the guest's memory 3.417 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.965
Then I find very few patterns in the guest's memory 3.449 
Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)
After features/support/hooks.rb:291 3.800
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.308
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 9.866
And I prepare Tails for memory erasure tests 0.560
When I fill a 128 MiB file with a known pattern on the root filesystem 12.279
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.950
Then patterns cover at least 128 MiB in the guest's memory 2.617 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.999 
Pattern coverage: 0.000% (0 MiB out of 935 MiB reference memory)
After features/support/hooks.rb:291 3.515
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:49.997
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:2.093
And I prepare Tails for memory erasure tests 0.408
When I fill a 128 MiB file with a known pattern on the persistent filesystem 25.150
When I trigger shutdown 0.036
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.288 
Pattern coverage: 0.000% (0 MiB out of 951 MiB reference memory)
After features/support/hooks.rb:291 3.550
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:39.537
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.543
And I update APT using apt 16.680
And I install "popularity-contest" using apt 22.551
Then I am proposed to add the "popularity-contest" package to my Additional Software 4.766
When I create a persistent storage and activate the Additional Software feature 22.281
Then Additional Software is correctly configured for package "popularity-contest" 1.384
When I shutdown Tails and wait for the computer to power off 12.028
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:28.191
Then Additional Software is correctly configured for package "popularity-contest" 0.809
And the package "popularity-contest" is installed after Additional Software has been started 0.300
After features/support/hooks.rb:450 40.736
After features/support/hooks.rb:291 1.185
After features/support/hooks.rb:75 0.021
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:18.320
Before features/support/hooks.rb:245 0.009
Before features/support/hooks.rb:442 0.020
Given a computer 0.306
And I start Tails from USB drive "__internal" and I login with an administration password 1:32.409
And I update APT using apt 18.052
When I install "makepp" using apt 23.207
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 4.250
And the package "makepp" is installed 0.094
After features/support/hooks.rb:450 40.219
After features/support/hooks.rb:291 0.882
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:49.686
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.211
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:4.081
When I uninstall "popularity-contest" using apt 19.152
And I accept removing "popularity-contest" from Additional Software 0.580
Then "popularity-contest" is not in the list of Additional Software 0.672
When I start Synaptic 23.475
And I update APT using Synaptic 22.312
And I install "cowsay" using Synaptic 9.985
And I accept adding "cowsay" to Additional Software 1.957
Then Additional Software is correctly configured for package "cowsay" 0.837
When I uninstall "cowsay" using apt 3.248
And I refuse removing "cowsay" from Additional Software 0.589
Then Additional Software is correctly configured for package "cowsay" 0.835
When I start "Additional Software" via GNOME Activities Overview 10.752
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.514
Then "cowsay" is not in the list of Additional Software 1.025
When I install "cowsay" using apt 3.244
And I refuse adding "cowsay" to Additional Software 0.552
Then "cowsay" is not in the list of Additional Software 0.656
After features/support/hooks.rb:450 1.452
After features/support/hooks.rb:291 0.767
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:11.466
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.009
Given a computer 0.231
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:11.323
And I configure APT to prefer an old version of cowsay 0.032
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.272
And I accept adding "cowsay" to Additional Software 6.966
And Additional Software is correctly configured for package "cowsay" 1.044
And I shutdown Tails and wait for the computer to power off 5.169
And I start Tails from USB drive "__internal" with network unplugged 56.172
And I enable persistence 11.428
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 34.504
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.998
And I revert the APT tweaks that made it prefer an old version of cowsay 0.052
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.063
And the network is plugged 0.044
And Tor is ready 46.199
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.512
And available upgrades have been checked 0.164
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.993
And I can open the Additional Software configuration window from the notification 3.631
And I shutdown Tails and wait for the computer to power off 2:6.832
And I start Tails from USB drive "__internal" with network unplugged 1:3.798
And I enable persistence 12.906
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 34.073
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.289
And I revert the APT tweaks that made it prefer an old version of cowsay 0.077
And the network is plugged 0.051
And Tor is ready 41.337
Then the Additional Software upgrade service has started 0.155
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.091
After features/support/hooks.rb:450 2.384
After features/support/hooks.rb:291 0.744
After features/support/hooks.rb:75 0.055
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:6.645
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.218
And I start Tails from USB drive "__internal" with network unplugged 56.917
And I enable persistence 13.120
And I remove the "cowsay" deb files from the APT cache 0.946
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.094
And I log in to a new session 34.736
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.792
And I can open the Additional Software log file from the notification 4.927
And the package "cowsay" is not installed 0.892
After features/support/hooks.rb:450 0.151
After features/support/hooks.rb:291 0.971
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:56.036
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.155
When I log in to a new session in Arabic (ar) 29.864
Then the keyboard layout is set to "us" 0.181
When the network is plugged 0.083
And Tor is ready 43.582
Then I successfully start the Unsafe Browser in "ar" 13.859
And I kill the Unsafe Browser 5.805
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 34.440
And DuckDuckGo is the default search engine 11.112
And I kill the Tor Browser 5.608
And the screen keyboard works in Thunderbird 22.660
And the layout of the screen keyboard is set to "us" 0.598
After features/support/hooks.rb:291 1.994
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.469
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.147
When I log in to a new session in Chinese (zh_CN) 31.345
Then the keyboard layout is set to "cn" 0.315
When the network is plugged 0.286
And Tor is ready 14.811
Then I successfully start the Unsafe Browser in "zh_CN" 14.514
And I kill the Unsafe Browser 5.793
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 36.418
And DuckDuckGo is the default search engine 11.864
And I kill the Tor Browser 5.560
And the screen keyboard works in Thunderbird 25.645
And the layout of the screen keyboard is set to "us" 0.607
After features/support/hooks.rb:291 1.308
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:5.025
Before features/support/hooks.rb:245 0.019
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.107
When I log in to a new session in English (en) 15.766
Then the keyboard layout is set to "us" 0.150
When the network is plugged 0.039
And Tor is ready 14.732
Then I successfully start the Unsafe Browser in "en" 13.149
And I kill the Unsafe Browser 6.021
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 34.074
And DuckDuckGo is the default search engine 5.396
And I kill the Tor Browser 5.355
And the screen keyboard works in Thunderbird 21.580
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.507
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.378
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.300
When I log in to a new session in French (fr) 30.567
Then the keyboard layout is set to "fr" 0.143
When the network is plugged 0.054
And Tor is ready 15.230
Then I successfully start the Unsafe Browser in "fr" 14.173
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 32.481
And DuckDuckGo is the default search engine 11.140
And I kill the Tor Browser 5.553
And the screen keyboard works in Thunderbird 22.129
And the layout of the screen keyboard is set to "fr" 0.574
After features/support/hooks.rb:291 1.446
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.783
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.034
When I log in to a new session in German (de) 31.744
Then the keyboard layout is set to "de" 0.151
When the network is plugged 0.050
And Tor is ready 14.432
Then I successfully start the Unsafe Browser in "de" 14.598
And I kill the Unsafe Browser 5.713
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 34.212
And DuckDuckGo is the default search engine 10.303
And I kill the Tor Browser 5.517
And the screen keyboard works in Thunderbird 23.266
And the layout of the screen keyboard is set to "de" 0.661
After features/support/hooks.rb:291 0.831
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.076
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.482
When I log in to a new session in Italian (it) 38.344
Then the keyboard layout is set to "it" 0.207
When the network is plugged 0.054
And Tor is ready 15.441
Then I successfully start the Unsafe Browser in "it" 13.331
And I kill the Unsafe Browser 6.403
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 35.311
And DuckDuckGo is the default search engine 11.023
And I kill the Tor Browser 5.630
And the screen keyboard works in Thunderbird 21.186
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.157
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.934
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.272
When I log in to a new session in Persian (fa) 31.648
Then the keyboard layout is set to "ir" 0.199
When the network is plugged 0.042
And Tor is ready 14.006
Then I successfully start the Unsafe Browser in "fa" 14.745
And I kill the Unsafe Browser 5.879
When I enable the screen keyboard 0.147
Then the screen keyboard works in Tor Browser 37.110
And DuckDuckGo is the default search engine 18.820
And I kill the Tor Browser 5.515
And the screen keyboard works in Thunderbird 23.944
And the layout of the screen keyboard is set to "ir" 0.602
After features/support/hooks.rb:291 0.867
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.071
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.056
When I log in to a new session in Portuguese (pt) 31.339
Then the keyboard layout is set to "pt" 0.220
When the network is plugged 0.038
And Tor is ready 17.372
Then I successfully start the Unsafe Browser in "pt" 13.979
And I kill the Unsafe Browser 5.699
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 33.509
And DuckDuckGo is the default search engine 11.044
And I kill the Tor Browser 5.513
And the screen keyboard works in Thunderbird 21.650
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 1.135
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:32.799
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.070
When I log in to a new session in Russian (ru) 29.678
Then the keyboard layout is set to "ru" 0.224
When the network is plugged 0.048
And Tor is ready 15.465
Then I successfully start the Unsafe Browser in "ru" 13.801
And I kill the Unsafe Browser 5.917
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 34.542
And DuckDuckGo is the default search engine 12.576
And I kill the Tor Browser 5.566
And the screen keyboard works in Thunderbird 26.168
And the layout of the screen keyboard is set to "ru" 0.628
After features/support/hooks.rb:291 1.567
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.948
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.286
When I log in to a new session in Spanish (es) 31.983
Then the keyboard layout is set to "es" 0.295
When the network is plugged 0.047
And Tor is ready 13.628
Then I successfully start the Unsafe Browser in "es" 15.034
And I kill the Unsafe Browser 5.640
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 36.094
And DuckDuckGo is the default search engine 10.827
And I kill the Tor Browser 5.442
And the screen keyboard works in Thunderbird 21.931
And the layout of the screen keyboard is set to "us" 0.641
After features/support/hooks.rb:291 1.569
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.149
Before features/support/hooks.rb:245 0.017
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.123
When I log in to a new session in Turkish (tr) 30.531
Then the keyboard layout is set to "tr" 0.196
When the network is plugged 0.058
And Tor is ready 14.382
Then I successfully start the Unsafe Browser in "tr" 15.357
And I kill the Unsafe Browser 5.858
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 33.829
And DuckDuckGo is the default search engine 10.442
And I kill the Tor Browser 5.528
And the screen keyboard works in Thunderbird 22.044
And the layout of the screen keyboard is set to "us" 0.685
After features/support/hooks.rb:291 1.195
After features/support/hooks.rb:75 0.000