Project Number Date
test_Tails_ISO_stable 4636 25 Jan 2024, 15:05

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:11:10.529 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.156
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.971
And I prepare Tails for memory erasure tests 0.637
When I start a process allocating 128 MiB of memory with a known pattern 1.219
Then patterns cover at least 128 MiB in the guest's memory 3.502 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.231
Then I find very few patterns in the guest's memory 4.593 
Pattern coverage: 0.000% (0 MiB out of 1199 MiB reference memory)
After features/support/hooks.rb:291 0.710
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.041
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.501
And I prepare Tails for memory erasure tests 0.501
And I find very few patterns in the guest's memory 4.835 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.879
Then patterns cover at least 99% of the test FS size in the guest's memory 4.963 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.229
Then I find very few patterns in the guest's memory 4.131 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 0.688
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:0.856
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 8.620
And I prepare Tails for memory erasure tests 0.484
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.037
Then I find very few patterns in the guest's memory 4.935 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:20.278
Then patterns cover at least 86% of the test FS size in the guest's memory 3.770 
Pattern coverage: 96.058% (119 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.697
Then I find very few patterns in the guest's memory 4.442 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
# read cache
When I mount the USB drive again 0.220
And I read the content of the test FS 1.001
Then patterns cover at least 99% of the test FS size in the guest's memory 3.748 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.265
Then I find very few patterns in the guest's memory 4.353 
Pattern coverage: 0.000% (0 MiB out of 1187 MiB reference memory)
After features/support/hooks.rb:291 0.874
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:33.047
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.428
And I prepare Tails for memory erasure tests 0.475
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 27.843
Then I find very few patterns in the guest's memory 3.901 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:34.627
Then patterns cover at least 99% of the test FS size in the guest's memory 2.991 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.910
Then I find very few patterns in the guest's memory 3.441 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
# read cache
When I mount the USB drive again 3.332
And I read the content of the test FS 0.408
Then patterns cover at least 99% of the test FS size in the guest's memory 2.814 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.453
Then I find very few patterns in the guest's memory 3.417 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 0.821
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.430
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.669
And I prepare Tails for memory erasure tests 0.595
When I fill a 128 MiB file with a known pattern on the root filesystem 13.224
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.567
Then patterns cover at least 128 MiB in the guest's memory 2.310 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 3.201
And I wait 20 seconds 20.010 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.851 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 3.446
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:13.285
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:26.740
And I prepare Tails for memory erasure tests 0.444
When I fill a 128 MiB file with a known pattern on the persistent filesystem 23.293
When I trigger shutdown 0.560
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.226 
Pattern coverage: 0.000% (0 MiB out of 1160 MiB reference memory)
After features/support/hooks.rb:291 3.489
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:51.623
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:10.087
And I update APT using apt 17.332
And I install "popularity-contest" using apt 19.656
Then I am proposed to add the "popularity-contest" package to my Additional Software 59.089
When I create a persistent storage and activate the Additional Software feature 18.685
Then Additional Software is correctly configured for package "popularity-contest" 1.423
When I shutdown Tails and wait for the computer to power off 10.941
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:33.062
Then Additional Software is correctly configured for package "popularity-contest" 1.054
And the package "popularity-contest" is installed after Additional Software has been started 0.289
After features/support/hooks.rb:450 39.911
After features/support/hooks.rb:291 1.551
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:58.237
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.008
Given a computer 0.232
And I start Tails from USB drive "__internal" and I login with an administration password 1:18.940
And I update APT using apt 17.742
When I install "makepp" using apt 19.879
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:1.367
And the package "makepp" is installed 0.074
After features/support/hooks.rb:450 40.892
After features/support/hooks.rb:291 0.960
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:54.979
Before features/support/hooks.rb:245 0.015
Before features/support/hooks.rb:442 0.007
Given a computer 0.346
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:10.784
When I uninstall "popularity-contest" using apt 19.088
And I accept removing "popularity-contest" from Additional Software 0.750
Then "popularity-contest" is not in the list of Additional Software 0.800
When I start Synaptic 20.833
And I update APT using Synaptic 22.014
And I install "cowsay" using Synaptic 9.975
And I accept adding "cowsay" to Additional Software 1.006
Then Additional Software is correctly configured for package "cowsay" 0.961
When I uninstall "cowsay" using apt 3.409
And I refuse removing "cowsay" from Additional Software 0.735
Then Additional Software is correctly configured for package "cowsay" 0.853
When I start "Additional Software" via GNOME Activities Overview 12.612
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.949
Then "cowsay" is not in the list of Additional Software 1.096
When I install "cowsay" using apt 3.310
And I refuse adding "cowsay" to Additional Software 0.672
Then "cowsay" is not in the list of Additional Software 0.777
After features/support/hooks.rb:450 0.924
After features/support/hooks.rb:291 0.670
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:5.309
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.185
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:7.984
And I configure APT to prefer an old version of cowsay 0.046
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.932
And I accept adding "cowsay" to Additional Software 1:5.695
And Additional Software is correctly configured for package "cowsay" 1.461
And I shutdown Tails and wait for the computer to power off 5.131
And I start Tails from USB drive "__internal" with network unplugged 46.362
And I enable persistence 31.426
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 24.601
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.107
And I revert the APT tweaks that made it prefer an old version of cowsay 0.055
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.070
And the network is plugged 0.033
And Tor is ready 19.305
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.881
And available upgrades have been checked 0.096
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.559
And I can open the Additional Software configuration window from the notification 2.926
And I shutdown Tails and wait for the computer to power off 2:2.532
And I start Tails from USB drive "__internal" with network unplugged 46.431
And I enable persistence 33.279
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 22.030
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.765
And I revert the APT tweaks that made it prefer an old version of cowsay 0.077
And the network is plugged 0.050
And Tor is ready 50.946
Then the Additional Software upgrade service has started 0.190
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.094
After features/support/hooks.rb:450 3.728
After features/support/hooks.rb:291 0.717
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.571
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.284
And I start Tails from USB drive "__internal" with network unplugged 46.473
And I enable persistence 33.349
And I remove the "cowsay" deb files from the APT cache 0.743
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.084
And I log in to a new session 29.642
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.579
And I can open the Additional Software log file from the notification 2.260
And the package "cowsay" is not installed 0.154
After features/support/hooks.rb:450 0.104
After features/support/hooks.rb:291 0.777
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.191
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.168
When I log in to a new session in Arabic (ar) 30.512
Then the keyboard layout is set to "us" 0.269
When the network is plugged 0.032
And Tor is ready 16.947
Then I successfully start the Unsafe Browser in "ar" 26.506
And I kill the Unsafe Browser 6.065
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 36.935
And DuckDuckGo is the default search engine 10.290
And I kill the Tor Browser 5.623
And the screen keyboard works in Thunderbird 23.121
And the layout of the screen keyboard is set to "us" 0.613
After features/support/hooks.rb:291 1.452
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.121
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.407
When I log in to a new session in Chinese (zh_CN) 31.107
Then the keyboard layout is set to "cn" 0.134
When the network is plugged 0.040
And Tor is ready 14.855
Then I successfully start the Unsafe Browser in "zh_CN" 27.157
And I kill the Unsafe Browser 5.982
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 36.210
And DuckDuckGo is the default search engine 9.986
And I kill the Tor Browser 5.397
And the screen keyboard works in Thunderbird 28.098
And the layout of the screen keyboard is set to "us" 0.610
After features/support/hooks.rb:291 1.482
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.677
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.983
When I log in to a new session in English (en) 15.719
Then the keyboard layout is set to "us" 0.169
When the network is plugged 0.035
And Tor is ready 16.945
Then I successfully start the Unsafe Browser in "en" 26.635
And I kill the Unsafe Browser 5.975
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 33.734
And DuckDuckGo is the default search engine 5.509
And I kill the Tor Browser 5.349
And the screen keyboard works in Thunderbird 21.892
And the layout of the screen keyboard is set to "us" 0.591
After features/support/hooks.rb:291 1.267
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.630
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.093
When I log in to a new session in French (fr) 33.592
Then the keyboard layout is set to "fr" 0.156
When the network is plugged 0.028
And Tor is ready 15.669
Then I successfully start the Unsafe Browser in "fr" 27.272
And I kill the Unsafe Browser 5.827
When I enable the screen keyboard 0.179
Then the screen keyboard works in Tor Browser 33.782
And DuckDuckGo is the default search engine 10.736
And I kill the Tor Browser 5.583
And the screen keyboard works in Thunderbird 21.142
And the layout of the screen keyboard is set to "fr" 0.566
After features/support/hooks.rb:291 1.162
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.499
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.896
When I log in to a new session in German (de) 29.908
Then the keyboard layout is set to "de" 0.252
When the network is plugged 0.045
And Tor is ready 16.077
Then I successfully start the Unsafe Browser in "de" 28.673
And I kill the Unsafe Browser 5.971
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 34.936
And DuckDuckGo is the default search engine 9.906
And I kill the Tor Browser 5.311
And the screen keyboard works in Thunderbird 21.787
And the layout of the screen keyboard is set to "de" 0.593
After features/support/hooks.rb:291 1.131
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.325
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.894
When I log in to a new session in Italian (it) 33.346
Then the keyboard layout is set to "it" 0.140
When the network is plugged 0.027
And Tor is ready 14.808
Then I successfully start the Unsafe Browser in "it" 28.913
And I kill the Unsafe Browser 5.941
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 35.601
And DuckDuckGo is the default search engine 9.868
And I kill the Tor Browser 5.346
And the screen keyboard works in Thunderbird 21.748
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:291 1.190
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.112
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.921
When I log in to a new session in Persian (fa) 28.379
Then the keyboard layout is set to "ir" 0.136
When the network is plugged 0.034
And Tor is ready 15.495
Then I successfully start the Unsafe Browser in "fa" 27.268
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 36.221
And DuckDuckGo is the default search engine 9.891
And I kill the Tor Browser 5.375
And the screen keyboard works in Thunderbird 23.680
And the layout of the screen keyboard is set to "ir" 0.632
After features/support/hooks.rb:291 1.233
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.758
Before features/support/hooks.rb:245 0.020
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.135
When I log in to a new session in Portuguese (pt) 28.975
Then the keyboard layout is set to "pt" 0.220
When the network is plugged 0.036
And Tor is ready 15.398
Then I successfully start the Unsafe Browser in "pt" 26.529
And I kill the Unsafe Browser 5.945
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 35.773
And DuckDuckGo is the default search engine 11.598
And I kill the Tor Browser 5.706
And the screen keyboard works in Thunderbird 21.623
And the layout of the screen keyboard is set to "us" 0.697
After features/support/hooks.rb:291 1.414
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.515
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.700
When I log in to a new session in Russian (ru) 27.520
Then the keyboard layout is set to "ru" 0.252
When the network is plugged 0.033
And Tor is ready 15.696
Then I successfully start the Unsafe Browser in "ru" 28.466
And I kill the Unsafe Browser 5.816
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 36.054
And DuckDuckGo is the default search engine 9.876
And I kill the Tor Browser 5.289
And the screen keyboard works in Thunderbird 26.063
And the layout of the screen keyboard is set to "ru" 0.578
After features/support/hooks.rb:291 1.146
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.173
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.895
When I log in to a new session in Spanish (es) 29.311
Then the keyboard layout is set to "es" 0.145
When the network is plugged 0.050
And Tor is ready 15.431
Then I successfully start the Unsafe Browser in "es" 26.688
And I kill the Unsafe Browser 5.925
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 34.154
And DuckDuckGo is the default search engine 9.467
And I kill the Tor Browser 5.347
And the screen keyboard works in Thunderbird 26.032
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:291 1.177
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:35.984
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.997
When I log in to a new session in Turkish (tr) 28.646
Then the keyboard layout is set to "tr" 0.149
When the network is plugged 0.055
And Tor is ready 15.209
Then I successfully start the Unsafe Browser in "tr" 26.021
And I kill the Unsafe Browser 6.128
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 34.069
And DuckDuckGo is the default search engine 9.655
And I kill the Tor Browser 5.324
And the screen keyboard works in Thunderbird 22.032
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.220
After features/support/hooks.rb:75 0.000