Project Number Date
test_Tails_ISO_stable 4558 07 Dec 2023, 20:51

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:12:49.947 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.702
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.040
And I prepare Tails for memory erasure tests 0.563
When I start a process allocating 128 MiB of memory with a known pattern 1.265
Then patterns cover at least 128 MiB in the guest's memory 3.798 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.309
Then I find very few patterns in the guest's memory 3.725 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:291 0.618
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.541
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.145
And I prepare Tails for memory erasure tests 0.505
And I find very few patterns in the guest's memory 4.902 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 42.858
Then patterns cover at least 99% of the test FS size in the guest's memory 3.227 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.235
Then I find very few patterns in the guest's memory 3.666 
Pattern coverage: 0.000% (0 MiB out of 1213 MiB reference memory)
After features/support/hooks.rb:291 0.930
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:50.731
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.951
And I prepare Tails for memory erasure tests 0.445
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.939
Then I find very few patterns in the guest's memory 4.336 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3:15.131
Then patterns cover at least 86% of the test FS size in the guest's memory 3.054 
Pattern coverage: 94.199% (117 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.572
Then I find very few patterns in the guest's memory 3.680 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
# read cache
When I mount the USB drive again 0.237
And I read the content of the test FS 0.732
Then patterns cover at least 99% of the test FS size in the guest's memory 2.842 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.242
Then I find very few patterns in the guest's memory 3.565 
Pattern coverage: 0.000% (0 MiB out of 1194 MiB reference memory)
After features/support/hooks.rb:291 0.787
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:2.600
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.245
And I prepare Tails for memory erasure tests 0.505
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.502
Then I find very few patterns in the guest's memory 3.454 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:8.105
Then patterns cover at least 99% of the test FS size in the guest's memory 3.762 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.392
Then I find very few patterns in the guest's memory 3.375 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
# read cache
When I mount the USB drive again 3.213
And I read the content of the test FS 0.662
Then patterns cover at least 99% of the test FS size in the guest's memory 2.786 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.558
Then I find very few patterns in the guest's memory 4.034 
Pattern coverage: 0.000% (0 MiB out of 1192 MiB reference memory)
After features/support/hooks.rb:291 1.045
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.695
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.322
And I prepare Tails for memory erasure tests 0.488
When I fill a 128 MiB file with a known pattern on the root filesystem 15.995
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.903
Then patterns cover at least 128 MiB in the guest's memory 2.698 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.545
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.722 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:291 3.438
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:13.058
Before features/support/hooks.rb:245 0.003
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:27.422
And I prepare Tails for memory erasure tests 0.459
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.552
When I trigger shutdown 0.415
And I wait 20 seconds 20.011 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.195 
Pattern coverage: 0.000% (0 MiB out of 1179 MiB reference memory)
After features/support/hooks.rb:291 3.479
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:48.081
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 55.699
And I update APT using apt 15.565
And I install "popularity-contest" using apt 19.574
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.790
When I create a persistent storage and activate the Additional Software feature 18.936
Then Additional Software is correctly configured for package "popularity-contest" 1.471
When I shutdown Tails and wait for the computer to power off 11.125
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:43.370
Then Additional Software is correctly configured for package "popularity-contest" 1.233
And the package "popularity-contest" is installed after Additional Software has been started 0.313
After features/support/hooks.rb:450 37.750
After features/support/hooks.rb:291 1.421
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:1.705
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.183
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.210
And I update APT using apt 15.740
When I install "makepp" using apt 19.581
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:2.894
And the package "makepp" is installed 0.095
After features/support/hooks.rb:450 39.312
After features/support/hooks.rb:291 0.988
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:55.086
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.176
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:11.565
When I uninstall "popularity-contest" using apt 15.754
And I accept removing "popularity-contest" from Additional Software 0.753
Then "popularity-contest" is not in the list of Additional Software 0.817
When I start Synaptic 24.211
And I update APT using Synaptic 22.025
And I install "cowsay" using Synaptic 9.118
And I accept adding "cowsay" to Additional Software 1.163
Then Additional Software is correctly configured for package "cowsay" 0.946
When I uninstall "cowsay" using apt 3.284
And I refuse removing "cowsay" from Additional Software 0.688
Then Additional Software is correctly configured for package "cowsay" 0.912
When I start "Additional Software" via GNOME Activities Overview 12.693
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.895
Then "cowsay" is not in the list of Additional Software 1.124
When I install "cowsay" using apt 3.318
And I refuse adding "cowsay" to Additional Software 0.744
Then "cowsay" is not in the list of Additional Software 0.891
After features/support/hooks.rb:450 1.033
After features/support/hooks.rb:291 0.747
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:20.037
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.150
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.723
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.496
And I accept adding "cowsay" to Additional Software 1:8.731
And Additional Software is correctly configured for package "cowsay" 1.357
And I shutdown Tails and wait for the computer to power off 6.152
And I start Tails from USB drive "__internal" with network unplugged 46.982
And I enable persistence 31.217
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.030
And I log in to a new session 31.141
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.422
And I revert the APT tweaks that made it prefer an old version of cowsay 0.053
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.098
And the network is plugged 0.022
And Tor is ready 18.904
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.400
And available upgrades have been checked 0.198
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.200
And I can open the Additional Software configuration window from the notification 3.137
And I shutdown Tails and wait for the computer to power off 2:2.679
And I start Tails from USB drive "__internal" with network unplugged 46.547
And I enable persistence 31.614
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 30.568
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.025
And I revert the APT tweaks that made it prefer an old version of cowsay 0.072
And the network is plugged 0.051
And Tor is ready 39.631
Then the Additional Software upgrade service has started 0.275
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.097
After features/support/hooks.rb:450 2.427
After features/support/hooks.rb:291 0.723
After features/support/hooks.rb:75 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:51.652
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.155
And I start Tails from USB drive "__internal" with network unplugged 46.323
And I enable persistence 32.791
And I remove the "cowsay" deb files from the APT cache 0.710
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.081
And I log in to a new session 27.984
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.375
And I can open the Additional Software log file from the notification 2.103
And the package "cowsay" is not installed 0.126
After features/support/hooks.rb:450 0.148
After features/support/hooks.rb:291 0.713
After features/support/hooks.rb:75 0.015
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.415
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 11.311
When I log in to a new session in Arabic (ar) 27.496
Then the keyboard layout is set to "us" 0.214
When the network is plugged 0.038
And Tor is ready 14.817
Then I successfully start the Unsafe Browser in "ar" 27.712
And I kill the Unsafe Browser 5.842
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 36.732
And DuckDuckGo is the default search engine 9.939
And I kill the Tor Browser 5.439
And the screen keyboard works in Thunderbird 23.175
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:291 1.668
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.705
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.651
When I log in to a new session in Chinese (zh_CN) 29.579
Then the keyboard layout is set to "cn" 0.144
When the network is plugged 0.028
And Tor is ready 16.979
Then I successfully start the Unsafe Browser in "zh_CN" 28.918
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 35.733
And DuckDuckGo is the default search engine 10.553
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 26.914
And the layout of the screen keyboard is set to "us" 0.656
After features/support/hooks.rb:291 1.150
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.210
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.134
When I log in to a new session in English (en) 19.338
Then the keyboard layout is set to "us" 0.136
When the network is plugged 0.028
And Tor is ready 14.666
Then I successfully start the Unsafe Browser in "en" 26.819
And I kill the Unsafe Browser 6.013
When I enable the screen keyboard 0.179
Then the screen keyboard works in Tor Browser 33.499
And DuckDuckGo is the default search engine 5.563
And I kill the Tor Browser 5.359
And the screen keyboard works in Thunderbird 22.834
And the layout of the screen keyboard is set to "us" 0.638
After features/support/hooks.rb:291 1.673
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.101
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.289
When I log in to a new session in French (fr) 32.453
Then the keyboard layout is set to "fr" 0.134
When the network is plugged 0.027
And Tor is ready 15.523
Then I successfully start the Unsafe Browser in "fr" 25.461
And I kill the Unsafe Browser 5.979
When I enable the screen keyboard 0.144
Then the screen keyboard works in Tor Browser 35.779
And DuckDuckGo is the default search engine 10.112
And I kill the Tor Browser 5.546
And the screen keyboard works in Thunderbird 24.034
And the layout of the screen keyboard is set to "fr" 0.614
After features/support/hooks.rb:291 1.221
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.626
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.041
When I log in to a new session in German (de) 29.624
Then the keyboard layout is set to "de" 0.232
When the network is plugged 0.027
And Tor is ready 14.954
Then I successfully start the Unsafe Browser in "de" 26.352
And I kill the Unsafe Browser 5.781
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 34.596
And DuckDuckGo is the default search engine 9.765
And I kill the Tor Browser 5.398
And the screen keyboard works in Thunderbird 24.071
And the layout of the screen keyboard is set to "de" 0.656
After features/support/hooks.rb:291 1.299
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.341
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.006
When I log in to a new session in Italian (it) 29.903
Then the keyboard layout is set to "it" 0.273
When the network is plugged 0.024
And Tor is ready 16.406
Then I successfully start the Unsafe Browser in "it" 27.845
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.128
Then the screen keyboard works in Tor Browser 34.839
And DuckDuckGo is the default search engine 9.897
And I kill the Tor Browser 5.401
And the screen keyboard works in Thunderbird 23.130
And the layout of the screen keyboard is set to "us" 0.647
After features/support/hooks.rb:291 1.296
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.214
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.963
When I log in to a new session in Persian (fa) 29.972
Then the keyboard layout is set to "ir" 0.148
When the network is plugged 0.030
And Tor is ready 15.403
Then I successfully start the Unsafe Browser in "fa" 29.339
And I kill the Unsafe Browser 5.837
When I enable the screen keyboard 0.202
Then the screen keyboard works in Tor Browser 35.667
And DuckDuckGo is the default search engine 10.106
And I kill the Tor Browser 5.400
And the screen keyboard works in Thunderbird 23.515
And the layout of the screen keyboard is set to "ir" 0.627
After features/support/hooks.rb:291 1.039
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.779
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.230
When I log in to a new session in Portuguese (pt) 29.877
Then the keyboard layout is set to "pt" 0.173
When the network is plugged 0.036
And Tor is ready 16.203
Then I successfully start the Unsafe Browser in "pt" 27.073
And I kill the Unsafe Browser 5.879
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 33.766
And DuckDuckGo is the default search engine 9.731
And I kill the Tor Browser 5.287
And the screen keyboard works in Thunderbird 22.704
And the layout of the screen keyboard is set to "us" 0.705
After features/support/hooks.rb:291 1.217
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.738
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.617
When I log in to a new session in Russian (ru) 31.287
Then the keyboard layout is set to "ru" 0.158
When the network is plugged 0.025
And Tor is ready 16.602
Then I successfully start the Unsafe Browser in "ru" 29.027
And I kill the Unsafe Browser 5.718
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 35.399
And DuckDuckGo is the default search engine 9.575
And I kill the Tor Browser 5.295
And the screen keyboard works in Thunderbird 23.308
And the layout of the screen keyboard is set to "ru" 0.595
After features/support/hooks.rb:291 1.334
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.828
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.566
When I log in to a new session in Spanish (es) 30.547
Then the keyboard layout is set to "es" 0.134
When the network is plugged 0.027
And Tor is ready 16.906
Then I successfully start the Unsafe Browser in "es" 27.274
And I kill the Unsafe Browser 5.935
When I enable the screen keyboard 0.120
Then the screen keyboard works in Tor Browser 33.975
And DuckDuckGo is the default search engine 10.210
And I kill the Tor Browser 5.680
And the screen keyboard works in Thunderbird 21.839
And the layout of the screen keyboard is set to "us" 0.609
After features/support/hooks.rb:291 1.355
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.092
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.015
When I log in to a new session in Turkish (tr) 28.577
Then the keyboard layout is set to "tr" 0.187
When the network is plugged 0.026
And Tor is ready 15.540
Then I successfully start the Unsafe Browser in "tr" 27.311
And I kill the Unsafe Browser 5.890
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 34.799
And DuckDuckGo is the default search engine 9.884
And I kill the Tor Browser 5.454
And the screen keyboard works in Thunderbird 22.626
And the layout of the screen keyboard is set to "us" 0.613
After features/support/hooks.rb:291 1.147
After features/support/hooks.rb:75 0.000