Project Number Date
test_Tails_ISO_devel 3432 18 Jun 2024, 16:38

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 284 0 0 0 0 284 24 0 24 1:16:3.404 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
19.177
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.255
And I prepare Tails for memory erasure tests 0.395
When I start a process allocating 128 MiB of memory with a known pattern 1.180
Then patterns cover at least 128 MiB in the guest's memory 3.906 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.023
Then I find very few patterns in the guest's memory 4.415 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
After features/support/hooks.rb:320 1.397
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.024
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.265
And I prepare Tails for memory erasure tests 0.478
And I find very few patterns in the guest's memory 4.176 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.777
Then patterns cover at least 99% of the test FS size in the guest's memory 3.806 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.498
Then I find very few patterns in the guest's memory 5.021 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:320 1.108
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
44.842
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.361
And I prepare Tails for memory erasure tests 0.453
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.153
Then I find very few patterns in the guest's memory 4.425 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.547
Then patterns cover at least 86% of the test FS size in the guest's memory 3.960 
Pattern coverage: 86.919% (110 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.410
Then I find very few patterns in the guest's memory 3.890 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
# read cache
When I mount the USB drive again 0.325
And I read the content of the test FS 0.871
Then patterns cover at least 99% of the test FS size in the guest's memory 3.730 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.521
Then I find very few patterns in the guest's memory 4.190 
Pattern coverage: 0.000% (0 MiB out of 895 MiB reference memory)
After features/support/hooks.rb:320 0.983
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:11.242
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.364
And I prepare Tails for memory erasure tests 0.436
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 35.786
Then I find very few patterns in the guest's memory 3.739 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.976
Then patterns cover at least 99% of the test FS size in the guest's memory 3.215 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.018
Then I find very few patterns in the guest's memory 3.572 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
# read cache
When I mount the USB drive again 4.597
And I read the content of the test FS 0.507
Then patterns cover at least 99% of the test FS size in the guest's memory 3.212 
Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.792
Then I find very few patterns in the guest's memory 4.021 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
After features/support/hooks.rb:320 0.885
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.687
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.249
And I prepare Tails for memory erasure tests 0.449
When I fill a 128 MiB file with a known pattern on the root filesystem 16.199
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.288
Then patterns cover at least 128 MiB in the guest's memory 2.657 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.011
And I wait 20 seconds 20.005 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.824 
Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)
After features/support/hooks.rb:320 3.502
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:47.771
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:4.148
And I prepare Tails for memory erasure tests 0.414
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.803
When I trigger shutdown 0.011
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.374 
Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)
After features/support/hooks.rb:320 3.509
After features/support/hooks.rb:100 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:1.605
Before features/support/hooks.rb:269 0.002
Before features/support/hooks.rb:501 0.007
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:37.554
And I update APT using apt 19.674
When I install "popularity-contest" using apt 22.460
Then I am notified I can not use Additional Software for "popularity-contest" 9.935
And I can open the Additional Software documentation from the notification 31.981
After features/support/hooks.rb:509 36.981
After features/support/hooks.rb:320 3.551
After features/support/hooks.rb:100 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:5.382
Before features/support/hooks.rb:269 0.008
Before features/support/hooks.rb:501 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:1.784
And I update APT using apt 16.552
And I install "popularity-contest" using apt 22.744
Then I am proposed to add the "popularity-contest" package to my Additional Software 7.625
When I create a persistent storage and activate the Additional Software feature 20.449
Then Additional Software is correctly configured for package "popularity-contest" 1.662
When I shutdown Tails and wait for the computer to power off 14.628
And I start Tails from USB drive "__internal" with network unplugged 1:1.278
And I enable persistence 21.096
And I log in to a new session 33.062
And the Additional Software installation service has started 41.384
Then I am notified that the installation succeeded 2.006
And Additional Software is correctly configured for package "popularity-contest" 0.830
And the package "popularity-contest" is installed after Additional Software has been started 0.274
After features/support/hooks.rb:509 39.113
After features/support/hooks.rb:320 1.410
After features/support/hooks.rb:100 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:29.944
Before features/support/hooks.rb:269 0.008
Before features/support/hooks.rb:501 0.009
Given a computer 0.221
And I start Tails from USB drive "__internal" and I login with an administration password 1:43.428
And I update APT using apt 17.222
When I install "makepp" using apt 22.434
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.546
And the package "makepp" is installed 0.090
After features/support/hooks.rb:509 40.316
After features/support/hooks.rb:320 0.892
After features/support/hooks.rb:100 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:0.588
Before features/support/hooks.rb:269 0.008
Before features/support/hooks.rb:501 0.006
Given a computer 0.221
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:13.223
When I uninstall "popularity-contest" using apt 21.832
And I accept removing "popularity-contest" from Additional Software 0.903
Then "popularity-contest" is not in the list of Additional Software 0.672
When I start Synaptic 24.666
And I update APT using Synaptic 22.756
And I install "cowsay" using Synaptic 10.040
And I accept adding "cowsay" to Additional Software 1.335
Then Additional Software is correctly configured for package "cowsay" 0.807
When I uninstall "cowsay" using apt 3.265
And I refuse removing "cowsay" from Additional Software 0.578
Then Additional Software is correctly configured for package "cowsay" 0.751
When I start "Additional Software" via GNOME Activities Overview 9.803
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.412
Then "cowsay" is not in the list of Additional Software 0.893
When I install "cowsay" using apt 3.206
And I refuse adding "cowsay" to Additional Software 0.592
Then "cowsay" is not in the list of Additional Software 0.624
After features/support/hooks.rb:509 1.202
After features/support/hooks.rb:320 0.695
After features/support/hooks.rb:100 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:31.301
Before features/support/hooks.rb:269 0.007
Before features/support/hooks.rb:501 0.008
Given a computer 0.220
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:14.489
And I configure APT to prefer an old version of cowsay 0.026
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.811
And I accept adding "cowsay" to Additional Software 5.932
And Additional Software is correctly configured for package "cowsay" 0.934
And I shutdown Tails and wait for the computer to power off 6.436
And I start Tails from USB drive "__internal" with network unplugged 57.721
And I enable persistence 10.853
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.027
And I log in to a new session 44.501
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.492
And I revert the APT tweaks that made it prefer an old version of cowsay 0.057
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.076
And the network is plugged 0.040
And Tor is ready 22.654
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.200
And available upgrades have been checked 0.058
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.140
And I can open the Additional Software configuration window from the notification 3.820
And I shutdown Tails and wait for the computer to power off 8.613
And I start Tails from USB drive "__internal" with network unplugged 1:4.918
And I enable persistence 12.034
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.048
And I log in to a new session 35.650
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.983
And I revert the APT tweaks that made it prefer an old version of cowsay 0.058
And the network is plugged 0.048
And Tor is ready 53.138
Then the Additional Software upgrade service has started 0.194
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.117
After features/support/hooks.rb:509 2.909
After features/support/hooks.rb:320 0.961
After features/support/hooks.rb:100 0.035
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:10.173
Before features/support/hooks.rb:269 0.007
Before features/support/hooks.rb:501 0.010
Given a computer 0.235
And I start Tails from USB drive "__internal" with network unplugged 58.421
And I enable persistence 12.925
And I remove the "cowsay" deb files from the APT cache 0.759
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.081
And I log in to a new session 36.958
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.685
And I can open the Additional Software log file from the notification 5.452
And the package "cowsay" is not installed 0.652
After features/support/hooks.rb:509 0.104
After features/support/hooks.rb:320 0.868
After features/support/hooks.rb:100 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.319
Before features/support/hooks.rb:269 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.714
When I log in to a new session in Arabic (ar) 33.881
Then the keyboard layout is set to "us" 0.289
When the network is plugged 0.041
And Tor is ready 16.674
Then I successfully start the Unsafe Browser in "ar" 15.878
And I kill the Unsafe Browser 5.683
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 31.655
And DuckDuckGo is the default search engine 10.625
And I kill the Tor Browser 5.530
And the screen keyboard works in Thunderbird 12.596
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:320 1.198
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.649
Before features/support/hooks.rb:269 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.278
When I log in to a new session in Chinese (zh_CN) 33.394
Then the keyboard layout is set to "cn" 0.553
When the network is plugged 0.178
And Tor is ready 20.196
Then I successfully start the Unsafe Browser in "zh_CN" 14.699
And I kill the Unsafe Browser 5.786
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 28.451
And DuckDuckGo is the default search engine 9.931
And I kill the Tor Browser 5.292
And the screen keyboard works in Thunderbird 16.195
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:320 3.121
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:54.233
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.012
When I log in to a new session in English (en) 16.749
Then the keyboard layout is set to "us" 0.378
When the network is plugged 0.038
And Tor is ready 15.200
Then I successfully start the Unsafe Browser in "en" 15.542
And I kill the Unsafe Browser 5.669
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 28.670
And DuckDuckGo is the default search engine 5.235
And I kill the Tor Browser 5.400
And the screen keyboard works in Thunderbird 12.660
And the layout of the screen keyboard is set to "us" 0.542
After features/support/hooks.rb:320 3.532
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.493
Before features/support/hooks.rb:269 0.017
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.031
When I log in to a new session in French (fr) 31.766
Then the keyboard layout is set to "fr" 0.218
When the network is plugged 0.033
And Tor is ready 17.331
Then I successfully start the Unsafe Browser in "fr" 15.238
And I kill the Unsafe Browser 5.742
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 30.358
And DuckDuckGo is the default search engine 9.751
And I kill the Tor Browser 5.268
And the screen keyboard works in Thunderbird 12.965
And the layout of the screen keyboard is set to "fr" 0.648
After features/support/hooks.rb:320 1.103
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.237
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.032
When I log in to a new session in German (de) 33.701
Then the keyboard layout is set to "de" 0.336
When the network is plugged 0.034
And Tor is ready 17.137
Then I successfully start the Unsafe Browser in "de" 14.728
And I kill the Unsafe Browser 5.826
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 27.484
And DuckDuckGo is the default search engine 9.786
And I kill the Tor Browser 5.279
And the screen keyboard works in Thunderbird 12.186
And the layout of the screen keyboard is set to "de" 0.572
After features/support/hooks.rb:320 1.195
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.412
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.864
When I log in to a new session in Italian (it) 32.114
Then the keyboard layout is set to "it" 0.446
When the network is plugged 0.039
And Tor is ready 16.705
Then I successfully start the Unsafe Browser in "it" 15.496
And I kill the Unsafe Browser 5.777
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 29.551
And DuckDuckGo is the default search engine 10.492
And I kill the Tor Browser 5.501
And the screen keyboard works in Thunderbird 12.742
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:320 1.199
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.792
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.384
When I log in to a new session in Persian (fa) 32.073
Then the keyboard layout is set to "ir" 0.163
When the network is plugged 0.046
And Tor is ready 16.324
Then I successfully start the Unsafe Browser in "fa" 15.293
And I kill the Unsafe Browser 5.704
When I enable the screen keyboard 0.132
Then the screen keyboard works in Tor Browser 29.231
And DuckDuckGo is the default search engine 10.139
And I kill the Tor Browser 5.559
And the screen keyboard works in Thunderbird 12.230
And the layout of the screen keyboard is set to "ir" 0.509
After features/support/hooks.rb:320 1.145
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.495
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.057
When I log in to a new session in Portuguese (pt) 32.766
Then the keyboard layout is set to "pt" 0.241
When the network is plugged 0.045
And Tor is ready 15.999
Then I successfully start the Unsafe Browser in "pt" 15.566
And I kill the Unsafe Browser 5.676
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 28.548
And DuckDuckGo is the default search engine 9.439
And I kill the Tor Browser 5.254
And the screen keyboard works in Thunderbird 13.172
And the layout of the screen keyboard is set to "us" 0.600
After features/support/hooks.rb:320 1.066
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.309
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.013
When I log in to a new session in Russian (ru) 32.213
Then the keyboard layout is set to "ru" 0.162
When the network is plugged 0.034
And Tor is ready 16.441
Then I successfully start the Unsafe Browser in "ru" 14.568
And I kill the Unsafe Browser 5.799
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 28.406
And DuckDuckGo is the default search engine 9.982
And I kill the Tor Browser 5.220
And the screen keyboard works in Thunderbird 12.785
And the layout of the screen keyboard is set to "ru" 0.562
After features/support/hooks.rb:320 1.146
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.136
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.097
When I log in to a new session in Spanish (es) 32.718
Then the keyboard layout is set to "es" 0.193
When the network is plugged 0.028
And Tor is ready 44.670
Then I successfully start the Unsafe Browser in "es" 14.848
And I kill the Unsafe Browser 5.813
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 28.946
And DuckDuckGo is the default search engine 10.127
And I kill the Tor Browser 5.230
And the screen keyboard works in Thunderbird 13.791
And the layout of the screen keyboard is set to "us" 0.539
After features/support/hooks.rb:320 1.016
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.625
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.012
When I log in to a new session in Turkish (tr) 31.951
Then the keyboard layout is set to "tr" 0.329
When the network is plugged 0.036
And Tor is ready 16.187
Then I successfully start the Unsafe Browser in "tr" 14.303
And I kill the Unsafe Browser 5.765
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 28.158
And DuckDuckGo is the default search engine 9.410
And I kill the Tor Browser 5.272
And the screen keyboard works in Thunderbird 12.519
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:320 1.356
After features/support/hooks.rb:100 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:11.957
When the network is plugged 0.051
And I wait 720 seconds 12:0.100 
Slept for 720 seconds
Then I successfully configure Tor 11.761
And the time has synced 0.044
After features/support/hooks.rb:320 1.603
After features/support/hooks.rb:100 0.000