Project Number Date
test_Tails_ISO_stable 4910 23 Jun 2024, 12:19

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 275 0 0 0 0 275 22 0 22 1:1:56.224 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.613
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.546
And I prepare Tails for memory erasure tests 0.592
When I start a process allocating 128 MiB of memory with a known pattern 4.123
Then patterns cover at least 128 MiB in the guest's memory 3.585 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.744
Then I find very few patterns in the guest's memory 4.021 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
After features/support/hooks.rb:326 1.052
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.933
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.337
And I prepare Tails for memory erasure tests 0.430
And I find very few patterns in the guest's memory 3.542 
Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 2.587
Then patterns cover at least 99% of the test FS size in the guest's memory 4.594 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 2.144
Then I find very few patterns in the guest's memory 5.297 
Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)
After features/support/hooks.rb:326 0.903
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.700
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.537
And I prepare Tails for memory erasure tests 0.419
When I plug and mount a 128 MiB USB drive with a vfat filesystem 10.260
Then I find very few patterns in the guest's memory 4.184 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 3.529
Then patterns cover at least 86% of the test FS size in the guest's memory 3.350 
Pattern coverage: 93.066% (118 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.739
Then I find very few patterns in the guest's memory 3.822 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
# read cache
When I mount the USB drive again 0.986
And I read the content of the test FS 0.520
Then patterns cover at least 99% of the test FS size in the guest's memory 4.086 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.478
Then I find very few patterns in the guest's memory 4.782 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
After features/support/hooks.rb:326 0.828
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:21.899
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 11.170
And I prepare Tails for memory erasure tests 0.435
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 39.123
Then I find very few patterns in the guest's memory 3.784 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.670
Then patterns cover at least 99% of the test FS size in the guest's memory 3.175 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.916
Then I find very few patterns in the guest's memory 3.653 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
# read cache
When I mount the USB drive again 6.894
And I read the content of the test FS 0.621
Then patterns cover at least 99% of the test FS size in the guest's memory 3.530 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.802
Then I find very few patterns in the guest's memory 4.121 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
After features/support/hooks.rb:326 0.930
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
54.262
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.493
And I prepare Tails for memory erasure tests 0.445
When I fill a 128 MiB file with a known pattern on the root filesystem 18.404
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.869
Then patterns cover at least 128 MiB in the guest's memory 3.118 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.897 
Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)
After features/support/hooks.rb:326 3.512
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:52.568
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:9.474
And I prepare Tails for memory erasure tests 0.388
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.548
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.126 
Pattern coverage: 0.000% (0 MiB out of 902 MiB reference memory)
After features/support/hooks.rb:326 3.468
After features/support/hooks.rb:100 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:2.710
Before features/support/hooks.rb:269 0.002
Before features/support/hooks.rb:507 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.172
And I update APT using apt 18.924
And I install "popularity-contest" using apt 22.878
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.927
When I create a persistent storage and activate the Additional Software feature 18.545
Then Additional Software is correctly configured for package "popularity-contest" 1.294
When I shutdown Tails and wait for the computer to power off 12.725
And I start Tails from USB drive "__internal" with network unplugged 57.408
And I enable persistence 21.748
And I log in to a new session 39.172
And the Additional Software installation service has started 41.648
Then I am notified that the installation succeeded 2.236
And Additional Software is correctly configured for package "popularity-contest" 0.776
And the package "popularity-contest" is installed after Additional Software has been started 0.251
After features/support/hooks.rb:515 36.779
After features/support/hooks.rb:326 1.415
After features/support/hooks.rb:100 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:28.674
Before features/support/hooks.rb:269 0.004
Before features/support/hooks.rb:507 0.004
Given a computer 0.231
And I start Tails from USB drive "__internal" and I login with an administration password 1:44.344
And I update APT using apt 16.247
When I install "makepp" using apt 22.470
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.302
And the package "makepp" is installed 0.078
After features/support/hooks.rb:515 37.781
After features/support/hooks.rb:326 0.953
After features/support/hooks.rb:100 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.953
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.005
Given a computer 0.234
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:4.626
When I uninstall "popularity-contest" using apt 21.857
And I accept removing "popularity-contest" from Additional Software 0.563
Then "popularity-contest" is not in the list of Additional Software 0.652
When I start Synaptic 24.013
And I update APT using Synaptic 22.525
And I install "cowsay" using Synaptic 11.222
And I accept adding "cowsay" to Additional Software 1.014
Then Additional Software is correctly configured for package "cowsay" 0.779
When I uninstall "cowsay" using apt 3.228
And I refuse removing "cowsay" from Additional Software 0.556
Then Additional Software is correctly configured for package "cowsay" 0.830
When I start "Additional Software" via GNOME Activities Overview 10.642
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.909
Then "cowsay" is not in the list of Additional Software 0.834
When I install "cowsay" using apt 3.221
And I refuse adding "cowsay" to Additional Software 0.585
Then "cowsay" is not in the list of Additional Software 0.653
After features/support/hooks.rb:515 0.889
After features/support/hooks.rb:326 0.690
After features/support/hooks.rb:100 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:47.460
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.007
Given a computer 0.245
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:27.820
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.817
And I accept adding "cowsay" to Additional Software 7.875
And Additional Software is correctly configured for package "cowsay" 1.066
And I shutdown Tails and wait for the computer to power off 6.332
And I start Tails from USB drive "__internal" with network unplugged 58.798
And I enable persistence 11.055
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 35.427
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.342
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.075
And the network is plugged 0.047
And Tor is ready 18.982
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 8.790
And available upgrades have been checked 0.083
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.331
And I can open the Additional Software configuration window from the notification 3.849
And I shutdown Tails and wait for the computer to power off 15.541
And I start Tails from USB drive "__internal" with network unplugged 57.675
And I enable persistence 12.338
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.033
And I log in to a new session 37.454
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.260
And I revert the APT tweaks that made it prefer an old version of cowsay 0.060
And the network is plugged 0.059
And Tor is ready 51.687
Then the Additional Software upgrade service has started 0.180
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.112
After features/support/hooks.rb:515 2.348
After features/support/hooks.rb:326 1.134
After features/support/hooks.rb:100 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:10.518
Before features/support/hooks.rb:269 0.006
Before features/support/hooks.rb:507 0.005
Given a computer 0.216
And I start Tails from USB drive "__internal" with network unplugged 59.810
And I enable persistence 10.671
And I remove the "cowsay" deb files from the APT cache 0.684
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.081
And I log in to a new session 37.752
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 15.211
And I can open the Additional Software log file from the notification 5.372
And the package "cowsay" is not installed 0.717
After features/support/hooks.rb:515 0.096
After features/support/hooks.rb:326 1.050
After features/support/hooks.rb:100 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.310
Before features/support/hooks.rb:269 0.034
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.113
When I log in to a new session in Arabic (ar) 32.314
Then the keyboard layout is set to "us" 0.122
When the network is plugged 0.042
And Tor is ready 14.711
Then I successfully start the Unsafe Browser in "ar" 16.096
And I kill the Unsafe Browser 5.761
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 30.682
And DuckDuckGo is the default search engine 15.742
And I kill the Tor Browser 5.519
And the screen keyboard works in Thunderbird 15.541
And the layout of the screen keyboard is set to "us" 0.542
After features/support/hooks.rb:326 1.463
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:30.712
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.022
When I log in to a new session in Chinese (zh_CN) 42.781
Then the keyboard layout is set to "cn" 0.251
When the network is plugged 0.046
And Tor is ready 16.640
Then I successfully start the Unsafe Browser in "zh_CN" 16.147
And I kill the Unsafe Browser 5.920
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 28.239
And DuckDuckGo is the default search engine 9.395
And I kill the Tor Browser 5.220
And the screen keyboard works in Thunderbird 17.360
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:326 1.704
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:53.848
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.156
When I log in to a new session in English (en) 17.631
Then the keyboard layout is set to "us" 0.178
When the network is plugged 0.043
And Tor is ready 15.359
Then I successfully start the Unsafe Browser in "en" 14.910
And I kill the Unsafe Browser 5.762
When I enable the screen keyboard 0.117
Then the screen keyboard works in Tor Browser 28.020
And DuckDuckGo is the default search engine 5.141
And I kill the Tor Browser 5.286
And the screen keyboard works in Thunderbird 12.687
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:326 1.007
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.973
Before features/support/hooks.rb:269 0.013
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.072
When I log in to a new session in French (fr) 32.763
Then the keyboard layout is set to "fr" 0.191
When the network is plugged 0.041
And Tor is ready 45.874
Then I successfully start the Unsafe Browser in "fr" 14.448
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.175
Then the screen keyboard works in Tor Browser 28.893
And DuckDuckGo is the default search engine 10.373
And I kill the Tor Browser 5.498
And the screen keyboard works in Thunderbird 13.168
And the layout of the screen keyboard is set to "fr" 0.573
After features/support/hooks.rb:326 1.372
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.459
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.627
When I log in to a new session in German (de) 34.110
Then the keyboard layout is set to "de" 0.142
When the network is plugged 0.049
And Tor is ready 15.640
Then I successfully start the Unsafe Browser in "de" 15.236
And I kill the Unsafe Browser 5.872
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 29.634
And DuckDuckGo is the default search engine 10.277
And I kill the Tor Browser 5.554
And the screen keyboard works in Thunderbird 12.660
And the layout of the screen keyboard is set to "de" 0.543
After features/support/hooks.rb:326 3.461
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.787
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.105
When I log in to a new session in Italian (it) 33.197
Then the keyboard layout is set to "it" 0.156
When the network is plugged 0.052
And Tor is ready 15.806
Then I successfully start the Unsafe Browser in "it" 15.139
And I kill the Unsafe Browser 5.669
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 28.890
And DuckDuckGo is the default search engine 9.953
And I kill the Tor Browser 5.236
And the screen keyboard works in Thunderbird 12.920
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:326 2.493
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.530
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.993
When I log in to a new session in Persian (fa) 32.989
Then the keyboard layout is set to "ir" 0.248
When the network is plugged 0.045
And Tor is ready 15.661
Then I successfully start the Unsafe Browser in "fa" 14.432
And I kill the Unsafe Browser 5.866
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 28.913
And DuckDuckGo is the default search engine 15.548
And I kill the Tor Browser 5.537
And the screen keyboard works in Thunderbird 12.587
And the layout of the screen keyboard is set to "ir" 0.569
After features/support/hooks.rb:326 1.076
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.759
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.965
When I log in to a new session in Portuguese (pt) 32.796
Then the keyboard layout is set to "pt" 0.236
When the network is plugged 0.038
And Tor is ready 16.915
Then I successfully start the Unsafe Browser in "pt" 14.035
And I kill the Unsafe Browser 5.667
When I enable the screen keyboard 0.133
Then the screen keyboard works in Tor Browser 29.374
And DuckDuckGo is the default search engine 10.058
And I kill the Tor Browser 5.560
And the screen keyboard works in Thunderbird 12.446
And the layout of the screen keyboard is set to "us" 0.530
After features/support/hooks.rb:326 1.042
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.228
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.941
When I log in to a new session in Russian (ru) 33.377
Then the keyboard layout is set to "ru" 0.141
When the network is plugged 0.112
And Tor is ready 15.979
Then I successfully start the Unsafe Browser in "ru" 14.538
And I kill the Unsafe Browser 5.953
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 29.145
And DuckDuckGo is the default search engine 15.387
And I kill the Tor Browser 5.522
And the screen keyboard works in Thunderbird 12.439
And the layout of the screen keyboard is set to "ru" 0.570
After features/support/hooks.rb:326 1.399
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:16.924
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.098
When I log in to a new session in Spanish (es) 33.855
Then the keyboard layout is set to "es" 0.115
When the network is plugged 0.048
And Tor is ready 15.429
Then I successfully start the Unsafe Browser in "es" 15.215
And I kill the Unsafe Browser 5.820
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 28.517
And DuckDuckGo is the default search engine 10.952
And I kill the Tor Browser 5.506
And the screen keyboard works in Thunderbird 12.704
And the layout of the screen keyboard is set to "us" 0.553
After features/support/hooks.rb:326 1.583
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.394
Before features/support/hooks.rb:269 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.758
When I log in to a new session in Turkish (tr) 33.599
Then the keyboard layout is set to "tr" 0.204
When the network is plugged 0.066
And Tor is ready 15.458
Then I successfully start the Unsafe Browser in "tr" 13.871
And I kill the Unsafe Browser 5.762
When I enable the screen keyboard 0.111
Then the screen keyboard works in Tor Browser 28.251
And DuckDuckGo is the default search engine 16.768
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 12.509
And the layout of the screen keyboard is set to "us" 0.547
After features/support/hooks.rb:326 1.235
After features/support/hooks.rb:100 0.000