Project Number Date
test_Tails_ISO_devel 3415 04 Jun 2024, 18:47

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 284 0 0 0 0 284 24 0 24 1:20:50.443 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
23.720
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 9.931
And I prepare Tails for memory erasure tests 0.416
When I start a process allocating 128 MiB of memory with a known pattern 2.270
Then patterns cover at least 128 MiB in the guest's memory 4.272 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 2.165
Then I find very few patterns in the guest's memory 4.663 
Pattern coverage: 0.000% (0 MiB out of 869 MiB reference memory)
After features/support/hooks.rb:315 2.379
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
28.132
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 8.707
And I prepare Tails for memory erasure tests 0.521
And I find very few patterns in the guest's memory 5.094 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 3.076
Then patterns cover at least 99% of the test FS size in the guest's memory 4.154 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 1.894
Then I find very few patterns in the guest's memory 4.684 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:315 2.559
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
49.199
Before features/support/hooks.rb:269 0.003
Given I have started Tails from DVD without network and logged in 9.063
And I prepare Tails for memory erasure tests 0.727
When I plug and mount a 128 MiB USB drive with a vfat filesystem 11.010
Then I find very few patterns in the guest's memory 5.080 
Pattern coverage: 0.000% (0 MiB out of 880 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.820
Then patterns cover at least 86% of the test FS size in the guest's memory 3.578 
Pattern coverage: 92.396% (117 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.715
Then I find very few patterns in the guest's memory 3.856 
Pattern coverage: 0.000% (0 MiB out of 880 MiB reference memory)
# read cache
When I mount the USB drive again 0.689
And I read the content of the test FS 2.079
Then patterns cover at least 99% of the test FS size in the guest's memory 4.233 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.786
Then I find very few patterns in the guest's memory 3.555 
Pattern coverage: 0.000% (0 MiB out of 880 MiB reference memory)
After features/support/hooks.rb:315 2.399
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:23.473
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.073
And I prepare Tails for memory erasure tests 0.481
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 35.198
Then I find very few patterns in the guest's memory 4.764 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.164
Then patterns cover at least 99% of the test FS size in the guest's memory 3.176 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.282
Then I find very few patterns in the guest's memory 5.809 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
# read cache
When I mount the USB drive again 13.176
And I read the content of the test FS 0.606
Then patterns cover at least 99% of the test FS size in the guest's memory 3.173 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.835
Then I find very few patterns in the guest's memory 3.731 
Pattern coverage: 0.000% (0 MiB out of 881 MiB reference memory)
After features/support/hooks.rb:315 1.048
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.475
Before features/support/hooks.rb:269 0.002
Given I have started Tails from DVD without network and logged in 8.412
And I prepare Tails for memory erasure tests 0.656
When I fill a 128 MiB file with a known pattern on the root filesystem 15.353
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 8.162
Then patterns cover at least 128 MiB in the guest's memory 3.060 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.015
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.794 
Pattern coverage: 0.000% (0 MiB out of 882 MiB reference memory)
After features/support/hooks.rb:315 3.534
After features/support/hooks.rb:100 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
8:17.271
Before features/support/hooks.rb:269 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 7:33.053
And I prepare Tails for memory erasure tests 0.480
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.513
When I trigger shutdown 0.011
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.199 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:315 3.506
After features/support/hooks.rb:100 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:7.771
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:496 0.013
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:43.627
And I update APT using apt 19.086
When I install "popularity-contest" using apt 22.396
Then I am notified I can not use Additional Software for "popularity-contest" 10.293
And I can open the Additional Software documentation from the notification 32.367
After features/support/hooks.rb:504 38.901
After features/support/hooks.rb:315 3.137
After features/support/hooks.rb:100 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:23.978
Before features/support/hooks.rb:269 0.007
Before features/support/hooks.rb:496 0.006
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 1:6.545
And I update APT using apt 16.624
And I install "popularity-contest" using apt 25.554
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.422
When I create a persistent storage and activate the Additional Software feature 23.207
Then Additional Software is correctly configured for package "popularity-contest" 1.434
When I shutdown Tails and wait for the computer to power off 10.591
And I start Tails from USB drive "__internal" with network unplugged 1:4.338
And I enable persistence 23.234
And I log in to a new session 42.022
And the Additional Software installation service has started 41.183
Then I am notified that the installation succeeded 1.759
And Additional Software is correctly configured for package "popularity-contest" 0.805
And the package "popularity-contest" is installed after Additional Software has been started 0.254
After features/support/hooks.rb:504 40.126
After features/support/hooks.rb:315 1.482
After features/support/hooks.rb:100 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:32.345
Before features/support/hooks.rb:269 0.008
Before features/support/hooks.rb:496 0.008
Given a computer 0.286
And I start Tails from USB drive "__internal" and I login with an administration password 1:42.841
And I update APT using apt 16.326
When I install "makepp" using apt 25.789
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 7.019
And the package "makepp" is installed 0.081
After features/support/hooks.rb:504 41.617
After features/support/hooks.rb:315 1.179
After features/support/hooks.rb:100 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:13.902
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:496 0.006
Given a computer 1.305
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:19.038
When I uninstall "popularity-contest" using apt 21.902
And I accept removing "popularity-contest" from Additional Software 0.643
Then "popularity-contest" is not in the list of Additional Software 0.807
When I start Synaptic 25.870
And I update APT using Synaptic 22.231
And I install "cowsay" using Synaptic 10.148
And I accept adding "cowsay" to Additional Software 2.636
Then Additional Software is correctly configured for package "cowsay" 0.945
When I uninstall "cowsay" using apt 3.292
And I refuse removing "cowsay" from Additional Software 0.684
Then Additional Software is correctly configured for package "cowsay" 0.874
When I start "Additional Software" via GNOME Activities Overview 10.699
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.276
Then "cowsay" is not in the list of Additional Software 0.950
When I install "cowsay" using apt 3.228
And I refuse adding "cowsay" to Additional Software 0.574
Then "cowsay" is not in the list of Additional Software 1.791
After features/support/hooks.rb:504 1.429
After features/support/hooks.rb:315 0.686
After features/support/hooks.rb:100 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:6.964
Before features/support/hooks.rb:269 0.009
Before features/support/hooks.rb:496 0.008
Given a computer 0.255
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:24.515
And I configure APT to prefer an old version of cowsay 0.029
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.052
And I accept adding "cowsay" to Additional Software 7.593
And Additional Software is correctly configured for package "cowsay" 0.900
And I shutdown Tails and wait for the computer to power off 6.593
And I start Tails from USB drive "__internal" with network unplugged 1:1.993
And I enable persistence 12.446
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 40.799
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.415
And I revert the APT tweaks that made it prefer an old version of cowsay 0.080
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.078
And the network is plugged 0.045
And Tor is ready 19.780
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 9.409
And available upgrades have been checked 0.093
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.666
And I can open the Additional Software configuration window from the notification 3.769
And I shutdown Tails and wait for the computer to power off 19.164
And I start Tails from USB drive "__internal" with network unplugged 1:1.062
And I enable persistence 11.672
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 39.750
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.664
And I revert the APT tweaks that made it prefer an old version of cowsay 0.078
And the network is plugged 0.035
And Tor is ready 53.652
Then the Additional Software upgrade service has started 0.230
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.087
After features/support/hooks.rb:504 2.323
After features/support/hooks.rb:315 0.994
After features/support/hooks.rb:100 0.030
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:17.317
Before features/support/hooks.rb:269 0.005
Before features/support/hooks.rb:496 0.007
Given a computer 0.256
And I start Tails from USB drive "__internal" with network unplugged 1:0.661
And I enable persistence 13.429
And I remove the "cowsay" deb files from the APT cache 0.928
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.097
And I log in to a new session 40.869
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.495
And I can open the Additional Software log file from the notification 5.976
And the package "cowsay" is not installed 0.603
After features/support/hooks.rb:504 0.111
After features/support/hooks.rb:315 0.871
After features/support/hooks.rb:100 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.060
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.347
When I log in to a new session in Arabic (ar) 33.579
Then the keyboard layout is set to "us" 0.241
When the network is plugged 0.056
And Tor is ready 18.423
Then I successfully start the Unsafe Browser in "ar" 15.376
And I kill the Unsafe Browser 5.807
When I enable the screen keyboard 0.154
Then the screen keyboard works in Tor Browser 31.031
And DuckDuckGo is the default search engine 10.684
And I kill the Tor Browser 5.475
And the screen keyboard works in Thunderbird 13.316
And the layout of the screen keyboard is set to "us" 0.568
After features/support/hooks.rb:315 1.142
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.149
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.694
When I log in to a new session in Chinese (zh_CN) 34.442
Then the keyboard layout is set to "cn" 0.753
When the network is plugged 0.071
And Tor is ready 18.139
Then I successfully start the Unsafe Browser in "zh_CN" 17.379
And I kill the Unsafe Browser 5.736
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 34.140
And DuckDuckGo is the default search engine 11.170
And I kill the Tor Browser 5.526
And the screen keyboard works in Thunderbird 17.397
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:315 1.872
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.336
Before features/support/hooks.rb:269 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.405
When I log in to a new session in English (en) 20.810
Then the keyboard layout is set to "us" 0.374
When the network is plugged 0.040
And Tor is ready 46.217
Then I successfully start the Unsafe Browser in "en" 15.207
And I kill the Unsafe Browser 5.680
When I enable the screen keyboard 0.129
Then the screen keyboard works in Tor Browser 31.732
And DuckDuckGo is the default search engine 5.926
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 13.887
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:315 1.592
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.806
Before features/support/hooks.rb:269 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.513
When I log in to a new session in French (fr) 34.790
Then the keyboard layout is set to "fr" 0.249
When the network is plugged 0.096
And Tor is ready 18.518
Then I successfully start the Unsafe Browser in "fr" 15.198
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 34.678
And DuckDuckGo is the default search engine 11.842
And I kill the Tor Browser 5.474
And the screen keyboard works in Thunderbird 12.876
And the layout of the screen keyboard is set to "fr" 0.569
After features/support/hooks.rb:315 3.022
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.563
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.227
When I log in to a new session in German (de) 34.046
Then the keyboard layout is set to "de" 0.223
When the network is plugged 0.041
And Tor is ready 18.903
Then I successfully start the Unsafe Browser in "de" 17.068
And I kill the Unsafe Browser 5.816
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 31.594
And DuckDuckGo is the default search engine 11.759
And I kill the Tor Browser 5.520
And the screen keyboard works in Thunderbird 13.523
And the layout of the screen keyboard is set to "de" 0.705
After features/support/hooks.rb:315 1.550
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:58.902
Before features/support/hooks.rb:269 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.603
When I log in to a new session in Italian (it) 36.237
Then the keyboard layout is set to "it" 0.223
When the network is plugged 0.045
And Tor is ready 46.383
Then I successfully start the Unsafe Browser in "it" 15.471
And I kill the Unsafe Browser 5.935
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 33.983
And DuckDuckGo is the default search engine 11.693
And I kill the Tor Browser 5.590
And the screen keyboard works in Thunderbird 13.918
And the layout of the screen keyboard is set to "us" 0.691
After features/support/hooks.rb:315 1.872
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:29.253
Before features/support/hooks.rb:269 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.757
When I log in to a new session in Persian (fa) 33.912
Then the keyboard layout is set to "ir" 0.267
When the network is plugged 0.198
And Tor is ready 20.917
Then I successfully start the Unsafe Browser in "fa" 14.905
And I kill the Unsafe Browser 5.783
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 33.614
And DuckDuckGo is the default search engine 12.153
And I kill the Tor Browser 5.496
And the screen keyboard works in Thunderbird 12.514
And the layout of the screen keyboard is set to "ir" 0.648
After features/support/hooks.rb:315 1.145
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.700
Before features/support/hooks.rb:269 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.679
When I log in to a new session in Portuguese (pt) 35.261
Then the keyboard layout is set to "pt" 0.288
When the network is plugged 0.055
And Tor is ready 16.304
Then I successfully start the Unsafe Browser in "pt" 16.442
And I kill the Unsafe Browser 5.768
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 29.484
And DuckDuckGo is the default search engine 10.740
And I kill the Tor Browser 5.609
And the screen keyboard works in Thunderbird 13.368
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:315 1.492
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.494
Before features/support/hooks.rb:269 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.579
When I log in to a new session in Russian (ru) 35.082
Then the keyboard layout is set to "ru" 0.233
When the network is plugged 0.063
And Tor is ready 17.396
Then I successfully start the Unsafe Browser in "ru" 18.373
And I kill the Unsafe Browser 5.867
When I enable the screen keyboard 0.140
Then the screen keyboard works in Tor Browser 28.349
And DuckDuckGo is the default search engine 11.741
And I kill the Tor Browser 5.473
And the screen keyboard works in Thunderbird 13.591
And the layout of the screen keyboard is set to "ru" 0.601
After features/support/hooks.rb:315 1.022
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.136
Before features/support/hooks.rb:269 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.633
When I log in to a new session in Spanish (es) 34.723
Then the keyboard layout is set to "es" 0.257
When the network is plugged 0.061
And Tor is ready 20.502
Then I successfully start the Unsafe Browser in "es" 14.820
And I kill the Unsafe Browser 5.807
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 31.224
And DuckDuckGo is the default search engine 11.775
And I kill the Tor Browser 5.576
And the screen keyboard works in Thunderbird 14.058
And the layout of the screen keyboard is set to "us" 0.581
After features/support/hooks.rb:315 1.895
After features/support/hooks.rb:100 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.996
Before features/support/hooks.rb:269 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.764
When I log in to a new session in Turkish (tr) 33.462
Then the keyboard layout is set to "tr" 0.167
When the network is plugged 0.093
And Tor is ready 17.349
Then I successfully start the Unsafe Browser in "tr" 14.913
And I kill the Unsafe Browser 5.841
When I enable the screen keyboard 0.135
Then the screen keyboard works in Tor Browser 31.870
And DuckDuckGo is the default search engine 11.806
And I kill the Tor Browser 5.578
And the screen keyboard works in Thunderbird 12.450
And the layout of the screen keyboard is set to "us" 0.560
After features/support/hooks.rb:315 1.257
After features/support/hooks.rb:100 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:12.488
When the network is plugged 0.518
And I wait 720 seconds 12:0.048 
Slept for 720 seconds
Then I successfully configure Tor 11.868
And the time has synced 0.053
After features/support/hooks.rb:315 0.663
After features/support/hooks.rb:100 0.000