Project Number Date
test_Tails_ISO_stable 4770 04 Apr 2024, 18:25

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 275 0 0 0 0 275 22 0 22 1:1:13.767 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
17.576
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.929
And I prepare Tails for memory erasure tests 0.434
When I start a process allocating 128 MiB of memory with a known pattern 1.242
Then patterns cover at least 128 MiB in the guest's memory 3.371 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.846
Then I find very few patterns in the guest's memory 3.753 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
After features/support/hooks.rb:291 0.673
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
22.346
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.896
And I prepare Tails for memory erasure tests 0.491
And I find very few patterns in the guest's memory 3.916 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.923
Then patterns cover at least 99% of the test FS size in the guest's memory 3.554 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.775
Then I find very few patterns in the guest's memory 3.789 
Pattern coverage: 0.000% (0 MiB out of 898 MiB reference memory)
After features/support/hooks.rb:291 0.758
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
38.384
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.552
And I prepare Tails for memory erasure tests 0.386
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.966
Then I find very few patterns in the guest's memory 3.739 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.431
Then patterns cover at least 86% of the test FS size in the guest's memory 3.740 
Pattern coverage: 91.884% (117 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.953
Then I find very few patterns in the guest's memory 3.431 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
# read cache
When I mount the USB drive again 0.228
And I read the content of the test FS 0.478
Then patterns cover at least 99% of the test FS size in the guest's memory 3.094 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.386
Then I find very few patterns in the guest's memory 3.994 
Pattern coverage: 0.000% (0 MiB out of 894 MiB reference memory)
After features/support/hooks.rb:291 0.724
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.393
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.821
And I prepare Tails for memory erasure tests 0.497
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.077
Then I find very few patterns in the guest's memory 3.438 
Pattern coverage: 0.000% (0 MiB out of 892 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.695
Then patterns cover at least 99% of the test FS size in the guest's memory 2.888 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 4.254
Then I find very few patterns in the guest's memory 3.340 
Pattern coverage: 0.000% (0 MiB out of 892 MiB reference memory)
# read cache
When I mount the USB drive again 3.700
And I read the content of the test FS 0.392
Then patterns cover at least 99% of the test FS size in the guest's memory 2.983 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.709
Then I find very few patterns in the guest's memory 3.595 
Pattern coverage: 0.000% (0 MiB out of 892 MiB reference memory)
After features/support/hooks.rb:291 0.693
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.497
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.013
And I prepare Tails for memory erasure tests 0.436
When I fill a 128 MiB file with a known pattern on the root filesystem 17.668
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.879
Then patterns cover at least 128 MiB in the guest's memory 2.731 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.016
And I wait 20 seconds 20.010 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.742 
Pattern coverage: 0.000% (0 MiB out of 901 MiB reference memory)
After features/support/hooks.rb:291 3.487
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:59.610
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:15.374
And I prepare Tails for memory erasure tests 0.481
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.159
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.562 
Pattern coverage: 0.000% (0 MiB out of 916 MiB reference memory)
After features/support/hooks.rb:291 3.601
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:38.705
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.870
And I update APT using apt 17.289
And I install "popularity-contest" using apt 19.183
Then I am proposed to add the "popularity-contest" package to my Additional Software 8.529
When I create a persistent storage and activate the Additional Software feature 21.576
Then Additional Software is correctly configured for package "popularity-contest" 1.380
When I shutdown Tails and wait for the computer to power off 11.634
And I start Tails from USB drive "__internal" with network unplugged 55.478
And I enable persistence 25.452
And I log in to a new session 33.181
And the Additional Software installation service has started 31.285
Then I am notified that the installation succeeded 1.746
And Additional Software is correctly configured for package "popularity-contest" 0.842
And the package "popularity-contest" is installed after Additional Software has been started 0.252
After features/support/hooks.rb:450 38.242
After features/support/hooks.rb:291 1.306
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:17.475
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.362
And I start Tails from USB drive "__internal" and I login with an administration password 1:35.382
And I update APT using apt 15.852
When I install "makepp" using apt 22.469
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 3.330
And the package "makepp" is installed 0.077
After features/support/hooks.rb:450 40.690
After features/support/hooks.rb:291 0.961
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:48.225
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given a computer 0.211
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:1.724
When I uninstall "popularity-contest" using apt 18.820
And I accept removing "popularity-contest" from Additional Software 0.713
Then "popularity-contest" is not in the list of Additional Software 0.718
When I start Synaptic 25.646
And I update APT using Synaptic 22.469
And I install "cowsay" using Synaptic 9.450
And I accept adding "cowsay" to Additional Software 2.367
Then Additional Software is correctly configured for package "cowsay" 0.799
When I uninstall "cowsay" using apt 3.227
And I refuse removing "cowsay" from Additional Software 0.562
Then Additional Software is correctly configured for package "cowsay" 0.760
When I start "Additional Software" via GNOME Activities Overview 9.812
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.639
Then "cowsay" is not in the list of Additional Software 0.934
When I install "cowsay" using apt 3.191
And I refuse adding "cowsay" to Additional Software 0.546
Then "cowsay" is not in the list of Additional Software 0.629
After features/support/hooks.rb:450 0.942
After features/support/hooks.rb:291 0.732
After features/support/hooks.rb:75 0.008
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:23.355
Before features/support/hooks.rb:245 0.004
Before features/support/hooks.rb:442 0.005
Given a computer 0.382
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:13.339
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 26.640
And I accept adding "cowsay" to Additional Software 6.250
And Additional Software is correctly configured for package "cowsay" 1.015
And I shutdown Tails and wait for the computer to power off 6.748
And I start Tails from USB drive "__internal" with network unplugged 56.442
And I enable persistence 17.123
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.026
And I log in to a new session 34.010
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.647
And I revert the APT tweaks that made it prefer an old version of cowsay 0.056
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.069
And the network is plugged 0.042
And Tor is ready 18.106
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.994
And available upgrades have been checked 0.462
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.519
And I can open the Additional Software configuration window from the notification 3.826
And I shutdown Tails and wait for the computer to power off 2:3.806
And I start Tails from USB drive "__internal" with network unplugged 55.967
And I enable persistence 10.383
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.028
And I log in to a new session 35.928
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.617
And I revert the APT tweaks that made it prefer an old version of cowsay 0.052
And the network is plugged 0.039
And Tor is ready 1:18.567
Then the Additional Software upgrade service has started 0.159
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.076
After features/support/hooks.rb:450 2.615
After features/support/hooks.rb:291 0.750
After features/support/hooks.rb:75 0.032
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:13.823
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.008
Given a computer 0.216
And I start Tails from USB drive "__internal" with network unplugged 1:2.474
And I enable persistence 11.113
And I remove the "cowsay" deb files from the APT cache 0.548
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.082
And I log in to a new session 37.056
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.925
And I can open the Additional Software log file from the notification 6.784
And the package "cowsay" is not installed 0.620
After features/support/hooks.rb:450 0.117
After features/support/hooks.rb:291 0.986
After features/support/hooks.rb:75 0.007
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:26.516
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.806
When I log in to a new session in Arabic (ar) 29.494
Then the keyboard layout is set to "us" 0.139
When the network is plugged 0.047
And Tor is ready 22.494
Then I successfully start the Unsafe Browser in "ar" 14.843
And I kill the Unsafe Browser 5.687
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 28.038
And DuckDuckGo is the default search engine 19.549
And I kill the Tor Browser 5.533
And the screen keyboard works in Thunderbird 12.226
And the layout of the screen keyboard is set to "us" 0.563
After features/support/hooks.rb:291 1.131
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.892
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.271
When I log in to a new session in Chinese (zh_CN) 28.720
Then the keyboard layout is set to "cn" 0.361
When the network is plugged 0.053
And Tor is ready 22.527
Then I successfully start the Unsafe Browser in "zh_CN" 14.722
And I kill the Unsafe Browser 6.150
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 27.690
And DuckDuckGo is the default search engine 19.175
And I kill the Tor Browser 5.448
And the screen keyboard works in Thunderbird 18.080
And the layout of the screen keyboard is set to "us" 0.593
After features/support/hooks.rb:291 1.491
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.909
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.814
When I log in to a new session in English (en) 15.452
Then the keyboard layout is set to "us" 0.184
When the network is plugged 0.035
And Tor is ready 44.315
Then I successfully start the Unsafe Browser in "en" 13.990
And I kill the Unsafe Browser 5.534
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 26.825
And DuckDuckGo is the default search engine 5.548
And I kill the Tor Browser 5.307
And the screen keyboard works in Thunderbird 13.248
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.488
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.770
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.120
When I log in to a new session in French (fr) 30.309
Then the keyboard layout is set to "fr" 0.154
When the network is plugged 0.040
And Tor is ready 16.148
Then I successfully start the Unsafe Browser in "fr" 14.712
And I kill the Unsafe Browser 5.658
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 24.564
And DuckDuckGo is the default search engine 21.908
And I kill the Tor Browser 5.587
And the screen keyboard works in Thunderbird 12.853
And the layout of the screen keyboard is set to "fr" 0.619
After features/support/hooks.rb:291 1.289
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.579
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.936
When I log in to a new session in German (de) 31.385
Then the keyboard layout is set to "de" 0.190
When the network is plugged 0.042
And Tor is ready 16.383
Then I successfully start the Unsafe Browser in "de" 14.642
And I kill the Unsafe Browser 5.795
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 25.818
And DuckDuckGo is the default search engine 23.110
And I kill the Tor Browser 5.557
And the screen keyboard works in Thunderbird 12.045
And the layout of the screen keyboard is set to "de" 0.585
After features/support/hooks.rb:291 1.121
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.356
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.061
When I log in to a new session in Italian (it) 29.127
Then the keyboard layout is set to "it" 0.355
When the network is plugged 0.047
And Tor is ready 16.152
Then I successfully start the Unsafe Browser in "it" 14.735
And I kill the Unsafe Browser 5.712
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 26.800
And DuckDuckGo is the default search engine 22.777
And I kill the Tor Browser 5.458
And the screen keyboard works in Thunderbird 13.382
And the layout of the screen keyboard is set to "us" 0.638
After features/support/hooks.rb:291 4.044
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.792
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.295
When I log in to a new session in Persian (fa) 28.984
Then the keyboard layout is set to "ir" 0.194
When the network is plugged 0.036
And Tor is ready 17.828
Then I successfully start the Unsafe Browser in "fa" 15.411
And I kill the Unsafe Browser 5.742
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 26.880
And DuckDuckGo is the default search engine 18.912
And I kill the Tor Browser 5.518
And the screen keyboard works in Thunderbird 13.330
And the layout of the screen keyboard is set to "ir" 0.572
After features/support/hooks.rb:291 1.198
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.885
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.028
When I log in to a new session in Portuguese (pt) 29.795
Then the keyboard layout is set to "pt" 0.182
When the network is plugged 0.054
And Tor is ready 15.985
Then I successfully start the Unsafe Browser in "pt" 13.777
And I kill the Unsafe Browser 5.756
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 24.670
And DuckDuckGo is the default search engine 10.900
And I kill the Tor Browser 5.493
And the screen keyboard works in Thunderbird 12.591
And the layout of the screen keyboard is set to "us" 0.539
After features/support/hooks.rb:291 1.430
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.764
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.829
When I log in to a new session in Russian (ru) 30.618
Then the keyboard layout is set to "ru" 0.320
When the network is plugged 0.039
And Tor is ready 15.726
Then I successfully start the Unsafe Browser in "ru" 14.493
And I kill the Unsafe Browser 5.744
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 25.866
And DuckDuckGo is the default search engine 10.359
And I kill the Tor Browser 5.444
And the screen keyboard works in Thunderbird 13.675
And the layout of the screen keyboard is set to "ru" 0.523
After features/support/hooks.rb:291 1.314
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.363
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.851
When I log in to a new session in Spanish (es) 31.361
Then the keyboard layout is set to "es" 0.248
When the network is plugged 0.035
And Tor is ready 16.291
Then I successfully start the Unsafe Browser in "es" 14.426
And I kill the Unsafe Browser 5.674
When I enable the screen keyboard 0.082
Then the screen keyboard works in Tor Browser 26.376
And DuckDuckGo is the default search engine 19.702
And I kill the Tor Browser 5.483
And the screen keyboard works in Thunderbird 13.256
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.091
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:9.539
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.950
When I log in to a new session in Turkish (tr) 29.185
Then the keyboard layout is set to "tr" 0.188
When the network is plugged 0.037
And Tor is ready 15.410
Then I successfully start the Unsafe Browser in "tr" 14.256
And I kill the Unsafe Browser 5.780
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 27.234
And DuckDuckGo is the default search engine 11.372
And I kill the Tor Browser 5.579
And the screen keyboard works in Thunderbird 11.886
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.792
After features/support/hooks.rb:75 0.000