Project Number Date
test_Tails_ISO_stable 4724 18 Mar 2024, 13:26

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 58:16.936 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.597
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and logged in 7.945
And I prepare Tails for memory erasure tests 0.418
When I start a process allocating 128 MiB of memory with a known pattern 1.331
Then patterns cover at least 128 MiB in the guest's memory 3.768 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.156
Then I find very few patterns in the guest's memory 3.977 
Pattern coverage: 0.000% (0 MiB out of 930 MiB reference memory)
After features/support/hooks.rb:291 0.874
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
21.679
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.880
And I prepare Tails for memory erasure tests 0.387
And I find very few patterns in the guest's memory 3.863 
Pattern coverage: 0.000% (0 MiB out of 934 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.652
Then patterns cover at least 99% of the test FS size in the guest's memory 3.391 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.619
Then I find very few patterns in the guest's memory 3.884 
Pattern coverage: 0.000% (0 MiB out of 934 MiB reference memory)
After features/support/hooks.rb:291 0.895
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
38.898
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.029
And I prepare Tails for memory erasure tests 0.373
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.758
Then I find very few patterns in the guest's memory 3.887 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.408
Then patterns cover at least 86% of the test FS size in the guest's memory 3.647 
Pattern coverage: 95.494% (121 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.026
Then I find very few patterns in the guest's memory 3.927 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
# read cache
When I mount the USB drive again 0.208
And I read the content of the test FS 1.052
Then patterns cover at least 99% of the test FS size in the guest's memory 3.269 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.487
Then I find very few patterns in the guest's memory 3.821 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
After features/support/hooks.rb:291 0.685
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:0.750
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.961
And I prepare Tails for memory erasure tests 0.427
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 28.868
Then I find very few patterns in the guest's memory 3.522 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.531
Then patterns cover at least 99% of the test FS size in the guest's memory 2.882 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.842
Then I find very few patterns in the guest's memory 3.607 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
# read cache
When I mount the USB drive again 4.016
And I read the content of the test FS 0.384
Then patterns cover at least 99% of the test FS size in the guest's memory 2.684 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.465
Then I find very few patterns in the guest's memory 3.556 
Pattern coverage: 0.000% (0 MiB out of 933 MiB reference memory)
After features/support/hooks.rb:291 0.668
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
48.405
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.938
And I prepare Tails for memory erasure tests 0.395
When I fill a 128 MiB file with a known pattern on the root filesystem 13.705
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.098
Then patterns cover at least 128 MiB in the guest's memory 2.484 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.012
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.748 
Pattern coverage: 0.000% (0 MiB out of 929 MiB reference memory)
After features/support/hooks.rb:291 3.504
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:0.807
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:17.191
And I prepare Tails for memory erasure tests 0.424
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.955
When I trigger shutdown 0.011
And I wait 20 seconds 20.016 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.208 
Pattern coverage: 0.000% (0 MiB out of 938 MiB reference memory)
After features/support/hooks.rb:291 3.486
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:35.184
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.018
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 56.345
And I update APT using apt 16.100
And I install "popularity-contest" using apt 19.131
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.351
When I create a persistent storage and activate the Additional Software feature 19.434
Then Additional Software is correctly configured for package "popularity-contest" 1.361
When I shutdown Tails and wait for the computer to power off 10.047
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:25.415
Then Additional Software is correctly configured for package "popularity-contest" 0.744
And the package "popularity-contest" is installed after Additional Software has been started 0.253
After features/support/hooks.rb:450 39.656
After features/support/hooks.rb:291 1.130
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:10.254
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.193
And I start Tails from USB drive "__internal" and I login with an administration password 1:29.555
And I update APT using apt 15.871
When I install "makepp" using apt 19.133
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.408
And the package "makepp" is installed 0.092
After features/support/hooks.rb:450 38.094
After features/support/hooks.rb:291 0.834
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:33.495
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.174
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:51.081
When I uninstall "popularity-contest" using apt 18.685
And I accept removing "popularity-contest" from Additional Software 0.532
Then "popularity-contest" is not in the list of Additional Software 0.637
When I start Synaptic 23.667
And I update APT using Synaptic 21.954
And I install "cowsay" using Synaptic 9.734
And I accept adding "cowsay" to Additional Software 0.959
Then Additional Software is correctly configured for package "cowsay" 0.733
When I uninstall "cowsay" using apt 3.219
And I refuse removing "cowsay" from Additional Software 0.525
Then Additional Software is correctly configured for package "cowsay" 0.811
When I start "Additional Software" via GNOME Activities Overview 9.935
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.602
Then "cowsay" is not in the list of Additional Software 0.915
When I install "cowsay" using apt 3.188
And I refuse adding "cowsay" to Additional Software 0.522
Then "cowsay" is not in the list of Additional Software 0.614
After features/support/hooks.rb:450 0.944
After features/support/hooks.rb:291 0.719
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:31.205
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.166
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.667
And I configure APT to prefer an old version of cowsay 0.028
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.756
And I accept adding "cowsay" to Additional Software 5.056
And Additional Software is correctly configured for package "cowsay" 0.823
And I shutdown Tails and wait for the computer to power off 5.030
And I start Tails from USB drive "__internal" with network unplugged 55.147
And I enable persistence 12.896
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 33.537
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.484
And I revert the APT tweaks that made it prefer an old version of cowsay 0.053
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.065
And the network is plugged 0.036
And Tor is ready 19.181
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.896
And available upgrades have been checked 0.073
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 0.845
And I can open the Additional Software configuration window from the notification 3.324
And I shutdown Tails and wait for the computer to power off 2:2.391
And I start Tails from USB drive "__internal" with network unplugged 55.129
And I enable persistence 12.490
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 34.442
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.423
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.037
And Tor is ready 51.769
Then the Additional Software upgrade service has started 0.232
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.098
After features/support/hooks.rb:450 2.659
After features/support/hooks.rb:291 0.773
After features/support/hooks.rb:75 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:18.822
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.215
And I start Tails from USB drive "__internal" with network unplugged 1:5.653
And I enable persistence 12.569
And I remove the "cowsay" deb files from the APT cache 0.794
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.086
And I log in to a new session 35.544
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 17.112
And I can open the Additional Software log file from the notification 6.140
And the package "cowsay" is not installed 0.705
After features/support/hooks.rb:450 0.105
After features/support/hooks.rb:291 1.491
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:46.285
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.951
When I log in to a new session in Arabic (ar) 29.983
Then the keyboard layout is set to "us" 0.203
When the network is plugged 0.036
And Tor is ready 42.569
Then I successfully start the Unsafe Browser in "ar" 13.736
And I kill the Unsafe Browser 5.936
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 28.693
And DuckDuckGo is the default search engine 18.894
And I kill the Tor Browser 5.482
And the screen keyboard works in Thunderbird 12.128
And the layout of the screen keyboard is set to "us" 0.558
After features/support/hooks.rb:291 1.008
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.652
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.045
When I log in to a new session in Chinese (zh_CN) 31.767
Then the keyboard layout is set to "cn" 0.186
When the network is plugged 0.032
And Tor is ready 13.735
Then I successfully start the Unsafe Browser in "zh_CN" 15.193
And I kill the Unsafe Browser 5.604
When I enable the screen keyboard 0.095
Then the screen keyboard works in Tor Browser 25.174
And DuckDuckGo is the default search engine 10.003
And I kill the Tor Browser 5.222
And the screen keyboard works in Thunderbird 15.998
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 1.128
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:56.355
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.921
When I log in to a new session in English (en) 17.428
Then the keyboard layout is set to "us" 0.143
When the network is plugged 0.025
And Tor is ready 13.582
Then I successfully start the Unsafe Browser in "en" 15.442
And I kill the Unsafe Browser 5.605
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 27.484
And DuckDuckGo is the default search engine 10.355
And I kill the Tor Browser 5.531
And the screen keyboard works in Thunderbird 11.111
And the layout of the screen keyboard is set to "us" 0.611
After features/support/hooks.rb:291 1.202
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.029
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.172
When I log in to a new session in French (fr) 29.862
Then the keyboard layout is set to "fr" 0.191
When the network is plugged 0.065
And Tor is ready 14.021
Then I successfully start the Unsafe Browser in "fr" 14.460
And I kill the Unsafe Browser 5.784
When I enable the screen keyboard 0.083
Then the screen keyboard works in Tor Browser 24.405
And DuckDuckGo is the default search engine 19.625
And I kill the Tor Browser 5.569
And the screen keyboard works in Thunderbird 12.152
And the layout of the screen keyboard is set to "fr" 0.635
After features/support/hooks.rb:291 1.143
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:7.029
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.124
When I log in to a new session in German (de) 30.174
Then the keyboard layout is set to "de" 0.121
When the network is plugged 0.042
And Tor is ready 14.146
Then I successfully start the Unsafe Browser in "de" 13.749
And I kill the Unsafe Browser 5.609
When I enable the screen keyboard 0.087
Then the screen keyboard works in Tor Browser 25.833
And DuckDuckGo is the default search engine 10.942
And I kill the Tor Browser 5.450
And the screen keyboard works in Thunderbird 12.155
And the layout of the screen keyboard is set to "de" 0.590
After features/support/hooks.rb:291 1.506
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:11.391
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.239
When I log in to a new session in Italian (it) 30.517
Then the keyboard layout is set to "it" 0.194
When the network is plugged 0.030
And Tor is ready 15.330
Then I successfully start the Unsafe Browser in "it" 13.793
And I kill the Unsafe Browser 5.774
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 26.229
And DuckDuckGo is the default search engine 13.368
And I kill the Tor Browser 5.505
And the screen keyboard works in Thunderbird 11.725
And the layout of the screen keyboard is set to "us" 0.595
After features/support/hooks.rb:291 1.552
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.723
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.034
When I log in to a new session in Persian (fa) 31.995
Then the keyboard layout is set to "ir" 0.221
When the network is plugged 0.038
And Tor is ready 15.328
Then I successfully start the Unsafe Browser in "fa" 13.976
And I kill the Unsafe Browser 5.787
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 26.571
And DuckDuckGo is the default search engine 10.897
And I kill the Tor Browser 5.475
And the screen keyboard works in Thunderbird 11.729
And the layout of the screen keyboard is set to "ir" 0.564
After features/support/hooks.rb:291 1.758
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.418
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.953
When I log in to a new session in Portuguese (pt) 29.792
Then the keyboard layout is set to "pt" 0.175
When the network is plugged 0.037
And Tor is ready 14.603
Then I successfully start the Unsafe Browser in "pt" 15.179
And I kill the Unsafe Browser 5.724
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 26.784
And DuckDuckGo is the default search engine 22.351
And I kill the Tor Browser 5.524
And the screen keyboard works in Thunderbird 12.616
And the layout of the screen keyboard is set to "us" 0.581
After features/support/hooks.rb:291 3.025
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:19.492
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.144
When I log in to a new session in Russian (ru) 29.423
Then the keyboard layout is set to "ru" 0.140
When the network is plugged 0.045
And Tor is ready 15.293
Then I successfully start the Unsafe Browser in "ru" 14.228
And I kill the Unsafe Browser 5.724
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 25.987
And DuckDuckGo is the default search engine 22.048
And I kill the Tor Browser 5.479
And the screen keyboard works in Thunderbird 12.260
And the layout of the screen keyboard is set to "ru" 0.607
After features/support/hooks.rb:291 3.038
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.992
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.015
When I log in to a new session in Spanish (es) 30.245
Then the keyboard layout is set to "es" 0.151
When the network is plugged 0.024
And Tor is ready 15.118
Then I successfully start the Unsafe Browser in "es" 13.938
And I kill the Unsafe Browser 5.903
When I enable the screen keyboard 0.093
Then the screen keyboard works in Tor Browser 26.001
And DuckDuckGo is the default search engine 19.257
And I kill the Tor Browser 5.515
And the screen keyboard works in Thunderbird 12.974
And the layout of the screen keyboard is set to "us" 0.752
After features/support/hooks.rb:291 1.233
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.465
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.125
When I log in to a new session in Turkish (tr) 32.883
Then the keyboard layout is set to "tr" 0.320
When the network is plugged 0.246
And Tor is ready 13.396
Then I successfully start the Unsafe Browser in "tr" 14.364
And I kill the Unsafe Browser 5.790
When I enable the screen keyboard 0.090
Then the screen keyboard works in Tor Browser 26.618
And DuckDuckGo is the default search engine 21.768
And I kill the Tor Browser 5.499
And the screen keyboard works in Thunderbird 11.768
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:291 2.727
After features/support/hooks.rb:75 0.000