Project Number Date
test_Tails_ISO_devel 3230 10 Jan 2024, 22:38

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:25:55.049 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.528
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.161
And I prepare Tails for memory erasure tests 1.693
When I start a process allocating 128 MiB of memory with a known pattern 2.334
Then patterns cover at least 128 MiB in the guest's memory 4.058 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.476
Then I find very few patterns in the guest's memory 3.802 
Pattern coverage: 0.000% (0 MiB out of 1203 MiB reference memory)
After features/support/hooks.rb:291 0.743
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.231
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.150
And I prepare Tails for memory erasure tests 0.546
And I find very few patterns in the guest's memory 3.960 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 37.358
Then patterns cover at least 99% of the test FS size in the guest's memory 3.089 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.410
Then I find very few patterns in the guest's memory 3.715 
Pattern coverage: 0.000% (0 MiB out of 1186 MiB reference memory)
After features/support/hooks.rb:291 0.767
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:23.368
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.996
And I prepare Tails for memory erasure tests 0.590
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.775
Then I find very few patterns in the guest's memory 4.374 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:47.496
Then patterns cover at least 86% of the test FS size in the guest's memory 2.909 
Pattern coverage: 98.033% (122 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.886
Then I find very few patterns in the guest's memory 3.670 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
# read cache
When I mount the USB drive again 0.253
And I read the content of the test FS 0.583
Then patterns cover at least 99% of the test FS size in the guest's memory 3.003 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.285
Then I find very few patterns in the guest's memory 4.542 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:291 0.699
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:35.326
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.202
And I prepare Tails for memory erasure tests 0.539
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 24.703
Then I find very few patterns in the guest's memory 3.337 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:42.334
Then patterns cover at least 99% of the test FS size in the guest's memory 2.420 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.615
Then I find very few patterns in the guest's memory 3.389 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
# read cache
When I mount the USB drive again 3.439
And I read the content of the test FS 0.406
Then patterns cover at least 99% of the test FS size in the guest's memory 2.283 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.460
Then I find very few patterns in the guest's memory 3.193 
Pattern coverage: 0.000% (0 MiB out of 1184 MiB reference memory)
After features/support/hooks.rb:291 0.735
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.085
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 7.920
And I prepare Tails for memory erasure tests 0.588
When I fill a 128 MiB file with a known pattern on the root filesystem 15.296
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.495
Then patterns cover at least 128 MiB in the guest's memory 2.620 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.419
And I wait 20 seconds 20.017 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.726 
Pattern coverage: 0.000% (0 MiB out of 1197 MiB reference memory)
After features/support/hooks.rb:291 3.448
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:46.251
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:2.593
And I prepare Tails for memory erasure tests 0.506
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.856
When I trigger shutdown 0.211
And I wait 20 seconds 20.019 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.064 
Pattern coverage: 0.000% (0 MiB out of 1201 MiB reference memory)
After features/support/hooks.rb:291 3.482
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:22.868
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:442 0.010
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:26.426
And I update APT using apt 17.138
When I install "popularity-contest" using apt 19.754
Then I am notified I can not use Additional Software for "popularity-contest" 56.081
And I can open the Additional Software documentation from the notification 23.468
After features/support/hooks.rb:450 38.867
After features/support/hooks.rb:291 1.960
After features/support/hooks.rb:75 0.006
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:24.051
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.009
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 50.477
And I update APT using apt 16.097
And I install "popularity-contest" using apt 19.548
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:0.918
When I create a persistent storage and activate the Additional Software feature 16.498
Then Additional Software is correctly configured for package "popularity-contest" 1.341
When I shutdown Tails and wait for the computer to power off 10.081
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:27.867
Then Additional Software is correctly configured for package "popularity-contest" 0.942
And the package "popularity-contest" is installed after Additional Software has been started 0.278
After features/support/hooks.rb:450 38.196
After features/support/hooks.rb:291 1.429
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:51.545
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.167
And I start Tails from USB drive "__internal" and I login with an administration password 1:21.009
And I update APT using apt 16.284
When I install "makepp" using apt 19.454
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 54.527
And the package "makepp" is installed 0.102
After features/support/hooks.rb:450 38.877
After features/support/hooks.rb:291 0.886
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:43.620
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.169
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:0.168
When I uninstall "popularity-contest" using apt 15.880
And I accept removing "popularity-contest" from Additional Software 0.673
Then "popularity-contest" is not in the list of Additional Software 0.734
When I start Synaptic 24.353
And I update APT using Synaptic 22.084
And I install "cowsay" using Synaptic 10.185
And I accept adding "cowsay" to Additional Software 0.820
Then Additional Software is correctly configured for package "cowsay" 0.880
When I uninstall "cowsay" using apt 3.362
And I refuse removing "cowsay" from Additional Software 0.593
Then Additional Software is correctly configured for package "cowsay" 0.861
When I start "Additional Software" via GNOME Activities Overview 12.506
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.368
Then "cowsay" is not in the list of Additional Software 1.081
When I install "cowsay" using apt 3.297
And I refuse adding "cowsay" to Additional Software 0.764
Then "cowsay" is not in the list of Additional Software 0.835
After features/support/hooks.rb:450 1.106
After features/support/hooks.rb:291 0.636
After features/support/hooks.rb:75 0.068
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:42.578
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.174
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:0.624
And I configure APT to prefer an old version of cowsay 0.030
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 24.175
And I accept adding "cowsay" to Additional Software 1:2.420
And Additional Software is correctly configured for package "cowsay" 1.678
And I shutdown Tails and wait for the computer to power off 6.058
And I start Tails from USB drive "__internal" with network unplugged 45.877
And I enable persistence 32.769
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 30.953
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.514
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.110
And the network is plugged 0.028
And Tor is ready 21.527
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.467
And available upgrades have been checked 0.312
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 2.085
And I can open the Additional Software configuration window from the notification 3.408
And I shutdown Tails and wait for the computer to power off 2:2.619
And I start Tails from USB drive "__internal" with network unplugged 45.524
And I enable persistence 32.255
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 20.516
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.650
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
And the network is plugged 0.498
And Tor is ready 38.852
Then the Additional Software upgrade service has started 0.190
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.088
After features/support/hooks.rb:450 2.448
After features/support/hooks.rb:291 0.995
After features/support/hooks.rb:75 0.031
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:50.739
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.169
And I start Tails from USB drive "__internal" with network unplugged 44.876
And I enable persistence 32.712
And I remove the "cowsay" deb files from the APT cache 0.606
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.071
And I log in to a new session 26.242
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.260
And I can open the Additional Software log file from the notification 3.362
And the package "cowsay" is not installed 0.438
After features/support/hooks.rb:450 0.187
After features/support/hooks.rb:291 0.860
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.692
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.942
When I log in to a new session in Arabic (ar) 29.973
Then the keyboard layout is set to "us" 0.250
When the network is plugged 0.031
And Tor is ready 15.269
Then I successfully start the Unsafe Browser in "ar" 27.612
And I kill the Unsafe Browser 5.836
When I enable the screen keyboard 0.138
Then the screen keyboard works in Tor Browser 35.387
And DuckDuckGo is the default search engine 9.792
And I kill the Tor Browser 5.319
And the screen keyboard works in Thunderbird 24.403
And the layout of the screen keyboard is set to "us" 0.734
After features/support/hooks.rb:291 1.160
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.039
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.939
When I log in to a new session in Chinese (zh_CN) 27.918
Then the keyboard layout is set to "cn" 0.239
When the network is plugged 0.028
And Tor is ready 15.181
Then I successfully start the Unsafe Browser in "zh_CN" 30.165
And I kill the Unsafe Browser 5.808
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 35.275
And DuckDuckGo is the default search engine 10.194
And I kill the Tor Browser 5.339
And the screen keyboard works in Thunderbird 24.224
And the layout of the screen keyboard is set to "us" 0.615
After features/support/hooks.rb:291 1.307
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.712
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.709
When I log in to a new session in English (en) 16.158
Then the keyboard layout is set to "us" 0.229
When the network is plugged 0.104
And Tor is ready 13.762
Then I successfully start the Unsafe Browser in "en" 25.791
And I kill the Unsafe Browser 5.988
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 32.791
And DuckDuckGo is the default search engine 10.934
And I kill the Tor Browser 5.585
And the screen keyboard works in Thunderbird 22.943
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 0.845
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.941
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.681
When I log in to a new session in French (fr) 30.269
Then the keyboard layout is set to "fr" 0.139
When the network is plugged 0.030
And Tor is ready 14.764
Then I successfully start the Unsafe Browser in "fr" 27.456
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 34.207
And DuckDuckGo is the default search engine 9.815
And I kill the Tor Browser 5.408
And the screen keyboard works in Thunderbird 23.656
And the layout of the screen keyboard is set to "fr" 0.540
After features/support/hooks.rb:291 1.083
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.742
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.089
When I log in to a new session in German (de) 29.973
Then the keyboard layout is set to "de" 0.124
When the network is plugged 0.027
And Tor is ready 14.125
Then I successfully start the Unsafe Browser in "de" 26.651
And I kill the Unsafe Browser 5.985
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 34.517
And DuckDuckGo is the default search engine 10.020
And I kill the Tor Browser 5.420
And the screen keyboard works in Thunderbird 22.129
And the layout of the screen keyboard is set to "de" 0.560
After features/support/hooks.rb:291 1.082
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.804
Before features/support/hooks.rb:245 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.288
When I log in to a new session in Italian (it) 30.738
Then the keyboard layout is set to "it" 0.166
When the network is plugged 0.023
And Tor is ready 16.366
Then I successfully start the Unsafe Browser in "it" 26.814
And I kill the Unsafe Browser 5.951
When I enable the screen keyboard 0.168
Then the screen keyboard works in Tor Browser 34.542
And DuckDuckGo is the default search engine 9.433
And I kill the Tor Browser 5.323
And the screen keyboard works in Thunderbird 22.399
And the layout of the screen keyboard is set to "us" 0.587
After features/support/hooks.rb:291 1.174
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.042
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.526
When I log in to a new session in Persian (fa) 29.176
Then the keyboard layout is set to "ir" 0.337
When the network is plugged 0.019
And Tor is ready 17.412
Then I successfully start the Unsafe Browser in "fa" 27.447
And I kill the Unsafe Browser 5.961
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 34.488
And DuckDuckGo is the default search engine 9.544
And I kill the Tor Browser 5.325
And the screen keyboard works in Thunderbird 23.084
And the layout of the screen keyboard is set to "ir" 0.588
After features/support/hooks.rb:291 1.240
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.176
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.707
When I log in to a new session in Portuguese (pt) 28.372
Then the keyboard layout is set to "pt" 0.539
When the network is plugged 0.028
And Tor is ready 15.981
Then I successfully start the Unsafe Browser in "pt" 29.739
And I kill the Unsafe Browser 5.859
When I enable the screen keyboard 0.151
Then the screen keyboard works in Tor Browser 34.028
And DuckDuckGo is the default search engine 20.251
And I kill the Tor Browser 5.518
And the screen keyboard works in Thunderbird 20.396
And the layout of the screen keyboard is set to "us" 0.602
After features/support/hooks.rb:291 1.324
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:18.463
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.519
When I log in to a new session in Russian (ru) 29.250
Then the keyboard layout is set to "ru" 0.152
When the network is plugged 0.026
And Tor is ready 44.839
Then I successfully start the Unsafe Browser in "ru" 27.796
And I kill the Unsafe Browser 5.847
When I enable the screen keyboard 0.169
Then the screen keyboard works in Tor Browser 35.233
And DuckDuckGo is the default search engine 17.205
And I kill the Tor Browser 5.703
And the screen keyboard works in Thunderbird 23.101
And the layout of the screen keyboard is set to "ru" 0.617
After features/support/hooks.rb:291 1.318
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.160
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.761
When I log in to a new session in Spanish (es) 28.632
Then the keyboard layout is set to "es" 0.299
When the network is plugged 0.024
And Tor is ready 14.699
Then I successfully start the Unsafe Browser in "es" 26.569
And I kill the Unsafe Browser 5.831
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 32.901
And DuckDuckGo is the default search engine 17.776
And I kill the Tor Browser 5.555
And the screen keyboard works in Thunderbird 21.414
And the layout of the screen keyboard is set to "us" 0.571
After features/support/hooks.rb:291 1.438
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.925
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.647
When I log in to a new session in Turkish (tr) 27.337
Then the keyboard layout is set to "tr" 0.218
When the network is plugged 0.026
And Tor is ready 15.896
Then I successfully start the Unsafe Browser in "tr" 26.901
And I kill the Unsafe Browser 5.891
When I enable the screen keyboard 0.165
Then the screen keyboard works in Tor Browser 32.637
And DuckDuckGo is the default search engine 9.624
And I kill the Tor Browser 5.282
And the screen keyboard works in Thunderbird 21.729
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:291 1.097
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:9.150
When the network is plugged 0.025
And I wait 720 seconds 12:0.094 
Slept for 720 seconds
Then I successfully configure Tor 8.986
And the time has synced 0.044
After features/support/hooks.rb:291 0.649
After features/support/hooks.rb:75 0.000