Project Number Date
test_Tails_ISO_devel 3212 25 Dec 2023, 17:47

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:23:0.175 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.223
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.036
And I prepare Tails for memory erasure tests 0.472
When I start a process allocating 128 MiB of memory with a known pattern 2.282
Then patterns cover at least 128 MiB in the guest's memory 3.144 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.323
Then I find very few patterns in the guest's memory 3.962 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 0.622
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
57.481
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.635
And I prepare Tails for memory erasure tests 0.519
And I find very few patterns in the guest's memory 3.738 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 38.661
Then patterns cover at least 99% of the test FS size in the guest's memory 3.124 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.193
Then I find very few patterns in the guest's memory 3.609 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 0.911
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:34.938
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.048
And I prepare Tails for memory erasure tests 0.442
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.781
Then I find very few patterns in the guest's memory 3.767 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:0.815
Then patterns cover at least 86% of the test FS size in the guest's memory 2.956 
Pattern coverage: 93.378% (116 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.411
Then I find very few patterns in the guest's memory 3.660 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
# read cache
When I mount the USB drive again 0.328
And I read the content of the test FS 0.612
Then patterns cover at least 99% of the test FS size in the guest's memory 2.935 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.253
Then I find very few patterns in the guest's memory 3.925 
Pattern coverage: 0.000% (0 MiB out of 1208 MiB reference memory)
After features/support/hooks.rb:291 1.477
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:28.662
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.873
And I prepare Tails for memory erasure tests 0.582
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.301
Then I find very few patterns in the guest's memory 3.667 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:35.489
Then patterns cover at least 99% of the test FS size in the guest's memory 2.353 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.627
Then I find very few patterns in the guest's memory 3.361 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
# read cache
When I mount the USB drive again 5.458
And I read the content of the test FS 0.363
Then patterns cover at least 99% of the test FS size in the guest's memory 2.634 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.527
Then I find very few patterns in the guest's memory 3.421 
Pattern coverage: 0.000% (0 MiB out of 1212 MiB reference memory)
After features/support/hooks.rb:291 0.796
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.628
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.174
And I prepare Tails for memory erasure tests 0.477
When I fill a 128 MiB file with a known pattern on the root filesystem 14.582
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.505
Then patterns cover at least 128 MiB in the guest's memory 3.289 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.787
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.791 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
After features/support/hooks.rb:291 3.429
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
5:55.270
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:10.740
And I prepare Tails for memory erasure tests 0.449
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.647
When I trigger shutdown 0.390
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.022 
Pattern coverage: 0.000% (0 MiB out of 1164 MiB reference memory)
After features/support/hooks.rb:291 3.465
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:21.571
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:26.325
And I update APT using apt 17.678
When I install "popularity-contest" using apt 19.696
Then I am notified I can not use Additional Software for "popularity-contest" 55.401
And I can open the Additional Software documentation from the notification 22.469
After features/support/hooks.rb:450 35.964
After features/support/hooks.rb:291 2.037
After features/support/hooks.rb:75 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:29.913
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 52.530
And I update APT using apt 16.450
And I install "popularity-contest" using apt 19.639
Then I am proposed to add the "popularity-contest" package to my Additional Software 53.339
When I create a persistent storage and activate the Additional Software feature 16.922
Then Additional Software is correctly configured for package "popularity-contest" 1.182
When I shutdown Tails and wait for the computer to power off 10.086
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:38.615
Then Additional Software is correctly configured for package "popularity-contest" 0.885
And the package "popularity-contest" is installed after Additional Software has been started 0.261
After features/support/hooks.rb:450 38.558
After features/support/hooks.rb:291 0.961
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:59.243
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.006
Given a computer 0.186
And I start Tails from USB drive "__internal" and I login with an administration password 1:27.558
And I update APT using apt 16.036
When I install "makepp" using apt 19.464
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 55.915
And the package "makepp" is installed 0.083
After features/support/hooks.rb:450 38.291
After features/support/hooks.rb:291 0.910
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:36.847
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.007
Given a computer 0.216
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:55.500
When I uninstall "popularity-contest" using apt 15.866
And I accept removing "popularity-contest" from Additional Software 0.988
Then "popularity-contest" is not in the list of Additional Software 0.714
When I start Synaptic 22.814
And I update APT using Synaptic 22.025
And I install "cowsay" using Synaptic 9.828
And I accept adding "cowsay" to Additional Software 0.792
Then Additional Software is correctly configured for package "cowsay" 0.773
When I uninstall "cowsay" using apt 3.263
And I refuse removing "cowsay" from Additional Software 0.616
Then Additional Software is correctly configured for package "cowsay" 0.837
When I start "Additional Software" via GNOME Activities Overview 12.493
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.366
Then "cowsay" is not in the list of Additional Software 1.034
When I install "cowsay" using apt 3.259
And I refuse adding "cowsay" to Additional Software 0.684
Then "cowsay" is not in the list of Additional Software 0.769
After features/support/hooks.rb:450 0.984
After features/support/hooks.rb:291 0.737
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:10.943
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.004
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:3.139
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.664
And I accept adding "cowsay" to Additional Software 1:0.993
And Additional Software is correctly configured for package "cowsay" 1.283
And I shutdown Tails and wait for the computer to power off 5.055
And I start Tails from USB drive "__internal" with network unplugged 43.981
And I enable persistence 31.604
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 23.563
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.346
And I revert the APT tweaks that made it prefer an old version of cowsay 0.054
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.090
And the network is plugged 0.064
And Tor is ready 18.782
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 34.518
And available upgrades have been checked 0.419
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.000
And I can open the Additional Software configuration window from the notification 2.735
And I shutdown Tails and wait for the computer to power off 13.100
And I start Tails from USB drive "__internal" with network unplugged 44.183
And I enable persistence 30.948
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.020
And I log in to a new session 27.445
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.746
And I revert the APT tweaks that made it prefer an old version of cowsay 0.049
And the network is plugged 0.079
And Tor is ready 40.482
Then the Additional Software upgrade service has started 0.233
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.109
After features/support/hooks.rb:450 2.286
After features/support/hooks.rb:291 0.753
After features/support/hooks.rb:75 0.025
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:42.849
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.204
And I start Tails from USB drive "__internal" with network unplugged 44.264
And I enable persistence 31.812
And I remove the "cowsay" deb files from the APT cache 0.662
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.080
And I log in to a new session 21.504
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 2.238
And I can open the Additional Software log file from the notification 1.828
And the package "cowsay" is not installed 0.251
After features/support/hooks.rb:450 0.134
After features/support/hooks.rb:291 1.236
After features/support/hooks.rb:75 0.014
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.142
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.944
When I log in to a new session in Arabic (ar) 33.612
Then the keyboard layout is set to "us" 0.131
When the network is plugged 0.054
And Tor is ready 15.382
Then I successfully start the Unsafe Browser in "ar" 25.826
And I kill the Unsafe Browser 5.855
When I enable the screen keyboard 0.136
Then the screen keyboard works in Tor Browser 34.174
And DuckDuckGo is the default search engine 9.742
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 22.320
And the layout of the screen keyboard is set to "us" 0.588
After features/support/hooks.rb:291 1.322
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.961
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.388
When I log in to a new session in Chinese (zh_CN) 27.552
Then the keyboard layout is set to "cn" 0.282
When the network is plugged 0.065
And Tor is ready 15.401
Then I successfully start the Unsafe Browser in "zh_CN" 27.234
And I kill the Unsafe Browser 5.759
When I enable the screen keyboard 0.183
Then the screen keyboard works in Tor Browser 33.889
And DuckDuckGo is the default search engine 9.612
And I kill the Tor Browser 5.313
And the screen keyboard works in Thunderbird 27.727
And the layout of the screen keyboard is set to "us" 0.551
After features/support/hooks.rb:291 1.239
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:17.072
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.363
When I log in to a new session in English (en) 15.799
Then the keyboard layout is set to "us" 0.133
When the network is plugged 0.036
And Tor is ready 14.590
Then I successfully start the Unsafe Browser in "en" 27.226
And I kill the Unsafe Browser 5.778
When I enable the screen keyboard 0.131
Then the screen keyboard works in Tor Browser 32.861
And DuckDuckGo is the default search engine 5.277
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 20.973
And the layout of the screen keyboard is set to "us" 0.567
After features/support/hooks.rb:291 1.050
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.908
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.678
When I log in to a new session in French (fr) 35.048
Then the keyboard layout is set to "fr" 0.211
When the network is plugged 0.034
And Tor is ready 15.229
Then I successfully start the Unsafe Browser in "fr" 29.218
And I kill the Unsafe Browser 5.874
When I enable the screen keyboard 0.194
Then the screen keyboard works in Tor Browser 33.733
And DuckDuckGo is the default search engine 9.320
And I kill the Tor Browser 5.336
And the screen keyboard works in Thunderbird 20.404
And the layout of the screen keyboard is set to "fr" 0.621
After features/support/hooks.rb:291 1.259
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.593
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.437
When I log in to a new session in German (de) 28.616
Then the keyboard layout is set to "de" 0.236
When the network is plugged 0.036
And Tor is ready 14.476
Then I successfully start the Unsafe Browser in "de" 28.860
And I kill the Unsafe Browser 5.927
When I enable the screen keyboard 0.163
Then the screen keyboard works in Tor Browser 33.612
And DuckDuckGo is the default search engine 9.757
And I kill the Tor Browser 5.378
And the screen keyboard works in Thunderbird 20.519
And the layout of the screen keyboard is set to "de" 0.571
After features/support/hooks.rb:291 3.722
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.933
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.050
When I log in to a new session in Italian (it) 28.532
Then the keyboard layout is set to "it" 0.166
When the network is plugged 0.053
And Tor is ready 15.269
Then I successfully start the Unsafe Browser in "it" 26.721
And I kill the Unsafe Browser 6.125
When I enable the screen keyboard 0.156
Then the screen keyboard works in Tor Browser 33.680
And DuckDuckGo is the default search engine 9.484
And I kill the Tor Browser 5.443
And the screen keyboard works in Thunderbird 21.668
And the layout of the screen keyboard is set to "us" 0.580
After features/support/hooks.rb:291 1.164
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.550
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.705
When I log in to a new session in Persian (fa) 29.003
Then the keyboard layout is set to "ir" 0.161
When the network is plugged 0.039
And Tor is ready 14.922
Then I successfully start the Unsafe Browser in "fa" 28.270
And I kill the Unsafe Browser 5.851
When I enable the screen keyboard 0.174
Then the screen keyboard works in Tor Browser 35.191
And DuckDuckGo is the default search engine 9.760
And I kill the Tor Browser 5.368
And the screen keyboard works in Thunderbird 22.500
And the layout of the screen keyboard is set to "ir" 0.600
After features/support/hooks.rb:291 1.049
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:59.652
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.788
When I log in to a new session in Portuguese (pt) 28.391
Then the keyboard layout is set to "pt" 0.144
When the network is plugged 0.036
And Tor is ready 42.503
Then I successfully start the Unsafe Browser in "pt" 24.948
And I kill the Unsafe Browser 5.913
When I enable the screen keyboard 0.126
Then the screen keyboard works in Tor Browser 34.049
And DuckDuckGo is the default search engine 9.371
And I kill the Tor Browser 5.345
And the screen keyboard works in Thunderbird 20.429
And the layout of the screen keyboard is set to "us" 0.604
After features/support/hooks.rb:291 1.365
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.813
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.243
When I log in to a new session in Russian (ru) 29.434
Then the keyboard layout is set to "ru" 0.182
When the network is plugged 0.036
And Tor is ready 17.406
Then I successfully start the Unsafe Browser in "ru" 28.036
And I kill the Unsafe Browser 5.937
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 34.532
And DuckDuckGo is the default search engine 9.822
And I kill the Tor Browser 5.356
And the screen keyboard works in Thunderbird 25.002
And the layout of the screen keyboard is set to "ru" 0.727
After features/support/hooks.rb:291 1.133
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:41.310
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.178
When I log in to a new session in Spanish (es) 28.578
Then the keyboard layout is set to "es" 0.165
When the network is plugged 0.041
And Tor is ready 15.956
Then I successfully start the Unsafe Browser in "es" 28.610
And I kill the Unsafe Browser 5.900
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 35.130
And DuckDuckGo is the default search engine 10.478
And I kill the Tor Browser 5.586
And the screen keyboard works in Thunderbird 21.896
And the layout of the screen keyboard is set to "us" 0.654
After features/support/hooks.rb:291 2.228
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.468
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.136
When I log in to a new session in Turkish (tr) 28.084
Then the keyboard layout is set to "tr" 0.168
When the network is plugged 0.032
And Tor is ready 12.654
Then I successfully start the Unsafe Browser in "tr" 28.670
And I kill the Unsafe Browser 5.861
When I enable the screen keyboard 0.180
Then the screen keyboard works in Tor Browser 34.882
And DuckDuckGo is the default search engine 9.655
And I kill the Tor Browser 5.423
And the screen keyboard works in Thunderbird 24.090
And the layout of the screen keyboard is set to "us" 0.628
After features/support/hooks.rb:291 1.159
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:11.195
When the network is plugged 0.039
And I wait 720 seconds 12:0.092 
Slept for 720 seconds
Then I successfully configure Tor 11.014
And the time has synced 0.048
After features/support/hooks.rb:291 0.681
After features/support/hooks.rb:75 0.000