Project Number Date
test_Tails_ISO_devel 3252 25 Jan 2024, 13:07

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:27:9.485 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.452
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.872
And I prepare Tails for memory erasure tests 0.566
When I start a process allocating 128 MiB of memory with a known pattern 2.364
Then patterns cover at least 128 MiB in the guest's memory 3.432 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.267
Then I find very few patterns in the guest's memory 3.948 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 0.726
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
59.531
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.975
And I prepare Tails for memory erasure tests 0.456
And I find very few patterns in the guest's memory 3.618 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 39.551
Then patterns cover at least 99% of the test FS size in the guest's memory 3.978 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.274
Then I find very few patterns in the guest's memory 3.676 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 0.759
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:53.973
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.883
And I prepare Tails for memory erasure tests 0.544
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.818
Then I find very few patterns in the guest's memory 3.714 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:16.764
Then patterns cover at least 86% of the test FS size in the guest's memory 3.378 
Pattern coverage: 94.833% (118 MiB out of 124 MiB reference memory)
When I umount the USB drive 1.091
Then I find very few patterns in the guest's memory 3.700 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
# read cache
When I mount the USB drive again 0.323
And I read the content of the test FS 1.670
Then patterns cover at least 99% of the test FS size in the guest's memory 3.195 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.564
Then I find very few patterns in the guest's memory 4.323 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 0.926
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:47.512
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.230
And I prepare Tails for memory erasure tests 0.476
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 21.971
Then I find very few patterns in the guest's memory 3.906 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:48.920
Then patterns cover at least 99% of the test FS size in the guest's memory 4.554 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.896
Then I find very few patterns in the guest's memory 5.298 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
# read cache
When I mount the USB drive again 3.645
And I read the content of the test FS 0.437
Then patterns cover at least 99% of the test FS size in the guest's memory 3.936 
Pattern coverage: 108.662% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.893
Then I find very few patterns in the guest's memory 4.344 
Pattern coverage: 0.000% (0 MiB out of 1214 MiB reference memory)
After features/support/hooks.rb:291 1.837
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.375
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and logged in 8.365
And I prepare Tails for memory erasure tests 0.438
When I fill a 128 MiB file with a known pattern on the root filesystem 16.022
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 2.185
Then patterns cover at least 128 MiB in the guest's memory 2.636 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.896
And I wait 20 seconds 20.015 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.815 
Pattern coverage: 0.000% (0 MiB out of 1217 MiB reference memory)
After features/support/hooks.rb:291 3.494
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:3.564
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:19.285
And I prepare Tails for memory erasure tests 0.456
When I fill a 128 MiB file with a known pattern on the persistent filesystem 21.239
When I trigger shutdown 0.341
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.222 
Pattern coverage: 0.000% (0 MiB out of 1158 MiB reference memory)
After features/support/hooks.rb:291 3.470
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
3:29.753
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.012
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:28.486
And I update APT using apt 17.013
When I install "popularity-contest" using apt 19.679
Then I am notified I can not use Additional Software for "popularity-contest" 59.039
And I can open the Additional Software documentation from the notification 25.534
After features/support/hooks.rb:450 42.614
After features/support/hooks.rb:291 2.375
After features/support/hooks.rb:75 0.005
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:39.291
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:442 0.009
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.854
And I update APT using apt 16.480
And I install "popularity-contest" using apt 19.579
Then I am proposed to add the "popularity-contest" package to my Additional Software 58.215
When I create a persistent storage and activate the Additional Software feature 19.271
Then Additional Software is correctly configured for package "popularity-contest" 1.544
When I shutdown Tails and wait for the computer to power off 11.110
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:37.949
Then Additional Software is correctly configured for package "popularity-contest" 1.010
And the package "popularity-contest" is installed after Additional Software has been started 0.275
After features/support/hooks.rb:450 40.782
After features/support/hooks.rb:291 1.123
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:54.086
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.007
Given a computer 0.224
And I start Tails from USB drive "__internal" and I login with an administration password 1:19.436
And I update APT using apt 16.480
When I install "makepp" using apt 19.736
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.112
And the package "makepp" is installed 0.095
After features/support/hooks.rb:450 41.819
After features/support/hooks.rb:291 0.945
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:1.196
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.006
Given a computer 0.186
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:12.550
When I uninstall "popularity-contest" using apt 19.084
And I accept removing "popularity-contest" from Additional Software 0.700
Then "popularity-contest" is not in the list of Additional Software 0.794
When I start Synaptic 23.700
And I update APT using Synaptic 21.783
And I install "cowsay" using Synaptic 11.048
And I accept adding "cowsay" to Additional Software 0.840
Then Additional Software is correctly configured for package "cowsay" 0.893
When I uninstall "cowsay" using apt 3.402
And I refuse removing "cowsay" from Additional Software 1.067
Then Additional Software is correctly configured for package "cowsay" 0.964
When I start "Additional Software" via GNOME Activities Overview 12.399
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 6.009
Then "cowsay" is not in the list of Additional Software 0.950
When I install "cowsay" using apt 3.315
And I refuse adding "cowsay" to Additional Software 0.678
Then "cowsay" is not in the list of Additional Software 0.825
After features/support/hooks.rb:450 0.995
After features/support/hooks.rb:291 0.732
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:34.461
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.167
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:2.990
And I configure APT to prefer an old version of cowsay 0.032
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.390
And I accept adding "cowsay" to Additional Software 1:4.449
And Additional Software is correctly configured for package "cowsay" 1.296
And I shutdown Tails and wait for the computer to power off 5.072
And I start Tails from USB drive "__internal" with network unplugged 45.599
And I enable persistence 30.769
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 22.059
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.330
And I revert the APT tweaks that made it prefer an old version of cowsay 0.068
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.093
And the network is plugged 0.038
And Tor is ready 17.796
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.192
And available upgrades have been checked 0.098
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.446
And I can open the Additional Software configuration window from the notification 2.603
And I shutdown Tails and wait for the computer to power off 2:2.438
And I start Tails from USB drive "__internal" with network unplugged 45.870
And I enable persistence 34.625
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.029
And I log in to a new session 21.012
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 42.137
And I revert the APT tweaks that made it prefer an old version of cowsay 0.071
And the network is plugged 0.042
And Tor is ready 41.408
Then the Additional Software upgrade service has started 0.183
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.120
After features/support/hooks.rb:450 2.655
After features/support/hooks.rb:291 0.738
After features/support/hooks.rb:75 0.050
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:47.249
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.200
And I start Tails from USB drive "__internal" with network unplugged 46.310
And I enable persistence 30.872
And I remove the "cowsay" deb files from the APT cache 0.656
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.082
And I log in to a new session 21.274
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 4.317
And I can open the Additional Software log file from the notification 3.356
And the package "cowsay" is not installed 0.177
After features/support/hooks.rb:450 0.116
After features/support/hooks.rb:291 0.990
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.992
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.624
When I log in to a new session in Arabic (ar) 30.940
Then the keyboard layout is set to "us" 0.314
When the network is plugged 0.064
And Tor is ready 14.744
Then I successfully start the Unsafe Browser in "ar" 27.051
And I kill the Unsafe Browser 5.933
When I enable the screen keyboard 0.164
Then the screen keyboard works in Tor Browser 35.784
And DuckDuckGo is the default search engine 10.906
And I kill the Tor Browser 5.636
And the screen keyboard works in Thunderbird 23.210
And the layout of the screen keyboard is set to "us" 0.617
After features/support/hooks.rb:291 2.934
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:55.724
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.766
When I log in to a new session in Chinese (zh_CN) 31.131
Then the keyboard layout is set to "cn" 0.219
When the network is plugged 0.045
And Tor is ready 16.033
Then I successfully start the Unsafe Browser in "zh_CN" 28.119
And I kill the Unsafe Browser 6.417
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 35.518
And DuckDuckGo is the default search engine 10.913
And I kill the Tor Browser 5.623
And the screen keyboard works in Thunderbird 32.115
And the layout of the screen keyboard is set to "us" 0.695
After features/support/hooks.rb:291 1.448
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.727
Before features/support/hooks.rb:245 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.893
When I log in to a new session in English (en) 21.468
Then the keyboard layout is set to "us" 0.193
When the network is plugged 0.049
And Tor is ready 16.300
Then I successfully start the Unsafe Browser in "en" 25.837
And I kill the Unsafe Browser 5.827
When I enable the screen keyboard 0.098
Then the screen keyboard works in Tor Browser 37.770
And DuckDuckGo is the default search engine 5.776
And I kill the Tor Browser 5.321
And the screen keyboard works in Thunderbird 23.560
And the layout of the screen keyboard is set to "us" 0.626
After features/support/hooks.rb:291 0.997
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.142
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.198
When I log in to a new session in French (fr) 30.072
Then the keyboard layout is set to "fr" 0.153
When the network is plugged 0.045
And Tor is ready 15.637
Then I successfully start the Unsafe Browser in "fr" 27.998
And I kill the Unsafe Browser 5.956
When I enable the screen keyboard 0.146
Then the screen keyboard works in Tor Browser 35.354
And DuckDuckGo is the default search engine 10.525
And I kill the Tor Browser 5.532
And the screen keyboard works in Thunderbird 22.870
And the layout of the screen keyboard is set to "fr" 0.650
After features/support/hooks.rb:291 1.255
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:49.266
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.373
When I log in to a new session in German (de) 32.290
Then the keyboard layout is set to "de" 0.295
When the network is plugged 0.364
And Tor is ready 16.242
Then I successfully start the Unsafe Browser in "de" 27.761
And I kill the Unsafe Browser 6.075
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 34.231
And DuckDuckGo is the default search engine 10.636
And I kill the Tor Browser 5.620
And the screen keyboard works in Thunderbird 25.619
And the layout of the screen keyboard is set to "de" 0.612
After features/support/hooks.rb:291 1.319
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.330
Before features/support/hooks.rb:245 0.018
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.261
When I log in to a new session in Italian (it) 29.974
Then the keyboard layout is set to "it" 0.227
When the network is plugged 0.054
And Tor is ready 19.426
Then I successfully start the Unsafe Browser in "it" 28.008
And I kill the Unsafe Browser 5.876
When I enable the screen keyboard 0.229
Then the screen keyboard works in Tor Browser 35.284
And DuckDuckGo is the default search engine 10.205
And I kill the Tor Browser 5.596
And the screen keyboard works in Thunderbird 21.634
And the layout of the screen keyboard is set to "us" 0.549
After features/support/hooks.rb:291 1.190
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.450
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.047
When I log in to a new session in Persian (fa) 32.440
Then the keyboard layout is set to "ir" 0.258
When the network is plugged 0.080
And Tor is ready 16.592
Then I successfully start the Unsafe Browser in "fa" 28.867
And I kill the Unsafe Browser 5.843
When I enable the screen keyboard 0.108
Then the screen keyboard works in Tor Browser 36.064
And DuckDuckGo is the default search engine 9.694
And I kill the Tor Browser 5.328
And the screen keyboard works in Thunderbird 26.488
And the layout of the screen keyboard is set to "ir" 0.635
After features/support/hooks.rb:291 2.120
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.084
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.420
When I log in to a new session in Portuguese (pt) 30.453
Then the keyboard layout is set to "pt" 0.160
When the network is plugged 0.036
And Tor is ready 16.244
Then I successfully start the Unsafe Browser in "pt" 26.037
And I kill the Unsafe Browser 5.959
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 35.683
And DuckDuckGo is the default search engine 10.057
And I kill the Tor Browser 5.441
And the screen keyboard works in Thunderbird 22.807
And the layout of the screen keyboard is set to "us" 0.639
After features/support/hooks.rb:291 1.434
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.248
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.723
When I log in to a new session in Russian (ru) 29.444
Then the keyboard layout is set to "ru" 0.151
When the network is plugged 0.028
And Tor is ready 14.944
Then I successfully start the Unsafe Browser in "ru" 26.854
And I kill the Unsafe Browser 5.954
When I enable the screen keyboard 0.134
Then the screen keyboard works in Tor Browser 35.744
And DuckDuckGo is the default search engine 9.903
And I kill the Tor Browser 5.321
And the screen keyboard works in Thunderbird 24.448
And the layout of the screen keyboard is set to "ru" 0.593
After features/support/hooks.rb:291 1.052
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.981
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.049
When I log in to a new session in Spanish (es) 30.319
Then the keyboard layout is set to "es" 0.195
When the network is plugged 0.043
And Tor is ready 15.919
Then I successfully start the Unsafe Browser in "es" 28.635
And I kill the Unsafe Browser 5.839
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 36.333
And DuckDuckGo is the default search engine 9.633
And I kill the Tor Browser 5.333
And the screen keyboard works in Thunderbird 22.915
And the layout of the screen keyboard is set to "us" 0.624
After features/support/hooks.rb:291 1.395
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:7.069
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.561
When I log in to a new session in Turkish (tr) 29.127
Then the keyboard layout is set to "tr" 0.130
When the network is plugged 0.034
And Tor is ready 44.157
Then I successfully start the Unsafe Browser in "tr" 26.709
And I kill the Unsafe Browser 6.010
When I enable the screen keyboard 0.123
Then the screen keyboard works in Tor Browser 34.931
And DuckDuckGo is the default search engine 9.454
And I kill the Tor Browser 5.326
And the screen keyboard works in Thunderbird 21.927
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.142
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:11.018
When the network is plugged 0.061
And I wait 720 seconds 12:0.062 
Slept for 720 seconds
Then I successfully configure Tor 10.824
And the time has synced 0.070
After features/support/hooks.rb:291 0.668
After features/support/hooks.rb:75 0.000