Project Number Date
test_Tails_ISO_devel 3178 24 Nov 2023, 12:28

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 280 0 0 0 0 280 24 0 24 1:27:14.046 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.687
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.128
And I prepare Tails for memory erasure tests 0.548
When I start a process allocating 128 MiB of memory with a known pattern 1.309
Then patterns cover at least 128 MiB in the guest's memory 4.548 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.200
Then I find very few patterns in the guest's memory 5.950 
Pattern coverage: 0.000% (0 MiB out of 1207 MiB reference memory)
After features/support/hooks.rb:290 0.671
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:6.281
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.264
And I prepare Tails for memory erasure tests 0.772
And I find very few patterns in the guest's memory 4.447 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 43.291
Then patterns cover at least 99% of the test FS size in the guest's memory 3.574 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.474
Then I find very few patterns in the guest's memory 5.456 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:290 1.043
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:0.173
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.909
And I prepare Tails for memory erasure tests 0.575
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.039
Then I find very few patterns in the guest's memory 4.224 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:18.112
Then patterns cover at least 86% of the test FS size in the guest's memory 4.089 
Pattern coverage: 98.478% (122 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.636
Then I find very few patterns in the guest's memory 4.392 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
# read cache
When I mount the USB drive again 0.411
And I read the content of the test FS 0.621
Then patterns cover at least 99% of the test FS size in the guest's memory 4.515 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.764
Then I find very few patterns in the guest's memory 4.880 
Pattern coverage: 0.000% (0 MiB out of 1209 MiB reference memory)
After features/support/hooks.rb:290 1.605
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:43.065
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and logged in 8.492
And I prepare Tails for memory erasure tests 0.717
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 26.804
Then I find very few patterns in the guest's memory 3.540 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:45.614
Then patterns cover at least 99% of the test FS size in the guest's memory 2.556 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.674
Then I find very few patterns in the guest's memory 3.529 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
# read cache
When I mount the USB drive again 3.615
And I read the content of the test FS 0.469
Then patterns cover at least 99% of the test FS size in the guest's memory 2.885 
Pattern coverage: 108.661% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.441
Then I find very few patterns in the guest's memory 3.723 
Pattern coverage: 0.000% (0 MiB out of 1215 MiB reference memory)
After features/support/hooks.rb:290 1.918
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
51.702
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.288
And I prepare Tails for memory erasure tests 0.730
When I fill a 128 MiB file with a known pattern on the root filesystem 14.228
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.596
Then patterns cover at least 128 MiB in the guest's memory 3.228 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.594
And I wait 20 seconds 20.004 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 3.032 
Pattern coverage: 0.000% (0 MiB out of 1190 MiB reference memory)
After features/support/hooks.rb:290 3.483
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:31.300
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:41.539
And I prepare Tails for memory erasure tests 0.533
When I fill a 128 MiB file with a known pattern on the persistent filesystem 26.348
When I trigger shutdown 0.434
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.424 
Pattern coverage: 0.000% (0 MiB out of 1191 MiB reference memory)
After features/support/hooks.rb:290 3.516
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
4:10.761
Before features/support/hooks.rb:245 0.002
Before features/support/hooks.rb:438 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 2:0.975
And I update APT using apt 17.698
When I install "popularity-contest" using apt 23.135
Then I am notified I can not use Additional Software for "popularity-contest" 1:6.484
And I can open the Additional Software documentation from the notification 22.468
After features/support/hooks.rb:446 37.487
After features/support/hooks.rb:290 2.156
After features/support/hooks.rb:75 0.007
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:55.594
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:438 0.008
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 55.527
And I update APT using apt 16.238
And I install "popularity-contest" using apt 19.805
Then I am proposed to add the "popularity-contest" package to my Additional Software 1:3.648
When I create a persistent storage and activate the Additional Software feature 18.792
Then Additional Software is correctly configured for package "popularity-contest" 1.657
When I shutdown Tails and wait for the computer to power off 11.206
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:47.470
Then Additional Software is correctly configured for package "popularity-contest" 0.951
And the package "popularity-contest" is installed after Additional Software has been started 0.296
After features/support/hooks.rb:446 36.994
After features/support/hooks.rb:290 0.943
After features/support/hooks.rb:75 0.016
Feature: Additional software
Tags: @product @check_tor_leaks @slow
3:6.242
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.008
Given a computer 0.205
And I start Tails from USB drive "__internal" and I login with an administration password 1:23.235
And I update APT using apt 16.480
When I install "makepp" using apt 19.861
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 1:6.036
And the package "makepp" is installed 0.424
After features/support/hooks.rb:446 41.498
After features/support/hooks.rb:290 1.039
After features/support/hooks.rb:75 0.036
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:52.883
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:438 0.009
Given a computer 0.220
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:14.727
When I uninstall "popularity-contest" using apt 15.937
And I accept removing "popularity-contest" from Additional Software 0.732
Then "popularity-contest" is not in the list of Additional Software 0.864
When I start Synaptic 20.362
And I update APT using Synaptic 22.007
And I install "cowsay" using Synaptic 8.410
And I accept adding "cowsay" to Additional Software 0.923
Then Additional Software is correctly configured for package "cowsay" 0.931
When I uninstall "cowsay" using apt 3.292
And I refuse removing "cowsay" from Additional Software 0.613
Then Additional Software is correctly configured for package "cowsay" 0.929
When I start "Additional Software" via GNOME Activities Overview 12.605
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.457
Then "cowsay" is not in the list of Additional Software 1.230
When I install "cowsay" using apt 3.304
And I refuse adding "cowsay" to Additional Software 0.581
Then "cowsay" is not in the list of Additional Software 0.749
After features/support/hooks.rb:446 1.373
After features/support/hooks.rb:290 0.703
After features/support/hooks.rb:75 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:16.982
Before features/support/hooks.rb:245 0.008
Before features/support/hooks.rb:438 0.008
Given a computer 0.205
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:13.604
And I configure APT to prefer an old version of cowsay 0.021
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 25.211
And I accept adding "cowsay" to Additional Software 1:8.090
And Additional Software is correctly configured for package "cowsay" 1.390
And I shutdown Tails and wait for the computer to power off 5.061
And I start Tails from USB drive "__internal" with network unplugged 46.462
And I enable persistence 34.495
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.025
And I log in to a new session 23.892
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 52.303
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.107
And the network is plugged 0.040
And Tor is ready 18.703
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.192
And available upgrades have been checked 0.162
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.067
And I can open the Additional Software configuration window from the notification 2.836
And I shutdown Tails and wait for the computer to power off 2:2.557
And I start Tails from USB drive "__internal" with network unplugged 47.185
And I enable persistence 36.497
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.021
And I log in to a new session 29.195
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.551
And I revert the APT tweaks that made it prefer an old version of cowsay 0.047
And the network is plugged 0.043
And Tor is ready 39.632
Then the Additional Software upgrade service has started 0.188
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.120
After features/support/hooks.rb:446 2.495
After features/support/hooks.rb:290 0.805
After features/support/hooks.rb:75 0.079
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.072
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:438 0.008
Given a computer 0.245
And I start Tails from USB drive "__internal" with network unplugged 47.301
And I enable persistence 33.815
And I remove the "cowsay" deb files from the APT cache 0.640
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.074
And I log in to a new session 28.990
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 0.870
And I can open the Additional Software log file from the notification 1.851
And the package "cowsay" is not installed 0.282
After features/support/hooks.rb:446 0.129
After features/support/hooks.rb:290 0.656
After features/support/hooks.rb:75 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.169
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 10.192
When I log in to a new session in Arabic (ar) 27.463
Then the keyboard layout is set to "us" 0.156
When the network is plugged 0.049
And Tor is ready 15.947
Then I successfully start the Unsafe Browser in "ar" 27.890
And I kill the Unsafe Browser 5.898
When I enable the screen keyboard 0.113
Then the screen keyboard works in Tor Browser 32.710
And DuckDuckGo is the default search engine 5.008
And I kill the Tor Browser 5.305
And the screen keyboard works in Thunderbird 21.876
And the layout of the screen keyboard is set to "us" 0.555
After features/support/hooks.rb:290 1.544
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.920
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.349
When I log in to a new session in Chinese (zh_CN) 27.805
Then the keyboard layout is set to "cn" 0.122
When the network is plugged 0.049
And Tor is ready 14.994
Then I successfully start the Unsafe Browser in "zh_CN" 28.518
And I kill the Unsafe Browser 6.093
When I enable the screen keyboard 0.121
Then the screen keyboard works in Tor Browser 32.639
And DuckDuckGo is the default search engine 4.558
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 24.742
And the layout of the screen keyboard is set to "us" 0.651
After features/support/hooks.rb:290 1.073
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.306
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.056
When I log in to a new session in English (en) 17.345
Then the keyboard layout is set to "us" 0.125
When the network is plugged 0.036
And Tor is ready 15.365
Then I successfully start the Unsafe Browser in "en" 26.463
And I kill the Unsafe Browser 6.141
When I enable the screen keyboard 0.137
Then the screen keyboard works in Tor Browser 32.478
And DuckDuckGo is the default search engine 4.894
And I kill the Tor Browser 5.343
And the screen keyboard works in Thunderbird 21.354
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:290 1.310
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:44.911
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 20.088
When I log in to a new session in French (fr) 29.226
Then the keyboard layout is set to "fr" 0.125
When the network is plugged 0.051
And Tor is ready 15.610
Then I successfully start the Unsafe Browser in "fr" 28.186
And I kill the Unsafe Browser 5.944
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 32.171
And DuckDuckGo is the default search engine 4.904
And I kill the Tor Browser 5.367
And the screen keyboard works in Thunderbird 22.567
And the layout of the screen keyboard is set to "fr" 0.563
After features/support/hooks.rb:290 1.180
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.470
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.587
When I log in to a new session in German (de) 28.175
Then the keyboard layout is set to "de" 0.341
When the network is plugged 0.035
And Tor is ready 15.584
Then I successfully start the Unsafe Browser in "de" 28.099
And I kill the Unsafe Browser 6.842
When I enable the screen keyboard 0.122
Then the screen keyboard works in Tor Browser 34.271
And DuckDuckGo is the default search engine 4.687
And I kill the Tor Browser 5.382
And the screen keyboard works in Thunderbird 21.775
And the layout of the screen keyboard is set to "de" 0.565
After features/support/hooks.rb:290 1.531
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.943
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.511
When I log in to a new session in Italian (it) 28.619
Then the keyboard layout is set to "it" 0.174
When the network is plugged 0.035
And Tor is ready 15.685
Then I successfully start the Unsafe Browser in "it" 29.601
And I kill the Unsafe Browser 5.860
When I enable the screen keyboard 0.119
Then the screen keyboard works in Tor Browser 33.410
And DuckDuckGo is the default search engine 4.777
And I kill the Tor Browser 5.371
And the screen keyboard works in Thunderbird 22.050
And the layout of the screen keyboard is set to "us" 0.726
After features/support/hooks.rb:290 1.142
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:36.548
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.497
When I log in to a new session in Persian (fa) 29.470
Then the keyboard layout is set to "ir" 0.104
When the network is plugged 0.052
And Tor is ready 13.915
Then I successfully start the Unsafe Browser in "fa" 28.193
And I kill the Unsafe Browser 6.510
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 35.533
And DuckDuckGo is the default search engine 4.571
And I kill the Tor Browser 5.273
And the screen keyboard works in Thunderbird 23.775
And the layout of the screen keyboard is set to "ir" 0.559
After features/support/hooks.rb:290 0.974
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:34.359
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.074
When I log in to a new session in Portuguese (pt) 30.434
Then the keyboard layout is set to "pt" 0.135
When the network is plugged 0.041
And Tor is ready 15.202
Then I successfully start the Unsafe Browser in "pt" 28.637
And I kill the Unsafe Browser 5.885
When I enable the screen keyboard 0.112
Then the screen keyboard works in Tor Browser 33.118
And DuckDuckGo is the default search engine 4.637
And I kill the Tor Browser 5.364
And the screen keyboard works in Thunderbird 21.128
And the layout of the screen keyboard is set to "us" 0.585
After features/support/hooks.rb:290 1.607
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:37.546
Before features/support/hooks.rb:245 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.163
When I log in to a new session in Russian (ru) 29.012
Then the keyboard layout is set to "ru" 0.290
When the network is plugged 0.035
And Tor is ready 19.714
Then I successfully start the Unsafe Browser in "ru" 27.504
And I kill the Unsafe Browser 5.935
When I enable the screen keyboard 0.078
Then the screen keyboard works in Tor Browser 33.204
And DuckDuckGo is the default search engine 4.660
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 23.026
And the layout of the screen keyboard is set to "ru" 0.589
After features/support/hooks.rb:290 1.415
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.197
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.698
When I log in to a new session in Spanish (es) 29.680
Then the keyboard layout is set to "es" 0.575
When the network is plugged 0.049
And Tor is ready 14.618
Then I successfully start the Unsafe Browser in "es" 26.056
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.089
Then the screen keyboard works in Tor Browser 32.432
And DuckDuckGo is the default search engine 4.838
And I kill the Tor Browser 5.314
And the screen keyboard works in Thunderbird 22.341
And the layout of the screen keyboard is set to "us" 0.636
After features/support/hooks.rb:290 1.288
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.193
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.900
When I log in to a new session in Turkish (tr) 27.829
Then the keyboard layout is set to "tr" 0.211
When the network is plugged 0.047
And Tor is ready 15.690
Then I successfully start the Unsafe Browser in "tr" 29.651
And I kill the Unsafe Browser 5.849
When I enable the screen keyboard 0.094
Then the screen keyboard works in Tor Browser 33.113
And DuckDuckGo is the default search engine 4.863
And I kill the Tor Browser 5.357
And the screen keyboard works in Thunderbird 21.946
And the layout of the screen keyboard is set to "us" 0.639
After features/support/hooks.rb:290 1.473
After features/support/hooks.rb:75 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:11.728
When the network is plugged 0.044
And I wait 720 seconds 12:0.097 
Slept for 720 seconds
Then I successfully configure Tor 11.523
And the time has synced 0.063
After features/support/hooks.rb:290 0.691
After features/support/hooks.rb:75 0.000