Project Number Date
test_Tails_ISO_stable 4719 14 Mar 2024, 16:53

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:1:4.218 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.703
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.137
And I prepare Tails for memory erasure tests 0.758
When I start a process allocating 128 MiB of memory with a known pattern 1.236
Then patterns cover at least 128 MiB in the guest's memory 3.972 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.654
Then I find very few patterns in the guest's memory 3.943 
Pattern coverage: 0.000% (0 MiB out of 938 MiB reference memory)
After features/support/hooks.rb:291 1.050
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.945
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.223
And I prepare Tails for memory erasure tests 0.473
And I find very few patterns in the guest's memory 3.443 
Pattern coverage: 0.000% (0 MiB out of 936 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.458
Then patterns cover at least 99% of the test FS size in the guest's memory 3.206 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.445
Then I find very few patterns in the guest's memory 3.694 
Pattern coverage: 0.000% (0 MiB out of 936 MiB reference memory)
After features/support/hooks.rb:291 1.437
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
40.775
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.278
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with a vfat filesystem 6.847
Then I find very few patterns in the guest's memory 4.021 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 4.475
Then patterns cover at least 86% of the test FS size in the guest's memory 3.138 
Pattern coverage: 95.050% (121 MiB out of 127 MiB reference memory)
When I umount the USB drive 1.023
Then I find very few patterns in the guest's memory 3.645 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
# read cache
When I mount the USB drive again 0.248
And I read the content of the test FS 0.570
Then patterns cover at least 99% of the test FS size in the guest's memory 3.276 
Pattern coverage: 100.000% (127 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.502
Then I find very few patterns in the guest's memory 4.296 
Pattern coverage: 0.000% (0 MiB out of 941 MiB reference memory)
After features/support/hooks.rb:291 0.708
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:2.927
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 7.945
And I prepare Tails for memory erasure tests 0.702
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.492
Then I find very few patterns in the guest's memory 3.648 
Pattern coverage: 0.000% (0 MiB out of 943 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.544
Then patterns cover at least 99% of the test FS size in the guest's memory 2.850 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.748
Then I find very few patterns in the guest's memory 3.740 
Pattern coverage: 0.000% (0 MiB out of 943 MiB reference memory)
# read cache
When I mount the USB drive again 4.369
And I read the content of the test FS 0.538
Then patterns cover at least 99% of the test FS size in the guest's memory 2.861 
Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.074
Then I find very few patterns in the guest's memory 3.412 
Pattern coverage: 0.000% (0 MiB out of 943 MiB reference memory)
After features/support/hooks.rb:291 0.801
After features/support/hooks.rb:75 0.001
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
47.461
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and logged in 7.958
And I prepare Tails for memory erasure tests 0.485
When I fill a 128 MiB file with a known pattern on the root filesystem 13.238
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.575
Then patterns cover at least 128 MiB in the guest's memory 2.439 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.011
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.732 
Pattern coverage: 0.000% (0 MiB out of 917 MiB reference memory)
After features/support/hooks.rb:291 3.524
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:35.857
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:53.033
And I prepare Tails for memory erasure tests 0.409
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.232
When I trigger shutdown 0.010
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.152 
Pattern coverage: 0.000% (0 MiB out of 944 MiB reference memory)
After features/support/hooks.rb:291 3.716
After features/support/hooks.rb:75 0.011
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:36.870
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.003
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 54.769
And I update APT using apt 17.771
And I install "popularity-contest" using apt 19.748
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.641
When I create a persistent storage and activate the Additional Software feature 20.066
Then Additional Software is correctly configured for package "popularity-contest" 1.215
When I shutdown Tails and wait for the computer to power off 9.023
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:27.659
Then Additional Software is correctly configured for package "popularity-contest" 0.696
And the package "popularity-contest" is installed after Additional Software has been started 0.277
After features/support/hooks.rb:450 37.551
After features/support/hooks.rb:291 1.129
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:13.288
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with an administration password 1:30.560
And I update APT using apt 16.646
When I install "makepp" using apt 19.298
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.488
And the package "makepp" is installed 0.093
After features/support/hooks.rb:450 42.769
After features/support/hooks.rb:291 1.116
After features/support/hooks.rb:75 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:45.927
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.741
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:2.000
When I uninstall "popularity-contest" using apt 18.716
And I accept removing "popularity-contest" from Additional Software 0.573
Then "popularity-contest" is not in the list of Additional Software 0.724
When I start Synaptic 22.792
And I update APT using Synaptic 22.280
And I install "cowsay" using Synaptic 9.692
And I accept adding "cowsay" to Additional Software 1.061
Then Additional Software is correctly configured for package "cowsay" 0.900
When I uninstall "cowsay" using apt 3.261
And I refuse removing "cowsay" from Additional Software 0.507
Then Additional Software is correctly configured for package "cowsay" 0.771
When I start "Additional Software" via GNOME Activities Overview 10.665
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.671
Then "cowsay" is not in the list of Additional Software 1.052
When I install "cowsay" using apt 3.235
And I refuse adding "cowsay" to Additional Software 0.556
Then "cowsay" is not in the list of Additional Software 0.722
After features/support/hooks.rb:450 0.969
After features/support/hooks.rb:291 0.721
After features/support/hooks.rb:75 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
10:28.143
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.200
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.798
And I configure APT to prefer an old version of cowsay 0.023
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.254
And I accept adding "cowsay" to Additional Software 5.922
And Additional Software is correctly configured for package "cowsay" 0.872
And I shutdown Tails and wait for the computer to power off 6.030
And I start Tails from USB drive "__internal" with network unplugged 54.802
And I enable persistence 11.208
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 34.963
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.387
And I revert the APT tweaks that made it prefer an old version of cowsay 0.064
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.079
And the network is plugged 0.042
And Tor is ready 19.827
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 6.902
And available upgrades have been checked 0.084
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.354
And I can open the Additional Software configuration window from the notification 3.583
And I shutdown Tails and wait for the computer to power off 2:2.431
And I start Tails from USB drive "__internal" with network unplugged 55.932
And I enable persistence 13.483
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 35.518
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.697
And I revert the APT tweaks that made it prefer an old version of cowsay 0.061
And the network is plugged 0.051
And Tor is ready 39.156
Then the Additional Software upgrade service has started 0.246
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.113
After features/support/hooks.rb:450 2.241
After features/support/hooks.rb:291 0.676
After features/support/hooks.rb:75 0.049
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:54.747
Before features/support/hooks.rb:245 0.007
Before features/support/hooks.rb:442 0.008
Given a computer 0.238
And I start Tails from USB drive "__internal" with network unplugged 56.147
And I enable persistence 12.231
And I remove the "cowsay" deb files from the APT cache 0.739
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.089
And I log in to a new session 34.207
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 6.149
And I can open the Additional Software log file from the notification 4.388
And the package "cowsay" is not installed 0.555
After features/support/hooks.rb:450 0.121
After features/support/hooks.rb:291 1.015
After features/support/hooks.rb:75 0.010
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.892
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.158
When I log in to a new session in Arabic (ar) 30.133
Then the keyboard layout is set to "us" 0.132
When the network is plugged 0.046
And Tor is ready 14.795
Then I successfully start the Unsafe Browser in "ar" 12.517
And I kill the Unsafe Browser 6.060
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 33.142
And DuckDuckGo is the default search engine 10.973
And I kill the Tor Browser 5.497
And the screen keyboard works in Thunderbird 21.746
And the layout of the screen keyboard is set to "us" 0.563
After features/support/hooks.rb:291 0.902
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:28.903
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.035
When I log in to a new session in Chinese (zh_CN) 30.073
Then the keyboard layout is set to "cn" 0.291
When the network is plugged 0.041
And Tor is ready 13.413
Then I successfully start the Unsafe Browser in "zh_CN" 13.494
And I kill the Unsafe Browser 5.784
When I enable the screen keyboard 0.081
Then the screen keyboard works in Tor Browser 36.300
And DuckDuckGo is the default search engine 10.553
And I kill the Tor Browser 5.457
And the screen keyboard works in Thunderbird 24.784
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:291 2.312
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:4.554
Before features/support/hooks.rb:245 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.506
When I log in to a new session in English (en) 18.297
Then the keyboard layout is set to "us" 0.172
When the network is plugged 0.046
And Tor is ready 13.379
Then I successfully start the Unsafe Browser in "en" 13.157
And I kill the Unsafe Browser 5.804
When I enable the screen keyboard 0.100
Then the screen keyboard works in Tor Browser 33.086
And DuckDuckGo is the default search engine 5.134
And I kill the Tor Browser 5.292
And the screen keyboard works in Thunderbird 20.048
And the layout of the screen keyboard is set to "us" 0.527
After features/support/hooks.rb:291 2.800
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.126
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.017
When I log in to a new session in French (fr) 30.094
Then the keyboard layout is set to "fr" 0.153
When the network is plugged 0.037
And Tor is ready 16.120
Then I successfully start the Unsafe Browser in "fr" 12.743
And I kill the Unsafe Browser 5.981
When I enable the screen keyboard 0.102
Then the screen keyboard works in Tor Browser 33.015
And DuckDuckGo is the default search engine 10.231
And I kill the Tor Browser 5.552
And the screen keyboard works in Thunderbird 20.500
And the layout of the screen keyboard is set to "fr" 0.575
After features/support/hooks.rb:291 1.226
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.963
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.795
When I log in to a new session in German (de) 29.755
Then the keyboard layout is set to "de" 0.285
When the network is plugged 0.038
And Tor is ready 15.855
Then I successfully start the Unsafe Browser in "de" 12.829
And I kill the Unsafe Browser 6.028
When I enable the screen keyboard 0.085
Then the screen keyboard works in Tor Browser 32.433
And DuckDuckGo is the default search engine 11.017
And I kill the Tor Browser 5.507
And the screen keyboard works in Thunderbird 21.747
And the layout of the screen keyboard is set to "de" 0.583
After features/support/hooks.rb:291 1.192
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:50.328
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.840
When I log in to a new session in Italian (it) 30.433
Then the keyboard layout is set to "it" 0.117
When the network is plugged 0.052
And Tor is ready 41.745
Then I successfully start the Unsafe Browser in "it" 13.258
And I kill the Unsafe Browser 5.770
When I enable the screen keyboard 0.080
Then the screen keyboard works in Tor Browser 33.854
And DuckDuckGo is the default search engine 9.773
And I kill the Tor Browser 5.253
And the screen keyboard works in Thunderbird 21.539
And the layout of the screen keyboard is set to "us" 0.609
After features/support/hooks.rb:291 1.257
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:53.617
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.872
When I log in to a new session in Persian (fa) 30.217
Then the keyboard layout is set to "ir" 0.181
When the network is plugged 0.054
And Tor is ready 42.905
Then I successfully start the Unsafe Browser in "fa" 13.276
And I kill the Unsafe Browser 5.764
When I enable the screen keyboard 0.124
Then the screen keyboard works in Tor Browser 34.479
And DuckDuckGo is the default search engine 10.226
And I kill the Tor Browser 5.234
And the screen keyboard works in Thunderbird 22.689
And the layout of the screen keyboard is set to "ir" 0.591
After features/support/hooks.rb:291 1.784
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:25.137
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.901
When I log in to a new session in Portuguese (pt) 31.411
Then the keyboard layout is set to "pt" 0.461
When the network is plugged 0.072
And Tor is ready 14.534
Then I successfully start the Unsafe Browser in "pt" 13.930
And I kill the Unsafe Browser 5.679
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 33.450
And DuckDuckGo is the default search engine 9.988
And I kill the Tor Browser 5.237
And the screen keyboard works in Thunderbird 21.817
And the layout of the screen keyboard is set to "us" 0.569
After features/support/hooks.rb:291 1.440
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:22.488
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.080
When I log in to a new session in Russian (ru) 30.250
Then the keyboard layout is set to "ru" 0.142
When the network is plugged 0.042
And Tor is ready 14.882
Then I successfully start the Unsafe Browser in "ru" 12.734
And I kill the Unsafe Browser 5.890
When I enable the screen keyboard 0.084
Then the screen keyboard works in Tor Browser 30.287
And DuckDuckGo is the default search engine 9.570
And I kill the Tor Browser 5.272
And the screen keyboard works in Thunderbird 24.702
And the layout of the screen keyboard is set to "ru" 0.547
After features/support/hooks.rb:291 1.259
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.894
Before features/support/hooks.rb:245 0.004
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.806
When I log in to a new session in Spanish (es) 29.526
Then the keyboard layout is set to "es" 0.176
When the network is plugged 0.046
And Tor is ready 16.383
Then I successfully start the Unsafe Browser in "es" 12.284
And I kill the Unsafe Browser 6.332
When I enable the screen keyboard 0.075
Then the screen keyboard works in Tor Browser 33.092
And DuckDuckGo is the default search engine 10.994
And I kill the Tor Browser 5.529
And the screen keyboard works in Thunderbird 21.112
And the layout of the screen keyboard is set to "us" 0.534
After features/support/hooks.rb:291 1.662
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.663
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.827
When I log in to a new session in Turkish (tr) 30.446
Then the keyboard layout is set to "tr" 0.206
When the network is plugged 0.048
And Tor is ready 15.656
Then I successfully start the Unsafe Browser in "tr" 13.526
And I kill the Unsafe Browser 5.876
When I enable the screen keyboard 0.127
Then the screen keyboard works in Tor Browser 31.868
And DuckDuckGo is the default search engine 25.413
And I kill the Tor Browser 5.582
And the screen keyboard works in Thunderbird 21.520
And the layout of the screen keyboard is set to "us" 0.562
After features/support/hooks.rb:291 1.759
After features/support/hooks.rb:75 0.000