Project Number Date
test_Tails_ISO_stable 4547 03 Dec 2023, 12:20

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 271 0 0 0 0 271 22 0 22 1:10:55.413 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
18.561
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.893
And I prepare Tails for memory erasure tests 0.496
When I start a process allocating 128 MiB of memory with a known pattern 1.235
Then patterns cover at least 128 MiB in the guest's memory 3.504 
Pattern coverage: 100.100% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.290
Then I find very few patterns in the guest's memory 4.140 
Pattern coverage: 0.000% (0 MiB out of 1223 MiB reference memory)
After features/support/hooks.rb:291 0.747
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:5.489
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.284
And I prepare Tails for memory erasure tests 0.462
And I find very few patterns in the guest's memory 4.321 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 44.048
Then patterns cover at least 99% of the test FS size in the guest's memory 3.676 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.731
Then I find very few patterns in the guest's memory 3.966 
Pattern coverage: 0.000% (0 MiB out of 1204 MiB reference memory)
After features/support/hooks.rb:291 2.209
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
3:4.795
Before features/support/hooks.rb:245 0.002
Given I have started Tails from DVD without network and logged in 8.364
And I prepare Tails for memory erasure tests 0.466
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.119
Then I find very few patterns in the guest's memory 4.189 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2:26.722
Then patterns cover at least 86% of the test FS size in the guest's memory 4.343 
Pattern coverage: 96.770% (120 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.529
Then I find very few patterns in the guest's memory 3.540 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
# read cache
When I mount the USB drive again 0.242
And I read the content of the test FS 0.576
Then patterns cover at least 99% of the test FS size in the guest's memory 3.351 
Pattern coverage: 102.400% (127 MiB out of 124 MiB reference memory)
When I umount the USB drive 0.351
Then I find very few patterns in the guest's memory 3.998 
Pattern coverage: 0.000% (0 MiB out of 1202 MiB reference memory)
After features/support/hooks.rb:291 0.797
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
2:40.802
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 8.516
And I prepare Tails for memory erasure tests 0.479
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 22.825
Then I find very few patterns in the guest's memory 3.639 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1:46.235
Then patterns cover at least 99% of the test FS size in the guest's memory 2.763 
Pattern coverage: 108.660% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 0.839
Then I find very few patterns in the guest's memory 3.395 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
# read cache
When I mount the USB drive again 4.323
And I read the content of the test FS 0.708
Then patterns cover at least 99% of the test FS size in the guest's memory 2.494 
Pattern coverage: 108.663% (97 MiB out of 89 MiB reference memory)
When I umount the USB drive 1.101
Then I find very few patterns in the guest's memory 3.480 
Pattern coverage: 0.000% (0 MiB out of 1211 MiB reference memory)
After features/support/hooks.rb:291 0.885
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.819
Before features/support/hooks.rb:245 0.003
Given I have started Tails from DVD without network and logged in 10.121
And I prepare Tails for memory erasure tests 0.519
When I fill a 128 MiB file with a known pattern on the root filesystem 12.565
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.332
Then patterns cover at least 128 MiB in the guest's memory 2.555 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 1.857
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.848 
Pattern coverage: 0.000% (0 MiB out of 1206 MiB reference memory)
After features/support/hooks.rb:291 3.454
After features/support/hooks.rb:75 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
6:7.627
Before features/support/hooks.rb:245 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 5:21.807
And I prepare Tails for memory erasure tests 0.476
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.681
When I trigger shutdown 0.400
And I wait 20 seconds 20.020 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.241 
Pattern coverage: 0.000% (0 MiB out of 1153 MiB reference memory)
After features/support/hooks.rb:291 3.448
After features/support/hooks.rb:75 0.010
Feature: Additional software
Tags: @product @check_tor_leaks @slow
5:21.612
Before features/support/hooks.rb:245 0.003
Before features/support/hooks.rb:442 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 49.126
And I update APT using apt 15.817
And I install "popularity-contest" using apt 19.435
Then I am proposed to add the "popularity-contest" package to my Additional Software 56.206
When I create a persistent storage and activate the Additional Software feature 17.518
Then Additional Software is correctly configured for package "popularity-contest" 1.688
When I shutdown Tails and wait for the computer to power off 10.186
And I start Tails from USB drive "__internal" with network unplugged and I login with persistence enabled 2:30.393
Then Additional Software is correctly configured for package "popularity-contest" 0.965
And the package "popularity-contest" is installed after Additional Software has been started 0.274
After features/support/hooks.rb:450 36.080
After features/support/hooks.rb:291 1.474
After features/support/hooks.rb:75 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:54.462
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.007
Given a computer 0.213
And I start Tails from USB drive "__internal" and I login with an administration password 1:20.105
And I update APT using apt 15.511
When I install "makepp" using apt 19.564
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 58.996
And the package "makepp" is installed 0.071
After features/support/hooks.rb:450 38.143
After features/support/hooks.rb:291 1.025
After features/support/hooks.rb:75 0.014
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:51.734
Before features/support/hooks.rb:245 0.005
Before features/support/hooks.rb:442 0.005
Given a computer 0.215
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:8.533
When I uninstall "popularity-contest" using apt 15.884
And I accept removing "popularity-contest" from Additional Software 2.120
Then "popularity-contest" is not in the list of Additional Software 0.782
When I start Synaptic 23.581
And I update APT using Synaptic 21.813
And I install "cowsay" using Synaptic 9.353
And I accept adding "cowsay" to Additional Software 0.898
Then Additional Software is correctly configured for package "cowsay" 0.860
When I uninstall "cowsay" using apt 3.359
And I refuse removing "cowsay" from Additional Software 0.630
Then Additional Software is correctly configured for package "cowsay" 0.851
When I start "Additional Software" via GNOME Activities Overview 12.420
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 4.637
Then "cowsay" is not in the list of Additional Software 1.047
When I install "cowsay" using apt 3.254
And I refuse adding "cowsay" to Additional Software 0.749
Then "cowsay" is not in the list of Additional Software 0.738
After features/support/hooks.rb:450 0.968
After features/support/hooks.rb:291 0.712
After features/support/hooks.rb:75 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
12:26.691
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.008
Given a computer 0.228
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:8.536
And I configure APT to prefer an old version of cowsay 0.022
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.719
And I accept adding "cowsay" to Additional Software 1:6.802
And Additional Software is correctly configured for package "cowsay" 1.298
And I shutdown Tails and wait for the computer to power off 5.069
And I start Tails from USB drive "__internal" with network unplugged 45.195
And I enable persistence 31.582
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 20.868
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 51.025
And I revert the APT tweaks that made it prefer an old version of cowsay 0.080
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.107
And the network is plugged 0.054
And Tor is ready 18.429
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 5.979
And available upgrades have been checked 0.095
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 3.272
And I can open the Additional Software configuration window from the notification 3.512
And I shutdown Tails and wait for the computer to power off 2:3.682
And I start Tails from USB drive "__internal" with network unplugged 44.805
And I enable persistence 32.775
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.022
And I log in to a new session 30.529
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 41.598
And I revert the APT tweaks that made it prefer an old version of cowsay 0.063
And the network is plugged 0.043
And Tor is ready 1:7.000
Then the Additional Software upgrade service has started 0.156
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.109
After features/support/hooks.rb:450 2.425
After features/support/hooks.rb:291 0.981
After features/support/hooks.rb:75 0.027
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:43.889
Before features/support/hooks.rb:245 0.006
Before features/support/hooks.rb:442 0.006
Given a computer 0.191
And I start Tails from USB drive "__internal" with network unplugged 44.815
And I enable persistence 31.921
And I remove the "cowsay" deb files from the APT cache 0.610
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.080
And I log in to a new session 22.786
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 1.268
And I can open the Additional Software log file from the notification 2.010
And the package "cowsay" is not installed 0.204
After features/support/hooks.rb:450 0.111
After features/support/hooks.rb:291 0.764
After features/support/hooks.rb:75 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:39.712
Before features/support/hooks.rb:245 0.012
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.150
When I log in to a new session in Arabic (ar) 31.629
Then the keyboard layout is set to "us" 0.149
When the network is plugged 0.043
And Tor is ready 15.145
Then I successfully start the Unsafe Browser in "ar" 26.419
And I kill the Unsafe Browser 5.717
When I enable the screen keyboard 0.153
Then the screen keyboard works in Tor Browser 33.517
And DuckDuckGo is the default search engine 9.254
And I kill the Tor Browser 5.356
And the screen keyboard works in Thunderbird 22.602
And the layout of the screen keyboard is set to "us" 0.573
After features/support/hooks.rb:291 1.039
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.822
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.170
When I log in to a new session in Chinese (zh_CN) 29.587
Then the keyboard layout is set to "cn" 0.298
When the network is plugged 0.039
And Tor is ready 15.533
Then I successfully start the Unsafe Browser in "zh_CN" 27.111
And I kill the Unsafe Browser 5.823
When I enable the screen keyboard 0.161
Then the screen keyboard works in Tor Browser 33.774
And DuckDuckGo is the default search engine 9.506
And I kill the Tor Browser 5.344
And the screen keyboard works in Thunderbird 26.889
And the layout of the screen keyboard is set to "us" 0.583
After features/support/hooks.rb:291 1.511
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.214
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.953
When I log in to a new session in English (en) 16.722
Then the keyboard layout is set to "us" 0.183
When the network is plugged 0.067
And Tor is ready 15.976
Then I successfully start the Unsafe Browser in "en" 26.283
And I kill the Unsafe Browser 5.950
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 34.440
And DuckDuckGo is the default search engine 5.264
And I kill the Tor Browser 5.344
And the screen keyboard works in Thunderbird 22.375
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.205
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:33.045
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.894
When I log in to a new session in French (fr) 27.037
Then the keyboard layout is set to "fr" 0.153
When the network is plugged 0.046
And Tor is ready 15.055
Then I successfully start the Unsafe Browser in "fr" 26.439
And I kill the Unsafe Browser 5.907
When I enable the screen keyboard 0.152
Then the screen keyboard works in Tor Browser 32.599
And DuckDuckGo is the default search engine 9.698
And I kill the Tor Browser 5.330
And the screen keyboard works in Thunderbird 22.098
And the layout of the screen keyboard is set to "fr" 0.631
After features/support/hooks.rb:291 1.743
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
3:10.340
Before features/support/hooks.rb:245 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.157
When I log in to a new session in German (de) 29.123
Then the keyboard layout is set to "de" 0.171
When the network is plugged 0.039
And Tor is ready 44.822
Then I successfully start the Unsafe Browser in "de" 29.861
And I kill the Unsafe Browser 5.789
When I enable the screen keyboard 0.162
Then the screen keyboard works in Tor Browser 33.762
And DuckDuckGo is the default search engine 9.634
And I kill the Tor Browser 5.352
And the screen keyboard works in Thunderbird 22.868
And the layout of the screen keyboard is set to "de" 0.594
After features/support/hooks.rb:291 1.124
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.606
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.713
When I log in to a new session in Italian (it) 28.065
Then the keyboard layout is set to "it" 0.196
When the network is plugged 0.039
And Tor is ready 17.260
Then I successfully start the Unsafe Browser in "it" 27.110
And I kill the Unsafe Browser 5.940
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.622
And DuckDuckGo is the default search engine 9.739
And I kill the Tor Browser 5.453
And the screen keyboard works in Thunderbird 21.751
And the layout of the screen keyboard is set to "us" 0.582
After features/support/hooks.rb:291 1.179
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:40.065
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.919
When I log in to a new session in Persian (fa) 28.469
Then the keyboard layout is set to "ir" 0.144
When the network is plugged 0.041
And Tor is ready 15.064
Then I successfully start the Unsafe Browser in "fa" 28.058
And I kill the Unsafe Browser 5.811
When I enable the screen keyboard 0.142
Then the screen keyboard works in Tor Browser 34.684
And DuckDuckGo is the default search engine 10.049
And I kill the Tor Browser 5.331
And the screen keyboard works in Thunderbird 23.770
And the layout of the screen keyboard is set to "ir" 0.577
After features/support/hooks.rb:291 1.151
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.452
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.758
When I log in to a new session in Portuguese (pt) 28.986
Then the keyboard layout is set to "pt" 0.293
When the network is plugged 0.038
And Tor is ready 16.470
Then I successfully start the Unsafe Browser in "pt" 26.133
And I kill the Unsafe Browser 6.874
When I enable the screen keyboard 0.160
Then the screen keyboard works in Tor Browser 33.897
And DuckDuckGo is the default search engine 9.581
And I kill the Tor Browser 5.296
And the screen keyboard works in Thunderbird 22.247
And the layout of the screen keyboard is set to "us" 0.715
After features/support/hooks.rb:291 1.263
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:42.688
Before features/support/hooks.rb:245 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.817
When I log in to a new session in Russian (ru) 29.200
Then the keyboard layout is set to "ru" 0.172
When the network is plugged 0.046
And Tor is ready 15.193
Then I successfully start the Unsafe Browser in "ru" 27.999
And I kill the Unsafe Browser 5.802
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 33.795
And DuckDuckGo is the default search engine 9.500
And I kill the Tor Browser 5.368
And the screen keyboard works in Thunderbird 26.050
And the layout of the screen keyboard is set to "ru" 0.623
After features/support/hooks.rb:291 1.075
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:43.071
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.303
When I log in to a new session in Spanish (es) 31.420
Then the keyboard layout is set to "es" 0.155
When the network is plugged 0.051
And Tor is ready 15.603
Then I successfully start the Unsafe Browser in "es" 27.104
And I kill the Unsafe Browser 5.813
When I enable the screen keyboard 0.148
Then the screen keyboard works in Tor Browser 34.859
And DuckDuckGo is the default search engine 10.950
And I kill the Tor Browser 5.655
And the screen keyboard works in Thunderbird 22.413
And the layout of the screen keyboard is set to "us" 0.590
After features/support/hooks.rb:291 1.216
After features/support/hooks.rb:75 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:38.905
Before features/support/hooks.rb:245 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.812
When I log in to a new session in Turkish (tr) 29.261
Then the keyboard layout is set to "tr" 0.170
When the network is plugged 0.117
And Tor is ready 15.056
Then I successfully start the Unsafe Browser in "tr" 26.922
And I kill the Unsafe Browser 5.865
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 33.901
And DuckDuckGo is the default search engine 9.476
And I kill the Tor Browser 5.332
And the screen keyboard works in Thunderbird 24.314
And the layout of the screen keyboard is set to "us" 0.540
After features/support/hooks.rb:291 1.413
After features/support/hooks.rb:75 0.000