Project Number Date
test_Tails_ISO_stable 4774 05 Apr 2024, 16:57

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 275 0 0 0 0 275 22 0 22 1:1:7.910 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
26.511
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.548
And I prepare Tails for memory erasure tests 0.540
When I start a process allocating 128 MiB of memory with a known pattern 2.714
Then patterns cover at least 128 MiB in the guest's memory 4.978 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 1.292
Then I find very few patterns in the guest's memory 8.437 
Pattern coverage: 0.000% (0 MiB out of 892 MiB reference memory)
After features/support/hooks.rb:305 1.236
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
29.186
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 9.511
And I prepare Tails for memory erasure tests 0.441
And I find very few patterns in the guest's memory 8.109 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.828
Then patterns cover at least 99% of the test FS size in the guest's memory 4.277 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.694
Then I find very few patterns in the guest's memory 4.322 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
After features/support/hooks.rb:305 0.723
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
43.160
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.095
And I prepare Tails for memory erasure tests 0.414
When I plug and mount a 128 MiB USB drive with a vfat filesystem 7.902
Then I find very few patterns in the guest's memory 5.141 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 2.386
Then patterns cover at least 86% of the test FS size in the guest's memory 4.264 
Pattern coverage: 88.649% (113 MiB out of 127 MiB reference memory)
When I umount the USB drive 2.070
Then I find very few patterns in the guest's memory 4.014 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
# read cache
When I mount the USB drive again 0.278
And I read the content of the test FS 0.518
Then patterns cover at least 99% of the test FS size in the guest's memory 3.246 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.436
Then I find very few patterns in the guest's memory 4.389 
Pattern coverage: 0.000% (0 MiB out of 893 MiB reference memory)
After features/support/hooks.rb:305 0.732
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:3.555
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.172
And I prepare Tails for memory erasure tests 0.441
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 29.544
Then I find very few patterns in the guest's memory 3.568 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.921
Then patterns cover at least 99% of the test FS size in the guest's memory 3.017 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.708
Then I find very few patterns in the guest's memory 3.301 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
# read cache
When I mount the USB drive again 5.515
And I read the content of the test FS 0.340
Then patterns cover at least 99% of the test FS size in the guest's memory 2.977 
Pattern coverage: 106.117% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.687
Then I find very few patterns in the guest's memory 3.358 
Pattern coverage: 0.000% (0 MiB out of 891 MiB reference memory)
After features/support/hooks.rb:305 0.808
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
52.859
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.630
And I prepare Tails for memory erasure tests 0.506
When I fill a 128 MiB file with a known pattern on the root filesystem 17.357
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.093
Then patterns cover at least 128 MiB in the guest's memory 3.209 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.016
And I wait 20 seconds 20.013 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.033 
Pattern coverage: 0.000% (0 MiB out of 887 MiB reference memory)
After features/support/hooks.rb:305 3.686
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:16.843
Before features/support/hooks.rb:259 0.002
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:33.498
And I prepare Tails for memory erasure tests 0.470
When I fill a 128 MiB file with a known pattern on the persistent filesystem 20.641
When I trigger shutdown 0.014
And I wait 20 seconds 20.012 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.206 
Pattern coverage: 0.000% (0 MiB out of 914 MiB reference memory)
After features/support/hooks.rb:305 3.505
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:41.065
Before features/support/hooks.rb:259 0.003
Before features/support/hooks.rb:456 0.011
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 53.502
And I update APT using apt 17.341
And I install "popularity-contest" using apt 19.340
Then I am proposed to add the "popularity-contest" package to my Additional Software 6.671
When I create a persistent storage and activate the Additional Software feature 21.178
Then Additional Software is correctly configured for package "popularity-contest" 1.479
When I shutdown Tails and wait for the computer to power off 12.434
And I start Tails from USB drive "__internal" with network unplugged 56.741
And I enable persistence 23.211
And I log in to a new session 35.600
And the Additional Software installation service has started 30.669
Then I am notified that the installation succeeded 1.864
And Additional Software is correctly configured for package "popularity-contest" 0.770
And the package "popularity-contest" is installed after Additional Software has been started 0.257
After features/support/hooks.rb:464 39.311
After features/support/hooks.rb:305 1.211
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:15.611
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.005
Given a computer 0.186
And I start Tails from USB drive "__internal" and I login with an administration password 1:32.045
And I update APT using apt 18.596
When I install "makepp" using apt 19.288
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 5.406
And the package "makepp" is installed 0.086
After features/support/hooks.rb:464 41.477
After features/support/hooks.rb:305 0.849
After features/support/hooks.rb:89 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:41.206
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.008
Given a computer 0.224
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:58.280
When I uninstall "popularity-contest" using apt 18.715
And I accept removing "popularity-contest" from Additional Software 0.533
Then "popularity-contest" is not in the list of Additional Software 0.748
When I start Synaptic 22.826
And I update APT using Synaptic 22.248
And I install "cowsay" using Synaptic 9.444
And I accept adding "cowsay" to Additional Software 1.163
Then Additional Software is correctly configured for package "cowsay" 0.727
When I uninstall "cowsay" using apt 3.240
And I refuse removing "cowsay" from Additional Software 0.514
Then Additional Software is correctly configured for package "cowsay" 0.830
When I start "Additional Software" via GNOME Activities Overview 10.536
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.717
Then "cowsay" is not in the list of Additional Software 1.042
When I install "cowsay" using apt 3.207
And I refuse adding "cowsay" to Additional Software 0.539
Then "cowsay" is not in the list of Additional Software 0.665
After features/support/hooks.rb:464 0.985
After features/support/hooks.rb:305 0.853
After features/support/hooks.rb:89 0.009
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
11:13.277
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.004
Given a computer 0.397
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:15.869
And I configure APT to prefer an old version of cowsay 0.025
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 23.395
And I accept adding "cowsay" to Additional Software 7.089
And Additional Software is correctly configured for package "cowsay" 0.891
And I shutdown Tails and wait for the computer to power off 6.448
And I start Tails from USB drive "__internal" with network unplugged 1:4.650
And I enable persistence 12.799
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 35.305
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.045
And I revert the APT tweaks that made it prefer an old version of cowsay 0.078
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.107
And the network is plugged 0.044
And Tor is ready 18.483
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 7.013
And available upgrades have been checked 0.118
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.064
And I can open the Additional Software configuration window from the notification 2.804
And I shutdown Tails and wait for the computer to power off 2:2.655
And I start Tails from USB drive "__internal" with network unplugged 56.004
And I enable persistence 10.331
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.024
And I log in to a new session 36.090
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.517
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.032
And Tor is ready 1:8.576
Then the Additional Software upgrade service has started 0.179
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.143
After features/support/hooks.rb:464 2.518
After features/support/hooks.rb:305 1.278
After features/support/hooks.rb:89 0.029
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
1:53.888
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.007
Given a computer 0.231
And I start Tails from USB drive "__internal" with network unplugged 55.500
And I enable persistence 10.459
And I remove the "cowsay" deb files from the APT cache 0.613
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.087
And I log in to a new session 35.264
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 6.374
And I can open the Additional Software log file from the notification 4.791
And the package "cowsay" is not installed 0.566
After features/support/hooks.rb:464 0.154
After features/support/hooks.rb:305 0.902
After features/support/hooks.rb:89 0.009
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.521
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.140
When I log in to a new session in Arabic (ar) 30.699
Then the keyboard layout is set to "us" 0.328
When the network is plugged 0.053
And Tor is ready 15.364
Then I successfully start the Unsafe Browser in "ar" 16.155
And I kill the Unsafe Browser 5.739
When I enable the screen keyboard 0.110
Then the screen keyboard works in Tor Browser 26.222
And DuckDuckGo is the default search engine 19.349
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 12.297
And the layout of the screen keyboard is set to "us" 0.574
After features/support/hooks.rb:305 1.227
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.250
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.027
When I log in to a new session in Chinese (zh_CN) 32.160
Then the keyboard layout is set to "cn" 0.139
When the network is plugged 0.041
And Tor is ready 16.912
Then I successfully start the Unsafe Browser in "zh_CN" 15.113
And I kill the Unsafe Browser 5.792
When I enable the screen keyboard 0.099
Then the screen keyboard works in Tor Browser 24.677
And DuckDuckGo is the default search engine 11.607
And I kill the Tor Browser 5.439
And the screen keyboard works in Thunderbird 17.463
And the layout of the screen keyboard is set to "us" 0.775
After features/support/hooks.rb:305 1.335
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:55.873
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.370
When I log in to a new session in English (en) 16.400
Then the keyboard layout is set to "us" 0.113
When the network is plugged 0.066
And Tor is ready 14.203
Then I successfully start the Unsafe Browser in "en" 15.065
And I kill the Unsafe Browser 5.721
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 25.618
And DuckDuckGo is the default search engine 10.359
And I kill the Tor Browser 5.505
And the screen keyboard works in Thunderbird 13.740
And the layout of the screen keyboard is set to "us" 0.610
After features/support/hooks.rb:305 1.433
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.107
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.364
When I log in to a new session in French (fr) 30.748
Then the keyboard layout is set to "fr" 0.139
When the network is plugged 0.053
And Tor is ready 14.468
Then I successfully start the Unsafe Browser in "fr" 14.474
And I kill the Unsafe Browser 5.640
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 27.928
And DuckDuckGo is the default search engine 10.516
And I kill the Tor Browser 5.461
And the screen keyboard works in Thunderbird 13.543
And the layout of the screen keyboard is set to "fr" 0.638
After features/support/hooks.rb:305 3.561
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.070
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.028
When I log in to a new session in German (de) 29.050
Then the keyboard layout is set to "de" 0.144
When the network is plugged 0.060
And Tor is ready 15.611
Then I successfully start the Unsafe Browser in "de" 14.759
And I kill the Unsafe Browser 5.780
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 26.837
And DuckDuckGo is the default search engine 10.990
And I kill the Tor Browser 5.488
And the screen keyboard works in Thunderbird 12.624
And the layout of the screen keyboard is set to "de" 0.575
After features/support/hooks.rb:305 1.362
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:10.769
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.452
When I log in to a new session in Italian (it) 28.314
Then the keyboard layout is set to "it" 0.249
When the network is plugged 0.056
And Tor is ready 14.811
Then I successfully start the Unsafe Browser in "it" 16.050
And I kill the Unsafe Browser 5.736
When I enable the screen keyboard 0.091
Then the screen keyboard works in Tor Browser 27.549
And DuckDuckGo is the default search engine 10.940
And I kill the Tor Browser 5.485
And the screen keyboard works in Thunderbird 12.441
And the layout of the screen keyboard is set to "us" 0.588
After features/support/hooks.rb:305 1.158
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.995
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.382
When I log in to a new session in Persian (fa) 29.259
Then the keyboard layout is set to "ir" 0.402
When the network is plugged 0.097
And Tor is ready 16.420
Then I successfully start the Unsafe Browser in "fa" 14.919
And I kill the Unsafe Browser 5.740
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 27.743
And DuckDuckGo is the default search engine 23.419
And I kill the Tor Browser 5.455
And the screen keyboard works in Thunderbird 12.443
And the layout of the screen keyboard is set to "ir" 0.604
After features/support/hooks.rb:305 1.089
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:20.667
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.183
When I log in to a new session in Portuguese (pt) 30.585
Then the keyboard layout is set to "pt" 0.172
When the network is plugged 0.047
And Tor is ready 16.518
Then I successfully start the Unsafe Browser in "pt" 14.964
And I kill the Unsafe Browser 5.734
When I enable the screen keyboard 0.104
Then the screen keyboard works in Tor Browser 26.412
And DuckDuckGo is the default search engine 19.629
And I kill the Tor Browser 5.500
And the screen keyboard works in Thunderbird 12.251
And the layout of the screen keyboard is set to "us" 0.561
After features/support/hooks.rb:305 1.056
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:14.971
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.254
When I log in to a new session in Russian (ru) 30.542
Then the keyboard layout is set to "ru" 0.178
When the network is plugged 0.045
And Tor is ready 16.682
Then I successfully start the Unsafe Browser in "ru" 14.915
And I kill the Unsafe Browser 5.761
When I enable the screen keyboard 0.107
Then the screen keyboard works in Tor Browser 27.787
And DuckDuckGo is the default search engine 11.685
And I kill the Tor Browser 5.495
And the screen keyboard works in Thunderbird 12.955
And the layout of the screen keyboard is set to "ru" 0.559
After features/support/hooks.rb:305 1.668
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:51.210
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.096
When I log in to a new session in Spanish (es) 32.115
Then the keyboard layout is set to "es" 0.197
When the network is plugged 0.049
And Tor is ready 16.191
Then I successfully start the Unsafe Browser in "es" 17.091
And I kill the Unsafe Browser 5.762
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 28.009
And DuckDuckGo is the default search engine 45.899
And I kill the Tor Browser 5.503
And the screen keyboard works in Thunderbird 11.524
And the layout of the screen keyboard is set to "us" 0.661
After features/support/hooks.rb:305 1.281
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:31.305
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.604
When I log in to a new session in Turkish (tr) 30.141
Then the keyboard layout is set to "tr" 0.158
When the network is plugged 0.040
And Tor is ready 14.873
Then I successfully start the Unsafe Browser in "tr" 15.485
And I kill the Unsafe Browser 5.738
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 29.863
And DuckDuckGo is the default search engine 27.758
And I kill the Tor Browser 5.517
And the screen keyboard works in Thunderbird 12.426
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:305 3.555
After features/support/hooks.rb:89 0.000