Project Number Date
test_Tails_ISO_devel 3354 18 Apr 2024, 12:38

Tag Report

Steps Scenarios Features
Tag Passed Failed Skipped Pending Undefined Total Passed Failed Total Duration Status
@slow 284 0 0 0 0 284 24 0 24 1:15:22.031 Passed
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
20.787
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 9.193
And I prepare Tails for memory erasure tests 0.374
When I start a process allocating 128 MiB of memory with a known pattern 1.550
Then patterns cover at least 128 MiB in the guest's memory 4.076 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I kill the allocating process 0.838
Then I find very few patterns in the guest's memory 4.755 
Pattern coverage: 0.000% (0 MiB out of 911 MiB reference memory)
After features/support/hooks.rb:305 0.965
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
24.089
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.049
And I prepare Tails for memory erasure tests 0.409
And I find very few patterns in the guest's memory 4.848 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
When I mount a 128 MiB tmpfs on "/mnt" and fill it with a known pattern 1.649
Then patterns cover at least 99% of the test FS size in the guest's memory 4.301 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I umount "/mnt" 0.543
Then I find very few patterns in the guest's memory 4.288 
Pattern coverage: 0.000% (0 MiB out of 889 MiB reference memory)
After features/support/hooks.rb:305 2.061
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
43.328
Before features/support/hooks.rb:259 0.002
Given I have started Tails from DVD without network and logged in 8.128
And I prepare Tails for memory erasure tests 0.465
When I plug and mount a 128 MiB USB drive with a vfat filesystem 8.007
Then I find very few patterns in the guest's memory 4.230 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 4.305
Then patterns cover at least 86% of the test FS size in the guest's memory 3.382 
Pattern coverage: 89.004% (113 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.887
Then I find very few patterns in the guest's memory 4.178 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
# read cache
When I mount the USB drive again 0.260
And I read the content of the test FS 0.526
Then patterns cover at least 99% of the test FS size in the guest's memory 4.268 
Pattern coverage: 100.596% (128 MiB out of 127 MiB reference memory)
When I umount the USB drive 0.440
Then I find very few patterns in the guest's memory 4.246 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
After features/support/hooks.rb:305 2.961
After features/support/hooks.rb:89 0.012
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
1:9.135
Before features/support/hooks.rb:259 0.015
Given I have started Tails from DVD without network and logged in 9.355
And I prepare Tails for memory erasure tests 0.450
When I plug and mount a 128 MiB USB drive with an ext4 filesystem encrypted with password "asdf" 30.921
Then I find very few patterns in the guest's memory 3.948 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
# write cache
When I fill the USB drive with a known pattern 1.662
Then patterns cover at least 99% of the test FS size in the guest's memory 3.579 
Pattern coverage: 106.113% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 0.680
Then I find very few patterns in the guest's memory 4.016 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
# read cache
When I mount the USB drive again 5.484
And I read the content of the test FS 0.329
Then patterns cover at least 99% of the test FS size in the guest's memory 3.629 
Pattern coverage: 106.116% (97 MiB out of 91 MiB reference memory)
When I umount the USB drive 1.096
Then I find very few patterns in the guest's memory 3.980 
Pattern coverage: 0.000% (0 MiB out of 888 MiB reference memory)
After features/support/hooks.rb:305 0.796
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
50.121
Before features/support/hooks.rb:259 0.003
Given I have started Tails from DVD without network and logged in 8.203
And I prepare Tails for memory erasure tests 0.579
When I fill a 128 MiB file with a known pattern on the root filesystem 14.908
# ensure the pattern is in memory due to tmpfs, not to disk cache
And I drop all kernel caches 1.089
Then patterns cover at least 128 MiB in the guest's memory 3.402 
Pattern coverage: 100.000% (128 MiB out of 128 MiB reference memory)
When I trigger shutdown 0.013
And I wait 20 seconds 20.011 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 1.914 
Pattern coverage: 0.000% (0 MiB out of 883 MiB reference memory)
After features/support/hooks.rb:305 3.575
After features/support/hooks.rb:89 0.000
Feature: System memory erasure on shutdown
Tags: @product @slow @not_release_blocker
7:6.635
Before features/support/hooks.rb:259 0.004
Given I have started Tails without network from a USB drive with a persistent partition enabled and logged in 6:21.363
And I prepare Tails for memory erasure tests 0.498
When I fill a 128 MiB file with a known pattern on the persistent filesystem 22.383
When I trigger shutdown 0.011
And I wait 20 seconds 20.008 
Slept for 20 seconds
Then I find very few patterns in the guest's memory 2.370 
Pattern coverage: 0.000% (0 MiB out of 896 MiB reference memory)
After features/support/hooks.rb:305 3.549
After features/support/hooks.rb:89 0.017
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker @fragile
2:49.951
Before features/support/hooks.rb:259 0.002
Before features/support/hooks.rb:456 0.003
Given I have started Tails from DVD and logged in with an administration password and the network is connected 1:33.744
And I update APT using apt 18.312
When I install "popularity-contest" using apt 19.368
Then I am notified I can not use Additional Software for "popularity-contest" 7.737
And I can open the Additional Software documentation from the notification 30.788
After features/support/hooks.rb:464 43.714
After features/support/hooks.rb:305 2.145
After features/support/hooks.rb:89 0.004
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:53.738
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.007
Given I start Tails from a freshly installed USB drive with an administration password and the network is plugged and I login 57.642
And I update APT using apt 17.442
And I install "popularity-contest" using apt 22.402
Then I am proposed to add the "popularity-contest" package to my Additional Software 5.743
When I create a persistent storage and activate the Additional Software feature 19.765
Then Additional Software is correctly configured for package "popularity-contest" 1.335
When I shutdown Tails and wait for the computer to power off 12.594
And I start Tails from USB drive "__internal" with network unplugged 1:0.354
And I enable persistence 25.405
And I log in to a new session 37.003
And the Additional Software installation service has started 31.551
Then I am notified that the installation succeeded 1.468
And Additional Software is correctly configured for package "popularity-contest" 0.782
And the package "popularity-contest" is installed after Additional Software has been started 0.245
After features/support/hooks.rb:464 39.877
After features/support/hooks.rb:305 1.014
After features/support/hooks.rb:89 0.013
Feature: Additional software
Tags: @product @check_tor_leaks @slow
2:27.614
Before features/support/hooks.rb:259 0.004
Before features/support/hooks.rb:456 0.006
Given a computer 0.201
And I start Tails from USB drive "__internal" and I login with an administration password 1:44.823
And I update APT using apt 16.801
When I install "makepp" using apt 19.332
Then the Additional Software dpkg hook has been run for package "makepp" and notices the persistence is locked 6.387
And the package "makepp" is installed 0.068
After features/support/hooks.rb:464 41.618
After features/support/hooks.rb:305 0.884
After features/support/hooks.rb:89 0.015
Feature: Additional software
Tags: @product @check_tor_leaks @slow
4:58.690
Before features/support/hooks.rb:259 0.006
Before features/support/hooks.rb:456 0.009
Given a computer 0.244
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 3:11.154
When I uninstall "popularity-contest" using apt 18.788
And I accept removing "popularity-contest" from Additional Software 0.535
Then "popularity-contest" is not in the list of Additional Software 0.655
When I start Synaptic 25.630
And I update APT using Synaptic 21.914
And I install "cowsay" using Synaptic 12.102
And I accept adding "cowsay" to Additional Software 1.380
Then Additional Software is correctly configured for package "cowsay" 0.976
When I uninstall "cowsay" using apt 3.251
And I refuse removing "cowsay" from Additional Software 0.564
Then Additional Software is correctly configured for package "cowsay" 0.804
When I start "Additional Software" via GNOME Activities Overview 9.944
And I remove "cowsay" from the list of Additional Software using Additional Software GUI 5.450
Then "cowsay" is not in the list of Additional Software 0.867
When I install "cowsay" using apt 3.203
And I refuse adding "cowsay" to Additional Software 0.564
Then "cowsay" is not in the list of Additional Software 0.656
After features/support/hooks.rb:464 0.993
After features/support/hooks.rb:305 0.794
After features/support/hooks.rb:89 0.012
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker
9:4.873
Before features/support/hooks.rb:259 0.008
Before features/support/hooks.rb:456 0.007
Given a computer 0.242
And I start Tails from USB drive "__internal" and I login with persistence enabled and an administration password 2:19.735
And I configure APT to prefer an old version of cowsay 0.027
When I install an old version "3.03+dfsg2-1" of the cowsay package using apt 27.010
And I accept adding "cowsay" to Additional Software 4.237
And Additional Software is correctly configured for package "cowsay" 0.999
And I shutdown Tails and wait for the computer to power off 6.342
And I start Tails from USB drive "__internal" with network unplugged 59.281
And I enable persistence 12.042
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.023
And I log in to a new session 35.360
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 31.456
And I revert the APT tweaks that made it prefer an old version of cowsay 0.066
# We remove the newest package after it has been downloaded and before
# it is installed, so that the upgrade process fails
And I prepare the Additional Software upgrade process to fail 0.068
And the network is plugged 0.046
And Tor is ready 21.033
# Note: the next step races against the appearance of the "The
# upgrade of your additional software failed" notification.
# It should win most of the time, which is good, but there's no
# guarantee it does. If it loses, then it'll remove the notification
# we'll be trying to interact with below ("I can open…")
And all notifications have disappeared 10.296
And available upgrades have been checked 0.446
And I see the "The upgrade of your additional software failed" notification after at most 300 seconds 1.064
And I can open the Additional Software configuration window from the notification 2.694
And I shutdown Tails and wait for the computer to power off 13.424
And I start Tails from USB drive "__internal" with network unplugged 55.732
And I enable persistence 14.641
# We need to add back this custom APT source for the Additional Software
# install step, as it was not saved in persistence
And I configure APT to prefer an old version of cowsay 0.045
And I log in to a new session 36.619
And the installed version of package "cowsay" is "3.03+dfsg2-1" after Additional Software has been started 30.891
And I revert the APT tweaks that made it prefer an old version of cowsay 0.065
And the network is plugged 0.034
And Tor is ready 40.623
Then the Additional Software upgrade service has started 0.203
And the installed version of package "cowsay" is newer than "3.03+dfsg2-1" 0.114
After features/support/hooks.rb:464 2.506
After features/support/hooks.rb:305 0.896
After features/support/hooks.rb:89 0.035
Feature: Additional software
Tags: @product @check_tor_leaks @slow @not_release_blocker_inherited
2:6.785
Before features/support/hooks.rb:259 0.007
Before features/support/hooks.rb:456 0.009
Given a computer 0.283
And I start Tails from USB drive "__internal" with network unplugged 58.174
And I enable persistence 12.487
And I remove the "cowsay" deb files from the APT cache 0.728
# Prevent the "Warning: virtual machine detected!" notification from racing
# with the one we'll be interacting with below.
And I disable the tails-virt-notify-user.service user unit 0.103
And I log in to a new session 34.281
Then I see the "The installation of your additional software failed" notification after at most 300 seconds 14.360
And I can open the Additional Software log file from the notification 5.611
And the package "cowsay" is not installed 0.753
After features/support/hooks.rb:464 0.154
After features/support/hooks.rb:305 1.084
After features/support/hooks.rb:89 0.011
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:24.094
Before features/support/hooks.rb:259 0.010
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 7.988
When I log in to a new session in Arabic (ar) 28.810
Then the keyboard layout is set to "us" 0.137
When the network is plugged 0.056
And Tor is ready 17.074
Then I successfully start the Unsafe Browser in "ar" 14.884
And I kill the Unsafe Browser 5.667
When I enable the screen keyboard 0.125
Then the screen keyboard works in Tor Browser 28.268
And DuckDuckGo is the default search engine 22.608
And I kill the Tor Browser 5.524
And the screen keyboard works in Thunderbird 12.390
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:305 1.266
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.544
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.162
When I log in to a new session in Chinese (zh_CN) 31.145
Then the keyboard layout is set to "cn" 0.233
When the network is plugged 0.036
And Tor is ready 17.635
Then I successfully start the Unsafe Browser in "zh_CN" 15.497
And I kill the Unsafe Browser 5.625
When I enable the screen keyboard 0.118
Then the screen keyboard works in Tor Browser 26.804
And DuckDuckGo is the default search engine 10.663
And I kill the Tor Browser 5.549
And the screen keyboard works in Thunderbird 16.508
And the layout of the screen keyboard is set to "us" 0.564
After features/support/hooks.rb:305 2.508
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
1:56.118
Before features/support/hooks.rb:259 0.008
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.545
When I log in to a new session in English (en) 16.128
Then the keyboard layout is set to "us" 0.256
When the network is plugged 0.034
And Tor is ready 15.693
Then I successfully start the Unsafe Browser in "en" 14.912
And I kill the Unsafe Browser 5.705
When I enable the screen keyboard 0.109
Then the screen keyboard works in Tor Browser 25.691
And DuckDuckGo is the default search engine 10.655
And I kill the Tor Browser 5.506
And the screen keyboard works in Thunderbird 12.286
And the layout of the screen keyboard is set to "us" 0.592
After features/support/hooks.rb:305 3.482
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:12.492
Before features/support/hooks.rb:259 0.009
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.835
When I log in to a new session in French (fr) 29.940
Then the keyboard layout is set to "fr" 0.219
When the network is plugged 0.049
And Tor is ready 14.953
Then I successfully start the Unsafe Browser in "fr" 15.486
And I kill the Unsafe Browser 5.740
When I enable the screen keyboard 0.116
Then the screen keyboard works in Tor Browser 27.767
And DuckDuckGo is the default search engine 10.527
And I kill the Tor Browser 5.457
And the screen keyboard works in Thunderbird 12.775
And the layout of the screen keyboard is set to "fr" 0.622
After features/support/hooks.rb:305 1.144
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:15.874
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.121
When I log in to a new session in German (de) 32.658
Then the keyboard layout is set to "de" 0.280
When the network is plugged 0.483
And Tor is ready 16.896
Then I successfully start the Unsafe Browser in "de" 14.493
And I kill the Unsafe Browser 5.655
When I enable the screen keyboard 0.086
Then the screen keyboard works in Tor Browser 27.306
And DuckDuckGo is the default search engine 11.138
And I kill the Tor Browser 5.617
And the screen keyboard works in Thunderbird 12.514
And the layout of the screen keyboard is set to "de" 0.620
After features/support/hooks.rb:305 1.212
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:27.380
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.301
When I log in to a new session in Italian (it) 29.188
Then the keyboard layout is set to "it" 0.179
When the network is plugged 0.047
And Tor is ready 19.808
Then I successfully start the Unsafe Browser in "it" 13.777
And I kill the Unsafe Browser 5.800
When I enable the screen keyboard 0.106
Then the screen keyboard works in Tor Browser 29.317
And DuckDuckGo is the default search engine 22.606
And I kill the Tor Browser 5.472
And the screen keyboard works in Thunderbird 12.218
And the layout of the screen keyboard is set to "us" 0.557
After features/support/hooks.rb:305 1.099
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:45.949
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.005
When I log in to a new session in Persian (fa) 28.788
Then the keyboard layout is set to "ir" 0.385
When the network is plugged 0.041
And Tor is ready 43.671
Then I successfully start the Unsafe Browser in "fa" 14.465
And I kill the Unsafe Browser 5.704
When I enable the screen keyboard 0.130
Then the screen keyboard works in Tor Browser 27.349
And DuckDuckGo is the default search engine 19.599
And I kill the Tor Browser 5.488
And the screen keyboard works in Thunderbird 11.714
And the layout of the screen keyboard is set to "ir" 0.604
After features/support/hooks.rb:305 1.089
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:23.482
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.222
When I log in to a new session in Portuguese (pt) 30.443
Then the keyboard layout is set to "pt" 0.159
When the network is plugged 0.047
And Tor is ready 15.832
Then I successfully start the Unsafe Browser in "pt" 14.945
And I kill the Unsafe Browser 5.820
When I enable the screen keyboard 0.103
Then the screen keyboard works in Tor Browser 26.060
And DuckDuckGo is the default search engine 22.500
And I kill the Tor Browser 5.447
And the screen keyboard works in Thunderbird 13.181
And the layout of the screen keyboard is set to "us" 0.719
After features/support/hooks.rb:305 1.386
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:48.605
Before features/support/hooks.rb:259 0.007
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 9.058
When I log in to a new session in Russian (ru) 29.884
Then the keyboard layout is set to "ru" 0.300
When the network is plugged 0.043
And Tor is ready 43.518
Then I successfully start the Unsafe Browser in "ru" 15.344
And I kill the Unsafe Browser 5.690
When I enable the screen keyboard 0.092
Then the screen keyboard works in Tor Browser 27.695
And DuckDuckGo is the default search engine 19.049
And I kill the Tor Browser 5.498
And the screen keyboard works in Thunderbird 11.814
And the layout of the screen keyboard is set to "ru" 0.615
After features/support/hooks.rb:305 1.081
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:18.403
Before features/support/hooks.rb:259 0.005
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.959
When I log in to a new session in Spanish (es) 28.912
Then the keyboard layout is set to "es" 0.137
When the network is plugged 0.032
And Tor is ready 17.579
Then I successfully start the Unsafe Browser in "es" 13.841
And I kill the Unsafe Browser 5.834
When I enable the screen keyboard 0.096
Then the screen keyboard works in Tor Browser 27.188
And DuckDuckGo is the default search engine 18.109
And I kill the Tor Browser 5.452
And the screen keyboard works in Thunderbird 11.624
And the layout of the screen keyboard is set to "us" 0.633
After features/support/hooks.rb:305 1.116
After features/support/hooks.rb:89 0.000
Feature: Localization
Tags: @product @doc @slow @not_release_blocker
2:21.948
Before features/support/hooks.rb:259 0.006
Given I have started Tails from DVD without network and stopped at Tails Greeter's login screen 8.041
When I log in to a new session in Turkish (tr) 29.959
Then the keyboard layout is set to "tr" 0.151
When the network is plugged 0.035
And Tor is ready 18.129
Then I successfully start the Unsafe Browser in "tr" 13.979
And I kill the Unsafe Browser 5.621
When I enable the screen keyboard 0.105
Then the screen keyboard works in Tor Browser 26.648
And DuckDuckGo is the default search engine 21.484
And I kill the Tor Browser 5.447
And the screen keyboard works in Thunderbird 11.744
And the layout of the screen keyboard is set to "us" 0.599
After features/support/hooks.rb:305 1.445
After features/support/hooks.rb:89 0.000
Feature: Tor Connection helps the user in connecting to Tor
Tags: @product @slow @not_release_blocker @skip_by_default
12:13.382
When the network is plugged 0.036
And I wait 720 seconds 12:0.091 
Slept for 720 seconds
Then I successfully configure Tor 13.206
And the time has synced 0.046
After features/support/hooks.rb:305 0.785
After features/support/hooks.rb:89 0.000