Remove all the results from previous releases 29/27929/1
authorjose.lausuch <jose.lausuch@ericsson.com>
Thu, 2 Feb 2017 16:40:14 +0000 (17:40 +0100)
committerjose.lausuch <jose.lausuch@ericsson.com>
Thu, 2 Feb 2017 16:40:14 +0000 (17:40 +0100)
These are obsolete and we use a different way to report
the results now.

Change-Id: Ia6a92149e484ae76701b12989abbf4de458f872b
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
16 files changed:
docs/results/apex-os-odl_l2-bgpvpn-ha.rst [deleted file]
docs/results/apex-os-odl_l2-nofeature-ha.rst [deleted file]
docs/results/compass-os-nosdn-nofeature-ha.rst [deleted file]
docs/results/compass-os-odl_l2-nofeature-ha.rst [deleted file]
docs/results/compass-os-onos-nofeature-ha.rst [deleted file]
docs/results/fuel-os-nosdn-kvm-ha.rst [deleted file]
docs/results/fuel-os-nosdn-nofeature-ha.rst [deleted file]
docs/results/fuel-os-nosdn-ovs-ha.rst [deleted file]
docs/results/fuel-os-odl_l2-bgpvpn-ha.rst [deleted file]
docs/results/fuel-os-odl_l2-nofeature-ha.rst [deleted file]
docs/results/fuel-os-odl_l2-sfc-ha.rst [deleted file]
docs/results/fuel-os-onos-nofeature-ha.rst [deleted file]
docs/results/index.rst [deleted file]
docs/results/joid-os-odl_l2-nofeature-ha.rst [deleted file]
docs/results/overview.rst [deleted file]
docs/results/results.rst [deleted file]

diff --git a/docs/results/apex-os-odl_l2-bgpvpn-ha.rst b/docs/results/apex-os-odl_l2-bgpvpn-ha.rst
deleted file mode 100644 (file)
index ca6d094..0000000
+++ /dev/null
@@ -1,926 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for apex-os-odl_l2-bgpvpn-ha
------------------------------------------------------
-
-VIM
----
-
-vping_userdata
-^^^^^^^^^^^^^^
-
-::
-
-  FUNCTEST.info: Running vPing-userdata test...
-  vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_userdata- INFO - Creating neutron network vping-net...
-  vPing_userdata- INFO - Creating security group  'vPing-sg'...
-  vPing_userdata- INFO - Flavor found 'm1.small'
-  vPing_userdata- INFO - vPing Start Time:'2016-04-26 15:40:43'
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-  vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-  vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_userdata- INFO - Waiting for ping...
-  vPing_userdata- INFO - vPing detected!
-  vPing_userdata- INFO - vPing duration:'87.1'
-  vPing_userdata- INFO - vPing OK
-  vPing_userdata- INFO - Cleaning up...
-  vPing_userdata- INFO - Deleting network 'vping-net'...
-
-Tempest
-^^^^^^^
-::
-
-    FUNCTEST.info: Running Tempest tests...
-    run_tempest - INFO - Creating tenant and user for Tempest suite
-    INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
-    INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
-    run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
-    Total results of verification:
-
-    +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-    | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
-    +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-    | 97cda33b-5d92-46c5-8425-861d087d0d57 | 938a64f1-d650-497c-897d-8964906711fb |          | 188   | 27       | 2016-04-26 15:42:30.384572 | finished |
-    +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-
-    Tests:
-
-    +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | name                                                                                                                             | time      | status  |
-    +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.643   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.048   | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 6.046   | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 6.507   | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 5.748   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.049   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.325   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.053   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.251   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.048   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.044   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.085   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.102   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.131   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.137   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.323   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.081   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.430   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.350   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.198   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.132   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.367   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 0.577   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 1.641   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 4.390   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 303.566 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.154   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.173   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 300.550 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.001   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 303.713 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.094   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.674   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 300.091 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.001   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.043   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 1.587   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.262   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.121   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.178   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.135   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.113   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.047   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.040   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.040   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.038   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.259   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.391   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.090   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.053   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.009   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.041   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.041   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.014   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.009   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.023   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.036   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.045   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.649   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.012   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.042   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.000   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 2.819   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 6.846   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 303.888 | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.347   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 317.471 | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 301.431 | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 301.068 | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 5.488   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.041   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.080   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.308   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.170   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.174   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.306   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.331   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.307   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 1.770   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 6.074   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 8.126   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 5.697   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 5.928   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 0.458   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 1.032   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 0.597   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 1.087   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 0.463   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 0.398   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.439   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.445   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.312   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 1.065   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.301   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.304   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.432   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.221   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 0.459   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.313   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 0.249   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.275   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.284   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.125   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.043   | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 323.768 | fail    |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.055   | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.289   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.052   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.009   | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.238   | success |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.107   | success |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.214   | success |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.102   | success |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.382   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.000   | fail    |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.894   | success |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.129   | success |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.168   | success |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.172   | success |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 0.000   | fail    |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.018   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.018   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.027   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.019   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.082   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.019   | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.091   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 0.630   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 1.296   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 2.890   | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 1.435   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 0.663   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 0.946   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 0.000   | fail    |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.000   | fail    |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.000   | fail    |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.000   | fail    |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.000   | fail    |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.000   | fail    |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 0.000   | fail    |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 0.000   | fail    |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 0.000   | fail    |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.000   | fail    |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.000   | fail    |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.425   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 2.459   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 0.711   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.099   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.094   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 3.077   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 1.372   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 1.769   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 0.889   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 3.092   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 1.691   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 1.689   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 1.001   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 0.748   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 1.306   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.142   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 0.748   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 1.189   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.074   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.278   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 2.527   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.015   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.629   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.355   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.333   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.335   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.353   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.339   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 2.951   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.022   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 303.959 | fail    |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 302.043 | fail    |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 1.600   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 1.606   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 8.446   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 8.743   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 8.966   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 10.497  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.105   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.038   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 134.544 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 333.942 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 336.063 | fail    |
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    run_tempest - INFO - Results: {'timestart': '2016-04-2615:42:30.384572', 'duration': 1497, 'tests': 188, 'failures': 27}
-    run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
-    run_tempest - INFO - Deleting tenant and user for Tempest suite)
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    run_rally - INFO - Starting test scenario "authenticate" ...
-
-    Preparing input task
-    Task  ad742546-c147-4903-a31f-841de938dd68: started
-    Task ad742546-c147-4903-a31f-841de938dd68: finished
-
-    test scenario Authenticate.validate_glance
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_glance_2_times | 0.196     | 0.321        | 0.365        | 0.372        | 0.38      | 0.302     | 100.0%  | 10    |
-    | total                                | 0.278     | 0.405        | 0.481        | 0.487        | 0.492     | 0.398     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.25959300995
-    Full duration: 4.72824001312
-
-    test scenario Authenticate.keystone
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.keystone | 0.076     | 0.084        | 0.111        | 0.116        | 0.121     | 0.09      | 100.0%  | 10    |
-    | total                 | 0.076     | 0.084        | 0.111        | 0.116        | 0.121     | 0.09      | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.271264076233
-    Full duration: 3.62738013268
-
-    test scenario Authenticate.validate_heat
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_heat_2_times | 0.175     | 0.197        | 0.249        | 0.254        | 0.258     | 0.207     | 100.0%  | 10    |
-    | total                              | 0.254     | 0.297        | 0.383        | 0.398        | 0.413     | 0.316     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.942983865738
-    Full duration: 4.24797916412
-
-    test scenario Authenticate.validate_nova
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_nova_2_times | 0.119     | 0.158        | 0.214        | 0.226        | 0.237     | 0.164     | 100.0%  | 10    |
-    | total                              | 0.206     | 0.255        | 0.317        | 0.323        | 0.329     | 0.261     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.78842997551
-    Full duration: 4.25593304634
-
-    test scenario Authenticate.validate_cinder
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_cinder_2_times | 0.119     | 0.189        | 0.375        | 0.376        | 0.378     | 0.229     | 100.0%  | 10    |
-    | total                                | 0.2       | 0.333        | 0.46         | 0.479        | 0.499     | 0.336     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.973871946335
-    Full duration: 4.23989796638
-
-    test scenario Authenticate.validate_neutron
-    +------------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                           Response Times (sec)                                                           |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_neutron_2_times | 0.195     | 0.211        | 0.231        | 0.247        | 0.263     | 0.215     | 100.0%  | 10    |
-    | total                                 | 0.277     | 0.305        | 0.331        | 0.345        | 0.359     | 0.309     | 100.0%  | 10    |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.916023015976
-    Full duration: 4.58919405937
-
-    2016-04-26 17:13:30,899 - run_rally - INFO - Test scenario: "authenticate" OK.
-    2016-04-26 17:13:30,899 - run_rally - INFO - Starting test scenario "glance" ...
-    2016-04-26 17:15:24,362 - run_rally - INFO -
-     Preparing input task
-     Task  9f0a1a59-63ee-4c5c-83b4-fda6ca64d4d3: started
-    Task 9f0a1a59-63ee-4c5c-83b4-fda6ca64d4d3: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                  |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.list_images | 0.265     | 0.322        | 0.356        | 0.383        | 0.411     | 0.319     | 100.0%  | 10    |
-    | total              | 0.265     | 0.322        | 0.356        | 0.383        | 0.411     | 0.319     | 100.0%  | 10    |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.958132982254
-    Full duration: 5.75791287422
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 3.814     | 4.56         | 5.238        | 5.417        | 5.597     | 4.572     | 100.0%  | 10    |
-    | nova.boot_servers   | 6.063     | 7.369        | 7.972        | 8.963        | 9.955     | 7.357     | 100.0%  | 10    |
-    | total               | 10.969    | 11.692       | 12.712       | 13.839       | 14.965    | 11.929    | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 34.7748630047
-    Full duration: 56.4055418968
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 3.733     | 4.173        | 4.872        | 4.909        | 4.946     | 4.299     | 100.0%  | 10    |
-    | glance.list_images  | 0.034     | 0.108        | 0.128        | 0.141        | 0.153     | 0.1       | 100.0%  | 10    |
-    | total               | 3.841     | 4.25         | 4.982        | 5.018        | 5.055     | 4.399     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 13.4400930405
-    Full duration: 21.2837600708
-
-    test scenario GlanceImages.create_and_delete_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 3.579     | 4.549        | 4.615        | 4.621        | 4.627     | 4.302     | 100.0%  | 10    |
-    | glance.delete_image | 0.561     | 0.882        | 1.06         | 1.077        | 1.093     | 0.878     | 100.0%  | 10    |
-    | total               | 4.529     | 5.366        | 5.55         | 5.629        | 5.707     | 5.18      | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 15.3838078976
-    Full duration: 20.4000329971
-
-    2016-04-26 17:15:25,993 - run_rally - INFO - Test scenario: "glance" OK.
-    2016-04-26 17:15:25,993 - run_rally - INFO - Starting test scenario "cinder" ...
-    2016-04-26 17:30:47,609 - run_rally - INFO -
-     Preparing input task
-     Task  814c7265-77f0-4627-b851-4d6307469184: started
-    Task 814c7265-77f0-4627-b851-4d6307469184: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server     | 3.253     | 3.8          | 5.748        | 5.876        | 6.003     | 4.299     | 100.0%  | 10    |
-    | cinder.create_volume | 2.647     | 2.849        | 3.122        | 3.314        | 3.506     | 2.905     | 100.0%  | 10    |
-    | nova.attach_volume   | 2.828     | 2.941        | 3.024        | 3.139        | 3.253     | 2.956     | 100.0%  | 10    |
-    | nova.detach_volume   | 2.694     | 2.805        | 3.047        | 3.066        | 3.085     | 2.854     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.465     | 2.501        | 2.589        | 2.62         | 2.652     | 2.292     | 100.0%  | 10    |
-    | nova.delete_server   | 2.31      | 2.432        | 2.572        | 2.61         | 2.647     | 2.445     | 100.0%  | 10    |
-    | total                | 17.005    | 17.344       | 19.667       | 19.684       | 19.702    | 17.752    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 52.3380470276
-    Full duration: 62.1368570328
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 5.365     | 5.628        | 6.335        | 7.213        | 8.09      | 5.894     | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.12      | 0.13         | 0.179        | 0.324        | 0.47      | 0.165     | 100.0%  | 10    |
-    | total                | 5.492     | 5.753        | 6.503        | 7.531        | 8.56      | 6.059     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 17.5699410439
-    Full duration: 32.550137043
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 2.66      | 2.948        | 3.145        | 3.171        | 3.197     | 2.939     | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.039     | 0.124        | 0.137        | 0.145        | 0.153     | 0.12      | 100.0%  | 10    |
-    | total                | 2.765     | 3.073        | 3.28         | 3.3          | 3.32      | 3.059     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 8.95114684105
-    Full duration: 20.4319190979
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 2.53      | 4.717        | 6.846        | 6.861        | 6.875     | 4.502     | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.017     | 0.106        | 0.12         | 0.135        | 0.15      | 0.094     | 100.0%  | 10    |
-    | total                  | 2.68      | 4.789        | 6.9          | 6.926        | 6.953     | 4.596     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 12.3801140785
-    Full duration: 44.4814119339
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 2.72      | 2.87         | 2.984        | 3.001        | 3.018     | 2.88      | 100.0%  | 10    |
-    | cinder.delete_volume | 2.327     | 2.533        | 2.641        | 2.663        | 2.685     | 2.526     | 100.0%  | 10    |
-    | total                | 5.148     | 5.386        | 5.625        | 5.664        | 5.703     | 5.406     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 16.1617929935
-    Full duration: 23.7529392242
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 5.261     | 5.487        | 5.686        | 5.742        | 5.797     | 5.493     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.393     | 2.591        | 2.671        | 2.776        | 2.881     | 2.572     | 100.0%  | 10    |
-    | total                | 7.72      | 8.0          | 8.304        | 8.491        | 8.679     | 8.065     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 23.9920217991
-    Full duration: 31.16101408
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 2.683     | 2.83         | 2.958        | 3.031        | 3.105     | 2.838     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.446     | 2.601        | 2.755        | 2.757        | 2.759     | 2.621     | 100.0%  | 10    |
-    | total                | 5.209     | 5.463        | 5.632        | 5.673        | 5.715     | 5.459     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 16.2941839695
-    Full duration: 23.1591808796
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +----------------------------------------------------------------------------------------------------------------------------------+
-    |                                                       Response Times (sec)                                                       |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume          | 2.705     | 3.234        | 5.839        | 6.009        | 6.178     | 4.101     | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 25.866    | 34.579       | 36.121       | 36.966       | 37.811    | 33.004    | 100.0%  | 10    |
-    | cinder.delete_volume          | 2.425     | 2.516        | 2.859        | 3.79         | 4.722     | 2.741     | 100.0%  | 10    |
-    | nova.delete_image             | 1.063     | 1.781        | 2.315        | 2.368        | 2.421     | 1.768     | 100.0%  | 10    |
-    | total                         | 33.42     | 42.477       | 46.051       | 46.561       | 47.071    | 41.614    | 100.0%  | 10    |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 122.33260107
-    Full duration: 130.417927027
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 2.619     | 4.753        | 5.128        | 5.998        | 6.868     | 4.741     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.341     | 4.464        | 4.614        | 4.628        | 4.642     | 3.881     | 100.0%  | 10    |
-    | total                  | 5.069     | 9.108        | 9.651        | 10.58        | 11.51     | 8.622     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 23.5147559643
-    Full duration: 42.4243760109
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 2.687     | 2.862        | 5.341        | 5.342        | 5.342     | 3.334     | 100.0%  | 10    |
-    | total                | 2.687     | 2.862        | 5.341        | 5.342        | 5.343     | 3.335     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 8.59894013405
-    Full duration: 18.9968831539
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 2.891     | 3.117        | 5.147        | 5.186        | 5.225     | 3.853     | 100.0%  | 10    |
-    | total                | 2.892     | 3.118        | 5.147        | 5.186        | 5.225     | 3.853     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.1855640411
-    Full duration: 23.8357381821
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.list_volumes | 0.23      | 0.276        | 0.313        | 0.333        | 0.353     | 0.281     | 100.0%  | 10    |
-    | total               | 0.23      | 0.276        | 0.313        | 0.333        | 0.354     | 0.281     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.832192182541
-    Full duration: 49.1499869823
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 2.745     | 3.988        | 5.311        | 5.419        | 5.527     | 4.036     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.448     | 3.519        | 4.951        | 5.828        | 6.704     | 3.762     | 100.0%  | 10    |
-    | nova.attach_volume     | 2.902     | 4.661        | 5.677        | 6.517        | 7.356     | 4.515     | 100.0%  | 10    |
-    | nova.detach_volume     | 2.665     | 3.03         | 5.013        | 5.036        | 5.058     | 3.398     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.347     | 2.526        | 4.474        | 4.544        | 4.615     | 3.094     | 100.0%  | 10    |
-    | cinder.delete_volume   | 2.357     | 2.512        | 2.616        | 2.622        | 2.629     | 2.497     | 100.0%  | 10    |
-    | total                  | 16.23     | 22.038       | 24.243       | 25.404       | 26.565    | 21.659    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 61.302448988
-    Full duration: 101.445744038
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.012     | 5.284        | 7.846        | 8.73         | 9.613     | 5.488     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.465     | 4.731        | 6.986        | 7.116        | 7.247     | 4.39      | 100.0%  | 10    |
-    | total                | 5.537     | 10.039       | 14.516       | 14.707       | 14.898    | 9.877     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 25.7450320721
-    Full duration: 44.7656638622
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 2.809     | 2.87         | 3.171        | 3.173        | 3.174     | 2.925     | 100.0%  | 10    |
-    | cinder.extend_volume | 2.68      | 2.828        | 5.155        | 5.156        | 5.157     | 3.67      | 100.0%  | 10    |
-    | cinder.delete_volume | 2.351     | 2.533        | 2.633        | 2.64         | 2.648     | 2.537     | 100.0%  | 10    |
-    | total                | 8.073     | 8.443        | 10.604       | 10.657       | 10.711    | 9.133     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 26.884996891
-    Full duration: 34.1721270084
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 2.775     | 2.863        | 2.974        | 3.062        | 3.151     | 2.888     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.383     | 3.589        | 6.958        | 7.815        | 8.672     | 4.208     | 100.0%  | 10    |
-    | nova.attach_volume     | 2.875     | 3.242        | 5.488        | 6.395        | 7.302     | 4.124     | 100.0%  | 10    |
-    | nova.detach_volume     | 2.665     | 2.896        | 3.035        | 3.047        | 3.059     | 2.879     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.154     | 2.468        | 2.771        | 3.49         | 4.209     | 2.6       | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.443     | 2.52         | 2.652        | 2.664        | 2.677     | 2.341     | 100.0%  | 10    |
-    | total                  | 16.386    | 19.141       | 21.529       | 23.357       | 25.184    | 19.466    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 56.0006937981
-    Full duration: 103.148792982
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 2.734     | 2.837        | 2.972        | 2.98         | 2.987     | 2.853     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.361     | 4.585        | 7.125        | 7.96         | 8.794     | 4.799     | 100.0%  | 10    |
-    | nova.attach_volume     | 2.861     | 3.062        | 5.2          | 5.255        | 5.311     | 3.579     | 100.0%  | 10    |
-    | nova.detach_volume     | 2.776     | 2.919        | 3.111        | 3.147        | 3.183     | 2.942     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.381     | 3.48         | 6.541        | 6.595        | 6.649     | 3.908     | 100.0%  | 10    |
-    | cinder.delete_volume   | 2.273     | 2.579        | 4.795        | 5.881        | 6.967     | 3.176     | 100.0%  | 10    |
-    | total                  | 16.565    | 23.291       | 23.896       | 24.12        | 24.344    | 21.919    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 62.6618189812
-    Full duration: 108.85529089
-
-SDN Controller
---------------
-
-ODL
-^^^
-::
-
-    FUNCTEST.info: Running ODL test...
-    ==============================================================================
-    Basic
-    ==============================================================================
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-    ==============================================================================
-    Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-    ------------------------------------------------------------------------------
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Basic                                                                 | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/output.xml
-    Log:     /home/opnfv/log.html
-    Report:  /home/opnfv/report.html
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin
-    ==============================================================================
-    Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-    ==============================================================================
-    Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-    ------------------------------------------------------------------------------
-    Create Network :: Create new network in OpenStack                     | PASS |
-    ------------------------------------------------------------------------------
-    Check Network :: Check Network created in OpenDaylight                | FAIL |
-    404 != 200
-    ------------------------------------------------------------------------------
-    Neutron.Networks :: Checking Network created in OpenStack are push... | FAIL |
-    4 critical tests, 3 passed, 1 failed
-    4 tests total, 3 passed, 1 failed
-    ==============================================================================
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-    ==============================================================================
-    Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-    ------------------------------------------------------------------------------
-    Create New subnet :: Create new subnet in OpenStack                   | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet :: Check new subnet created in OpenDaylight          | FAIL |
-    404 != 200
-    ------------------------------------------------------------------------------
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | FAIL |
-    4 critical tests, 3 passed, 1 failed
-    4 tests total, 3 passed, 1 failed
-    ==============================================================================
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-    ==============================================================================
-    Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-    ------------------------------------------------------------------------------
-    Create New Port :: Create new port in OpenStack                       | PASS |
-    ------------------------------------------------------------------------------
-    Check New Port :: Check new subnet created in OpenDaylight            | FAIL |
-    404 != 200
-    ------------------------------------------------------------------------------
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | FAIL |
-    4 critical tests, 3 passed, 1 failed
-    4 tests total, 3 passed, 1 failed
-    ==============================================================================
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-    ==============================================================================
-    Delete New Port :: Delete previously created port in OpenStack        | PASS |
-    ------------------------------------------------------------------------------
-    Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-    ==============================================================================
-    Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-    ==============================================================================
-    Delete Network :: Delete network in OpenStack                         | PASS |
-    ------------------------------------------------------------------------------
-    Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin                              | FAIL |
-    18 critical tests, 15 passed, 3 failed
-    18 tests total, 15 passed, 3 failed
-    ==============================================================================
-    Output:  /home/opnfv/output.xml
-    Log:     /home/opnfv/log.html
-    Report:  /home/opnfv/report.html
-    Log:     /home/opnfv/log.html
-    Report:  /home/opnfv/report.html
-
-Feature tests
--------------
-
-vIMS
-^^^^
-
-::
-
-    FUNCTEST.info: Running vIMS test...
-    vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-    vIMS - INFO - Update OpenStack creds informations
-    vIMS - INFO - Upload some OS images if it doesn't exist
-    vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                  Try downloading this image and upload on glance !
-    vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                  Try downloading this image and upload on glance !
-    vIMS - INFO - Update security group quota for this tenant
-    vIMS - INFO - Update cinder quota for this tenant
-    vIMS - INFO - Collect flavor id for cloudify manager server
-    vIMS - INFO - Prepare virtualenv for cloudify-cli
-    vIMS - INFO - Downloading the cloudify manager server blueprint
-    vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 08:04:17'
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the cloudify-manager deployment
-    vIMS - INFO - Cloudify-manager server is UP !
-    vIMS - INFO - Cloudify deployment duration:'495.7'
-    vIMS - INFO - Collect flavor id for all clearwater vm
-    vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 08:12:33'
-    vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the clearwater deployment
-    vIMS - INFO - The deployment of clearwater-opnfv is ended
-    vIMS - INFO - vIMS VNF deployment duration:'759.1'
-    vIMS - INFO - vIMS functional test Start Time:'2016-02-23 08:28:17'
-    vIMS - INFO - vIMS functional test duration:'109.1'
-    vIMS - INFO - Launching the clearwater-opnfv undeployment
-    vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-    vIMS - INFO - Launching the cloudify-manager undeployment
-    vIMS - INFO - Cloudify-manager server has been successfully removed!
-    vIMS - INFO - Removing vIMS tenant ..
-    vIMS - INFO - Removing vIMS user ..
-
-Doctor
-^^^^^^
-
-::
-
-    FUNCTEST.info: Running Doctor test...
-    doctor - DEBUG - Executing command : cd /home/opnfv/repos/doctor/tests && ./run.sh
-    doctor - DEBUG - + IMAGE_URL=https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
-    Note: doctor/tests/run.sh has been executed.
-    PING 192.30.9.7 (192.30.9.7) 56(84) bytes of data.
-    64 bytes from 192.30.9.7: icmp_seq=1 ttl=63 time=0.753 ms
-
-    --- 192.30.9.7 ping statistics ---
-    1 packets transmitted, 1 received, 0% packet loss, time 0ms
-    rtt min/avg/max/mdev = 0.753/0.753/0.753/0.000 ms
-    preparing VM image...
-    +------------------+--------------------------------------+
-    | Property         | Value                                |
-    +------------------+--------------------------------------+
-    | checksum         | 7ca2842a166c276d49880998e4b397d5     |
-    | container_format | bare                                 |
-    | created_at       | 2016-04-26T17:07:58Z                 |
-    | disk_format      | qcow2                                |
-    | id               | ccc11584-d901-4c83-9bbe-1e35b12f03ee |
-    | min_disk         | 0                                    |
-    | min_ram          | 0                                    |
-    | name             | cirros                               |
-    | owner            | 8f39920048ea444d9dedb35e601c1292     |
-    | protected        | False                                |
-    | size             | 15446                                |
-    | status           | active                               |
-    | tags             | []                                   |
-    | updated_at       | 2016-04-26T17:07:59Z                 |
-    | virtual_size     | None                                 |
-    | visibility       | public                               |
-    +------------------+--------------------------------------+
-    starting doctor sample components...
-    creating VM and alarm...
-    +--------------------------------------+-----------------------------------------------+
-    | Property                             | Value                                         |
-    +--------------------------------------+-----------------------------------------------+
-    | OS-DCF:diskConfig                    | MANUAL                                        |
-    | OS-EXT-AZ:availability_zone          |                                               |
-    | OS-EXT-SRV-ATTR:host                 | -                                             |
-    | OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
-    | OS-EXT-SRV-ATTR:instance_name        | instance-00000048                             |
-    | OS-EXT-STS:power_state               | 0                                             |
-    | OS-EXT-STS:task_state                | scheduling                                    |
-    | OS-EXT-STS:vm_state                  | building                                      |
-    | OS-SRV-USG:launched_at               | -                                             |
-    | OS-SRV-USG:terminated_at             | -                                             |
-    | accessIPv4                           |                                               |
-    | accessIPv6                           |                                               |
-    | adminPass                            | AaUNZaoqw74Q                                  |
-    | config_drive                         |                                               |
-    | created                              | 2016-04-26T17:08:01Z                          |
-    | flavor                               | m1.tiny (1)                                   |
-    | hostId                               |                                               |
-    | id                                   | 1ab94214-1d8c-46b5-8467-3d3e3b602f04          |
-    | image                                | cirros (0074bf80-807e-4cb7-b904-bf4347c2a668) |
-    | key_name                             | -                                             |
-    | metadata                             | {}                                            |
-    | name                                 | doctor_vm1                                    |
-    | os-extended-volumes:volumes_attached | []                                            |
-    | progress                             | 0                                             |
-    | security_groups                      | default                                       |
-    | status                               | BUILD                                         |
-    | tenant_id                            | 3d15a63c2519439f839df6785236b0e1              |
-    | updated                              | 2016-02-24T07:59:49Z                          |
-    | user_id                              | 0cfa3d72e33b490880278ff6676aa961              |
-    +--------------------------------------+-----------------------------------------------+
-
-    +---------------------------+----------------------------------------------------------------------+
-    | Property                  | Value                                                                |
-    +---------------------------+----------------------------------------------------------------------+
-    | alarm_actions             | ["http://localhost:12346/failure"]                                   |
-    | alarm_id                  | 739ca887-1a9d-4fb4-ad77-17793de1db16                                 |
-    | description               | VM failure                                                           |
-    | enabled                   | True                                                                 |
-    | event_type                | compute.instance.update                                              |
-    | insufficient_data_actions | []                                                                   |
-    | name                      | doctor_alarm1                                                        |
-    | ok_actions                | []                                                                   |
-    | project_id                | 3d15a63c2519439f839df6785236b0e1                                     |
-    | query                     | [{"field": "traits.state", "type": "string", "value": "error", "op": |
-    |                           | "eq"}, {"field": "traits.instance_id", "type": "string", "value":    |
-    |                           | "1ab94214-1d8c-46b5-8467-3d3e3b602f04", "op": "eq"}]                 |
-    | repeat_actions            | False                                                                |
-    | severity                  | moderate                                                             |
-    | state                     | insufficient data                                                    |
-    | type                      | event                                                                |
-    | user_id                   | 0cfa3d72e33b490880278ff6676aa961                                     |
-    +---------------------------+----------------------------------------------------------------------+
-    waiting for vm launch...
-    injecting host failure...
-    disabling network of comupte host [overcloud-novacompute-0] for 3 mins...
-    Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
-    Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
-    0 OK
-    done
-    cleanup...
-    24120
-    24124
-    24122
-    24144
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    24125
-    24136
-    + ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i instack_key heat-admin@192.30.9.7 '[ -e disable_network.log ] && cat disable_network.log'
-    Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
-    sudo ip link set enp8s0 down
-    <Response [200]>
-    Request to delete server doctor_vm1 has been accepted.
-    waiting disabled compute host back to be enabled...
-
-    doctor - INFO - doctor OK
-
-bgpvpn
-^^^^^^
-
-::
-
-    ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover}  --load-list /tmp/tmpvjQxKe
-    {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn [0.191925s] ... ok
-    {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail [0.078978s] ... ok
-
-    ======
-    Totals
-    ======
-    Ran: 2 tests in 7.0000 sec.
-     - Passed: 2
-     - Skipped: 0
-     - Expected Fail: 0
-     - Unexpected Success: 0
-     - Failed: 0
-    Sum of execute time for each test: 0.2709 sec.
diff --git a/docs/results/apex-os-odl_l2-nofeature-ha.rst b/docs/results/apex-os-odl_l2-nofeature-ha.rst
deleted file mode 100644 (file)
index 5ad050b..0000000
+++ /dev/null
@@ -1,1750 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for apex-os-odl_l2-nofeature-ha
------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-SSH test...
-  vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_ssh- INFO - Creating neutron network vping-net...
-  vPing_ssh- INFO - Creating security group  'vPing-sg'...
-  vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-  vPing_ssh- INFO - vPing Start Time:'2016-02-23 07:43:00'
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=a0698b8a-e881-4b84-b540-a0324d671c5a
-     network=df3509f4-ef3d-4264-9293-9e0688a5c38e
-  vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=a0698b8a-e881-4b84-b540-a0324d671c5a
-     network=df3509f4-ef3d-4264-9293-9e0688a5c38e
-  vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-  vPing_ssh- INFO - Floating IP created: '172.30.9.201'
-  vPing_ssh- INFO - Associating floating ip: '172.30.9.201' to VM 'opnfv-vping-2'
-  vPing_ssh- INFO - Trying to establish SSH connection to 172.30.9.201...
-  vPing_ssh- INFO - Waiting for ping...
-  vPing_ssh- INFO - vPing detected!
-  vPing_ssh- INFO - vPing duration:'82.0' s.
-  vPing_ssh- INFO - Cleaning up...
-  vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-
-::
-
-  FUNCTEST.info: Running vPing-userdata test...
-  vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_userdata- INFO - Creating neutron network vping-net...
-  vPing_userdata- INFO - Creating security group  'vPing-sg'...
-  vPing_userdata- INFO - Flavor found 'm1.small'
-  vPing_userdata- INFO - vPing Start Time:'2016-02-23 07:44:41'
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=78cd8dbf-54fb-43ce-9f19-7801130b5a99
-     network=a030c4ca-00ea-4913-bbec-505eaca9f5ff
-  vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=78cd8dbf-54fb-43ce-9f19-7801130b5a99
-     network=a030c4ca-00ea-4913-bbec-505eaca9f5ff
-     userdata=
-    #!/bin/sh
-
-    while true; do
-     ping -c 1 192.168.130.6 2>&1 >/dev/null
-     RES=$?
-     if [ "Z$RES" = "Z0" ] ; then
-      echo 'vPing OK'
-     break
-     else
-      echo 'vPing KO'
-     fi
-     sleep 1
-    done
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_userdata- INFO - Waiting for ping...
-  vPing_userdata- INFO - vPing detected!
-  vPing_userdata- INFO - vPing duration:'72.7'
-  vPing_userdata- INFO - vPing OK
-  vPing_userdata- INFO - Cleaning up...
-  vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-  FUNCTEST.info: Running Tempest tests...
-  run_tempest - INFO - Creating tenant and user for Tempest suite
-  INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
-  INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
-  run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
-  Total results of verification:
-
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | b470a125-b6d9-400e-872e-abe779ff1ab5 | 784b68a9-2eab-4e1e-abc7-a4f68d4d02fe |          | 70    | 8        | 2016-02-23 07:46:13.668289 | finished |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-
-  Tests:
-
-  +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | name                                                                                                                             | time      | status  |
-  +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since             | 0.10275   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                      | 0.14924   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                 | 0.05661   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                | 0.32593   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                    | 0.38913   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                      | 0.05691   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                       | 0.09185   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.04789   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name          | 0.04881   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref    | 0.27540   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status        | 0.10541   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type          | 0.13467   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results           | 0.33891   | success |
-  | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete          | 2.13276   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                       | 331.74491 | fail    |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                           | 0.41803   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                               | 0.17025   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                            | 316.35661 | fail    |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                  | 0.00272   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                  | 1.84308   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                             | 10.10318  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                   | 17.23894  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                       | 7.82065   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                 | 7.02428   | success |
-  | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                  | 0.0       | fail    |
-  | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                          | 0.09527   | success |
-  | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                     | 0.16436   | success |
-  | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                      | 0.02123   | success |
-  | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                      | 0.32681   | success |
-  | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                        | 0.74903   | success |
-  | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                   | 1.33567   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                 | 0.01368   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                           | 0.01283   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                            | 0.01451   | success |
-  | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                             | 0.17814   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                     | 0.69374   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                   | 1.40285   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                     | 2.95154   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                   | 0.85749   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                         | 1.12230   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                         | 1.29858   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                            | 3.11215   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                          | 3.42505   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                 | 3.05471   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                         | 0.15865   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                       | 0.08296   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                        | 0.08528   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                        | 0.02219   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                         | 0.09302   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                     | 0.71309   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                            | 3.81771   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                              | 0.01890   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                         | 1.06254   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                | 2.54527   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                  | 0.26689   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                      | 1.09816   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                  | 0.67413   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                      | 0.56914   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                      | 0.37443   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change            | 0.74292   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change          | 0.43472   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                         | 0.0       | fail    |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                             | 0.0       | fail    |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications        | 303.15352 | fail    |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications        | 301.75020 | fail    |
-  | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                               | 2.79412   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                        | 9.60493   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                             | 11.53698  | success |
-  | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                      | 0.40696   | success |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                         | 383.53375 | fail    |
-  +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  run_tempest - INFO - Results: {'timestart': '2016-02-2307:46:13.668289', 'duration': 695, 'tests': 70, 'failures': 8}
-  run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
-  run_tempest - INFO - Deleting tenant and user for Tempest suite)
-
-
-Rally
-^^^^^
-::
-
-  FUNCTEST.info: Running Rally benchmark suite...
-  run_rally - INFO - Starting test scenario "authenticate" ...
-
-  Preparing input task
-  Task  7ac7e940-ea41-4f7d-9cca-facd241c0d42: started
-  Task 7ac7e940-ea41-4f7d-9cca-facd241c0d42: finished
-
-  test scenario Authenticate.validate_glance
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_glance     | 0.14  | 0.147  | 0.19   | 0.23   | 0.27  | 0.164 | 100.0%  | 10    |
-  | authenticate.validate_glance (2) | 0.027 | 0.085  | 0.091  | 0.097  | 0.103 | 0.081 | 100.0%  | 10    |
-  | total                            | 0.24  | 0.324  | 0.449  | 0.497  | 0.544 | 0.354 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.991291999817
-  Full duration: 3.52114295959
-
-  test scenario Authenticate.keystone
-  +-----------------------------------------------------------------------------+
-  |                            Response Times (sec)                             |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | total  | 0.062 | 0.071  | 0.092  | 0.093  | 0.093 | 0.075 | 100.0%  | 10    |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.256750106812
-  Full duration: 3.22034788132
-
-  test scenario Authenticate.validate_heat
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_heat     | 0.079 | 0.083  | 0.086  | 0.089  | 0.091 | 0.083 | 100.0%  | 10    |
-  | authenticate.validate_heat (2) | 0.073 | 0.083  | 0.088  | 0.088  | 0.088 | 0.082 | 100.0%  | 10    |
-  | total                          | 0.219 | 0.235  | 0.273  | 0.281  | 0.289 | 0.247 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.758399963379
-  Full duration: 3.36240792274
-
-  test scenario Authenticate.validate_nova
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_nova     | 0.08  | 0.095  | 0.164  | 0.194  | 0.225 | 0.116 | 100.0%  | 10    |
-  | authenticate.validate_nova (2) | 0.018 | 0.024  | 0.032  | 0.035  | 0.037 | 0.025 | 100.0%  | 10    |
-  | total                          | 0.172 | 0.198  | 0.261  | 0.297  | 0.333 | 0.221 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.659279108047
-  Full duration: 3.35535907745
-
-  test scenario Authenticate.validate_cinder
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_cinder     | 0.073 | 0.079  | 0.092  | 0.094  | 0.097 | 0.082 | 100.0%  | 10    |
-  | authenticate.validate_cinder (2) | 0.013 | 0.082  | 0.149  | 0.265  | 0.381 | 0.106 | 100.0%  | 10    |
-  | total                            | 0.152 | 0.241  | 0.344  | 0.464  | 0.585 | 0.272 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.793002128601
-  Full duration: 3.46288895607
-
-  test scenario Authenticate.validate_neutron
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_neutron     | 0.082 | 0.095  | 0.115  | 0.137  | 0.159 | 0.1   | 100.0%  | 10    |
-  | authenticate.validate_neutron (2) | 0.018 | 0.089  | 0.103  | 0.104  | 0.105 | 0.072 | 100.0%  | 10    |
-  | total                             | 0.177 | 0.243  | 0.29   | 0.321  | 0.353 | 0.247 | 100.0%  | 10    |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.788791894913
-  Full duration: 3.39974403381
-
-  run_rally - INFO - Test scenario: "authenticate" OK.
-  run_rally - INFO - Starting test scenario "glance" ...
-
-  Preparing input task
-  Task  56b5e198-2c90-4440-a9bf-b098659c5783: started
-  Task 56b5e198-2c90-4440-a9bf-b098659c5783: finished
-
-  test scenario GlanceImages.list_images
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.list_images | 0.226 | 0.256  | 0.328  | 0.335  | 0.343 | 0.268 | 100.0%  | 10    |
-  | total              | 0.226 | 0.256  | 0.328  | 0.336  | 0.343 | 0.268 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.82669711113
-  Full duration: 4.65047502518
-
-  test scenario GlanceImages.create_image_and_boot_instances
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | glance.create_image | 3.917 | 4.559  | 4.731  | 4.819  | 4.906  | 4.469  | 100.0%  | 10    |
-  | nova.boot_servers   | 5.082 | 8.269  | 10.835 | 11.119 | 11.402 | 8.596  | 100.0%  | 10    |
-  | total               | 9.684 | 12.929 | 15.683 | 15.704 | 15.725 | 13.065 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 38.0555651188
-  Full duration: 65.7321281433
-
-  test scenario GlanceImages.create_and_list_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 3.631 | 4.223  | 4.681  | 4.717  | 4.753 | 4.26  | 100.0%  | 10    |
-  | glance.list_images  | 0.03  | 0.1    | 0.11   | 0.132  | 0.153 | 0.085 | 100.0%  | 10    |
-  | total               | 3.731 | 4.287  | 4.781  | 4.817  | 4.854 | 4.345 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 13.4343621731
-  Full duration: 20.5471830368
-
-  test scenario GlanceImages.create_and_delete_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 3.679 | 4.522  | 4.775  | 4.781  | 4.786 | 4.475 | 100.0%  | 10    |
-  | glance.delete_image | 0.68  | 1.416  | 1.924  | 1.945  | 1.966 | 1.355 | 100.0%  | 10    |
-  | total               | 4.359 | 5.895  | 6.659  | 6.682  | 6.706 | 5.83  | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 17.0444431305
-  Full duration: 21.4709100723
-
-  run_rally - INFO - Test scenario: "glance" OK.
-  run_rally - INFO - Starting test scenario "cinder" ...
-
-  Preparing input task
-  Task  30bb498c-6dda-4d30-bf2d-cf3979a83615: started
-  Task 30bb498c-6dda-4d30-bf2d-cf3979a83615: finished
-
-  test scenario CinderVolumes.create_and_attach_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server     | 3.361  | 5.067  | 5.688  | 5.748  | 5.808  | 4.948  | 100.0%  | 10    |
-  | cinder.create_volume | 2.56   | 2.856  | 3.04   | 3.098  | 3.156  | 2.872  | 100.0%  | 10    |
-  | nova.attach_volume   | 3.018  | 3.376  | 4.145  | 5.024  | 5.903  | 3.65   | 100.0%  | 10    |
-  | nova.detach_volume   | 2.643  | 2.895  | 3.093  | 3.156  | 3.219  | 2.912  | 100.0%  | 10    |
-  | cinder.delete_volume | 0.517  | 2.429  | 2.538  | 2.676  | 2.814  | 2.268  | 100.0%  | 10    |
-  | nova.delete_server   | 2.329  | 2.456  | 2.645  | 2.656  | 2.667  | 2.468  | 100.0%  | 10    |
-  | total                | 17.686 | 19.384 | 20.284 | 20.286 | 20.288 | 19.117 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 56.4022140503
-  Full duration: 68.9135789871
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 5.146 | 5.432  | 5.632  | 5.652  | 5.673 | 5.415 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.034 | 0.115  | 0.135  | 0.135  | 0.135 | 0.096 | 100.0%  | 10    |
-  | total                | 5.18  | 5.507  | 5.747  | 5.772  | 5.797 | 5.511 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.3556389809
-  Full duration: 27.6093170643
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.773 | 2.959  | 3.11   | 3.137  | 3.165 | 2.955 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.028 | 0.127  | 0.202  | 0.219  | 0.237 | 0.111 | 100.0%  | 10    |
-  | total                | 2.812 | 3.033  | 3.293  | 3.298  | 3.302 | 3.066 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.06200098991
-  Full duration: 19.9587731361
-
-  test scenario CinderVolumes.create_and_list_snapshots
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.482 | 4.642  | 4.889  | 4.91   | 4.931 | 4.296 | 100.0%  | 10    |
-  | cinder.list_snapshots  | 0.013 | 0.096  | 0.107  | 0.134  | 0.162 | 0.079 | 100.0%  | 10    |
-  | total                  | 2.583 | 4.772  | 4.95   | 4.967  | 4.984 | 4.375 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 12.2352650166
-  Full duration: 44.3921279907
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.707 | 2.813  | 2.903  | 2.956  | 3.009 | 2.825 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.407 | 2.548  | 2.613  | 2.626  | 2.638 | 2.55  | 100.0%  | 10    |
-  | total                | 5.191 | 5.377  | 5.507  | 5.532  | 5.558 | 5.375 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.1588079929
-  Full duration: 22.6795511246
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 5.089 | 5.255  | 5.753  | 6.601  | 7.449 | 5.494 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.343 | 2.456  | 2.615  | 2.688  | 2.761 | 2.496 | 100.0%  | 10    |
-  | total                | 7.471 | 7.795  | 8.253  | 9.073  | 9.893 | 7.991 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 23.303401947
-  Full duration: 30.3196620941
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.724 | 2.844  | 2.939  | 2.963  | 2.986 | 2.856 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.353 | 2.519  | 2.659  | 2.718  | 2.778 | 2.525 | 100.0%  | 10    |
-  | total                | 5.147 | 5.393  | 5.45   | 5.541  | 5.633 | 5.381 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.1724491119
-  Full duration: 22.9236290455
-
-  test scenario CinderVolumes.create_and_upload_volume_to_image
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume          | 2.726  | 2.886  | 3.014  | 3.047  | 3.08   | 2.888  | 100.0%  | 10    |
-  | cinder.upload_volume_to_image | 28.041 | 44.016 | 44.644 | 44.698 | 44.751 | 40.726 | 100.0%  | 10    |
-  | cinder.delete_volume          | 2.34   | 2.458  | 2.551  | 2.622  | 2.692  | 2.452  | 100.0%  | 10    |
-  | nova.delete_image             | 0.846  | 1.837  | 2.379  | 2.418  | 2.456  | 1.73   | 100.0%  | 10    |
-  | total                         | 34.983 | 51.394 | 51.872 | 51.877 | 51.881 | 47.796 | 100.0%  | 10    |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 136.222712994
-  Full duration: 144.124747038
-
-  test scenario CinderVolumes.create_and_delete_snapshot
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.51  | 4.611  | 4.709  | 4.787  | 4.865 | 4.288 | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.233 | 4.443  | 4.619  | 4.627  | 4.634 | 3.882 | 100.0%  | 10    |
-  | total                  | 4.981 | 9.079  | 9.333  | 9.362  | 9.39  | 8.17  | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 23.2197830677
-  Full duration: 42.1724328995
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.725 | 2.887  | 3.064  | 3.106  | 3.149 | 2.895 | 100.0%  | 10    |
-  | total                | 2.725 | 2.887  | 3.064  | 3.106  | 3.149 | 2.895 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 8.62664198875
-  Full duration: 18.587531805
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.696 | 2.857  | 2.932  | 2.943  | 2.954 | 2.838 | 100.0%  | 10    |
-  | total                | 2.696 | 2.857  | 2.932  | 2.943  | 2.954 | 2.838 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 8.48678183556
-  Full duration: 20.6692960262
-
-  test scenario CinderVolumes.list_volumes
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.list_volumes | 0.202 | 0.275  | 0.381  | 0.408  | 0.435 | 0.283 | 100.0%  | 10    |
-  | total               | 0.202 | 0.275  | 0.381  | 0.408  | 0.435 | 0.284 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.910716056824
-  Full duration: 47.5472760201
-
-  test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-  +-----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                      |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.74  | 2.894  | 3.015  | 3.036  | 3.056  | 2.893  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.407 | 2.549  | 4.689  | 4.745  | 4.802  | 3.163  | 100.0%  | 10    |
-  | nova.attach_volume     | 2.856 | 3.305  | 5.42   | 5.647  | 5.874  | 3.866  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.746 | 3.092  | 3.492  | 4.368  | 5.245  | 3.261  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.347 | 2.508  | 4.471  | 4.534  | 4.596  | 2.868  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.418 | 2.546  | 2.956  | 3.852  | 4.748  | 2.758  | 100.0%  | 10    |
-  | total                  | 16.42 | 18.913 | 21.766 | 22.976 | 24.185 | 19.181 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 55.4410011768
-  Full duration: 103.909024954
-
-  test scenario CinderVolumes.create_from_volume_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.821 | 4.176  | 7.514  | 7.588  | 7.662 | 4.605 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.451 | 4.688  | 4.929  | 4.955  | 4.981 | 4.087 | 100.0%  | 10    |
-  | total                | 5.373 | 8.93   | 12.095 | 12.233 | 12.37 | 8.692 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.4642841816
-  Full duration: 44.0787379742
-
-  test scenario CinderVolumes.create_and_extend_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.58  | 2.854  | 3.055  | 3.19   | 3.325 | 2.89  | 100.0%  | 10    |
-  | cinder.extend_volume | 2.55  | 2.699  | 2.795  | 2.849  | 2.903 | 2.705 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.458 | 2.516  | 2.674  | 2.786  | 2.898 | 2.573 | 100.0%  | 10    |
-  | total                | 7.82  | 8.198  | 8.396  | 8.442  | 8.488 | 8.169 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.4196460247
-  Full duration: 31.8590240479
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.748  | 2.952  | 3.137  | 3.199  | 3.261  | 2.978  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.472  | 2.569  | 4.675  | 4.696  | 4.717  | 3.178  | 100.0%  | 10    |
-  | nova.attach_volume     | 3.051  | 3.462  | 5.38   | 5.41   | 5.439  | 3.956  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.802  | 3.058  | 3.281  | 3.413  | 3.546  | 3.096  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.255  | 2.431  | 4.385  | 4.44   | 4.496  | 2.984  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.341  | 2.485  | 2.773  | 3.721  | 4.67   | 2.693  | 100.0%  | 10    |
-  | total                  | 16.553 | 19.163 | 21.677 | 21.681 | 21.686 | 19.224 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 55.8534150124
-  Full duration: 107.20220089
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +-----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +------------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  | cinder.create_volume   | 2.655  | 2.924  | 3.771  | 3.779  | 3.786  | 3.159 | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.411  | 2.565  | 4.602  | 4.659  | 4.716  | 3.157 | 100.0%  | 10    |
-  | nova.attach_volume     | 3.053  | 3.236  | 5.158  | 5.352  | 5.546  | 3.726 | 100.0%  | 10    |
-  | nova.detach_volume     | 2.752  | 2.964  | 3.54   | 4.371  | 5.201  | 3.196 | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.147  | 2.424  | 4.491  | 4.497  | 4.503  | 2.802 | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.484  | 2.574  | 2.677  | 2.726  | 2.775  | 2.582 | 100.0%  | 10    |
-  | total                  | 17.334 | 19.301 | 20.332 | 21.118 | 21.904 | 19.2  | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 56.6079628468
-  Full duration: 108.998883963
-
-  run_rally - INFO - Test scenario: "cinder" OK.
-  run_rally - INFO - Starting test scenario "heat" ...
-
-  Preparing input task
-  Task  aae5a92c-66ff-4c8c-b4a3-0957baac4610: started
-  Task aae5a92c-66ff-4c8c-b4a3-0957baac4610: finished
-
-  test scenario HeatStacks.create_suspend_resume_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack  | 2.922 | 3.271  | 3.354  | 3.38   | 3.406 | 3.229 | 100.0%  | 10    |
-  | heat.suspend_stack | 1.21  | 1.305  | 1.397  | 1.4    | 1.403 | 1.31  | 100.0%  | 10    |
-  | heat.resume_stack  | 1.183 | 1.318  | 1.348  | 1.352  | 1.356 | 1.301 | 100.0%  | 10    |
-  | heat.delete_stack  | 1.161 | 1.306  | 2.368  | 2.383  | 2.398 | 1.68  | 100.0%  | 10    |
-  | total              | 6.612 | 7.196  | 8.411  | 8.476  | 8.541 | 7.519 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 21.979665041
-  Full duration: 25.784487009
-
-  test scenario HeatStacks.create_and_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.8   | 2.896  | 3.053  | 3.136  | 3.219 | 2.929 | 100.0%  | 10    |
-  | heat.delete_stack | 1.167 | 1.185  | 1.272  | 1.284  | 1.296 | 1.202 | 100.0%  | 10    |
-  | total             | 3.967 | 4.11   | 4.26   | 4.334  | 4.409 | 4.13  | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 12.3352811337
-  Full duration: 16.1414811611
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 13.463 | 15.842 | 17.472 | 17.519 | 17.565 | 15.768 | 100.0%  | 10    |
-  | heat.delete_stack | 8.575  | 9.635  | 10.691 | 10.703 | 10.714 | 9.537  | 100.0%  | 10    |
-  | total             | 22.054 | 25.534 | 27.126 | 27.181 | 27.236 | 25.305 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 74.6174178123
-  Full duration: 78.7209010124
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 9.848  | 12.353 | 14.548 | 14.574 | 14.6   | 12.757 | 100.0%  | 10    |
-  | heat.delete_stack | 6.448  | 7.541  | 8.549  | 8.581  | 8.612  | 7.65   | 100.0%  | 10    |
-  | total             | 17.369 | 19.894 | 23.098 | 23.155 | 23.212 | 20.407 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 61.6486670971
-  Full duration: 65.8705642223
-
-  test scenario HeatStacks.list_stacks_and_resources
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.list_stacks                | 0.198 | 0.23   | 0.268  | 0.302  | 0.337 | 0.238 | 100.0%  | 10    |
-  | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-  | total                           | 0.198 | 0.231  | 0.268  | 0.302  | 0.337 | 0.238 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.700455904007
-  Full duration: 4.55407810211
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | heat.create_stack | 3.01  | 3.109  | 3.377  | 3.561  | 3.744  | 3.173 | 100.0%  | 10    |
-  | heat.update_stack | 3.232 | 3.408  | 4.335  | 4.354  | 4.374  | 3.612 | 100.0%  | 10    |
-  | heat.delete_stack | 1.146 | 1.207  | 2.478  | 2.887  | 3.296  | 1.721 | 100.0%  | 10    |
-  | total             | 7.423 | 7.67   | 9.921  | 10.311 | 10.702 | 8.505 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 24.7915220261
-  Full duration: 29.4085850716
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.881 | 3.066  | 3.233  | 3.377  | 3.52  | 3.09  | 100.0%  | 10    |
-  | heat.update_stack | 3.212 | 3.254  | 3.48   | 3.507  | 3.535 | 3.303 | 100.0%  | 10    |
-  | heat.delete_stack | 1.154 | 1.167  | 1.188  | 1.194  | 1.201 | 1.17  | 100.0%  | 10    |
-  | total             | 7.263 | 7.498  | 7.904  | 7.912  | 7.921 | 7.563 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 22.4006979465
-  Full duration: 26.8767819405
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 3.972  | 4.032  | 6.634  | 6.716  | 6.798  | 4.942  | 100.0%  | 10    |
-  | heat.update_stack | 5.327  | 5.354  | 5.482  | 5.548  | 5.614  | 5.388  | 100.0%  | 10    |
-  | heat.delete_stack | 2.19   | 2.207  | 2.213  | 2.214  | 2.215  | 2.203  | 100.0%  | 10    |
-  | total             | 11.521 | 11.583 | 14.284 | 14.325 | 14.367 | 12.534 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 37.184043169
-  Full duration: 41.6411378384
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------+
-  |                         Response Times (sec)                          |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | action | min | median | 90%ile | 95%ile | max | avg | success | count |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 8     |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  Load duration: 8.45521402359
-  Full duration: 17.6498777866
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 3.971  | 5.16   | 5.356  | 5.407  | 5.459  | 4.973  | 100.0%  | 10    |
-  | heat.update_stack | 5.318  | 5.359  | 5.382  | 5.394  | 5.405  | 5.358  | 100.0%  | 10    |
-  | heat.delete_stack | 2.188  | 2.198  | 2.266  | 2.267  | 2.267  | 2.211  | 100.0%  | 10    |
-  | total             | 11.488 | 12.723 | 12.979 | 13.011 | 13.043 | 12.543 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 37.0396420956
-  Full duration: 41.5464501381
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.829 | 3.044  | 3.212  | 3.247  | 3.283 | 3.029 | 100.0%  | 10    |
-  | heat.update_stack | 3.215 | 3.228  | 3.295  | 3.317  | 3.339 | 3.248 | 100.0%  | 10    |
-  | heat.delete_stack | 1.144 | 1.154  | 1.183  | 1.191  | 1.198 | 1.161 | 100.0%  | 10    |
-  | total             | 7.202 | 7.41   | 7.611  | 7.692  | 7.774 | 7.438 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 22.2332119942
-  Full duration: 26.9551222324
-
-  test scenario HeatStacks.create_and_list_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.901 | 3.019  | 3.106  | 3.131  | 3.157 | 3.024 | 100.0%  | 10    |
-  | heat.list_stacks  | 0.026 | 0.033  | 0.038  | 0.039  | 0.039 | 0.032 | 100.0%  | 10    |
-  | total             | 2.94  | 3.049  | 3.139  | 3.163  | 3.188 | 3.056 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.14466500282
-  Full duration: 16.6371269226
-
-  test scenario HeatStacks.create_check_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.988 | 3.093  | 3.17   | 3.178  | 3.187 | 3.087 | 100.0%  | 10    |
-  | heat.check_stack  | 1.182 | 1.191  | 1.218  | 1.227  | 1.235 | 1.197 | 100.0%  | 10    |
-  | heat.delete_stack | 1.135 | 1.146  | 1.159  | 1.163  | 1.167 | 1.148 | 100.0%  | 10    |
-  | total             | 5.315 | 5.451  | 5.54   | 5.549  | 5.558 | 5.432 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.1800320148
-  Full duration: 20.4218199253
-
-  run_rally - INFO - Test scenario: "heat" Failed.
-  run_rally - INFO - Starting test scenario "keystone" ...
-
-  Preparing input task
-  Task  a2566777-434b-4a10-8720-118485a7d427: started
-  Task a2566777-434b-4a10-8720-118485a7d427: finished
-
-  test scenario KeystoneBasic.create_tenant_with_users
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.129 | 0.152  | 0.179  | 0.185  | 0.19  | 0.153 | 100.0%  | 10    |
-  | keystone.create_users  | 1.041 | 1.142  | 1.45   | 1.48   | 1.509 | 1.211 | 100.0%  | 10    |
-  | total                  | 1.177 | 1.295  | 1.637  | 1.653  | 1.668 | 1.363 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.19324994087
-  Full duration: 15.3481221199
-
-  test scenario KeystoneBasic.create_add_and_list_user_roles
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.126 | 0.137  | 0.15   | 0.155  | 0.16  | 0.138 | 100.0%  | 10    |
-  | keystone.add_role    | 0.116 | 0.123  | 0.145  | 0.158  | 0.171 | 0.128 | 100.0%  | 10    |
-  | keystone.list_roles  | 0.055 | 0.064  | 0.076  | 0.093  | 0.11  | 0.068 | 100.0%  | 10    |
-  | total                | 0.308 | 0.334  | 0.36   | 0.362  | 0.364 | 0.335 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.02259397507
-  Full duration: 7.21977186203
-
-  test scenario KeystoneBasic.add_and_remove_user_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.127 | 0.155  | 0.187  | 0.19   | 0.192 | 0.159 | 100.0%  | 10    |
-  | keystone.add_role    | 0.117 | 0.131  | 0.161  | 0.175  | 0.188 | 0.137 | 100.0%  | 10    |
-  | keystone.remove_role | 0.089 | 0.104  | 0.137  | 0.161  | 0.184 | 0.113 | 100.0%  | 10    |
-  | total                | 0.352 | 0.4    | 0.454  | 0.471  | 0.487 | 0.408 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.2577559948
-  Full duration: 7.18419408798
-
-  test scenario KeystoneBasic.create_update_and_delete_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.131 | 0.147  | 0.168  | 0.175  | 0.181 | 0.15  | 100.0%  | 10    |
-  | keystone.update_tenant | 0.073 | 0.081  | 0.138  | 0.138  | 0.138 | 0.094 | 100.0%  | 10    |
-  | keystone.delete_tenant | 0.146 | 0.181  | 0.212  | 0.215  | 0.218 | 0.182 | 100.0%  | 10    |
-  | total                  | 0.356 | 0.436  | 0.488  | 0.501  | 0.514 | 0.426 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.28746080399
-  Full duration: 5.78163409233
-
-  test scenario KeystoneBasic.create_and_delete_service
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_service | 0.136 | 0.149  | 0.185  | 0.201  | 0.217 | 0.158 | 100.0%  | 10    |
-  | keystone.delete_service | 0.079 | 0.081  | 0.094  | 0.105  | 0.116 | 0.086 | 100.0%  | 10    |
-  | total                   | 0.22  | 0.233  | 0.267  | 0.288  | 0.309 | 0.244 | 100.0%  | 10    |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.732470035553
-  Full duration: 5.50471711159
-
-  test scenario KeystoneBasic.create_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.135 | 0.141  | 0.177  | 0.184  | 0.19  | 0.151 | 100.0%  | 10    |
-  | total                  | 0.135 | 0.141  | 0.177  | 0.184  | 0.191 | 0.152 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.47666311264
-  Full duration: 4.65166783333
-
-  test scenario KeystoneBasic.create_user
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.145 | 0.17   | 0.2    | 0.206  | 0.211 | 0.174 | 100.0%  | 10    |
-  | total                | 0.145 | 0.171  | 0.2    | 0.206  | 0.212 | 0.174 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.544457912445
-  Full duration: 4.52855014801
-
-  test scenario KeystoneBasic.create_and_list_tenants
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.139 | 0.151  | 0.184  | 0.204  | 0.224 | 0.161 | 100.0%  | 10    |
-  | keystone.list_tenants  | 0.054 | 0.062  | 0.076  | 0.095  | 0.115 | 0.067 | 100.0%  | 10    |
-  | total                  | 0.201 | 0.213  | 0.277  | 0.286  | 0.295 | 0.227 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.684409141541
-  Full duration: 7.2159280777
-
-  test scenario KeystoneBasic.create_and_delete_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.131 | 0.156  | 0.212  | 0.213  | 0.215 | 0.167 | 100.0%  | 10    |
-  | keystone.delete_role | 0.132 | 0.159  | 0.222  | 0.244  | 0.266 | 0.174 | 100.0%  | 10    |
-  | total                | 0.276 | 0.349  | 0.375  | 0.409  | 0.444 | 0.341 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.00079798698
-  Full duration: 5.79344797134
-
-  test scenario KeystoneBasic.get_entities
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.14  | 0.148  | 0.211  | 0.214  | 0.216 | 0.161 | 100.0%  | 10    |
-  | keystone.create_user   | 0.083 | 0.09   | 0.105  | 0.122  | 0.138 | 0.094 | 100.0%  | 10    |
-  | keystone.create_role   | 0.065 | 0.081  | 0.12   | 0.126  | 0.131 | 0.087 | 100.0%  | 10    |
-  | keystone.get_tenant    | 0.054 | 0.064  | 0.115  | 0.117  | 0.119 | 0.078 | 100.0%  | 10    |
-  | keystone.get_user      | 0.055 | 0.062  | 0.081  | 0.104  | 0.127 | 0.069 | 100.0%  | 10    |
-  | keystone.get_role      | 0.055 | 0.062  | 0.096  | 0.109  | 0.121 | 0.071 | 100.0%  | 10    |
-  | keystone.service_list  | 0.053 | 0.06   | 0.069  | 0.072  | 0.074 | 0.061 | 100.0%  | 10    |
-  | keystone.get_service   | 0.054 | 0.059  | 0.068  | 0.087  | 0.105 | 0.063 | 100.0%  | 10    |
-  | total                  | 0.577 | 0.674  | 0.806  | 0.815  | 0.825 | 0.685 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.99226713181
-  Full duration: 11.5220220089
-
-  test scenario KeystoneBasic.create_and_list_users
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.148 | 0.173  | 0.197  | 0.206  | 0.215 | 0.175 | 100.0%  | 10    |
-  | keystone.list_users  | 0.059 | 0.062  | 0.068  | 0.068  | 0.069 | 0.063 | 100.0%  | 10    |
-  | total                | 0.207 | 0.238  | 0.259  | 0.267  | 0.275 | 0.238 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.724813938141
-  Full duration: 4.96498990059
-
-  run_rally - INFO - Test scenario: "keystone" OK.
-  run_rally - INFO - Starting test scenario "neutron" ...
-
-  Preparing input task
-  Task  54896a60-668a-4109-89ce-b6be1526b03c: started
-  Task 54896a60-668a-4109-89ce-b6be1526b03c: finished
-
-  test scenario NeutronNetworks.create_and_delete_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.495 | 0.647  | 0.86   | 0.862  | 0.864 | 0.662 | 100.0%  | 10    |
-  | neutron.delete_port | 0.138 | 0.389  | 0.568  | 0.757  | 0.946 | 0.413 | 100.0%  | 10    |
-  | total               | 0.633 | 0.994  | 1.292  | 1.551  | 1.809 | 1.075 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.11711192131
-  Full duration: 33.0977571011
-
-  test scenario NeutronNetworks.create_and_list_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.499 | 0.61   | 0.652  | 0.678  | 0.704 | 0.602 | 100.0%  | 10    |
-  | neutron.create_router        | 0.146 | 0.344  | 0.458  | 0.463  | 0.467 | 0.349 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.258 | 0.522  | 0.604  | 0.672  | 0.739 | 0.519 | 100.0%  | 10    |
-  | neutron.list_routers         | 0.026 | 0.282  | 0.457  | 0.501  | 0.545 | 0.272 | 100.0%  | 10    |
-  | total                        | 1.316 | 1.657  | 1.975  | 2.111  | 2.247 | 1.742 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 5.24421405792
-  Full duration: 37.3269040585
-
-  test scenario NeutronNetworks.create_and_delete_routers
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet           | 0.563 | 0.666  | 0.868  | 1.002  | 1.136 | 0.721 | 100.0%  | 10    |
-  | neutron.create_router           | 0.13  | 0.373  | 0.573  | 0.595  | 0.616 | 0.384 | 100.0%  | 10    |
-  | neutron.add_interface_router    | 0.274 | 0.505  | 0.574  | 0.605  | 0.637 | 0.471 | 100.0%  | 10    |
-  | neutron.remove_interface_router | 0.234 | 0.492  | 0.66   | 0.676  | 0.692 | 0.512 | 100.0%  | 10    |
-  | neutron.delete_router           | 0.117 | 0.329  | 0.731  | 0.744  | 0.756 | 0.341 | 100.0%  | 10    |
-  | total                           | 1.572 | 2.372  | 2.966  | 3.156  | 3.347 | 2.43  | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 7.02413988113
-  Full duration: 37.7696969509
-
-  test scenario NeutronNetworks.create_and_list_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.507 | 0.678  | 0.859  | 0.871  | 0.883 | 0.7   | 100.0%  | 10    |
-  | neutron.list_ports  | 0.131 | 0.305  | 0.497  | 0.512  | 0.526 | 0.325 | 100.0%  | 10    |
-  | total               | 0.792 | 1.051  | 1.18   | 1.187  | 1.193 | 1.025 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.00920605659
-  Full duration: 34.7632040977
-
-  test scenario NeutronNetworks.create_and_delete_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.505 | 0.561  | 0.698  | 0.722  | 0.747 | 0.592 | 100.0%  | 10    |
-  | neutron.delete_subnet | 0.141 | 0.477  | 0.75   | 0.785  | 0.82  | 0.516 | 100.0%  | 10    |
-  | total                 | 0.759 | 1.066  | 1.367  | 1.429  | 1.491 | 1.108 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.30927801132
-  Full duration: 34.2646439075
-
-  test scenario NeutronNetworks.create_and_delete_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.368 | 0.511  | 0.727  | 0.746  | 0.765 | 0.541 | 100.0%  | 10    |
-  | neutron.delete_network | 0.115 | 0.331  | 0.399  | 0.421  | 0.443 | 0.328 | 100.0%  | 10    |
-  | total                  | 0.519 | 0.876  | 1.09   | 1.149  | 1.209 | 0.87  | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.45112395287
-  Full duration: 17.3522310257
-
-  test scenario NeutronNetworks.create_and_list_networks
-  +-----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                      |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | neutron.create_network | 0.376 | 0.514  | 51.874 | 51.881 | 51.887 | 21.012 | 100.0%  | 10    |
-  | neutron.list_networks  | 0.048 | 0.264  | 0.303  | 0.312  | 0.32   | 0.246  | 100.0%  | 10    |
-  | total                  | 0.644 | 0.78   | 52.142 | 52.175 | 52.208 | 21.258 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 53.5037658215
-  Full duration: 70.7888660431
-
-  test scenario NeutronNetworks.create_and_update_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.457 | 0.651  | 0.738  | 0.757  | 0.777 | 0.631 | 100.0%  | 10    |
-  | neutron.create_router        | 0.144 | 0.334  | 0.45   | 0.477  | 0.504 | 0.349 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.286 | 0.546  | 0.676  | 0.685  | 0.695 | 0.555 | 100.0%  | 10    |
-  | neutron.update_router        | 0.099 | 0.36   | 0.43   | 0.438  | 0.446 | 0.312 | 100.0%  | 10    |
-  | total                        | 1.176 | 1.895  | 2.106  | 2.13   | 2.155 | 1.848 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 5.49681401253
-  Full duration: 37.4188079834
-
-  test scenario NeutronNetworks.create_and_update_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.36  | 0.471  | 0.71   | 0.73   | 0.75  | 0.528 | 100.0%  | 10    |
-  | neutron.update_network | 0.123 | 0.355  | 0.42   | 0.426  | 0.431 | 0.336 | 100.0%  | 10    |
-  | total                  | 0.651 | 0.826  | 1.115  | 1.126  | 1.137 | 0.863 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.45435285568
-  Full duration: 19.8497779369
-
-  test scenario NeutronNetworks.create_and_update_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.522 | 0.606  | 0.691  | 0.706  | 0.721 | 0.612 | 100.0%  | 10    |
-  | neutron.update_port | 0.187 | 0.343  | 0.388  | 0.389  | 0.39  | 0.336 | 100.0%  | 10    |
-  | total               | 0.756 | 0.965  | 1.027  | 1.044  | 1.061 | 0.948 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.89304494858
-  Full duration: 35.0843141079
-
-  test scenario NeutronNetworks.create_and_list_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.435 | 0.561  | 0.697  | 0.716  | 0.735 | 0.584 | 100.0%  | 10    |
-  | neutron.list_subnets  | 0.259 | 0.312  | 0.4    | 0.427  | 0.455 | 0.331 | 100.0%  | 10    |
-  | total                 | 0.785 | 0.877  | 1.111  | 1.12   | 1.129 | 0.915 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.61414718628
-  Full duration: 34.7340919971
-
-  test scenario NeutronNetworks.create_and_update_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.496 | 0.57   | 0.724  | 0.732  | 0.741 | 0.598 | 100.0%  | 10    |
-  | neutron.update_subnet | 0.356 | 0.433  | 0.584  | 0.599  | 0.615 | 0.47  | 100.0%  | 10    |
-  | total                 | 0.889 | 1.045  | 1.22   | 1.231  | 1.242 | 1.068 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.22795987129
-  Full duration: 33.4197108746
-
-  run_rally - INFO - Test scenario: "neutron" OK.
-  run_rally - INFO - Starting test scenario "nova" ...
-
-  Preparing input task
-  Task  d97765c7-bb1a-461c-8a74-ade03e3cc05a: started
-  Task d97765c7-bb1a-461c-8a74-ade03e3cc05a: finished
-
-  test scenario NovaKeypair.create_and_delete_keypair
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.404 | 0.52   | 1.075  | 1.084  | 1.093 | 0.647 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.021 | 0.023  | 0.03   | 0.036  | 0.041 | 0.026 | 100.0%  | 10    |
-  | total               | 0.432 | 0.546  | 1.099  | 1.11   | 1.122 | 0.673 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.18305206299
-  Full duration: 18.7849049568
-
-  test scenario NovaServers.snapshot_server
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server       | 4.34   | 6.072  | 6.37   | 6.458  | 6.546  | 5.696  | 100.0%  | 10    |
-  | nova.create_image      | 26.042 | 43.405 | 45.329 | 45.435 | 45.541 | 40.593 | 100.0%  | 10    |
-  | nova.delete_server     | 2.313  | 2.59   | 2.699  | 2.859  | 3.019  | 2.586  | 100.0%  | 10    |
-  | nova.boot_server (2)   | 8.297  | 11.985 | 12.916 | 13.279 | 13.642 | 11.495 | 100.0%  | 10    |
-  | nova.delete_server (2) | 2.4    | 2.622  | 2.761  | 2.777  | 2.792  | 2.638  | 100.0%  | 10    |
-  | nova.delete_image      | 1.443  | 2.236  | 2.891  | 3.258  | 3.626  | 2.279  | 100.0%  | 10    |
-  | total                  | 45.514 | 69.068 | 71.631 | 72.478 | 73.326 | 65.288 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 189.056165934
-  Full duration: 227.369397879
-
-  test scenario NovaKeypair.boot_and_delete_server_with_keypair
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.create_keypair | 0.393 | 0.542  | 0.682  | 0.906  | 1.129  | 0.575 | 100.0%  | 10    |
-  | nova.boot_server    | 5.333 | 6.169  | 7.894  | 7.9    | 7.907  | 6.354 | 100.0%  | 10    |
-  | nova.delete_server  | 2.343 | 2.689  | 2.83   | 2.847  | 2.864  | 2.658 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.02  | 0.025  | 0.032  | 0.034  | 0.035  | 0.026 | 100.0%  | 10    |
-  | total               | 8.385 | 9.359  | 11.149 | 11.258 | 11.367 | 9.613 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 29.3410420418
-  Full duration: 66.8611400127
-
-  test scenario NovaKeypair.create_and_list_keypairs
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +---------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.4  | 0.494  | 0.589  | 0.867  | 1.146 | 0.544 | 100.0%  | 10    |
-  | nova.list_keypairs  | 0.01 | 0.014  | 0.017  | 0.018  | 0.019 | 0.013 | 100.0%  | 10    |
-  | total               | 0.41 | 0.508  | 0.603  | 0.884  | 1.165 | 0.558 | 100.0%  | 10    |
-  +---------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.71813702583
-  Full duration: 20.3168940544
-
-  test scenario NovaServers.list_servers
-  +---------------------------------------------------------------------------------------+
-  |                                 Response Times (sec)                                  |
-  +-------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.list_servers | 0.64 | 0.917  | 1.069  | 1.117  | 1.165 | 0.895 | 100.0%  | 10    |
-  | total             | 0.64 | 0.917  | 1.07   | 1.117  | 1.165 | 0.895 | 100.0%  | 10    |
-  +-------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.65287709236
-  Full duration: 66.0498650074
-
-  test scenario NovaServers.resize_server
-  +-----------------------------------------------------------------------+
-  |                         Response Times (sec)                          |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | action | min | median | 90%ile | 95%ile | max | avg | success | count |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 6     |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  Load duration: 815.834815979
-  Full duration: 839.469985008
-
-  test scenario NovaServers.boot_server_from_volume_and_delete
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max   | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-  | cinder.create_volume | 5.574  | 6.234  | 8.567  | 8.613  | 8.66  | 6.605  | 100.0%  | 10    |
-  | nova.boot_server     | 4.812  | 6.08   | 6.59   | 6.789  | 6.988 | 6.029  | 100.0%  | 10    |
-  | nova.delete_server   | 2.339  | 2.631  | 2.668  | 2.687  | 2.707 | 2.602  | 100.0%  | 10    |
-  | total                | 13.379 | 15.107 | 16.804 | 16.977 | 17.15 | 15.236 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-  Load duration: 45.449835062
-  Full duration: 88.6502871513
-
-  test scenario NovaServers.boot_and_migrate_server
-  +-----------------------------------------------------------------------+
-  |                         Response Times (sec)                          |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | action | min | median | 90%ile | 95%ile | max | avg | success | count |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  Load duration: 824.306979895
-  Full duration: 846.910109043
-
-  test scenario NovaServers.boot_and_delete_server
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server   | 4.471 | 5.91   | 6.147  | 6.182  | 6.217 | 5.681 | 100.0%  | 10    |
-  | nova.delete_server | 2.378 | 2.586  | 2.707  | 2.746  | 2.785 | 2.579 | 100.0%  | 10    |
-  | total              | 7.061 | 8.47   | 8.67   | 8.754  | 8.839 | 8.26  | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.1857261658
-  Full duration: 60.5944719315
-
-  test scenario NovaServers.boot_and_rebuild_server
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.boot_server    | 4.333  | 5.804  | 6.335  | 6.417  | 6.498  | 5.565 | 100.0%  | 10    |
-  | nova.rebuild_server | 7.496  | 8.885  | 9.786  | 9.911  | 10.036 | 8.862 | 100.0%  | 10    |
-  | nova.delete_server  | 2.289  | 2.614  | 2.738  | 2.741  | 2.744  | 2.563 | 100.0%  | 10    |
-  | total               | 14.866 | 17.495 | 18.471 | 18.474 | 18.476 | 16.99 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 49.6322209835
-  Full duration: 85.0604588985
-
-  test scenario NovaSecGroup.create_and_list_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 3.185  | 3.686  | 3.987  | 4.312  | 4.638  | 3.699  | 100.0%  | 10    |
-  | nova.create_100_rules          | 18.567 | 26.267 | 26.534 | 26.699 | 26.865 | 24.773 | 100.0%  | 10    |
-  | nova.list_security_groups      | 0.078  | 0.128  | 0.182  | 0.185  | 0.187  | 0.13   | 100.0%  | 10    |
-  | total                          | 22.414 | 29.93  | 30.82  | 30.98  | 31.14  | 28.603 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 82.9733760357
-  Full duration: 116.589685917
-
-  test scenario NovaSecGroup.create_and_delete_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 2.944  | 3.432  | 3.733  | 3.782  | 3.831  | 3.421  | 100.0%  | 10    |
-  | nova.create_100_rules          | 16.376 | 21.41  | 22.17  | 22.462 | 22.754 | 20.611 | 100.0%  | 10    |
-  | nova.delete_10_security_groups | 0.917  | 1.088  | 1.275  | 1.303  | 1.332  | 1.093  | 100.0%  | 10    |
-  | total                          | 20.695 | 25.965 | 26.896 | 26.95  | 27.004 | 25.125 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 72.9624798298
-  Full duration: 89.82077384
-
-  test scenario NovaServers.boot_and_bounce_server
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  | action                  | min    | median | 90%ile | 95%ile  | max     | avg    | success | count |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  | nova.boot_server        | 4.125  | 4.583  | 6.312  | 6.519   | 6.725   | 5.156  | 100.0%  | 10    |
-  | nova.reboot_server      | 2.419  | 2.493  | 2.871  | 3.889   | 4.906   | 2.736  | 100.0%  | 10    |
-  | nova.soft_reboot_server | 4.365  | 4.758  | 16.946 | 70.03   | 123.114 | 16.564 | 100.0%  | 10    |
-  | nova.stop_server        | 5.106  | 14.074 | 15.736 | 15.772  | 15.808  | 13.538 | 100.0%  | 10    |
-  | nova.start_server       | 1.398  | 1.653  | 1.789  | 2.027   | 2.264   | 1.691  | 100.0%  | 10    |
-  | nova.rescue_server      | 6.466  | 6.855  | 15.712 | 16.593  | 17.474  | 8.701  | 100.0%  | 10    |
-  | nova.unrescue_server    | 2.236  | 2.258  | 2.473  | 2.501   | 2.529   | 2.318  | 100.0%  | 10    |
-  | nova.delete_server      | 2.302  | 2.339  | 2.497  | 2.533   | 2.568   | 2.392  | 100.0%  | 10    |
-  | total                   | 30.075 | 40.221 | 65.737 | 113.006 | 160.274 | 53.112 | 100.0%  | 10    |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  Load duration: 160.307124138
-  Full duration: 195.760754108
-
-  test scenario NovaServers.boot_server
-  +---------------------------------------------------------------------------------------+
-  |                                 Response Times (sec)                                  |
-  +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server | 4.346 | 5.987  | 7.641  | 7.662  | 7.683 | 6.099 | 100.0%  | 10    |
-  | total            | 4.346 | 5.987  | 7.641  | 7.662  | 7.684 | 6.099 | 100.0%  | 10    |
-  +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 17.5887329578
-  Full duration: 42.9464931488
-
-  test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-  +-----------------------------------------------------------------------------------------------------------+
-  |                                           Response Times (sec)                                            |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups    | 2.723  | 3.726  | 4.171  | 4.216  | 4.261  | 3.683  | 100.0%  | 10    |
-  | nova.create_100_rules             | 18.505 | 26.114 | 26.91  | 26.926 | 26.943 | 24.62  | 100.0%  | 10    |
-  | nova.boot_server                  | 3.627  | 4.946  | 5.965  | 6.019  | 6.073  | 4.932  | 100.0%  | 10    |
-  | nova.get_attached_security_groups | 0.108  | 0.131  | 0.253  | 0.324  | 0.396  | 0.166  | 100.0%  | 10    |
-  | nova.delete_server                | 2.334  | 2.379  | 2.491  | 2.512  | 2.533  | 2.396  | 100.0%  | 10    |
-  | nova.delete_10_security_groups    | 0.973  | 1.409  | 1.639  | 1.832  | 2.026  | 1.399  | 100.0%  | 10    |
-  | total                             | 28.564 | 39.133 | 39.77  | 39.952 | 40.134 | 37.197 | 100.0%  | 10    |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 107.169257164
-  Full duration: 144.236375093
-
-  test scenario NovaServers.pause_and_unpause_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 4.178  | 6.265  | 6.892  | 7.037  | 7.182  | 6.066  | 100.0%  | 10    |
-  | nova.pause_server   | 2.287  | 2.526  | 2.683  | 2.743  | 2.804  | 2.548  | 100.0%  | 10    |
-  | nova.unpause_server | 2.436  | 2.503  | 2.571  | 2.571  | 2.572  | 2.507  | 100.0%  | 10    |
-  | nova.delete_server  | 2.294  | 2.606  | 2.995  | 3.945  | 4.895  | 2.755  | 100.0%  | 10    |
-  | total               | 11.529 | 13.896 | 14.859 | 15.712 | 16.564 | 13.876 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 40.5261249542
-  Full duration: 76.823114872
-
-  test scenario NovaServers.boot_server_from_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 5.836  | 6.478  | 9.07   | 9.177  | 9.283  | 7.115  | 100.0%  | 10    |
-  | nova.boot_server     | 5.52   | 6.079  | 6.596  | 7.362  | 8.128  | 6.22   | 100.0%  | 10    |
-  | total                | 11.526 | 12.516 | 15.434 | 15.438 | 15.442 | 13.335 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 39.5622808933
-  Full duration: 73.6733939648
-
-  test scenario NovaServers.boot_and_list_server
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server  | 4.694 | 6.002  | 6.133  | 6.249  | 6.365 | 5.738 | 100.0%  | 10    |
-  | nova.list_servers | 0.141 | 0.377  | 0.551  | 0.599  | 0.646 | 0.376 | 100.0%  | 10    |
-  | total             | 5.074 | 6.186  | 6.707  | 6.807  | 6.906 | 6.114 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 17.6599957943
-  Full duration: 64.1471071243
-
-  run_rally - INFO - Test scenario: "nova" Failed.
-  run_rally - INFO - Starting test scenario "quotas" ...
-
-  Preparing input task
-  Task  5eda6ea1-f001-4a0e-b6cd-7685d1803fd5: started
-  Task 5eda6ea1-f001-4a0e-b6cd-7685d1803fd5: finished
-
-  test scenario Quotas.cinder_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.692 | 0.867  | 1.007  | 1.025  | 1.043 | 0.869 | 100.0%  | 10    |
-  | total                | 0.692 | 0.867  | 1.007  | 1.025  | 1.043 | 0.869 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.54990196228
-  Full duration: 9.24233794212
-
-  test scenario Quotas.neutron_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.318 | 0.578  | 0.742  | 0.759  | 0.776 | 0.558 | 100.0%  | 10    |
-  | total                | 0.384 | 0.669  | 0.825  | 0.837  | 0.848 | 0.646 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.74635910988
-  Full duration: 8.15396595001
-
-  test scenario Quotas.cinder_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.686 | 0.867  | 1.072  | 1.087  | 1.102 | 0.87  | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.563 | 0.613  | 0.737  | 0.75   | 0.763 | 0.631 | 100.0%  | 10    |
-  | total                | 1.274 | 1.453  | 1.698  | 1.782  | 1.865 | 1.501 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.41035509109
-  Full duration: 11.0862941742
-
-  test scenario Quotas.nova_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.48  | 0.753  | 1.082  | 1.107  | 1.133 | 0.811 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.025 | 0.066  | 0.091  | 0.114  | 0.138 | 0.066 | 100.0%  | 10    |
-  | total                | 0.505 | 0.812  | 1.14   | 1.173  | 1.206 | 0.878 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.45851612091
-  Full duration: 8.88383197784
-
-  test scenario Quotas.nova_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.516 | 0.798  | 1.182  | 1.19   | 1.198 | 0.829 | 100.0%  | 10    |
-  | total                | 0.516 | 0.798  | 1.182  | 1.19   | 1.198 | 0.829 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.38111186028
-  Full duration: 8.62598204613
-
-  run_rally - INFO - Test scenario: "quotas" OK.
-  run_rally - INFO - Starting test scenario "requests" ...
-
-  Preparing input task
-  Task  6afaa02c-ce64-423c-8af7-1f3436c08dbd: started
-  Task 6afaa02c-ce64-423c-8af7-1f3436c08dbd: finished
-
-  test scenario HttpRequests.check_random_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 5.022 | 5.033  | 5.491  | 5.493  | 5.495 | 5.191 | 100.0%  | 10    |
-  | total                  | 5.022 | 5.034  | 5.491  | 5.493  | 5.495 | 5.191 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 15.5716190338
-  Full duration: 18.0286371708
-
-  test scenario HttpRequests.check_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 5.021 | 5.026  | 5.03   | 5.032  | 5.033 | 5.026 | 100.0%  | 10    |
-  | total                  | 5.021 | 5.026  | 5.03   | 5.032  | 5.033 | 5.026 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 15.1103169918
-  Full duration: 17.6116039753
-
-  run_rally - INFO - Test scenario: "requests" OK.
-
-                       Rally Summary Report
-  +===================+============+===============+===========+
-  | Module            | Duration   | nb. Test Run  | Success   |
-  +===================+============+===============+===========+
-  | authenticate      | 00:20      | 10            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | glance            | 01:52      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | cinder            | 15:05      | 50            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | heat              | 06:52      | 32            | 92.31%    |
-  +-------------------+------------+---------------+-----------+
-  | keystone          | 01:19      | 29            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | neutron           | 07:05      | 31            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | nova              | 52:04      | 52            | 88.89%    |
-  +-------------------+------------+---------------+-----------+
-  | quotas            | 00:45      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | requests          | 00:35      | 2             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  +===================+============+===============+===========+
-  | TOTAL:            | 01:26:02   | 220           | 97.91%    |
-  +===================+============+===============+===========+
-
-
-
-SDN Controller
---------------
-
-ODL
-^^^
-::
-
-  FUNCTEST.info: Running ODL test...
-  ==============================================================================
-  Basic
-  ==============================================================================
-  Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-  ==============================================================================
-  Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-  ------------------------------------------------------------------------------
-  Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-  1 critical test, 1 passed, 0 failed
-  1 test total, 1 passed, 0 failed
-  ==============================================================================
-  Basic                                                                 | PASS |
-  1 critical test, 1 passed, 0 failed
-  1 test total, 1 passed, 0 failed
-  ==============================================================================
-  Output:  /home/opnfv/output.xml
-  Log:     /home/opnfv/log.html
-  Report:  /home/opnfv/report.html
-  ==============================================================================
-  Neutron :: Test suite for Neutron Plugin
-  ==============================================================================
-  Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-  ==============================================================================
-  Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-  ------------------------------------------------------------------------------
-  Create Network :: Create new network in OpenStack                     | PASS |
-  ------------------------------------------------------------------------------
-  Check Network :: Check Network created in OpenDaylight                | FAIL |
-  404 != 200
-  ------------------------------------------------------------------------------
-  Neutron.Networks :: Checking Network created in OpenStack are push... | FAIL |
-  4 critical tests, 3 passed, 1 failed
-  4 tests total, 3 passed, 1 failed
-  ==============================================================================
-  Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-  ==============================================================================
-  Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-  ------------------------------------------------------------------------------
-  Create New subnet :: Create new subnet in OpenStack                   | PASS |
-  ------------------------------------------------------------------------------
-  Check New subnet :: Check new subnet created in OpenDaylight          | FAIL |
-  404 != 200
-  ------------------------------------------------------------------------------
-  Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | FAIL |
-  4 critical tests, 3 passed, 1 failed
-  4 tests total, 3 passed, 1 failed
-  ==============================================================================
-  Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-  ==============================================================================
-  Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-  ------------------------------------------------------------------------------
-  Create New Port :: Create new port in OpenStack                       | PASS |
-  ------------------------------------------------------------------------------
-  Check New Port :: Check new subnet created in OpenDaylight            | FAIL |
-  404 != 200
-  ------------------------------------------------------------------------------
-  Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | FAIL |
-  4 critical tests, 3 passed, 1 failed
-  4 tests total, 3 passed, 1 failed
-  ==============================================================================
-  Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-  ==============================================================================
-  Delete New Port :: Delete previously created port in OpenStack        | PASS |
-  ------------------------------------------------------------------------------
-  Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-  ==============================================================================
-  Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-  ------------------------------------------------------------------------------
-  Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-  ==============================================================================
-  Delete Network :: Delete network in OpenStack                         | PASS |
-  ------------------------------------------------------------------------------
-  Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron :: Test suite for Neutron Plugin                              | FAIL |
-  18 critical tests, 15 passed, 3 failed
-  18 tests total, 15 passed, 3 failed
-  ==============================================================================
-  Output:  /home/opnfv/output.xml
-  Log:     /home/opnfv/log.html
-  Report:  /home/opnfv/report.html
-  Log:     /home/opnfv/log.html
-  Report:  /home/opnfv/report.html
-
-
-Feature tests
--------------
-
-vIMS
-^^^^
-
-::
-
-  FUNCTEST.info: Running vIMS test...
-  vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-  vIMS - INFO - Update OpenStack creds informations
-  vIMS - INFO - Upload some OS images if it doesn't exist
-  vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-  vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-  vIMS - INFO - Update security group quota for this tenant
-  vIMS - INFO - Update cinder quota for this tenant
-  vIMS - INFO - Collect flavor id for cloudify manager server
-  vIMS - INFO - Prepare virtualenv for cloudify-cli
-  vIMS - INFO - Downloading the cloudify manager server blueprint
-  vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 08:04:17'
-  vIMS - INFO - Writing the inputs file
-  vIMS - INFO - Launching the cloudify-manager deployment
-  vIMS - INFO - Cloudify-manager server is UP !
-  vIMS - INFO - Cloudify deployment duration:'495.7'
-  vIMS - INFO - Collect flavor id for all clearwater vm
-  vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 08:12:33'
-  vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-  vIMS - INFO - Writing the inputs file
-  vIMS - INFO - Launching the clearwater deployment
-  vIMS - INFO - The deployment of clearwater-opnfv is ended
-  vIMS - INFO - vIMS VNF deployment duration:'759.1'
-  vIMS - INFO - vIMS functional test Start Time:'2016-02-23 08:28:17'
-  vIMS - INFO - vIMS functional test duration:'109.1'
-  vIMS - INFO - Launching the clearwater-opnfv undeployment
-  vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-  vIMS - INFO - Launching the cloudify-manager undeployment
-  vIMS - INFO - Cloudify-manager server has been successfully removed!
-  vIMS - INFO - Removing vIMS tenant ..
-  vIMS - INFO - Removing vIMS user ..
-
-
-Doctor
-^^^^^^
-
-::
-
-    FUNCTEST.info: Running Doctor test...
-    doctor - DEBUG - Executing command : cd /home/opnfv/repos/doctor/tests && ./run.sh
-    doctor - DEBUG - + IMAGE_URL=https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
-    Note: doctor/tests/run.sh has been executed.
-    PING 192.30.9.7 (192.30.9.7) 56(84) bytes of data.
-    64 bytes from 192.30.9.7: icmp_seq=1 ttl=63 time=0.753 ms
-
-    --- 192.30.9.7 ping statistics ---
-    1 packets transmitted, 1 received, 0% packet loss, time 0ms
-    rtt min/avg/max/mdev = 0.753/0.753/0.753/0.000 ms
-    preparing VM image...
-    +------------------+--------------------------------------+
-    | Property         | Value                                |
-    +------------------+--------------------------------------+
-    | checksum         | 11834a548b5f6fa25d331353b139cb1a     |
-    | container_format | bare                                 |
-    | created_at       | 2016-02-24T07:59:46Z                 |
-    | disk_format      | qcow2                                |
-    | id               | 0074bf80-807e-4cb7-b904-bf4347c2a668 |
-    | min_disk         | 0                                    |
-    | min_ram          | 0                                    |
-    | name             | cirros                               |
-    | owner            | 3d15a63c2519439f839df6785236b0e1     |
-    | protected        | False                                |
-    | size             | 15482                                |
-    | status           | active                               |
-    | tags             | []                                   |
-    | updated_at       | 2016-02-24T07:59:47Z                 |
-    | virtual_size     | None                                 |
-    | visibility       | public                               |
-    +------------------+--------------------------------------+
-    starting doctor sample components...
-    creating VM and alarm...
-    +--------------------------------------+-----------------------------------------------+
-    | Property                             | Value                                         |
-    +--------------------------------------+-----------------------------------------------+
-    | OS-DCF:diskConfig                    | MANUAL                                        |
-    | OS-EXT-AZ:availability_zone          |                                               |
-    | OS-EXT-SRV-ATTR:host                 | -                                             |
-    | OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
-    | OS-EXT-SRV-ATTR:instance_name        | instance-00000048                             |
-    | OS-EXT-STS:power_state               | 0                                             |
-    | OS-EXT-STS:task_state                | scheduling                                    |
-    | OS-EXT-STS:vm_state                  | building                                      |
-    | OS-SRV-USG:launched_at               | -                                             |
-    | OS-SRV-USG:terminated_at             | -                                             |
-    | accessIPv4                           |                                               |
-    | accessIPv6                           |                                               |
-    | adminPass                            | AaUNZaoqw74Q                                  |
-    | config_drive                         |                                               |
-    | created                              | 2016-02-24T07:59:49Z                          |
-    | flavor                               | m1.tiny (1)                                   |
-    | hostId                               |                                               |
-    | id                                   | 1ab94214-1d8c-46b5-8467-3d3e3b602f04          |
-    | image                                | cirros (0074bf80-807e-4cb7-b904-bf4347c2a668) |
-    | key_name                             | -                                             |
-    | metadata                             | {}                                            |
-    | name                                 | doctor_vm1                                    |
-    | os-extended-volumes:volumes_attached | []                                            |
-    | progress                             | 0                                             |
-    | security_groups                      | default                                       |
-    | status                               | BUILD                                         |
-    | tenant_id                            | 3d15a63c2519439f839df6785236b0e1              |
-    | updated                              | 2016-02-24T07:59:49Z                          |
-    | user_id                              | 0cfa3d72e33b490880278ff6676aa961              |
-    +--------------------------------------+-----------------------------------------------+
-
-    +---------------------------+----------------------------------------------------------------------+
-    | Property                  | Value                                                                |
-    +---------------------------+----------------------------------------------------------------------+
-    | alarm_actions             | ["http://localhost:12346/failure"]                                   |
-    | alarm_id                  | 739ca887-1a9d-4fb4-ad77-17793de1db16                                 |
-    | description               | VM failure                                                           |
-    | enabled                   | True                                                                 |
-    | event_type                | compute.instance.update                                              |
-    | insufficient_data_actions | []                                                                   |
-    | name                      | doctor_alarm1                                                        |
-    | ok_actions                | []                                                                   |
-    | project_id                | 3d15a63c2519439f839df6785236b0e1                                     |
-    | query                     | [{"field": "traits.state", "type": "string", "value": "error", "op": |
-    |                           | "eq"}, {"field": "traits.instance_id", "type": "string", "value":    |
-    |                           | "1ab94214-1d8c-46b5-8467-3d3e3b602f04", "op": "eq"}]                 |
-    | repeat_actions            | False                                                                |
-    | severity                  | moderate                                                             |
-    | state                     | insufficient data                                                    |
-    | type                      | event                                                                |
-    | user_id                   | 0cfa3d72e33b490880278ff6676aa961                                     |
-    +---------------------------+----------------------------------------------------------------------+
-    waiting for vm launch...
-    injecting host failure...
-    disabling network of comupte host [overcloud-novacompute-0] for 3 mins...
-    Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
-    Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
-    0 OK
-    done
-    cleanup...
-    24120
-    24124
-    24122
-    24144
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
-    24125
-    24136
-    + ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i instack_key heat-admin@192.30.9.7 '[ -e disable_network.log ] && cat disable_network.log'
-    Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
-    sudo ip link set enp8s0 down
-    <Response [200]>
-    Request to delete server doctor_vm1 has been accepted.
-    waiting disabled compute host back to be enabled...
-
-    doctor - INFO - doctor OK
diff --git a/docs/results/compass-os-nosdn-nofeature-ha.rst b/docs/results/compass-os-nosdn-nofeature-ha.rst
deleted file mode 100644 (file)
index 294cb09..0000000
+++ /dev/null
@@ -1,1667 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for compass-os-nosdn-nofeature-ha
--------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-SSH test...
-  vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_ssh- INFO - Creating neutron network vping-net...
-  vPing_ssh- INFO - Creating security group  'vPing-sg'...
-  vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-  vPing_ssh- INFO - vPing Start Time:'2016-02-23 04:35:47'
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=193891f9-6644-4668-9ac4-bd9336610a99
-   network=999caa31-8f28-4737-aa6e-3981e28a7e55
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=193891f9-6644-4668-9ac4-bd9336610a99
-   network=999caa31-8f28-4737-aa6e-3981e28a7e55
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-  vPing_ssh- INFO - Floating IP created: '192.168.10.101'
-  vPing_ssh- INFO - Associating floating ip: '192.168.10.101' to VM 'opnfv-vping-2'
-  vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.101...
-  vPing_ssh- INFO - Waiting for ping...
-  vPing_ssh- INFO - vPing detected!
-  vPing_ssh- INFO - vPing duration:'43.2' s.
-  vPing_ssh- INFO - Cleaning up...
-  vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-userdata test...
-  vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_userdata- INFO - Creating neutron network vping-net...
-  vPing_userdata- INFO - Creating security group  'vPing-sg'...
-  vPing_userdata- INFO - Flavor found 'm1.small'
-  vPing_userdata- INFO - vPing Start Time:'2016-02-23 04:36:44'
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=53004632-aa69-4868-8234-2ef945681fcd
-   network=bf5529b1-1cb7-4ea6-93b8-5ff436c5ed3c
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=53004632-aa69-4868-8234-2ef945681fcd
-   network=bf5529b1-1cb7-4ea6-93b8-5ff436c5ed3c
-   userdata=
-  #!/bin/sh
-
-  while true; do
-   ping -c 1 192.168.130.3 2>&1 >/dev/null
-   RES=$?
-   if [ "Z$RES" = "Z0" ] ; then
-    echo 'vPing OK'
-   break
-   else
-    echo 'vPing KO'
-   fi
-   sleep 1
-  done
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_userdata- INFO - Waiting for ping...
-  vPing_userdata- INFO - vPing detected!
-  vPing_userdata- INFO - vPing duration:'24.4'
-  vPing_userdata- INFO - vPing OK
-  vPing_userdata- INFO - Cleaning up...
-  vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-  FUNCTEST.info: Running Tempest tests...
-  run_tempest - INFO - Creating tenant and user for Tempest suite
-  2016-02-23 04:37:19.865 23855 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
-  2016-02-23 04:37:24.332 23855 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
-
-  run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
-  Total results of verification:
-
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | 28be74fb-34e0-4247-833c-a8c5b3fd85d2 | d2a31b24-70b3-48ab-bd03-8d7a0dab20bd |          | 210   | 0        | 2016-02-23 04:37:25.793306 | finished |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-
-  Tests:
-
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | name                                                                                                                                     | time      | status  |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.20837   | success |
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.20097   | success |
-  | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 27.41889  | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 6.64765   | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 7.27470   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.06285   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.06897   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.06414   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.11873   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.06762   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.06739   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.06986   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.06254   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.05104   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.12018   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.07818   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.10564   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.06481   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.30634   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 1.20722   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.13093   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.38276   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 0.54540   | success |
-  | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 3.33321   | success |
-  | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 17.36469  | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 3.15517   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.06856   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.18377   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.16882   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00068   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 3.15690   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.07962   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.15120   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.18218   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.00110   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.06973   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 6.27398   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.20951   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.18499   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.15917   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.31948   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.14946   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.07635   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.07788   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.06447   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.05937   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.07365   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.19332   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00071   | skip    |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.15138   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.06312   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.01957   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.07095   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08593   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.01455   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01158   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.04029   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.06225   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.06189   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.26184   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.02082   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.06492   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00083   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 3.32560   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 8.17266   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 8.58619   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.29429   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 79.87435  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 14.54175  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 23.12381  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 6.94824   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.08712   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.16214   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.68228   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.29523   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.35906   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.68377   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.54206   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.55368   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 2.45879   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 29.40153  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 25.63768  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 14.29183  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 12.85255  | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 0.59683   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 0.78070   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 0.64926   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 0.79184   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 0.62816   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 0.67889   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 0.91872   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.67651   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.39363   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.50851   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 0.57311   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.45111   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.39532   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.43734   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.62367   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 0.59665   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.38844   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.29632   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.34865   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 0.46513   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.41424   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.08979   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.01101   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.07763   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.01368   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.50557   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.08336   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.23059   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05377   | success |
-  | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 42.94954  | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.65627   | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.08496   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.09567   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.00685   | success |
-  | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.20509   | success |
-  | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.12058   | success |
-  | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.13306   | success |
-  | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.03344   | success |
-  | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.28451   | success |
-  | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.15089   | success |
-  | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.93789   | success |
-  | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.11553   | success |
-  | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.11774   | success |
-  | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.20859   | success |
-  | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.15701   | success |
-  | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 0.84413   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.02197   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01614   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.01513   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.01626   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01377   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.01219   | success |
-  | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.06385   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 0.74490   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 0.30669   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 0.42703   | success |
-  | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 0.46679   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.11398   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 1.40153   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 0.62250   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 1.06048   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 3.64767   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 1.05674   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 1.46703   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 1.15288   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 1.19505   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.18705   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.16809   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.06150   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.06589   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.03918   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 1.09078   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.12778   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.04437   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.07037   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.08725   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.03485   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 0.94866   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 1.57085   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 0.63361   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.05208   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.04959   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.22772   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 1.51603   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 0.89179   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.16512   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.05618   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 4.21613   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 1.92424   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 1.44097   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 1.08964   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 3.05695   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 1.48158   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 1.24519   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 1.01040   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 0.40816   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 0.55388   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.02194   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 0.51425   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 0.62336   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.02465   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.31894   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.32025   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.02302   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.66552   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.40307   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.43128   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.50089   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.47817   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.50681   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.37768   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.07322   | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 0.82997   | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 1.47396   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.64936   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 1.83658   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 12.39640  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 11.41953  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 11.27254  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 11.80658  | success |
-  | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.05079   | success |
-  | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.05690   | success |
-  | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 44.43032  | success |
-  | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 21.90475  | success |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 121.16825 | success |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 117.34801 | success |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  run_tempest - INFO - Results: {'timestart': '2016-02-2304:37:25.793306', 'duration': 261, 'tests': 210, 'failures': 0}
-  run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
-  run_tempest - INFO - Deleting tenant and user for Tempest suite)
-
-
-Rally
-^^^^^
-::
-
-  FUNCTEST.info: Running Rally benchmark suite...
-  run_rally - INFO - Starting test scenario "authenticate" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  d78a7e66-b2a5-42de-ac0c-cc6145aaa77a: started
-  Task d78a7e66-b2a5-42de-ac0c-cc6145aaa77a: finished
-
-  test scenario Authenticate.validate_glance
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_glance     | 0.122 | 0.136  | 0.153  | 0.155  | 0.158 | 0.138 | 100.0%  | 10    |
-  | authenticate.validate_glance (2) | 0.039 | 0.045  | 0.056  | 0.06   | 0.064 | 0.047 | 100.0%  | 10    |
-  | total                            | 0.227 | 0.264  | 0.28   | 0.283  | 0.285 | 0.26  | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.795955181122
-  Full duration: 2.89371585846
-
-  test scenario Authenticate.keystone
-  +-----------------------------------------------------------------------------+
-  |                            Response Times (sec)                             |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | total  | 0.064 | 0.077  | 0.097  | 0.114  | 0.131 | 0.081 | 100.0%  | 10    |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.246862888336
-  Full duration: 2.44218397141
-
-  test scenario Authenticate.validate_heat
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_heat     | 0.127 | 0.151  | 0.186  | 0.195  | 0.205 | 0.157 | 100.0%  | 10    |
-  | authenticate.validate_heat (2) | 0.026 | 0.09   | 0.113  | 0.133  | 0.153 | 0.08  | 100.0%  | 10    |
-  | total                          | 0.228 | 0.319  | 0.383  | 0.402  | 0.422 | 0.321 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.963713884354
-  Full duration: 3.11927700043
-
-  test scenario Authenticate.validate_nova
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_nova     | 0.104 | 0.122  | 0.133  | 0.139  | 0.144 | 0.121 | 100.0%  | 10    |
-  | authenticate.validate_nova (2) | 0.028 | 0.031  | 0.04   | 0.041  | 0.042 | 0.034 | 100.0%  | 10    |
-  | total                          | 0.2   | 0.243  | 0.249  | 0.256  | 0.263 | 0.235 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.704430103302
-  Full duration: 2.78888607025
-
-  test scenario Authenticate.validate_cinder
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_cinder     | 0.102 | 0.117  | 0.131  | 0.139  | 0.147 | 0.119 | 100.0%  | 10    |
-  | authenticate.validate_cinder (2) | 0.019 | 0.076  | 0.083  | 0.085  | 0.087 | 0.071 | 100.0%  | 10    |
-  | total                            | 0.229 | 0.263  | 0.304  | 0.317  | 0.331 | 0.269 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.82511305809
-  Full duration: 2.97128987312
-
-  test scenario Authenticate.validate_neutron
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_neutron     | 0.111 | 0.12   | 0.134  | 0.135  | 0.135 | 0.123 | 100.0%  | 10    |
-  | authenticate.validate_neutron (2) | 0.03  | 0.086  | 0.104  | 0.104  | 0.104 | 0.084 | 100.0%  | 10    |
-  | total                             | 0.22  | 0.28   | 0.307  | 0.31   | 0.312 | 0.278 | 100.0%  | 10    |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.855668067932
-  Full duration: 3.13501811028
-
-  run_rally - INFO - Test scenario: "authenticate" OK.
-  run_rally - INFO - Starting test scenario "glance" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  3234c959-6176-4a4f-adf4-50f3f3083d67: started
-  Task 3234c959-6176-4a4f-adf4-50f3f3083d67: finished
-
-  test scenario GlanceImages.list_images
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.list_images | 0.189 | 0.215  | 0.246  | 0.252  | 0.258 | 0.218 | 100.0%  | 10    |
-  | total              | 0.189 | 0.215  | 0.246  | 0.252  | 0.258 | 0.218 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.649740934372
-  Full duration: 3.67985486984
-
-  test scenario GlanceImages.create_image_and_boot_instances
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | glance.create_image | 2.782  | 3.177  | 3.617  | 3.638  | 3.659  | 3.198  | 100.0%  | 10    |
-  | nova.boot_servers   | 9.48   | 13.931 | 17.26  | 17.274 | 17.287 | 13.824 | 100.0%  | 10    |
-  | total               | 12.296 | 16.956 | 20.848 | 20.857 | 20.866 | 17.022 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 49.9618289471
-  Full duration: 73.9044458866
-
-  test scenario GlanceImages.create_and_list_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 2.779 | 3.406  | 3.655  | 3.673  | 3.692 | 3.306 | 100.0%  | 10    |
-  | glance.list_images  | 0.039 | 0.046  | 0.048  | 0.049  | 0.049 | 0.045 | 100.0%  | 10    |
-  | total               | 2.82  | 3.453  | 3.703  | 3.722  | 3.741 | 3.351 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.77695393562
-  Full duration: 14.4172940254
-
-  test scenario GlanceImages.create_and_delete_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 2.788 | 3.69   | 3.785  | 3.83   | 3.876 | 3.489 | 100.0%  | 10    |
-  | glance.delete_image | 0.129 | 0.146  | 0.203  | 0.239  | 0.275 | 0.166 | 100.0%  | 10    |
-  | total               | 2.933 | 3.884  | 3.951  | 3.986  | 4.02  | 3.655 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 10.762845993
-  Full duration: 13.6261451244
-
-  run_rally - INFO - Test scenario: "glance" OK.
-  run_rally - INFO - Starting test scenario "cinder" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  21cb74f0-6bd9-44e3-aff3-99085ad0525f: started
-  Task 21cb74f0-6bd9-44e3-aff3-99085ad0525f: finished
-
-  test scenario CinderVolumes.create_and_attach_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server     | 7.723  | 10.184 | 13.839 | 13.936 | 14.032 | 10.913 | 100.0%  | 10    |
-  | cinder.create_volume | 2.731  | 2.833  | 2.935  | 3.005  | 3.076  | 2.847  | 100.0%  | 10    |
-  | nova.attach_volume   | 7.613  | 7.977  | 8.755  | 9.542  | 10.33  | 8.197  | 100.0%  | 10    |
-  | nova.detach_volume   | 3.034  | 3.429  | 5.352  | 5.414  | 5.476  | 4.052  | 100.0%  | 10    |
-  | cinder.delete_volume | 2.44   | 2.495  | 2.591  | 2.6    | 2.609  | 2.503  | 100.0%  | 10    |
-  | nova.delete_server   | 2.423  | 2.508  | 2.823  | 3.661  | 4.499  | 2.704  | 100.0%  | 10    |
-  | total                | 28.081 | 29.986 | 35.858 | 36.584 | 37.309 | 31.218 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 93.1938638687
-  Full duration: 105.67930007
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.887 | 5.424  | 5.581  | 5.636  | 5.69  | 4.98  | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.079 | 0.157  | 0.177  | 0.182  | 0.186 | 0.147 | 100.0%  | 10    |
-  | total                | 2.966 | 5.594  | 5.745  | 5.781  | 5.817 | 5.127 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.3176538944
-  Full duration: 25.6212191582
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.813 | 2.965  | 3.036  | 3.048  | 3.059 | 2.962 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.08  | 0.127  | 0.142  | 0.161  | 0.18  | 0.128 | 100.0%  | 10    |
-  | total                | 2.893 | 3.093  | 3.178  | 3.209  | 3.239 | 3.09  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.30827403069
-  Full duration: 19.9378697872
-
-  test scenario CinderVolumes.create_and_list_snapshots
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.438 | 2.526  | 2.593  | 2.593  | 2.593 | 2.528 | 100.0%  | 10    |
-  | cinder.list_snapshots  | 0.018 | 0.088  | 0.099  | 0.104  | 0.109 | 0.083 | 100.0%  | 10    |
-  | total                  | 2.523 | 2.613  | 2.683  | 2.687  | 2.692 | 2.611 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 7.79824590683
-  Full duration: 31.6265990734
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.891 | 3.012  | 3.068  | 3.069  | 3.069 | 2.987 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.505 | 2.583  | 2.686  | 2.713  | 2.739 | 2.598 | 100.0%  | 10    |
-  | total                | 5.445 | 5.6    | 5.697  | 5.7    | 5.703 | 5.586 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.8130619526
-  Full duration: 23.3862919807
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.06  | 5.419  | 5.676  | 5.725  | 5.774 | 4.793 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.457 | 2.536  | 2.613  | 2.63   | 2.648 | 2.548 | 100.0%  | 10    |
-  | total                | 5.557 | 7.997  | 8.239  | 8.276  | 8.313 | 7.341 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 21.6966080666
-  Full duration: 28.6927661896
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.819 | 2.943  | 3.235  | 3.249  | 3.264 | 3.001 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.545 | 2.581  | 2.665  | 2.684  | 2.702 | 2.603 | 100.0%  | 10    |
-  | total                | 5.375 | 5.546  | 5.826  | 5.896  | 5.966 | 5.604 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.8036949635
-  Full duration: 23.085185051
-
-  test scenario CinderVolumes.create_and_upload_volume_to_image
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume          | 2.833  | 3.116  | 3.438  | 3.496  | 3.553  | 3.134  | 100.0%  | 10    |
-  | cinder.upload_volume_to_image | 25.838 | 62.678 | 78.019 | 78.434 | 78.85  | 55.7   | 100.0%  | 10    |
-  | cinder.delete_volume          | 2.358  | 2.511  | 2.619  | 2.684  | 2.749  | 2.531  | 100.0%  | 10    |
-  | nova.delete_image             | 0.221  | 0.371  | 3.025  | 13.33  | 23.635 | 2.707  | 100.0%  | 10    |
-  | total                         | 31.573 | 68.573 | 83.845 | 84.418 | 84.99  | 64.072 | 100.0%  | 10    |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 182.231485128
-  Full duration: 189.13320303
-
-  test scenario CinderVolumes.create_and_delete_snapshot
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.43  | 2.545  | 2.599  | 2.6    | 2.602 | 2.539 | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.326 | 2.495  | 2.611  | 2.675  | 2.739 | 2.493 | 100.0%  | 10    |
-  | total                  | 4.887 | 5.04   | 5.173  | 5.186  | 5.199 | 5.032 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.9942228794
-  Full duration: 33.8261451721
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.829 | 2.973  | 3.402  | 3.412  | 3.422 | 3.063 | 100.0%  | 10    |
-  | total                | 2.829 | 2.973  | 3.403  | 3.412  | 3.422 | 3.063 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.0781109333
-  Full duration: 18.1423990726
-
-  test scenario CinderVolumes.create_volume
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +----------------------+------+--------+--------+--------+------+-------+---------+-------+
-  | action               | min  | median | 90%ile | 95%ile | max  | avg   | success | count |
-  +----------------------+------+--------+--------+--------+------+-------+---------+-------+
-  | cinder.create_volume | 2.85 | 2.939  | 2.978  | 2.984  | 2.99 | 2.932 | 100.0%  | 10    |
-  | total                | 2.85 | 2.94   | 2.978  | 2.984  | 2.99 | 2.932 | 100.0%  | 10    |
-  +----------------------+------+--------+--------+--------+------+-------+---------+-------+
-  Load duration: 8.73497700691
-  Full duration: 19.4855289459
-
-  test scenario CinderVolumes.list_volumes
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.list_volumes | 0.211 | 0.266  | 0.312  | 0.327  | 0.342 | 0.274 | 100.0%  | 10    |
-  | total               | 0.211 | 0.266  | 0.312  | 0.327  | 0.342 | 0.275 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.827063083649
-  Full duration: 47.6483559608
-
-  test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.852  | 3.009  | 3.091  | 3.106  | 3.122  | 3.005  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.321  | 2.392  | 2.404  | 2.404  | 2.405  | 2.377  | 100.0%  | 10    |
-  | nova.attach_volume     | 5.473  | 7.981  | 11.399 | 12.215 | 13.031 | 8.96   | 100.0%  | 10    |
-  | nova.detach_volume     | 3.035  | 5.168  | 5.603  | 5.772  | 5.941  | 4.587  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.209  | 2.347  | 2.41   | 2.417  | 2.424  | 2.349  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.412  | 2.494  | 2.582  | 2.616  | 2.65   | 2.508  | 100.0%  | 10    |
-  | total                  | 21.417 | 23.884 | 26.577 | 26.903 | 27.228 | 24.098 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 70.9750390053
-  Full duration: 126.263324976
-
-  test scenario CinderVolumes.create_from_volume_and_delete_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 9.872  | 12.204 | 17.525 | 19.351 | 21.177 | 13.167 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.325  | 2.554  | 2.928  | 3.924  | 4.92   | 2.779  | 100.0%  | 10    |
-  | total                | 12.426 | 14.781 | 20.202 | 21.897 | 23.592 | 15.947 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 43.4407100677
-  Full duration: 62.327357769
-
-  test scenario CinderVolumes.create_and_extend_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.858 | 2.94   | 3.074  | 3.087  | 3.1   | 2.956 | 100.0%  | 10    |
-  | cinder.extend_volume | 2.572 | 2.848  | 2.884  | 2.919  | 2.954 | 2.8   | 100.0%  | 10    |
-  | cinder.delete_volume | 2.433 | 2.567  | 2.67   | 2.693  | 2.716 | 2.567 | 100.0%  | 10    |
-  | total                | 7.982 | 8.292  | 8.558  | 8.616  | 8.674 | 8.323 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.9033889771
-  Full duration: 31.5932898521
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.882  | 2.947  | 3.229  | 3.231  | 3.233  | 3.005  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.268  | 2.345  | 2.421  | 2.456  | 2.491  | 2.36   | 100.0%  | 10    |
-  | nova.attach_volume     | 7.593  | 8.071  | 12.707 | 13.727 | 14.747 | 9.373  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.962  | 5.331  | 5.412  | 5.491  | 5.57   | 5.076  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.185  | 2.286  | 2.366  | 2.374  | 2.381  | 2.298  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.425  | 2.524  | 2.593  | 2.61   | 2.627  | 2.52   | 100.0%  | 10    |
-  | total                  | 21.713 | 23.963 | 28.368 | 29.657 | 30.947 | 24.974 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 73.7474370003
-  Full duration: 132.963656902
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.739  | 2.89   | 3.033  | 3.058  | 3.084  | 2.914  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.247  | 2.401  | 2.466  | 2.485  | 2.503  | 2.388  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.882  | 8.891  | 10.439 | 11.312 | 12.186 | 9.222  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.94   | 5.373  | 5.635  | 5.661  | 5.687  | 4.764  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.283  | 2.332  | 2.481  | 2.585  | 2.688  | 2.381  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.425  | 2.495  | 2.547  | 2.558  | 2.569  | 2.489  | 100.0%  | 10    |
-  | total                  | 21.386 | 24.555 | 26.13  | 26.247 | 26.365 | 24.746 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 76.0001449585
-  Full duration: 139.533368111
-
-  run_rally - INFO - Test scenario: "cinder" OK.
-  run_rally - INFO - Starting test scenario "heat" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  7d1551b5-51d4-480b-816d-571bc61773ac: started
-  Task 7d1551b5-51d4-480b-816d-571bc61773ac: finished
-
-  test scenario HeatStacks.create_suspend_resume_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack  | 2.896 | 3.025  | 3.297  | 3.342  | 3.386 | 3.075 | 100.0%  | 10    |
-  | heat.suspend_stack | 0.444 | 1.622  | 1.791  | 1.817  | 1.844 | 1.332 | 100.0%  | 10    |
-  | heat.resume_stack  | 1.365 | 1.657  | 1.701  | 1.755  | 1.809 | 1.598 | 100.0%  | 10    |
-  | heat.delete_stack  | 0.499 | 1.531  | 1.644  | 1.655  | 1.665 | 1.451 | 100.0%  | 10    |
-  | total              | 5.782 | 7.652  | 8.146  | 8.28   | 8.414 | 7.455 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 21.9193868637
-  Full duration: 25.3411290646
-
-  test scenario HeatStacks.create_and_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 3.023 | 3.144  | 3.331  | 3.531  | 3.73  | 3.206 | 100.0%  | 10    |
-  | heat.delete_stack | 0.437 | 0.646  | 1.617  | 1.676  | 1.734 | 0.972 | 100.0%  | 10    |
-  | total             | 3.54  | 3.767  | 4.914  | 5.114  | 5.314 | 4.178 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 12.2326231003
-  Full duration: 15.3595271111
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 14.933 | 16.348 | 17.828 | 18.321 | 18.813 | 16.471 | 100.0%  | 10    |
-  | heat.delete_stack | 6.665  | 8.038  | 8.335  | 8.772  | 9.208  | 7.711  | 100.0%  | 10    |
-  | total             | 22.386 | 24.346 | 25.661 | 25.74  | 25.818 | 24.182 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 72.8466770649
-  Full duration: 76.0618572235
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 16.663 | 19.357 | 20.553 | 21.32  | 22.088 | 19.17  | 100.0%  | 10    |
-  | heat.delete_stack | 9.144  | 9.269  | 10.036 | 10.227 | 10.417 | 9.461  | 100.0%  | 10    |
-  | total             | 25.982 | 28.953 | 30.462 | 30.847 | 31.232 | 28.631 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 84.6888990402
-  Full duration: 88.1814341545
-
-  test scenario HeatStacks.list_stacks_and_resources
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.list_stacks                | 0.219 | 0.246  | 0.383  | 0.4    | 0.417 | 0.287 | 100.0%  | 10    |
-  | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-  | total                           | 0.219 | 0.246  | 0.383  | 0.4    | 0.418 | 0.287 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.863615989685
-  Full duration: 3.55412602425
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.866 | 3.102  | 3.266  | 3.29   | 3.314 | 3.097 | 100.0%  | 10    |
-  | heat.update_stack | 2.641 | 3.637  | 3.803  | 3.813  | 3.822 | 3.497 | 100.0%  | 10    |
-  | heat.delete_stack | 1.394 | 1.515  | 1.651  | 1.666  | 1.681 | 1.534 | 100.0%  | 10    |
-  | total             | 7.247 | 8.255  | 8.454  | 8.543  | 8.631 | 8.127 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.2989928722
-  Full duration: 27.7337241173
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.799 | 3.033  | 3.19   | 3.306  | 3.422 | 3.046 | 100.0%  | 10    |
-  | heat.update_stack | 2.509 | 3.732  | 3.845  | 3.847  | 3.849 | 3.321 | 100.0%  | 10    |
-  | heat.delete_stack | 1.302 | 1.538  | 1.641  | 1.733  | 1.824 | 1.542 | 100.0%  | 10    |
-  | total             | 7.14  | 8.084  | 8.351  | 8.371  | 8.39  | 7.909 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 23.4465420246
-  Full duration: 27.0243220329
-
-  test scenario HeatStacks.create_update_delete_stack
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 2.894 | 3.127  | 3.22   | 3.399  | 3.579  | 3.129  | 100.0%  | 10    |
-  | heat.update_stack | 4.739 | 5.169  | 6.092  | 6.105  | 6.119  | 5.309  | 100.0%  | 10    |
-  | heat.delete_stack | 1.422 | 1.839  | 2.562  | 2.565  | 2.567  | 1.989  | 100.0%  | 10    |
-  | total             | 9.674 | 10.622 | 10.9   | 10.921 | 10.941 | 10.427 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 30.9374701977
-  Full duration: 34.6409509182
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------+
-  |                         Response Times (sec)                          |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | action | min | median | 90%ile | 95%ile | max | avg | success | count |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  Load duration: 6.25441002846
-  Full duration: 14.2524240017
-
-  test scenario HeatStacks.create_update_delete_stack
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 2.776 | 3.256  | 3.502  | 3.878  | 4.255  | 3.292  | 100.0%  | 10    |
-  | heat.update_stack | 4.632 | 4.964  | 5.353  | 5.818  | 6.284  | 5.076  | 100.0%  | 10    |
-  | heat.delete_stack | 1.439 | 2.134  | 2.645  | 2.668  | 2.691  | 2.088  | 100.0%  | 10    |
-  | total             | 9.373 | 10.496 | 11.129 | 11.584 | 12.039 | 10.455 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 31.1429200172
-  Full duration: 34.8937320709
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.804 | 3.071  | 3.166  | 3.186  | 3.206 | 3.026 | 100.0%  | 10    |
-  | heat.update_stack | 2.737 | 3.748  | 4.018  | 4.043  | 4.068 | 3.617 | 100.0%  | 10    |
-  | heat.delete_stack | 1.31  | 1.555  | 1.823  | 1.832  | 1.841 | 1.569 | 100.0%  | 10    |
-  | total             | 7.424 | 8.294  | 8.696  | 8.74   | 8.783 | 8.212 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.5028841496
-  Full duration: 28.3026170731
-
-  test scenario HeatStacks.create_and_list_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.956 | 3.13   | 3.324  | 3.341  | 3.359 | 3.141 | 100.0%  | 10    |
-  | heat.list_stacks  | 0.033 | 0.168  | 0.248  | 0.276  | 0.304 | 0.14  | 100.0%  | 10    |
-  | total             | 3.124 | 3.262  | 3.41   | 3.453  | 3.497 | 3.281 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 10.0396568775
-  Full duration: 17.6087501049
-
-  test scenario HeatStacks.create_check_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.922 | 3.155  | 3.412  | 3.413  | 3.415 | 3.159 | 100.0%  | 10    |
-  | heat.check_stack  | 0.418 | 0.518  | 1.02   | 1.361  | 1.702 | 0.701 | 100.0%  | 10    |
-  | heat.delete_stack | 0.687 | 1.665  | 1.773  | 1.786  | 1.799 | 1.56  | 100.0%  | 10    |
-  | total             | 4.445 | 5.362  | 5.863  | 6.138  | 6.413 | 5.42  | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.1680779457
-  Full duration: 20.0481300354
-
-  run_rally - INFO - Test scenario: "heat" Failed.
-  run_rally - INFO - Starting test scenario "keystone" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  5cfc1b63-088e-4840-a525-13064451e8d6: started
-  Task 5cfc1b63-088e-4840-a525-13064451e8d6: finished
-
-  test scenario KeystoneBasic.create_tenant_with_users
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.105 | 0.119  | 0.16   | 0.16   | 0.161 | 0.125 | 100.0%  | 10    |
-  | keystone.create_users  | 0.592 | 0.653  | 0.694  | 0.719  | 0.744 | 0.657 | 100.0%  | 10    |
-  | total                  | 0.706 | 0.77   | 0.844  | 0.874  | 0.905 | 0.782 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.32407808304
-  Full duration: 12.4144320488
-
-  test scenario KeystoneBasic.create_add_and_list_user_roles
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.116 | 0.119  | 0.144  | 0.149  | 0.154 | 0.125 | 100.0%  | 10    |
-  | keystone.add_role    | 0.088 | 0.099  | 0.107  | 0.107  | 0.107 | 0.099 | 100.0%  | 10    |
-  | keystone.list_roles  | 0.054 | 0.058  | 0.095  | 0.097  | 0.1   | 0.067 | 100.0%  | 10    |
-  | total                | 0.27  | 0.28   | 0.345  | 0.35   | 0.355 | 0.292 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.863723993301
-  Full duration: 6.29958295822
-
-  test scenario KeystoneBasic.add_and_remove_user_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.121 | 0.217  | 0.274  | 0.281  | 0.288 | 0.2   | 100.0%  | 10    |
-  | keystone.add_role    | 0.089 | 0.092  | 0.098  | 0.098  | 0.099 | 0.093 | 100.0%  | 10    |
-  | keystone.remove_role | 0.058 | 0.061  | 0.156  | 0.161  | 0.167 | 0.081 | 100.0%  | 10    |
-  | total                | 0.274 | 0.371  | 0.497  | 0.517  | 0.537 | 0.373 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.090020895
-  Full duration: 6.37877011299
-
-  test scenario KeystoneBasic.create_update_and_delete_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.123 | 0.223  | 0.286  | 0.291  | 0.296 | 0.209 | 100.0%  | 10    |
-  | keystone.update_tenant | 0.052 | 0.056  | 0.065  | 0.066  | 0.068 | 0.057 | 100.0%  | 10    |
-  | keystone.delete_tenant | 0.125 | 0.135  | 0.286  | 0.307  | 0.327 | 0.18  | 100.0%  | 10    |
-  | total                  | 0.302 | 0.416  | 0.63   | 0.632  | 0.634 | 0.446 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.29043102264
-  Full duration: 5.07875084877
-
-  test scenario KeystoneBasic.create_and_delete_service
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_service | 0.109 | 0.123  | 0.128  | 0.132  | 0.135 | 0.122 | 100.0%  | 10    |
-  | keystone.delete_service | 0.059 | 0.07   | 0.121  | 0.128  | 0.134 | 0.079 | 100.0%  | 10    |
-  | total                   | 0.174 | 0.196  | 0.234  | 0.245  | 0.255 | 0.201 | 100.0%  | 10    |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.603389024734
-  Full duration: 4.27351093292
-
-  test scenario KeystoneBasic.create_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.118 | 0.133  | 0.186  | 0.187  | 0.188 | 0.142 | 100.0%  | 10    |
-  | total                  | 0.118 | 0.133  | 0.186  | 0.187  | 0.188 | 0.142 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.428766012192
-  Full duration: 4.18886899948
-
-  test scenario KeystoneBasic.create_user
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | keystone.create_user | 0.137 | 0.138  | 0.145  | 0.145  | 0.146 | 0.14 | 100.0%  | 10    |
-  | total                | 0.137 | 0.138  | 0.145  | 0.145  | 0.146 | 0.14 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 0.443462133408
-  Full duration: 4.19236207008
-
-  test scenario KeystoneBasic.create_and_list_tenants
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.111 | 0.117  | 0.165  | 0.178  | 0.191 | 0.132 | 100.0%  | 10    |
-  | keystone.list_tenants  | 0.046 | 0.055  | 0.065  | 0.066  | 0.067 | 0.055 | 100.0%  | 10    |
-  | total                  | 0.163 | 0.179  | 0.214  | 0.231  | 0.247 | 0.187 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.561487913132
-  Full duration: 5.7246799469
-
-  test scenario KeystoneBasic.create_and_delete_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.12  | 0.232  | 0.282  | 0.289  | 0.296 | 0.206 | 100.0%  | 10    |
-  | keystone.delete_role | 0.104 | 0.117  | 0.133  | 0.169  | 0.206 | 0.124 | 100.0%  | 10    |
-  | total                | 0.239 | 0.342  | 0.401  | 0.452  | 0.502 | 0.33  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.990566015244
-  Full duration: 4.97686004639
-
-  test scenario KeystoneBasic.get_entities
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.106 | 0.133  | 0.16   | 0.174  | 0.187 | 0.139 | 100.0%  | 10    |
-  | keystone.create_user   | 0.058 | 0.066  | 0.07   | 0.071  | 0.071 | 0.065 | 100.0%  | 10    |
-  | keystone.create_role   | 0.046 | 0.053  | 0.07   | 0.086  | 0.103 | 0.059 | 100.0%  | 10    |
-  | keystone.get_tenant    | 0.044 | 0.048  | 0.055  | 0.076  | 0.098 | 0.053 | 100.0%  | 10    |
-  | keystone.get_user      | 0.051 | 0.057  | 0.063  | 0.063  | 0.063 | 0.057 | 100.0%  | 10    |
-  | keystone.get_role      | 0.044 | 0.047  | 0.055  | 0.056  | 0.058 | 0.049 | 100.0%  | 10    |
-  | keystone.service_list  | 0.045 | 0.049  | 0.06   | 0.081  | 0.101 | 0.054 | 100.0%  | 10    |
-  | keystone.get_service   | 0.043 | 0.049  | 0.062  | 0.079  | 0.097 | 0.053 | 100.0%  | 10    |
-  | total                  | 0.475 | 0.518  | 0.577  | 0.6    | 0.622 | 0.529 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.58831310272
-  Full duration: 9.76444888115
-
-  test scenario KeystoneBasic.create_and_list_users
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.13  | 0.145  | 0.177  | 0.195  | 0.213 | 0.152 | 100.0%  | 10    |
-  | keystone.list_users  | 0.052 | 0.055  | 0.08   | 0.093  | 0.106 | 0.062 | 100.0%  | 10    |
-  | total                | 0.183 | 0.2    | 0.269  | 0.274  | 0.279 | 0.214 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.642003059387
-  Full duration: 4.59805297852
-
-  run_rally - INFO - Test scenario: "keystone" OK.
-  run_rally - INFO - Starting test scenario "neutron" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  aa890d07-7f64-4bf2-9cc1-adb8d5a95c9e: started
-  Task aa890d07-7f64-4bf2-9cc1-adb8d5a95c9e: finished
-
-  test scenario NeutronNetworks.create_and_delete_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.42  | 0.516  | 0.669  | 0.677  | 0.684 | 0.538 | 100.0%  | 10    |
-  | neutron.delete_port | 0.149 | 0.287  | 0.338  | 0.344  | 0.349 | 0.274 | 100.0%  | 10    |
-  | total               | 0.65  | 0.787  | 0.989  | 0.992  | 0.996 | 0.812 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.28342914581
-  Full duration: 25.3548538685
-
-  test scenario NeutronNetworks.create_and_list_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.389 | 0.492  | 0.542  | 0.564  | 0.587 | 0.479 | 100.0%  | 10    |
-  | neutron.create_router        | 0.034 | 0.165  | 0.179  | 0.18   | 0.181 | 0.118 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.273 | 0.398  | 0.459  | 0.475  | 0.492 | 0.378 | 100.0%  | 10    |
-  | neutron.list_routers         | 0.042 | 0.111  | 0.208  | 0.214  | 0.219 | 0.12  | 100.0%  | 10    |
-  | total                        | 0.873 | 1.083  | 1.266  | 1.32   | 1.373 | 1.095 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.14495706558
-  Full duration: 27.2623529434
-
-  test scenario NeutronNetworks.create_and_delete_routers
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet           | 0.421 | 0.528  | 0.576  | 0.593  | 0.609 | 0.516 | 100.0%  | 10    |
-  | neutron.create_router           | 0.037 | 0.174  | 0.193  | 0.194  | 0.196 | 0.138 | 100.0%  | 10    |
-  | neutron.add_interface_router    | 0.372 | 0.44   | 0.726  | 0.729  | 0.732 | 0.499 | 100.0%  | 10    |
-  | neutron.remove_interface_router | 0.231 | 0.385  | 0.445  | 0.495  | 0.545 | 0.365 | 100.0%  | 10    |
-  | neutron.delete_router           | 0.155 | 0.243  | 0.363  | 0.374  | 0.385 | 0.257 | 100.0%  | 10    |
-  | total                           | 1.492 | 1.722  | 2.126  | 2.135  | 2.145 | 1.776 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 5.06723308563
-  Full duration: 27.7173280716
-
-  test scenario NeutronNetworks.create_and_list_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.429 | 0.479  | 0.682  | 0.709  | 0.736 | 0.518 | 100.0%  | 10    |
-  | neutron.list_ports  | 0.101 | 0.302  | 0.368  | 0.377  | 0.386 | 0.267 | 100.0%  | 10    |
-  | total               | 0.565 | 0.819  | 0.9    | 0.971  | 1.042 | 0.785 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.22692918777
-  Full duration: 25.9097590446
-
-  test scenario NeutronNetworks.create_and_delete_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.383 | 0.414  | 0.558  | 0.562  | 0.565 | 0.439 | 100.0%  | 10    |
-  | neutron.delete_subnet | 0.134 | 0.271  | 0.307  | 0.34   | 0.372 | 0.235 | 100.0%  | 10    |
-  | total                 | 0.522 | 0.677  | 0.872  | 0.901  | 0.93  | 0.674 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.97971510887
-  Full duration: 24.8733260632
-
-  test scenario NeutronNetworks.create_and_delete_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.3   | 0.32   | 0.403  | 0.407  | 0.411 | 0.338 | 100.0%  | 10    |
-  | neutron.delete_network | 0.107 | 0.248  | 0.316  | 0.32   | 0.325 | 0.228 | 100.0%  | 10    |
-  | total                  | 0.411 | 0.556  | 0.697  | 0.698  | 0.699 | 0.566 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.71673607826
-  Full duration: 13.4693968296
-
-  test scenario NeutronNetworks.create_and_list_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.279 | 0.326  | 0.389  | 0.406  | 0.423 | 0.334 | 100.0%  | 10    |
-  | neutron.list_networks  | 0.043 | 0.11   | 0.18   | 0.187  | 0.194 | 0.112 | 100.0%  | 10    |
-  | total                  | 0.328 | 0.437  | 0.564  | 0.59   | 0.617 | 0.446 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.4160130024
-  Full duration: 15.1821639538
-
-  test scenario NeutronNetworks.create_and_update_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.401 | 0.436  | 0.454  | 0.473  | 0.492 | 0.433 | 100.0%  | 10    |
-  | neutron.create_router        | 0.035 | 0.175  | 0.181  | 0.186  | 0.191 | 0.123 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.293 | 0.416  | 0.46   | 0.461  | 0.461 | 0.401 | 100.0%  | 10    |
-  | neutron.update_router        | 0.131 | 0.215  | 0.311  | 0.331  | 0.35  | 0.219 | 100.0%  | 10    |
-  | total                        | 1.012 | 1.171  | 1.336  | 1.359  | 1.381 | 1.176 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.52523398399
-  Full duration: 28.7934508324
-
-  test scenario NeutronNetworks.create_and_update_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.299 | 0.338  | 0.397  | 0.408  | 0.418 | 0.346 | 100.0%  | 10    |
-  | neutron.update_network | 0.095 | 0.24   | 0.297  | 0.299  | 0.302 | 0.202 | 100.0%  | 10    |
-  | total                  | 0.41  | 0.543  | 0.699  | 0.707  | 0.714 | 0.549 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.61482715607
-  Full duration: 15.459831953
-
-  test scenario NeutronNetworks.create_and_update_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.436 | 0.465  | 0.588  | 0.595  | 0.601 | 0.487 | 100.0%  | 10    |
-  | neutron.update_port | 0.114 | 0.282  | 0.317  | 0.326  | 0.335 | 0.255 | 100.0%  | 10    |
-  | total               | 0.576 | 0.751  | 0.862  | 0.899  | 0.936 | 0.742 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.15260481834
-  Full duration: 25.8613479137
-
-  test scenario NeutronNetworks.create_and_list_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.4   | 0.495  | 0.538  | 0.551  | 0.564 | 0.483 | 100.0%  | 10    |
-  | neutron.list_subnets  | 0.065 | 0.217  | 0.28   | 0.319  | 0.357 | 0.22  | 100.0%  | 10    |
-  | total                 | 0.563 | 0.718  | 0.793  | 0.798  | 0.802 | 0.703 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.06506896019
-  Full duration: 25.971654892
-
-  test scenario NeutronNetworks.create_and_update_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.398 | 0.465  | 0.543  | 0.564  | 0.584 | 0.475 | 100.0%  | 10    |
-  | neutron.update_subnet | 0.152 | 0.178  | 0.348  | 0.366  | 0.383 | 0.234 | 100.0%  | 10    |
-  | total                 | 0.557 | 0.693  | 0.85   | 0.867  | 0.883 | 0.709 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.06711506844
-  Full duration: 25.9731898308
-
-  run_rally - INFO - Test scenario: "neutron" OK.
-  run_rally - INFO - Starting test scenario "nova" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  84ecab73-326c-41f9-9d80-ffb7b41c7f0d: started
-  Task 84ecab73-326c-41f9-9d80-ffb7b41c7f0d: finished
-
-  test scenario NovaKeypair.create_and_delete_keypair
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.374 | 0.484  | 0.667  | 0.672  | 0.678 | 0.503 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.016 | 0.021  | 0.025  | 0.027  | 0.028 | 0.021 | 100.0%  | 10    |
-  | total               | 0.399 | 0.51   | 0.687  | 0.692  | 0.698 | 0.524 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.59278798103
-  Full duration: 15.4121351242
-
-  test scenario NovaServers.snapshot_server
-  +--------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                       |
-  +------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile  | 95%ile  | max    | avg    | success | count |
-  +------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
-  | nova.boot_server       | 9.938  | 10.314 | 11.977  | 12.384  | 12.791 | 10.711 | 100.0%  | 10    |
-  | nova.create_image      | 33.802 | 39.898 | 69.264  | 70.135  | 71.005 | 45.583 | 100.0%  | 10    |
-  | nova.delete_server     | 2.408  | 2.848  | 3.266   | 4.121   | 4.975  | 2.967  | 100.0%  | 10    |
-  | nova.boot_server (2)   | 19.438 | 33.013 | 43.809  | 46.043  | 48.276 | 33.839 | 100.0%  | 10    |
-  | nova.delete_server (2) | 2.395  | 2.453  | 4.821   | 4.891   | 4.961  | 3.009  | 100.0%  | 10    |
-  | nova.delete_image      | 0.264  | 0.373  | 0.749   | 1.036   | 1.323  | 0.484  | 100.0%  | 10    |
-  | total                  | 70.267 | 96.724 | 117.768 | 118.599 | 119.43 | 96.593 | 100.0%  | 10    |
-  +------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
-  Load duration: 280.300797939
-  Full duration: 304.846863985
-
-  test scenario NovaKeypair.boot_and_delete_server_with_keypair
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_keypair | 0.406  | 0.458  | 0.533  | 0.575  | 0.616  | 0.474  | 100.0%  | 10    |
-  | nova.boot_server    | 8.324  | 10.158 | 11.335 | 11.766 | 12.197 | 10.115 | 100.0%  | 10    |
-  | nova.delete_server  | 2.382  | 2.425  | 2.618  | 2.621  | 2.625  | 2.456  | 100.0%  | 10    |
-  | nova.delete_keypair | 0.014  | 0.019  | 0.028  | 0.029  | 0.029  | 0.02   | 100.0%  | 10    |
-  | total               | 11.352 | 13.038 | 14.228 | 14.667 | 15.107 | 13.066 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 39.3250300884
-  Full duration: 62.0274989605
-
-  test scenario NovaKeypair.create_and_list_keypairs
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.389 | 0.483  | 0.646  | 0.673  | 0.701 | 0.503 | 100.0%  | 10    |
-  | nova.list_keypairs  | 0.013 | 0.018  | 0.021  | 0.024  | 0.027 | 0.018 | 100.0%  | 10    |
-  | total               | 0.405 | 0.504  | 0.659  | 0.688  | 0.716 | 0.521 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.55672502518
-  Full duration: 16.8414058685
-
-  test scenario NovaServers.list_servers
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.list_servers | 0.604 | 0.661  | 0.751  | 0.753  | 0.755 | 0.667 | 100.0%  | 10    |
-  | total             | 0.604 | 0.661  | 0.751  | 0.753  | 0.755 | 0.667 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.98178386688
-  Full duration: 66.4639019966
-
-  test scenario NovaServers.resize_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 8.516  | 10.952 | 12.492 | 12.717 | 12.943 | 11.085 | 100.0%  | 10    |
-  | nova.resize         | 21.055 | 26.446 | 42.177 | 42.263 | 42.349 | 29.612 | 100.0%  | 10    |
-  | nova.resize_confirm | 2.392  | 2.451  | 2.573  | 2.592  | 2.611  | 2.47   | 100.0%  | 10    |
-  | nova.delete_server  | 2.375  | 2.427  | 2.595  | 2.673  | 2.751  | 2.475  | 100.0%  | 10    |
-  | total               | 34.884 | 42.48  | 59.742 | 59.88  | 60.019 | 45.642 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 133.771182775
-  Full duration: 147.319270134
-
-  test scenario NovaServers.boot_server_from_volume_and_delete
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 3.421  | 5.82   | 6.128  | 6.151  | 6.173  | 5.197  | 100.0%  | 10    |
-  | nova.boot_server     | 13.462 | 15.116 | 17.314 | 17.513 | 17.711 | 15.217 | 100.0%  | 10    |
-  | nova.delete_server   | 4.532  | 4.689  | 6.776  | 6.8    | 6.823  | 5.275  | 100.0%  | 10    |
-  | total                | 21.563 | 26.332 | 28.183 | 28.315 | 28.446 | 25.689 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 76.1264929771
-  Full duration: 105.501106024
-
-  test scenario NovaServers.boot_and_migrate_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 8.668  | 10.279 | 12.669 | 12.746 | 12.824 | 10.808 | 100.0%  | 10    |
-  | nova.stop_server    | 4.695  | 14.48  | 15.73  | 15.737 | 15.745 | 11.929 | 100.0%  | 10    |
-  | nova.migrate        | 16.259 | 18.003 | 25.275 | 25.347 | 25.419 | 19.085 | 100.0%  | 10    |
-  | nova.resize_confirm | 2.394  | 2.416  | 2.564  | 2.604  | 2.644  | 2.46   | 100.0%  | 10    |
-  | nova.delete_server  | 2.383  | 2.408  | 2.55   | 2.58   | 2.61   | 2.448  | 100.0%  | 10    |
-  | total               | 35.744 | 47.034 | 56.397 | 57.427 | 58.457 | 46.73  | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 131.940564156
-  Full duration: 145.82509613
-
-  test scenario NovaServers.boot_and_delete_server
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server   | 8.359  | 10.277 | 11.312 | 11.367 | 11.422 | 10.063 | 100.0%  | 10    |
-  | nova.delete_server | 2.388  | 2.607  | 4.826  | 4.853  | 4.881  | 3.21   | 100.0%  | 10    |
-  | total              | 11.023 | 12.798 | 15.929 | 16.116 | 16.303 | 13.273 | 100.0%  | 10    |
-  +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 39.1904668808
-  Full duration: 62.8628950119
-
-  test scenario NovaServers.boot_and_rebuild_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 8.636  | 9.789  | 12.354 | 12.414 | 12.474 | 10.12  | 100.0%  | 10    |
-  | nova.rebuild_server | 11.032 | 13.82  | 21.821 | 22.321 | 22.821 | 16.342 | 100.0%  | 10    |
-  | nova.delete_server  | 2.382  | 2.461  | 2.664  | 2.759  | 2.854  | 2.524  | 100.0%  | 10    |
-  | total               | 24.342 | 28.632 | 33.812 | 34.242 | 34.671 | 28.986 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 82.0937809944
-  Full duration: 105.129650116
-
-  test scenario NovaSecGroup.create_and_list_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 1.596  | 2.105  | 2.35   | 2.351  | 2.352  | 2.061  | 100.0%  | 10    |
-  | nova.create_100_rules          | 8.873  | 10.349 | 10.555 | 10.65  | 10.745 | 10.067 | 100.0%  | 10    |
-  | nova.list_security_groups      | 0.129  | 0.183  | 0.281  | 0.318  | 0.354  | 0.201  | 100.0%  | 10    |
-  | total                          | 11.189 | 12.51  | 12.822 | 12.823 | 12.823 | 12.329 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 36.4927339554
-  Full duration: 63.6400220394
-
-  test scenario NovaSecGroup.create_and_delete_secgroups
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 1.326 | 1.779  | 1.959  | 1.983  | 2.006  | 1.748  | 100.0%  | 10    |
-  | nova.create_100_rules          | 9.29  | 10.389 | 10.656 | 10.731 | 10.805 | 10.241 | 100.0%  | 10    |
-  | nova.delete_10_security_groups | 0.833 | 0.896  | 1.02   | 1.03   | 1.04   | 0.918  | 100.0%  | 10    |
-  | total                          | 11.55 | 13.143 | 13.488 | 13.549 | 13.611 | 12.907 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 38.0758161545
-  Full duration: 52.9351670742
-
-  test scenario NovaServers.boot_and_bounce_server
-  +----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                        |
-  +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
-  | action                  | min    | median | 90%ile  | 95%ile  | max     | avg    | success | count |
-  +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
-  | nova.boot_server        | 8.49   | 12.054 | 12.335  | 12.336  | 12.338  | 11.077 | 100.0%  | 10    |
-  | nova.reboot_server      | 4.412  | 4.746  | 6.676   | 6.794   | 6.912   | 5.252  | 100.0%  | 10    |
-  | nova.soft_reboot_server | 6.592  | 7.729  | 125.626 | 125.9   | 126.174 | 31.142 | 100.0%  | 10    |
-  | nova.stop_server        | 4.709  | 4.817  | 4.999   | 5.006   | 5.013   | 4.835  | 100.0%  | 10    |
-  | nova.start_server       | 2.636  | 3.348  | 4.108   | 4.153   | 4.198   | 3.361  | 100.0%  | 10    |
-  | nova.rescue_server      | 6.613  | 6.787  | 17.596  | 17.726  | 17.855  | 11.037 | 100.0%  | 10    |
-  | nova.unrescue_server    | 2.324  | 4.485  | 6.647   | 6.653   | 6.659   | 4.948  | 100.0%  | 10    |
-  | nova.delete_server      | 2.375  | 2.416  | 4.666   | 4.731   | 4.797   | 3.1    | 100.0%  | 10    |
-  | total                   | 39.617 | 54.891 | 166.239 | 170.845 | 175.451 | 74.764 | 100.0%  | 10    |
-  +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
-  Load duration: 241.107405901
-  Full duration: 264.433083773
-
-  test scenario NovaServers.boot_server
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action           | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server | 9.537 | 9.723  | 12.302 | 12.597 | 12.891 | 10.539 | 100.0%  | 10    |
-  | total            | 9.537 | 9.723  | 12.302 | 12.597 | 12.891 | 10.539 | 100.0%  | 10    |
-  +------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 31.5377810001
-  Full duration: 56.3936619759
-
-  test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-  +-----------------------------------------------------------------------------------------------------------+
-  |                                           Response Times (sec)                                            |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups    | 1.677  | 1.957  | 2.26   | 2.317  | 2.373  | 1.975  | 100.0%  | 10    |
-  | nova.create_100_rules             | 9.032  | 10.031 | 10.512 | 10.585 | 10.658 | 9.992  | 100.0%  | 10    |
-  | nova.boot_server                  | 8.152  | 11.436 | 11.645 | 11.66  | 11.675 | 10.446 | 100.0%  | 10    |
-  | nova.get_attached_security_groups | 0.145  | 0.154  | 0.17   | 0.185  | 0.2    | 0.158  | 100.0%  | 10    |
-  | nova.delete_server                | 2.412  | 4.581  | 4.637  | 4.667  | 4.696  | 3.741  | 100.0%  | 10    |
-  | nova.delete_10_security_groups    | 0.791  | 0.902  | 0.983  | 0.993  | 1.003  | 0.901  | 100.0%  | 10    |
-  | total                             | 22.687 | 29.402 | 29.574 | 29.639 | 29.704 | 27.213 | 100.0%  | 10    |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 81.6792809963
-  Full duration: 106.045881033
-
-  test scenario NovaServers.pause_and_unpause_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 9.557  | 11.959 | 12.616 | 12.617 | 12.618 | 11.399 | 100.0%  | 10    |
-  | nova.pause_server   | 2.3    | 2.488  | 2.647  | 2.73   | 2.813  | 2.485  | 100.0%  | 10    |
-  | nova.unpause_server | 2.313  | 2.338  | 2.459  | 2.519  | 2.579  | 2.376  | 100.0%  | 10    |
-  | nova.delete_server  | 2.379  | 4.554  | 4.593  | 4.6    | 4.608  | 3.72   | 100.0%  | 10    |
-  | total               | 16.731 | 21.47  | 21.938 | 22.069 | 22.201 | 19.98  | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 60.1143479347
-  Full duration: 84.1553788185
-
-  test scenario NovaServers.boot_server_from_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 3.296  | 3.584  | 6.23   | 6.254  | 6.278  | 4.296  | 100.0%  | 10    |
-  | nova.boot_server     | 13.316 | 14.103 | 15.99  | 16.029 | 16.068 | 14.371 | 100.0%  | 10    |
-  | total                | 16.8   | 18.338 | 20.779 | 21.536 | 22.293 | 18.667 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 55.7340800762
-  Full duration: 89.9920220375
-
-  test scenario NovaServers.boot_and_list_server
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server  | 8.714 | 10.615 | 12.468 | 12.501 | 12.535 | 10.613 | 100.0%  | 10    |
-  | nova.list_servers | 0.14  | 0.241  | 0.434  | 0.454  | 0.474  | 0.274  | 100.0%  | 10    |
-  | total             | 8.854 | 10.943 | 12.715 | 12.756 | 12.798 | 10.887 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 30.5609071255
-  Full duration: 64.9602191448
-
-  run_rally - INFO - Test scenario: "nova" OK.
-
-  run_rally - INFO - Starting test scenario "quotas" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  98d9ffba-dd50-429a-ab90-4549e00b19cf: started
-  Task 98d9ffba-dd50-429a-ab90-4549e00b19cf: finished
-
-  test scenario Quotas.cinder_update
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.58 | 0.646  | 0.661  | 0.671  | 0.682 | 0.636 | 100.0%  | 10    |
-  | total                | 0.58 | 0.646  | 0.661  | 0.671  | 0.682 | 0.636 | 100.0%  | 10    |
-  +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.98423290253
-  Full duration: 7.3744559288
-
-  test scenario Quotas.neutron_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.232 | 0.251  | 0.276  | 0.281  | 0.286 | 0.254 | 100.0%  | 10    |
-  | total                | 0.295 | 0.324  | 0.348  | 0.352  | 0.355 | 0.325 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.987355947495
-  Full duration: 6.55621004105
-
-  test scenario Quotas.cinder_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.609 | 0.648  | 0.736  | 0.755  | 0.775 | 0.663 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.267 | 0.474  | 0.498  | 0.518  | 0.539 | 0.454 | 100.0%  | 10    |
-  | total                | 0.95  | 1.099  | 1.254  | 1.262  | 1.271 | 1.117 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.2654209137
-  Full duration: 8.84793901443
-
-  test scenario Quotas.nova_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.319 | 0.353  | 0.393  | 0.4    | 0.408 | 0.358 | 100.0%  | 8     |
-  | quotas.delete_quotas | 0.015 | 0.025  | 0.031  | 0.032  | 0.033 | 0.025 | 75.0%   | 8     |
-  | total                | 0.351 | 0.366  | 0.405  | 0.416  | 0.428 | 0.374 | 75.0%   | 8     |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.80732011795
-  Full duration: 6.24122095108
-
-  test scenario Quotas.nova_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.346 | 0.366  | 0.413  | 0.414  | 0.416 | 0.373 | 100.0%  | 10    |
-  | total                | 0.346 | 0.366  | 0.413  | 0.414  | 0.416 | 0.373 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.10930514336
-  Full duration: 6.21793103218
-
-  run_rally - INFO - Test scenario: "quotas" Failed.
-  run_rally - INFO - Starting test scenario "requests" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  712d1722-52e2-4e3a-93dc-515e3fea5977: started
-  Task 712d1722-52e2-4e3a-93dc-515e3fea5977: finished
-
-  test scenario HttpRequests.check_random_request
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | requests.check_request | 5.462 | 5.488  | 5.976  | 5.991  | 6.006 | 5.59 | 100.0%  | 10    |
-  | total                  | 5.462 | 5.488  | 5.976  | 5.991  | 6.006 | 5.59 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 16.976375103
-  Full duration: 19.3119690418
-
-  test scenario HttpRequests.check_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 5.466 | 5.48   | 5.487  | 5.491  | 5.496 | 5.479 | 100.0%  | 10    |
-  | total                  | 5.466 | 5.48   | 5.487  | 5.491  | 5.496 | 5.479 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.4575350285
-  Full duration: 18.7219369411
-
-  run_rally - INFO - Test scenario: "requests" OK.
-  run_rally - INFO -
-
-                       Rally Summary Report
-  +===================+============+===============+===========+
-  | Module            | Duration   | nb. Test Run  | Success   |
-  +===================+============+===============+===========+
-  | authenticate      | 00:17      | 10            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | glance            | 01:45      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | cinder            | 17:38      | 50            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | heat              | 06:53      | 32            | 92.31%    |
-  +-------------------+------------+---------------+-----------+
-  | keystone          | 01:07      | 29            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | neutron           | 04:41      | 31            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | nova              | 30:14      | 61            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | quotas            | 00:35      | 7             | 95.00%    |
-  +-------------------+------------+---------------+-----------+
-  | requests          | 00:38      | 2             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  +===================+============+===============+===========+
-  | TOTAL:            | 01:03:52   | 229           | 98.59%    |
-  +===================+============+===============+===========+
-
-
-
-Feature tests
--------------
-
-vIMS
-^^^^
-::
-
-  FUNCTEST.info: Running vIMS test...
-  vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-  vIMS - INFO - Update OpenStack creds informations
-  vIMS - INFO - Upload some OS images if it doesn't exist
-  vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                              Try downloading this image and upload on glance !
-  vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                              Try downloading this image and upload on glance !
-  vIMS - INFO - Update security group quota for this tenant
-  vIMS - INFO - Update cinder quota for this tenant
-  vIMS - INFO - Collect flavor id for cloudify manager server
-  vIMS - INFO - Prepare virtualenv for cloudify-cli
-  vIMS - INFO - Downloading the cloudify manager server blueprint
-  vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 04:47:07'
-  vIMS - INFO - Writing the inputs file
-  vIMS - INFO - Launching the cloudify-manager deployment
-  vIMS - INFO - Cloudify-manager server is UP !
-  vIMS - INFO - Cloudify deployment duration:'432.5'
-  vIMS - INFO - Collect flavor id for all clearwater vm
-  vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 04:54:20'
-  vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-  vIMS - INFO - Writing the inputs file
-  vIMS - INFO - Launching the clearwater deployment
-  vIMS - INFO - The deployment of clearwater-opnfv is ended
-  vIMS - INFO - vIMS VNF deployment duration:'616.2'
-  vIMS - INFO - vIMS functional test Start Time:'2016-02-23 05:07:44'
-  vIMS - INFO - vIMS functional test duration:'3.5'
-  vIMS - INFO - Launching the clearwater-opnfv undeployment
-  vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-  vIMS - INFO - Launching the cloudify-manager undeployment
-  vIMS - INFO - Cloudify-manager server has been successfully removed!
-  vIMS - INFO - Removing vIMS tenant ..
-  vIMS - INFO - Removing vIMS user ..
diff --git a/docs/results/compass-os-odl_l2-nofeature-ha.rst b/docs/results/compass-os-odl_l2-nofeature-ha.rst
deleted file mode 100644 (file)
index bed7f86..0000000
+++ /dev/null
@@ -1,1769 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for apex-os-odl_l2-nofeature-ha
------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-SSH test...
-  vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_ssh- INFO - Creating neutron network vping-net...
-  vPing_ssh- INFO - Creating security group  'vPing-sg'...
-  vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-  vPing_ssh- INFO - vPing Start Time:'2016-02-22 22:26:26'
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=8588bf92-664e-46f0-ad4f-40347349b4db
-   network=1e07302c-1060-4862-ac96-81db4c46b173
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=8588bf92-664e-46f0-ad4f-40347349b4db
-   network=1e07302c-1060-4862-ac96-81db4c46b173
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-  vPing_ssh- INFO - Floating IP created: '192.168.10.101'
-  vPing_ssh- INFO - Associating floating ip: '192.168.10.101' to VM 'opnfv-vping-2'
-  vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.101...
-  vPing_ssh- INFO - Waiting for ping...
-  vPing_ssh- INFO - vPing detected!
-  vPing_ssh- INFO - vPing duration:'26.0' s.
-  vPing_ssh- INFO - Cleaning up...
-  vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-userdata test...
-  vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_userdata- INFO - Creating neutron network vping-net...
-  vPing_userdata- INFO - Creating security group  'vPing-sg'...
-  vPing_userdata- INFO - Flavor found 'm1.small'
-  vPing_userdata- INFO - vPing Start Time:'2016-02-22 22:27:09'
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=4e085313-471b-4846-96f8-d89c5fcdb453
-   network=f1c6e324-f469-4d43-a53e-3716a2075556
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=4e085313-471b-4846-96f8-d89c5fcdb453
-   network=f1c6e324-f469-4d43-a53e-3716a2075556
-   userdata=
-  #!/bin/sh
-
-  while true; do
-   ping -c 1 192.168.130.3 2>&1 >/dev/null
-   RES=$?
-   if [ "Z$RES" = "Z0" ] ; then
-    echo 'vPing OK'
-   break
-   else
-    echo 'vPing KO'
-   fi
-   sleep 1
-  done
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_userdata- INFO - Waiting for ping...
-  vPing_userdata- INFO - vPing detected!
-  vPing_userdata- INFO - vPing duration:'13.7'
-  vPing_userdata- INFO - vPing OK
-  vPing_userdata- INFO - Cleaning up...
-  vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-  FUNCTEST.info: Running Tempest tests...
-  run_tempest - INFO - Creating tenant and user for Tempest suite
-  INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
-  INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
-  run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
-  Total results of verification:
-
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | 3275e5cd-a0cd-4961-95c8-11c5eceaa6a6 | 94d6d0c4-f111-4f1a-a9ee-dee149fe7ce1 |          | 210   | 1        | 2016-02-22 22:27:42.722872 | finished |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-
-  Tests:
-
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | name                                                                                                                                     | time      | status  |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.24365   | success |
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.06964   | success |
-  | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 8.22175   | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 10.97975  | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 7.03882   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.06729   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.05931   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.06307   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.11320   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.06453   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.06586   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.06862   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.06207   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.05691   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.18730   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.07965   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.10485   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.06917   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.14038   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.10940   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.07005   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.52047   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 0.56007   | success |
-  | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 1.36847   | success |
-  | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 6.81057   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 2.10654   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.06566   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.16011   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.20656   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00068   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 69.80953  | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.07774   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.17023   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.14159   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.00084   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.09269   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 5.41847   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.30351   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.24031   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.16460   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.23510   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.18628   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.07873   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.07850   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.05956   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.06586   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.09254   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.23073   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00060   | skip    |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.14221   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.05795   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.01868   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.06964   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.07267   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.01534   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01306   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.03567   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.06330   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.05500   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.22976   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.01362   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.08669   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00039   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 4.49759   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 10.29434  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 11.00534  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.31208   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 17.08686  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 12.94698  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 18.51575  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 7.22487   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.07714   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.15308   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.54182   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.31556   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.31066   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.53469   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.59802   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.53771   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 1.24685   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 17.18514  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 14.43669  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 6.66687   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 6.82712   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 0.87441   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 1.61025   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 0.77729   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 0.66808   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 0.66403   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 0.97748   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 0.53671   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.53750   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.48586   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.38319   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 1.47622   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.47227   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.53487   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.41419   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.37761   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 0.66937   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.40626   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.18956   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.41639   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 0.42068   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.32462   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.09822   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.01379   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.06999   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.01451   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.50159   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.06452   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.11341   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05076   | success |
-  | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 38.69512  | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.21321   | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.17329   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.18341   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.00759   | success |
-  | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.24642   | success |
-  | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.07626   | success |
-  | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.08835   | success |
-  | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.02633   | success |
-  | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.37189   | success |
-  | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.15162   | success |
-  | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.86306   | success |
-  | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.10101   | success |
-  | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.12434   | success |
-  | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.11215   | fail    |
-  | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.12074   | success |
-  | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 0.86182   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.06049   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01891   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.01815   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.02941   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.02461   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.03987   | success |
-  | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.05957   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 0.26863   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 0.41872   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 0.46002   | success |
-  | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 0.68221   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.77595   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 2.72713   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 0.59088   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 1.16562   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 3.93480   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 1.01314   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 1.66236   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 1.72675   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 1.39541   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.13054   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.03480   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.05462   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.03106   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.03278   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 1.42674   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.18894   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.08396   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.11331   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.06513   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.04251   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 1.36723   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 1.36291   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 0.73091   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.20694   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.15012   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.36701   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 1.50158   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 0.70437   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.07769   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.06964   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 3.74936   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 1.65997   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 1.75798   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 1.38648   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 3.00947   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 1.91922   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 1.66228   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 1.09354   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 0.73626   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 0.59551   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.02945   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 0.47389   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 0.93740   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.02787   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.55494   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.50572   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.02163   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.82447   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.53325   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.38634   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.32465   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.55989   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.51489   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.86241   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.03735   | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 11.17975  | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 1.67439   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.39084   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.38683   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 12.07426  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 11.07575  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 11.26088  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 11.66599  | success |
-  | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.41386   | success |
-  | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.39419   | success |
-  | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 27.45308  | success |
-  | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 13.84478  | success |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 85.32205  | success |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 100.83926 | success |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  run_tempest - INFO - Results: {'timestart': '2016-02-2222:27:42.722872', 'duration': 171, 'tests': 210, 'failures': 1}
-  run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
-  run_tempest - INFO - Deleting tenant and user for Tempest suite)
-
-
-Rally
-^^^^^
-::
-
-  FUNCTEST.info: Running Rally benchmark suite...
-  run_rally - INFO - Starting test scenario "authenticate" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  8ccbcb5f-32ba-4621-be0d-09b54fb1c9ea: started
-  Task 8ccbcb5f-32ba-4621-be0d-09b54fb1c9ea: finished
-
-  test scenario Authenticate.validate_glance
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_glance     | 0.112 | 0.132  | 0.201  | 0.201  | 0.201 | 0.143 | 100.0%  | 10    |
-  | authenticate.validate_glance (2) | 0.039 | 0.046  | 0.107  | 0.111  | 0.115 | 0.063 | 100.0%  | 10    |
-  | total                            | 0.226 | 0.257  | 0.386  | 0.389  | 0.391 | 0.286 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.860725164413
-  Full duration: 3.2147500515
-
-  test scenario Authenticate.keystone
-  +-----------------------------------------------------------------------------+
-  |                            Response Times (sec)                             |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | total  | 0.065 | 0.07   | 0.085  | 0.106  | 0.127 | 0.076 | 100.0%  | 10    |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.236154079437
-  Full duration: 2.56328606606
-
-  test scenario Authenticate.validate_heat
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_heat     | 0.106 | 0.121  | 0.259  | 0.268  | 0.277 | 0.148 | 100.0%  | 10    |
-  | authenticate.validate_heat (2) | 0.022 | 0.028  | 0.122  | 0.18   | 0.237 | 0.065 | 100.0%  | 10    |
-  | total                          | 0.212 | 0.25   | 0.426  | 0.429  | 0.431 | 0.294 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.876858949661
-  Full duration: 3.099599123
-
-  test scenario Authenticate.validate_nova
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_nova     | 0.108 | 0.125  | 0.144  | 0.144  | 0.144 | 0.126 | 100.0%  | 10    |
-  | authenticate.validate_nova (2) | 0.025 | 0.034  | 0.039  | 0.04   | 0.04  | 0.034 | 100.0%  | 10    |
-  | total                          | 0.214 | 0.242  | 0.258  | 0.263  | 0.268 | 0.239 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.719485044479
-  Full duration: 2.89414715767
-
-  test scenario Authenticate.validate_cinder
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_cinder     | 0.102 | 0.111  | 0.167  | 0.177  | 0.188 | 0.124 | 100.0%  | 10    |
-  | authenticate.validate_cinder (2) | 0.014 | 0.075  | 0.098  | 0.147  | 0.195 | 0.07  | 100.0%  | 10    |
-  | total                            | 0.197 | 0.261  | 0.37   | 0.39   | 0.41  | 0.281 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.842756032944
-  Full duration: 3.36014580727
-
-  test scenario Authenticate.validate_neutron
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_neutron     | 0.106 | 0.121  | 0.133  | 0.137  | 0.142 | 0.122 | 100.0%  | 10    |
-  | authenticate.validate_neutron (2) | 0.029 | 0.088  | 0.109  | 0.11   | 0.111 | 0.087 | 100.0%  | 10    |
-  | total                             | 0.218 | 0.286  | 0.32   | 0.324  | 0.328 | 0.281 | 100.0%  | 10    |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.860924005508
-  Full duration: 3.14792895317
-
-  run_rally - INFO - Test scenario: "authenticate" OK.
-  run_rally - INFO - Starting test scenario "glance" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  e020cf98-caa0-4014-a28d-42748bf9dca3: started
-  Task e020cf98-caa0-4014-a28d-42748bf9dca3: finished
-
-  test scenario GlanceImages.list_images
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.list_images | 0.193 | 0.22   | 0.23   | 0.234  | 0.238 | 0.217 | 100.0%  | 10    |
-  | total              | 0.193 | 0.22   | 0.23   | 0.234  | 0.238 | 0.217 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.657658100128
-  Full duration: 3.69541883469
-
-  test scenario GlanceImages.create_image_and_boot_instances
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | glance.create_image | 2.85  | 3.139  | 3.39   | 3.41   | 3.43   | 3.133 | 100.0%  | 10    |
-  | nova.boot_servers   | 5.898 | 6.853  | 7.241  | 7.329  | 7.417  | 6.806 | 100.0%  | 10    |
-  | total               | 8.797 | 10.039 | 10.461 | 10.534 | 10.607 | 9.94  | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 29.545609951
-  Full duration: 55.3799848557
-
-  test scenario GlanceImages.create_and_list_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 2.821 | 3.548  | 3.89   | 3.905  | 3.92  | 3.507 | 100.0%  | 10    |
-  | glance.list_images  | 0.04  | 0.045  | 0.053  | 0.054  | 0.056 | 0.046 | 100.0%  | 10    |
-  | total               | 2.873 | 3.599  | 3.934  | 3.948  | 3.962 | 3.553 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 10.4028940201
-  Full duration: 15.1872868538
-
-  test scenario GlanceImages.create_and_delete_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 2.876 | 3.678  | 3.734  | 3.742  | 3.75  | 3.507 | 100.0%  | 10    |
-  | glance.delete_image | 0.141 | 0.148  | 0.209  | 0.217  | 0.226 | 0.162 | 100.0%  | 10    |
-  | total               | 3.036 | 3.822  | 3.893  | 3.934  | 3.976 | 3.669 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 10.7681660652
-  Full duration: 13.7783231735
-
-  run_rally - INFO - Test scenario: "glance" OK.
-  run_rally - INFO - Starting test scenario "cinder" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  d1dd9119-e59d-4e80-ad09-072f6300762b: started
-  Task d1dd9119-e59d-4e80-ad09-072f6300762b: finished
-
-  test scenario CinderVolumes.create_and_attach_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server     | 3.086  | 4.323  | 5.484  | 5.514  | 5.544  | 4.505  | 100.0%  | 10    |
-  | cinder.create_volume | 2.703  | 2.882  | 2.961  | 2.969  | 2.978  | 2.865  | 100.0%  | 10    |
-  | nova.attach_volume   | 7.55   | 7.801  | 10.194 | 10.345 | 10.495 | 8.292  | 100.0%  | 10    |
-  | nova.detach_volume   | 2.967  | 5.217  | 5.602  | 5.694  | 5.786  | 4.468  | 100.0%  | 10    |
-  | cinder.delete_volume | 2.393  | 2.51   | 2.562  | 2.572  | 2.582  | 2.497  | 100.0%  | 10    |
-  | nova.delete_server   | 2.375  | 2.429  | 2.554  | 2.595  | 2.637  | 2.46   | 100.0%  | 10    |
-  | total                | 21.586 | 25.034 | 28.962 | 29.376 | 29.79  | 25.088 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 74.0110630989
-  Full duration: 87.3835339546
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 5.186 | 5.298  | 5.406  | 5.44   | 5.474 | 5.311 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.11  | 0.134  | 0.147  | 0.148  | 0.15  | 0.133 | 100.0%  | 10    |
-  | total                | 5.336 | 5.425  | 5.529  | 5.575  | 5.62  | 5.444 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.3077280521
-  Full duration: 27.7325429916
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.841 | 2.921  | 3.157  | 3.158  | 3.158 | 2.951 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.067 | 0.12   | 0.18   | 0.18   | 0.18  | 0.127 | 100.0%  | 10    |
-  | total                | 2.954 | 3.036  | 3.281  | 3.282  | 3.283 | 3.078 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.12118315697
-  Full duration: 19.8639061451
-
-  test scenario CinderVolumes.create_and_list_snapshots
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.433 | 2.508  | 2.551  | 2.552  | 2.554 | 2.5   | 100.0%  | 10    |
-  | cinder.list_snapshots  | 0.018 | 0.082  | 0.103  | 0.111  | 0.119 | 0.069 | 100.0%  | 10    |
-  | total                  | 2.523 | 2.561  | 2.612  | 2.627  | 2.641 | 2.57  | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 7.76097297668
-  Full duration: 31.5859258175
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.795 | 2.848  | 2.943  | 2.955  | 2.968 | 2.867 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.446 | 2.499  | 2.595  | 2.669  | 2.744 | 2.524 | 100.0%  | 10    |
-  | total                | 5.295 | 5.374  | 5.521  | 5.53   | 5.539 | 5.391 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.1756019592
-  Full duration: 23.199131012
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 5.287 | 5.38   | 5.424  | 5.439  | 5.454 | 5.365 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.394 | 2.549  | 2.687  | 2.699  | 2.711 | 2.555 | 100.0%  | 10    |
-  | total                | 7.728 | 7.896  | 8.06   | 8.081  | 8.103 | 7.92  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 23.6543819904
-  Full duration: 30.6390721798
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.885 | 2.937  | 3.053  | 3.059  | 3.066 | 2.962 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.405 | 2.586  | 2.691  | 2.732  | 2.773 | 2.577 | 100.0%  | 10    |
-  | total                | 5.421 | 5.531  | 5.59   | 5.691  | 5.793 | 5.539 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.603798151
-  Full duration: 23.3788831234
-
-  test scenario CinderVolumes.create_and_upload_volume_to_image
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume          | 2.792  | 2.951  | 3.369  | 3.545  | 3.721  | 3.036  | 100.0%  | 10    |
-  | cinder.upload_volume_to_image | 26.207 | 65.967 | 78.731 | 83.94  | 89.149 | 62.382 | 100.0%  | 10    |
-  | cinder.delete_volume          | 2.469  | 2.587  | 2.777  | 2.908  | 3.038  | 2.617  | 100.0%  | 10    |
-  | nova.delete_image             | 0.306  | 0.602  | 1.075  | 1.085  | 1.095  | 0.679  | 100.0%  | 10    |
-  | total                         | 32.909 | 73.046 | 84.953 | 90.036 | 95.118 | 68.714 | 100.0%  | 10    |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 183.403058052
-  Full duration: 190.890599012
-
-  test scenario CinderVolumes.create_and_delete_snapshot
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.494 | 2.541  | 2.623  | 2.662  | 2.701 | 2.563 | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.29  | 2.379  | 2.557  | 2.611  | 2.665 | 2.424 | 100.0%  | 10    |
-  | total                  | 4.784 | 4.953  | 5.15   | 5.215  | 5.279 | 4.988 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.7655448914
-  Full duration: 33.6425430775
-
-  test scenario CinderVolumes.create_volume
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +----------------------+-------+--------+--------+--------+-----+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-----+-------+---------+-------+
-  | cinder.create_volume | 2.789 | 2.912  | 3.076  | 3.088  | 3.1 | 2.933 | 100.0%  | 10    |
-  | total                | 2.789 | 2.913  | 3.076  | 3.088  | 3.1 | 2.933 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-----+-------+---------+-------+
-  Load duration: 8.82123494148
-  Full duration: 18.1940879822
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.807 | 2.927  | 3.035  | 3.036  | 3.036 | 2.926 | 100.0%  | 10    |
-  | total                | 2.808 | 2.927  | 3.036  | 3.036  | 3.036 | 2.927 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 8.90417385101
-  Full duration: 20.1418190002
-
-  test scenario CinderVolumes.list_volumes
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.list_volumes | 0.226 | 0.251  | 0.27   | 0.282  | 0.293 | 0.253 | 100.0%  | 10    |
-  | total               | 0.226 | 0.251  | 0.27   | 0.282  | 0.293 | 0.253 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.773681879044
-  Full duration: 47.6445128918
-
-  test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.752  | 2.933  | 3.066  | 3.089  | 3.112  | 2.943  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.319  | 2.388  | 2.432  | 2.437  | 2.441  | 2.387  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.626  | 9.641  | 12.934 | 14.634 | 16.334 | 10.372 | 100.0%  | 10    |
-  | nova.detach_volume     | 3.067  | 5.326  | 5.451  | 5.507  | 5.563  | 4.908  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.261  | 2.317  | 2.419  | 2.448  | 2.476  | 2.333  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.339  | 2.491  | 2.583  | 2.615  | 2.647  | 2.486  | 100.0%  | 10    |
-  | total                  | 21.617 | 24.353 | 28.724 | 30.338 | 31.953 | 25.746 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 72.4364318848
-  Full duration: 113.83590889
-
-  test scenario CinderVolumes.create_from_volume_and_delete_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 9.733  | 14.37  | 14.917 | 16.883 | 18.848 | 13.936 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.357  | 2.482  | 2.618  | 2.619  | 2.619  | 2.497  | 100.0%  | 10    |
-  | total                | 12.277 | 16.823 | 17.514 | 19.491 | 21.468 | 16.433 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 46.032130003
-  Full duration: 65.3552489281
-
-  test scenario CinderVolumes.create_and_extend_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.81  | 2.879  | 3.049  | 3.065  | 3.082 | 2.923 | 100.0%  | 10    |
-  | cinder.extend_volume | 2.584 | 2.789  | 2.943  | 2.951  | 2.958 | 2.782 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.402 | 2.564  | 2.615  | 2.633  | 2.65  | 2.54  | 100.0%  | 10    |
-  | total                | 8.046 | 8.216  | 8.376  | 8.506  | 8.636 | 8.246 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.652312994
-  Full duration: 31.6354629993
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +-----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                      |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.872 | 2.939  | 2.986  | 3.045  | 3.103  | 2.944  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.312 | 2.389  | 2.452  | 2.499  | 2.546  | 2.395  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.624 | 7.814  | 13.095 | 16.211 | 19.328 | 9.374  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.991 | 4.159  | 5.336  | 5.399  | 5.461  | 4.171  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.186 | 2.277  | 2.41   | 2.418  | 2.426  | 2.296  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.431 | 2.498  | 2.589  | 2.595  | 2.601  | 2.51   | 100.0%  | 10    |
-  | total                  | 21.28 | 23.314 | 26.739 | 29.882 | 33.025 | 24.004 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 68.312828064
-  Full duration: 112.127801895
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.617  | 2.833  | 2.941  | 2.982  | 3.022  | 2.823  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.282  | 2.375  | 2.445  | 2.47   | 2.494  | 2.384  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.58   | 7.741  | 13.508 | 16.698 | 19.888 | 9.501  | 100.0%  | 10    |
-  | nova.detach_volume     | 3.07   | 5.287  | 5.408  | 5.463  | 5.518  | 4.882  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.254  | 2.326  | 2.432  | 2.435  | 2.438  | 2.343  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.339  | 2.475  | 2.593  | 2.625  | 2.656  | 2.483  | 100.0%  | 10    |
-  | total                  | 21.236 | 23.663 | 29.169 | 32.362 | 35.555 | 24.955 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 71.8869941235
-  Full duration: 117.904321909
-
-  run_rally - INFO - Test scenario: "cinder" OK.
-  run_rally - INFO - Starting test scenario "heat" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  e23e2615-b959-461f-9e63-973b9de00f98: started
-  Task e23e2615-b959-461f-9e63-973b9de00f98: finished
-
-  test scenario HeatStacks.create_suspend_resume_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack  | 2.856 | 3.146  | 3.227  | 3.244  | 3.262 | 3.087 | 100.0%  | 10    |
-  | heat.suspend_stack | 0.525 | 1.615  | 1.756  | 1.822  | 1.888 | 1.284 | 100.0%  | 10    |
-  | heat.resume_stack  | 0.549 | 1.6    | 1.663  | 1.673  | 1.682 | 1.296 | 100.0%  | 10    |
-  | heat.delete_stack  | 1.312 | 1.491  | 1.655  | 1.659  | 1.662 | 1.501 | 100.0%  | 10    |
-  | total              | 5.641 | 7.374  | 8.053  | 8.167  | 8.281 | 7.168 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 22.0507199764
-  Full duration: 25.5707690716
-
-  test scenario HeatStacks.create_and_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.923 | 3.085  | 3.286  | 3.309  | 3.331 | 3.115 | 100.0%  | 10    |
-  | heat.delete_stack | 0.243 | 0.963  | 1.56   | 1.624  | 1.688 | 0.962 | 100.0%  | 10    |
-  | total             | 3.166 | 4.127  | 4.666  | 4.735  | 4.803 | 4.076 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 13.0132920742
-  Full duration: 16.5792620182
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 9.979  | 11.338 | 13.752 | 13.849 | 13.946 | 11.536 | 100.0%  | 10    |
-  | heat.delete_stack | 7.092  | 8.228  | 8.71   | 8.871  | 9.033  | 8.149  | 100.0%  | 10    |
-  | total             | 18.547 | 19.228 | 21.86  | 22.086 | 22.312 | 19.685 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 58.1043260098
-  Full duration: 61.6377520561
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 11.918 | 13.906 | 16.154 | 16.286 | 16.418 | 13.895 | 100.0%  | 10    |
-  | heat.delete_stack | 8.414  | 9.204  | 10.491 | 10.538 | 10.585 | 9.295  | 100.0%  | 10    |
-  | total             | 21.347 | 22.82  | 25.491 | 26.247 | 27.003 | 23.19  | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 68.1649589539
-  Full duration: 71.9318380356
-
-  test scenario HeatStacks.list_stacks_and_resources
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.list_stacks                | 0.233 | 0.257  | 0.318  | 0.436  | 0.555 | 0.286 | 100.0%  | 10    |
-  | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-  | total                           | 0.233 | 0.257  | 0.318  | 0.436  | 0.555 | 0.286 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.829450845718
-  Full duration: 3.74743390083
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.703 | 2.996  | 3.064  | 3.184  | 3.304 | 2.981 | 100.0%  | 10    |
-  | heat.update_stack | 2.487 | 3.644  | 3.84   | 3.918  | 3.996 | 3.387 | 100.0%  | 10    |
-  | heat.delete_stack | 0.52  | 1.473  | 1.686  | 1.691  | 1.697 | 1.413 | 100.0%  | 10    |
-  | total             | 6.639 | 8.102  | 8.301  | 8.486  | 8.671 | 7.781 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 23.5321931839
-  Full duration: 26.9891970158
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.69  | 3.032  | 3.266  | 3.279  | 3.293 | 3.041 | 100.0%  | 10    |
-  | heat.update_stack | 2.458 | 2.642  | 3.727  | 3.766  | 3.805 | 3.037 | 100.0%  | 10    |
-  | heat.delete_stack | 0.556 | 1.511  | 1.586  | 1.632  | 1.678 | 1.419 | 100.0%  | 10    |
-  | total             | 6.957 | 7.396  | 8.15   | 8.18   | 8.21  | 7.497 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 22.4653220177
-  Full duration: 25.9613161087
-
-  test scenario HeatStacks.create_update_delete_stack
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 2.936 | 3.18   | 3.4    | 3.735  | 4.069  | 3.237  | 100.0%  | 10    |
-  | heat.update_stack | 4.79  | 5.132  | 6.045  | 6.06   | 6.076  | 5.308  | 100.0%  | 10    |
-  | heat.delete_stack | 1.518 | 2.424  | 2.589  | 2.618  | 2.647  | 2.182  | 100.0%  | 10    |
-  | total             | 9.624 | 10.703 | 11.721 | 11.781 | 11.842 | 10.727 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 31.7993149757
-  Full duration: 35.7221229076
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------+
-  |                         Response Times (sec)                          |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | action | min | median | 90%ile | 95%ile | max | avg | success | count |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 7     |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  Load duration: 6.70760798454
-  Full duration: 15.0584180355
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-  | heat.create_stack | 2.893 | 3.127  | 3.179  | 3.194  | 3.209 | 3.079  | 100.0%  | 10    |
-  | heat.update_stack | 4.695 | 5.02   | 5.189  | 5.193  | 5.197 | 5.007  | 100.0%  | 10    |
-  | heat.delete_stack | 1.51  | 2.454  | 2.786  | 2.821  | 2.855 | 2.302  | 100.0%  | 10    |
-  | total             | 9.334 | 10.621 | 10.981 | 10.985 | 10.99 | 10.388 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-  Load duration: 31.2812139988
-  Full duration: 35.1641018391
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.885 | 3.01   | 3.24   | 3.311  | 3.381 | 3.05  | 100.0%  | 10    |
-  | heat.update_stack | 2.83  | 3.881  | 3.936  | 3.968  | 4.0   | 3.777 | 100.0%  | 10    |
-  | heat.delete_stack | 1.307 | 1.567  | 1.645  | 1.79   | 1.935 | 1.543 | 100.0%  | 10    |
-  | total             | 7.316 | 8.436  | 8.859  | 8.868  | 8.876 | 8.37  | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.9058198929
-  Full duration: 28.9196100235
-
-  test scenario HeatStacks.create_and_list_stack
-  +---------------------------------------------------------------------------------------+
-  |                                 Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | heat.create_stack | 2.882 | 3.04   | 3.213  | 3.318  | 3.423 | 3.07 | 100.0%  | 10    |
-  | heat.list_stacks  | 0.037 | 0.16   | 0.174  | 0.178  | 0.182 | 0.14 | 100.0%  | 10    |
-  | total             | 3.046 | 3.142  | 3.382  | 3.478  | 3.575 | 3.21 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 9.64803004265
-  Full duration: 17.1896460056
-
-  test scenario HeatStacks.create_check_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.808 | 3.191  | 3.252  | 3.281  | 3.311 | 3.148 | 100.0%  | 10    |
-  | heat.check_stack  | 0.407 | 0.668  | 1.405  | 1.545  | 1.685 | 0.776 | 100.0%  | 10    |
-  | heat.delete_stack | 0.678 | 1.561  | 1.687  | 1.707  | 1.726 | 1.474 | 100.0%  | 10    |
-  | total             | 4.931 | 5.317  | 5.757  | 5.974  | 6.192 | 5.398 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.0285110474
-  Full duration: 19.9199111462
-
-  run_rally - INFO - Test scenario: "heat" Failed.
-  run_rally - INFO - Starting test scenario "keystone" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  08dbf827-7838-43b0-9cd2-3d48c9632781: started
-  Task 08dbf827-7838-43b0-9cd2-3d48c9632781: finished
-
-  test scenario KeystoneBasic.create_tenant_with_users
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.113 | 0.12   | 0.158  | 0.176  | 0.195 | 0.13  | 100.0%  | 10    |
-  | keystone.create_users  | 0.651 | 0.684  | 0.707  | 0.733  | 0.759 | 0.685 | 100.0%  | 10    |
-  | total                  | 0.772 | 0.8    | 0.865  | 0.91   | 0.954 | 0.815 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.42733502388
-  Full duration: 12.6668281555
-
-  test scenario KeystoneBasic.create_add_and_list_user_roles
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.115 | 0.123  | 0.132  | 0.145  | 0.159 | 0.125 | 100.0%  | 10    |
-  | keystone.add_role    | 0.09  | 0.101  | 0.122  | 0.137  | 0.151 | 0.106 | 100.0%  | 10    |
-  | keystone.list_roles  | 0.049 | 0.057  | 0.062  | 0.065  | 0.067 | 0.057 | 100.0%  | 10    |
-  | total                | 0.26  | 0.282  | 0.328  | 0.329  | 0.33  | 0.288 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.850867986679
-  Full duration: 6.24242782593
-
-  test scenario KeystoneBasic.add_and_remove_user_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.118 | 0.172  | 0.235  | 0.244  | 0.254 | 0.177 | 100.0%  | 10    |
-  | keystone.add_role    | 0.095 | 0.115  | 0.16   | 0.162  | 0.165 | 0.122 | 100.0%  | 10    |
-  | keystone.remove_role | 0.059 | 0.068  | 0.163  | 0.164  | 0.166 | 0.085 | 100.0%  | 10    |
-  | total                | 0.281 | 0.407  | 0.444  | 0.447  | 0.451 | 0.385 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.1720468998
-  Full duration: 6.63848996162
-
-  test scenario KeystoneBasic.create_update_and_delete_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.125 | 0.19   | 0.247  | 0.268  | 0.289 | 0.191 | 100.0%  | 10    |
-  | keystone.update_tenant | 0.052 | 0.063  | 0.11   | 0.111  | 0.113 | 0.07  | 100.0%  | 10    |
-  | keystone.delete_tenant | 0.12  | 0.141  | 0.192  | 0.227  | 0.261 | 0.153 | 100.0%  | 10    |
-  | total                  | 0.331 | 0.418  | 0.486  | 0.502  | 0.517 | 0.415 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.27042984962
-  Full duration: 5.3805770874
-
-  test scenario KeystoneBasic.create_and_delete_service
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_service | 0.111 | 0.117  | 0.13   | 0.139  | 0.147 | 0.121 | 100.0%  | 10    |
-  | keystone.delete_service | 0.055 | 0.067  | 0.096  | 0.097  | 0.097 | 0.071 | 100.0%  | 10    |
-  | total                   | 0.176 | 0.189  | 0.212  | 0.215  | 0.218 | 0.192 | 100.0%  | 10    |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.61040687561
-  Full duration: 4.58190393448
-
-  test scenario KeystoneBasic.create_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.114 | 0.128  | 0.136  | 0.16   | 0.183 | 0.131 | 100.0%  | 10    |
-  | total                  | 0.114 | 0.128  | 0.137  | 0.16   | 0.183 | 0.131 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.400830030441
-  Full duration: 4.4062628746
-
-  test scenario KeystoneBasic.create_user
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.124 | 0.137  | 0.146  | 0.163  | 0.179 | 0.138 | 100.0%  | 10    |
-  | total                | 0.125 | 0.137  | 0.146  | 0.163  | 0.179 | 0.138 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.42484498024
-  Full duration: 4.1389541626
-
-  test scenario KeystoneBasic.create_and_list_tenants
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.117 | 0.126  | 0.134  | 0.152  | 0.17  | 0.129 | 100.0%  | 10    |
-  | keystone.list_tenants  | 0.046 | 0.059  | 0.104  | 0.104  | 0.105 | 0.069 | 100.0%  | 10    |
-  | total                  | 0.166 | 0.19   | 0.231  | 0.233  | 0.235 | 0.198 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.600751876831
-  Full duration: 6.1798210144
-
-  test scenario KeystoneBasic.create_and_delete_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.118 | 0.227  | 0.298  | 0.3    | 0.302 | 0.204 | 100.0%  | 10    |
-  | keystone.delete_role | 0.105 | 0.13   | 0.271  | 0.29   | 0.309 | 0.157 | 100.0%  | 10    |
-  | total                | 0.238 | 0.346  | 0.573  | 0.59   | 0.607 | 0.362 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.21080708504
-  Full duration: 5.530189991
-
-  test scenario KeystoneBasic.get_entities
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.121 | 0.125  | 0.148  | 0.149  | 0.151 | 0.13  | 100.0%  | 10    |
-  | keystone.create_user   | 0.062 | 0.078  | 0.103  | 0.121  | 0.139 | 0.084 | 100.0%  | 10    |
-  | keystone.create_role   | 0.046 | 0.051  | 0.067  | 0.069  | 0.072 | 0.055 | 100.0%  | 10    |
-  | keystone.get_tenant    | 0.04  | 0.05   | 0.054  | 0.057  | 0.06  | 0.049 | 100.0%  | 10    |
-  | keystone.get_user      | 0.048 | 0.058  | 0.072  | 0.082  | 0.093 | 0.062 | 100.0%  | 10    |
-  | keystone.get_role      | 0.042 | 0.047  | 0.053  | 0.058  | 0.064 | 0.048 | 100.0%  | 10    |
-  | keystone.service_list  | 0.046 | 0.055  | 0.069  | 0.079  | 0.09  | 0.058 | 100.0%  | 10    |
-  | keystone.get_service   | 0.041 | 0.048  | 0.057  | 0.072  | 0.088 | 0.051 | 100.0%  | 10    |
-  | total                  | 0.483 | 0.541  | 0.568  | 0.584  | 0.599 | 0.538 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.66359400749
-  Full duration: 10.0017409325
-
-  test scenario KeystoneBasic.create_and_list_users
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.131 | 0.14   | 0.157  | 0.205  | 0.254 | 0.151 | 100.0%  | 10    |
-  | keystone.list_users  | 0.051 | 0.057  | 0.065  | 0.078  | 0.091 | 0.06  | 100.0%  | 10    |
-  | total                | 0.182 | 0.199  | 0.239  | 0.274  | 0.309 | 0.211 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.62369799614
-  Full duration: 4.64324808121
-
-  run_rally - INFO - Test scenario: "keystone" OK.
-  run_rally - INFO - Starting test scenario "neutron" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  7a8d4b82-85d3-485c-996e-08dbd3787094: started
-  Task 7a8d4b82-85d3-485c-996e-08dbd3787094: finished
-
-  test scenario NeutronNetworks.create_and_delete_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.424 | 0.519  | 0.555  | 0.559  | 0.563 | 0.503 | 100.0%  | 10    |
-  | neutron.delete_port | 0.148 | 0.283  | 0.32   | 0.339  | 0.358 | 0.259 | 100.0%  | 10    |
-  | total               | 0.584 | 0.797  | 0.849  | 0.859  | 0.87  | 0.762 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.3002948761
-  Full duration: 25.5696978569
-
-  test scenario NeutronNetworks.create_and_list_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.421 | 0.453  | 0.541  | 0.55   | 0.56  | 0.472 | 100.0%  | 10    |
-  | neutron.create_router        | 0.039 | 0.045  | 0.24   | 0.247  | 0.254 | 0.11  | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.28  | 0.297  | 0.417  | 0.427  | 0.438 | 0.32  | 100.0%  | 10    |
-  | neutron.list_routers         | 0.043 | 0.163  | 0.181  | 0.185  | 0.189 | 0.122 | 100.0%  | 10    |
-  | total                        | 0.795 | 1.045  | 1.115  | 1.243  | 1.372 | 1.024 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.85029602051
-  Full duration: 27.2547390461
-
-  test scenario NeutronNetworks.create_and_delete_routers
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet           | 0.399 | 0.476  | 0.542  | 0.561  | 0.579 | 0.479 | 100.0%  | 10    |
-  | neutron.create_router           | 0.038 | 0.041  | 0.181  | 0.186  | 0.19  | 0.096 | 100.0%  | 10    |
-  | neutron.add_interface_router    | 0.272 | 0.306  | 0.421  | 0.426  | 0.43  | 0.34  | 100.0%  | 10    |
-  | neutron.remove_interface_router | 0.228 | 0.311  | 0.514  | 0.518  | 0.521 | 0.338 | 100.0%  | 10    |
-  | neutron.delete_router           | 0.151 | 0.159  | 0.295  | 0.297  | 0.298 | 0.205 | 100.0%  | 10    |
-  | total                           | 1.218 | 1.388  | 1.829  | 1.868  | 1.908 | 1.458 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.20906496048
-  Full duration: 28.1987309456
-
-  test scenario NeutronNetworks.create_and_list_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.429 | 0.5    | 0.612  | 0.626  | 0.639 | 0.521 | 100.0%  | 10    |
-  | neutron.list_ports  | 0.108 | 0.282  | 0.352  | 0.372  | 0.392 | 0.262 | 100.0%  | 10    |
-  | total               | 0.594 | 0.761  | 0.957  | 0.957  | 0.957 | 0.783 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.34113693237
-  Full duration: 26.7457489967
-
-  test scenario NeutronNetworks.create_and_delete_subnets
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max  | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+------+-------+---------+-------+
-  | neutron.create_subnet | 0.402 | 0.436  | 0.542  | 0.566  | 0.59 | 0.463 | 100.0%  | 10    |
-  | neutron.delete_subnet | 0.142 | 0.29   | 0.334  | 0.367  | 0.4  | 0.25  | 100.0%  | 10    |
-  | total                 | 0.564 | 0.709  | 0.86   | 0.875  | 0.89 | 0.713 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+------+-------+---------+-------+
-  Load duration: 2.14902901649
-  Full duration: 25.5031478405
-
-  test scenario NeutronNetworks.create_and_delete_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.301 | 0.346  | 0.477  | 0.499  | 0.521 | 0.363 | 100.0%  | 10    |
-  | neutron.delete_network | 0.105 | 0.112  | 0.289  | 0.29   | 0.291 | 0.161 | 100.0%  | 10    |
-  | total                  | 0.411 | 0.457  | 0.766  | 0.789  | 0.812 | 0.524 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.52401685715
-  Full duration: 14.2058041096
-
-  test scenario NeutronNetworks.create_and_list_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.307 | 0.336  | 0.388  | 0.405  | 0.423 | 0.348 | 100.0%  | 10    |
-  | neutron.list_networks  | 0.043 | 0.172  | 0.242  | 0.279  | 0.316 | 0.147 | 100.0%  | 10    |
-  | total                  | 0.36  | 0.503  | 0.621  | 0.622  | 0.623 | 0.495 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.58333802223
-  Full duration: 15.9647290707
-
-  test scenario NeutronNetworks.create_and_update_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.434 | 0.497  | 0.576  | 0.576  | 0.577 | 0.499 | 100.0%  | 10    |
-  | neutron.create_router        | 0.037 | 0.173  | 0.305  | 0.36   | 0.415 | 0.158 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.294 | 0.439  | 0.504  | 0.513  | 0.522 | 0.404 | 100.0%  | 10    |
-  | neutron.update_router        | 0.131 | 0.272  | 0.316  | 0.359  | 0.402 | 0.263 | 100.0%  | 10    |
-  | total                        | 0.93  | 1.355  | 1.47   | 1.584  | 1.698 | 1.324 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.98894906044
-  Full duration: 29.5306479931
-
-  test scenario NeutronNetworks.create_and_update_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.317 | 0.356  | 0.487  | 0.489  | 0.491 | 0.377 | 100.0%  | 10    |
-  | neutron.update_network | 0.103 | 0.277  | 0.309  | 0.316  | 0.322 | 0.22  | 100.0%  | 10    |
-  | total                  | 0.421 | 0.626  | 0.787  | 0.79   | 0.793 | 0.598 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.78881001472
-  Full duration: 16.6285750866
-
-  test scenario NeutronNetworks.create_and_update_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.435 | 0.471  | 0.575  | 0.578  | 0.58  | 0.49  | 100.0%  | 10    |
-  | neutron.update_port | 0.124 | 0.245  | 0.349  | 0.375  | 0.402 | 0.237 | 100.0%  | 10    |
-  | total               | 0.565 | 0.725  | 0.912  | 0.917  | 0.922 | 0.728 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.24334001541
-  Full duration: 26.9849171638
-
-  test scenario NeutronNetworks.create_and_list_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.428 | 0.456  | 0.539  | 0.544  | 0.549 | 0.476 | 100.0%  | 10    |
-  | neutron.list_subnets  | 0.061 | 0.192  | 0.234  | 0.25   | 0.265 | 0.157 | 100.0%  | 10    |
-  | total                 | 0.498 | 0.642  | 0.77   | 0.786  | 0.803 | 0.633 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.8174021244
-  Full duration: 26.2954719067
-
-  test scenario NeutronNetworks.create_and_update_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.396 | 0.432  | 0.523  | 0.543  | 0.562 | 0.444 | 100.0%  | 10    |
-  | neutron.update_subnet | 0.157 | 0.226  | 0.355  | 0.395  | 0.434 | 0.256 | 100.0%  | 10    |
-  | total                 | 0.554 | 0.688  | 0.876  | 0.892  | 0.909 | 0.7   | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.9577729702
-  Full duration: 25.9509670734
-
-  run_rally - INFO - Test scenario: "neutron" OK.
-  run_rally - INFO - Starting test scenario "nova" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  c520ad11-229c-433c-9fbb-2ddc8152c608: started
-  Task c520ad11-229c-433c-9fbb-2ddc8152c608: finished
-
-  test scenario NovaKeypair.create_and_delete_keypair
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.423 | 0.517  | 0.708  | 1.052  | 1.396 | 0.61  | 100.0%  | 10    |
-  | nova.delete_keypair | 0.013 | 0.018  | 0.02   | 0.023  | 0.025 | 0.018 | 100.0%  | 10    |
-  | total               | 0.442 | 0.534  | 0.722  | 1.068  | 1.415 | 0.627 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.91971611977
-  Full duration: 16.1851501465
-
-  test scenario NovaServers.snapshot_server
-  +----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                        |
-  +------------------------+--------+---------+---------+---------+---------+--------+---------+-------+
-  | action                 | min    | median  | 90%ile  | 95%ile  | max     | avg    | success | count |
-  +------------------------+--------+---------+---------+---------+---------+--------+---------+-------+
-  | nova.boot_server       | 3.327  | 5.71    | 6.47    | 7.233   | 7.996   | 5.669  | 100.0%  | 10    |
-  | nova.create_image      | 35.707 | 57.482  | 68.949  | 70.89   | 72.832  | 55.735 | 100.0%  | 10    |
-  | nova.delete_server     | 2.417  | 2.639   | 3.37    | 4.016   | 4.662   | 2.931  | 100.0%  | 10    |
-  | nova.boot_server (2)   | 14.245 | 30.97   | 41.617  | 41.703  | 41.788  | 28.214 | 100.0%  | 10    |
-  | nova.delete_server (2) | 2.702  | 4.558   | 6.714   | 6.78    | 6.847   | 4.351  | 100.0%  | 10    |
-  | nova.delete_image      | 0.222  | 0.481   | 0.801   | 0.912   | 1.024   | 0.514  | 100.0%  | 10    |
-  | total                  | 61.815 | 104.063 | 118.678 | 119.932 | 121.185 | 97.414 | 100.0%  | 10    |
-  +------------------------+--------+---------+---------+---------+---------+--------+---------+-------+
-  Load duration: 270.805267096
-  Full duration: 295.748194933
-
-  test scenario NovaKeypair.boot_and_delete_server_with_keypair
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.create_keypair | 0.371 | 0.431  | 0.516  | 0.517  | 0.517  | 0.439 | 100.0%  | 10    |
-  | nova.boot_server    | 3.04  | 4.457  | 5.757  | 5.786  | 5.815  | 4.552 | 100.0%  | 10    |
-  | nova.delete_server  | 2.381 | 2.534  | 2.842  | 3.654  | 4.465  | 2.696 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.012 | 0.018  | 0.02   | 0.021  | 0.022  | 0.017 | 100.0%  | 10    |
-  | total               | 5.958 | 7.497  | 9.018  | 9.735  | 10.452 | 7.704 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 22.5302600861
-  Full duration: 46.1866869926
-
-  test scenario NovaKeypair.create_and_list_keypairs
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.414 | 0.575  | 0.631  | 0.71   | 0.789 | 0.556 | 100.0%  | 10    |
-  | nova.list_keypairs  | 0.013 | 0.018  | 0.02   | 0.021  | 0.021 | 0.018 | 100.0%  | 10    |
-  | total               | 0.433 | 0.596  | 0.649  | 0.728  | 0.808 | 0.574 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.60233187675
-  Full duration: 16.7130730152
-
-  test scenario NovaServers.list_servers
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.list_servers | 0.587 | 0.606  | 0.69   | 0.722  | 0.755 | 0.631 | 100.0%  | 10    |
-  | total             | 0.587 | 0.606  | 0.69   | 0.722  | 0.755 | 0.631 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.8859231472
-  Full duration: 50.8739178181
-
-  test scenario NovaServers.resize_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.363  | 3.918  | 6.304  | 6.779  | 7.255  | 4.596  | 100.0%  | 10    |
-  | nova.resize         | 21.13  | 26.439 | 42.015 | 42.22  | 42.424 | 29.139 | 100.0%  | 10    |
-  | nova.resize_confirm | 2.398  | 2.551  | 2.703  | 2.704  | 2.706  | 2.563  | 100.0%  | 10    |
-  | nova.delete_server  | 2.37   | 2.395  | 2.798  | 3.721  | 4.644  | 2.648  | 100.0%  | 10    |
-  | total               | 29.822 | 34.933 | 54.227 | 54.69  | 55.153 | 38.945 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 114.259507179
-  Full duration: 128.127579927
-
-  test scenario NovaServers.boot_server_from_volume_and_delete
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 3.235  | 5.567  | 6.045  | 6.052  | 6.06   | 4.919  | 100.0%  | 10    |
-  | nova.boot_server     | 8.307  | 9.5    | 12.422 | 13.056 | 13.69  | 9.862  | 100.0%  | 10    |
-  | nova.delete_server   | 4.461  | 4.62   | 4.671  | 4.692  | 4.714  | 4.589  | 100.0%  | 10    |
-  | total                | 16.186 | 19.059 | 22.977 | 23.551 | 24.126 | 19.371 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 56.1163849831
-  Full duration: 87.4642381668
-
-  test scenario NovaServers.boot_and_migrate_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.453  | 4.707  | 6.199  | 6.246  | 6.293  | 4.887  | 100.0%  | 10    |
-  | nova.stop_server    | 4.627  | 5.136  | 15.964 | 16.161 | 16.358 | 9.106  | 100.0%  | 10    |
-  | nova.migrate        | 14.455 | 16.394 | 25.486 | 26.426 | 27.366 | 18.474 | 100.0%  | 10    |
-  | nova.resize_confirm | 2.376  | 2.404  | 2.575  | 2.612  | 2.649  | 2.458  | 100.0%  | 10    |
-  | nova.delete_server  | 2.351  | 2.377  | 2.42   | 2.479  | 2.538  | 2.394  | 100.0%  | 10    |
-  | total               | 29.051 | 37.529 | 44.149 | 47.114 | 50.08  | 37.32  | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 101.067945957
-  Full duration: 115.384446144
-
-  test scenario NovaServers.boot_and_delete_server
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server   | 3.655 | 6.711  | 7.36   | 7.385  | 7.41   | 6.243  | 100.0%  | 10    |
-  | nova.delete_server | 2.362 | 4.587  | 4.739  | 4.809  | 4.879  | 4.013  | 100.0%  | 10    |
-  | total              | 6.017 | 10.937 | 11.962 | 12.02  | 12.078 | 10.256 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 29.3568899632
-  Full duration: 52.9771959782
-
-  test scenario NovaServers.boot_and_rebuild_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.859  | 4.72   | 6.26   | 6.315  | 6.369  | 5.06   | 100.0%  | 10    |
-  | nova.rebuild_server | 6.283  | 7.559  | 9.599  | 12.803 | 16.006 | 8.2    | 100.0%  | 10    |
-  | nova.delete_server  | 2.37   | 2.551  | 4.527  | 4.582  | 4.638  | 3.088  | 100.0%  | 10    |
-  | total               | 13.383 | 16.01  | 18.944 | 20.596 | 22.249 | 16.348 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 55.2873470783
-  Full duration: 79.1774559021
-
-  test scenario NovaSecGroup.create_and_list_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 1.595  | 1.928  | 2.017  | 2.036  | 2.055  | 1.891  | 100.0%  | 10    |
-  | nova.create_100_rules          | 9.581  | 10.462 | 10.693 | 10.803 | 10.913 | 10.36  | 100.0%  | 10    |
-  | nova.list_security_groups      | 0.136  | 0.189  | 0.245  | 0.272  | 0.299  | 0.198  | 100.0%  | 10    |
-  | total                          | 11.447 | 12.553 | 12.839 | 12.881 | 12.923 | 12.449 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 36.6872730255
-  Full duration: 63.5205390453
-
-  test scenario NovaSecGroup.create_and_delete_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 1.492  | 1.946  | 2.157  | 2.214  | 2.271  | 1.932  | 100.0%  | 10    |
-  | nova.create_100_rules          | 9.298  | 10.497 | 10.608 | 10.624 | 10.64  | 10.256 | 100.0%  | 10    |
-  | nova.delete_10_security_groups | 0.783  | 1.061  | 1.126  | 1.132  | 1.138  | 1.005  | 100.0%  | 10    |
-  | total                          | 11.788 | 13.418 | 13.784 | 13.788 | 13.793 | 13.194 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 38.9264039993
-  Full duration: 53.6155569553
-
-  test scenario NovaServers.boot_and_bounce_server
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  | action                  | min    | median | 90%ile | 95%ile  | max     | avg    | success | count |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  | nova.boot_server        | 3.546  | 5.034  | 5.948  | 6.012   | 6.077   | 4.964  | 100.0%  | 10    |
-  | nova.reboot_server      | 2.449  | 4.78   | 6.939  | 6.961   | 6.984   | 5.332  | 100.0%  | 10    |
-  | nova.soft_reboot_server | 6.583  | 6.718  | 18.85  | 72.219  | 125.589 | 18.596 | 100.0%  | 10    |
-  | nova.stop_server        | 4.622  | 4.796  | 15.736 | 15.861  | 15.986  | 6.96   | 100.0%  | 10    |
-  | nova.start_server       | 2.662  | 2.828  | 3.001  | 3.04    | 3.078   | 2.849  | 100.0%  | 10    |
-  | nova.rescue_server      | 6.77   | 15.566 | 17.493 | 17.544  | 17.595  | 12.874 | 100.0%  | 10    |
-  | nova.unrescue_server    | 2.291  | 4.444  | 4.571  | 4.583   | 4.596   | 3.643  | 100.0%  | 10    |
-  | nova.delete_server      | 2.372  | 2.397  | 2.507  | 2.528   | 2.55    | 2.424  | 100.0%  | 10    |
-  | total                   | 35.205 | 49.523 | 70.623 | 110.831 | 151.04  | 57.653 | 100.0%  | 10    |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  Load duration: 193.802706003
-  Full duration: 217.975458145
-
-  test scenario NovaServers.boot_server
-  +--------------------------------------------------------------------------------------+
-  |                                 Response Times (sec)                                 |
-  +------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | action           | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server | 3.41 | 4.816  | 6.024  | 6.056  | 6.089 | 4.692 | 100.0%  | 10    |
-  | total            | 3.41 | 4.816  | 6.024  | 6.057  | 6.089 | 4.692 | 100.0%  | 10    |
-  +------------------+------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 13.1493849754
-  Full duration: 37.5227308273
-
-  test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-  +----------------------------------------------------------------------------------------------------------+
-  |                                           Response Times (sec)                                           |
-  +-----------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-----------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups    | 1.487 | 1.851  | 2.252  | 2.299  | 2.345  | 1.876  | 100.0%  | 10    |
-  | nova.create_100_rules             | 9.079 | 10.618 | 10.831 | 10.864 | 10.897 | 10.241 | 100.0%  | 10    |
-  | nova.boot_server                  | 4.315 | 4.525  | 5.609  | 5.629  | 5.649  | 4.901  | 100.0%  | 10    |
-  | nova.get_attached_security_groups | 0.137 | 0.156  | 0.289  | 0.312  | 0.334  | 0.183  | 100.0%  | 10    |
-  | nova.delete_server                | 2.381 | 2.417  | 2.572  | 2.663  | 2.754  | 2.47   | 100.0%  | 10    |
-  | nova.delete_10_security_groups    | 0.844 | 1.033  | 1.131  | 1.171  | 1.212  | 1.021  | 100.0%  | 10    |
-  | total                             | 18.91 | 21.054 | 21.677 | 21.936 | 22.195 | 20.692 | 100.0%  | 10    |
-  +-----------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 61.2168090343
-  Full duration: 85.7305738926
-
-  test scenario NovaServers.pause_and_unpause_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.337  | 5.865  | 6.135  | 6.166  | 6.198  | 5.184  | 100.0%  | 10    |
-  | nova.pause_server   | 2.311  | 2.468  | 2.511  | 2.528  | 2.545  | 2.422  | 100.0%  | 10    |
-  | nova.unpause_server | 2.306  | 2.47   | 2.538  | 2.548  | 2.558  | 2.441  | 100.0%  | 10    |
-  | nova.delete_server  | 2.37   | 2.623  | 4.832  | 4.882  | 4.932  | 3.392  | 100.0%  | 10    |
-  | total               | 10.861 | 13.388 | 15.614 | 15.649 | 15.684 | 13.439 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 39.8893749714
-  Full duration: 65.2461550236
-
-  test scenario NovaServers.boot_server_from_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 3.172  | 3.51   | 6.009  | 6.055  | 6.102  | 4.387  | 100.0%  | 10    |
-  | nova.boot_server     | 7.575  | 8.761  | 11.062 | 12.16  | 13.258 | 9.396  | 100.0%  | 10    |
-  | total                | 10.812 | 12.565 | 17.043 | 18.063 | 19.083 | 13.783 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 40.4101068974
-  Full duration: 76.4117758274
-
-  test scenario NovaServers.boot_and_list_server
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server  | 3.891 | 4.847  | 6.169  | 6.267  | 6.365 | 5.093 | 100.0%  | 10    |
-  | nova.list_servers | 0.163 | 0.201  | 0.418  | 0.475  | 0.533 | 0.268 | 100.0%  | 10    |
-  | total             | 4.296 | 5.066  | 6.393  | 6.646  | 6.899 | 5.361 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 15.2852530479
-  Full duration: 50.1823370457
-
-  run_rally - INFO - Test scenario: "nova" OK.
-  run_rally - INFO - Starting test scenario "quotas" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  4d0fc176-8b72-4789-8249-7ca3ed815669: started
-  Task 4d0fc176-8b72-4789-8249-7ca3ed815669: finished
-
-  test scenario Quotas.cinder_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.591 | 0.621  | 0.669  | 0.672  | 0.674 | 0.626 | 100.0%  | 10    |
-  | total                | 0.591 | 0.621  | 0.669  | 0.672  | 0.674 | 0.626 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.86674189568
-  Full duration: 7.90543198586
-
-  test scenario Quotas.neutron_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.243 | 0.257  | 0.271  | 0.271  | 0.271 | 0.258 | 100.0%  | 10    |
-  | total                | 0.308 | 0.328  | 0.36   | 0.367  | 0.374 | 0.331 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.996067047119
-  Full duration: 6.61853408813
-
-  test scenario Quotas.cinder_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.568 | 0.604  | 0.623  | 0.677  | 0.732 | 0.611 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.415 | 0.442  | 0.477  | 0.501  | 0.526 | 0.449 | 100.0%  | 10    |
-  | total                | 0.992 | 1.049  | 1.142  | 1.165  | 1.188 | 1.06  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.19247508049
-  Full duration: 9.27472686768
-
-  test scenario Quotas.nova_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.323 | 0.35   | 0.371  | 0.38   | 0.39  | 0.349 | 100.0%  | 7     |
-  | quotas.delete_quotas | 0.02  | 0.021  | 0.023  | 0.024  | 0.025 | 0.022 | 71.4%   | 7     |
-  | total                | 0.344 | 0.369  | 0.378  | 0.378  | 0.379 | 0.363 | 71.4%   | 7     |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.752856969833
-  Full duration: 6.31551885605
-
-  test scenario Quotas.nova_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.307 | 0.354  | 0.396  | 0.43   | 0.463 | 0.361 | 100.0%  | 10    |
-  | total                | 0.307 | 0.354  | 0.396  | 0.43   | 0.463 | 0.361 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.06656098366
-  Full duration: 6.7101290226
-
-  run_rally - INFO - Test scenario: "quotas" Failed.
-  run_rally - INFO - Starting test scenario "requests" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  16778409-ff5d-4254-aa3b-b80de677272e: started
-  Task 16778409-ff5d-4254-aa3b-b80de677272e: finished
-
-  test scenario HttpRequests.check_random_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 5.446 | 5.5    | 5.982  | 5.983  | 5.984 | 5.611 | 100.0%  | 10    |
-  | total                  | 5.446 | 5.5    | 5.982  | 5.983  | 5.984 | 5.611 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.9417049885
-  Full duration: 19.4220340252
-
-  test scenario HttpRequests.check_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 5.459 | 5.479  | 5.494  | 5.501  | 5.508 | 5.478 | 100.0%  | 10    |
-  | total                  | 5.459 | 5.479  | 5.494  | 5.501  | 5.508 | 5.478 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.4412920475
-  Full duration: 18.8327140808
-
-  run_rally - INFO - Test scenario: "requests" OK.
-  run_rally - INFO -
-
-                       Rally Summary Report
-  +===================+============+===============+===========+
-  | Module            | Duration   | nb. Test Run  | Success   |
-  +===================+============+===============+===========+
-  | authenticate      | 00:18      | 10            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | glance            | 01:28      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | cinder            | 16:35      | 50            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | heat              | 06:24      | 32            | 92.31%    |
-  +-------------------+------------+---------------+-----------+
-  | keystone          | 01:10      | 29            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | neutron           | 04:48      | 31            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | nova              | 25:39      | 61            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | quotas            | 00:36      | 7             | 94.28%    |
-  +-------------------+------------+---------------+-----------+
-  | requests          | 00:38      | 2             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  +===================+============+===============+===========+
-  | TOTAL:            | 00:57:39   | 229           | 98.51%    |
-  +===================+============+===============+===========+
-
-
-SDN Controller
---------------
-
-ODL
-^^^
-::
-
-  ==============================================================================
-  Basic
-  ==============================================================================
-  Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-  ==============================================================================
-  Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-  ------------------------------------------------------------------------------
-  Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-  1 critical test, 1 passed, 0 failed
-  1 test total, 1 passed, 0 failed
-  ==============================================================================
-  Basic                                                                 | PASS |
-  1 critical test, 1 passed, 0 failed
-  1 test total, 1 passed, 0 failed
-  ==============================================================================
-  Output:  /home/opnfv/output.xml
-  Log:     /home/opnfv/log.html
-  Report:  /home/opnfv/report.html
-  ==============================================================================
-  Neutron :: Test suite for Neutron Plugin
-  ==============================================================================
-  Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-  ==============================================================================
-  Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-  ------------------------------------------------------------------------------
-  Create Network :: Create new network in OpenStack                     | PASS |
-  ------------------------------------------------------------------------------
-  Check Network :: Check Network created in OpenDaylight                | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
-  4 critical tests, 4 passed, 0 failed
-  4 tests total, 4 passed, 0 failed
-  ==============================================================================
-  Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-  ==============================================================================
-  Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-  ------------------------------------------------------------------------------
-  Create New subnet :: Create new subnet in OpenStack                   | PASS |
-  ------------------------------------------------------------------------------
-  Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
-  4 critical tests, 4 passed, 0 failed
-  4 tests total, 4 passed, 0 failed
-  ==============================================================================
-  Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-  ==============================================================================
-  Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-  ------------------------------------------------------------------------------
-  Create New Port :: Create new port in OpenStack                       | PASS |
-  ------------------------------------------------------------------------------
-  Check New Port :: Check new subnet created in OpenDaylight            | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
-  4 critical tests, 4 passed, 0 failed
-  4 tests total, 4 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-  ==============================================================================
-  Delete New Port :: Delete previously created port in OpenStack        | PASS |
-  ------------------------------------------------------------------------------
-  Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-  ==============================================================================
-  Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-  ------------------------------------------------------------------------------
-  Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-  ==============================================================================
-  Delete Network :: Delete network in OpenStack                         | PASS |
-  ------------------------------------------------------------------------------
-  Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron :: Test suite for Neutron Plugin                              | PASS |
-  18 critical tests, 18 passed, 0 failed
-  18 tests total, 18 passed, 0 failed
-
-
-Feature tests
--------------
-
-vIMS
-^^^^
-::
-
-  FUNCTEST.info: Running vIMS test...
-  vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-  vIMS - INFO - Update OpenStack creds informations
-  vIMS - INFO - Upload some OS images if it doesn't exist
-  vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                              Try downloading this image and upload on glance !
-  vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                              Try downloading this image and upload on glance !
-  vIMS - INFO - Update security group quota for this tenant
-  vIMS - INFO - Update cinder quota for this tenant
-  vIMS - INFO - Collect flavor id for cloudify manager server
-  vIMS - INFO - Prepare virtualenv for cloudify-cli
-  vIMS - INFO - Downloading the cloudify manager server blueprint
-  vIMS - INFO - Cloudify deployment Start Time:'2016-02-22 22:37:41'
-  vIMS - INFO - Writing the inputs file
-  vIMS - INFO - Launching the cloudify-manager deployment
-  vIMS - INFO - Cloudify-manager server is UP !
-  vIMS - INFO - Cloudify deployment duration:'745.0'
-  vIMS - INFO - Collect flavor id for all clearwater vm
-  vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-22 22:50:07'
-  vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-  vIMS - INFO - Writing the inputs file
-  vIMS - INFO - Launching the clearwater deployment
-  vIMS - INFO - The deployment of clearwater-opnfv is ended
-  vIMS - INFO - vIMS VNF deployment duration:'633.6'
-  vIMS - INFO - vIMS functional test Start Time:'2016-02-22 23:03:48'
-  vIMS - INFO - vIMS functional test duration:'4.1'
-  vIMS - INFO - Launching the clearwater-opnfv undeployment
-  vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-  vIMS - INFO - Launching the cloudify-manager undeployment
-  vIMS - INFO - Cloudify-manager server has been successfully removed!
-  vIMS - INFO - Removing vIMS tenant ..
-  vIMS - INFO - Removing vIMS user ..
diff --git a/docs/results/compass-os-onos-nofeature-ha.rst b/docs/results/compass-os-onos-nofeature-ha.rst
deleted file mode 100644 (file)
index 87103c3..0000000
+++ /dev/null
@@ -1,2118 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for compass-os-onos-nofeature-ha
-------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-SSH test...
-  vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_ssh- INFO - Creating neutron network vping-net...
-  vPing_ssh- INFO - Creating security group  'vPing-sg'...
-  vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-  vPing_ssh- INFO - vPing Start Time:'2016-02-22 16:24:22'
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=defb6423-f831-4d2e-8a46-21171b471811
-   network=47a5262f-1252-4ceb-b054-4d81216c1510
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=defb6423-f831-4d2e-8a46-21171b471811
-   network=47a5262f-1252-4ceb-b054-4d81216c1510
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-  vPing_ssh- INFO - Floating IP created: '192.168.10.102'
-  vPing_ssh- INFO - Associating floating ip: '192.168.10.102' to VM 'opnfv-vping-2'
-  vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.102...
-  vPing_ssh- INFO - Waiting for ping...
-  vPing_ssh- INFO - vPing detected!
-  vPing_ssh- INFO - vPing duration:'262.5' s.
-  vPing_ssh- INFO - Cleaning up...
-  vPing_ssh- INFO - vPing OK
-
-Tempest
-^^^^^^^
-::
-
-  FUNCTEST.info: Running Tempest tests...
-  run_tempest - INFO - Creating tenant and user for Tempest suite
-  2016-02-22 16:28:55.743 23855 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
-  2016-02-22 16:29:00.285 23855 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
-
-  run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
-  Total results of verification:
-
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | ac98ac8a-e502-4828-ad00-5b6b9428c346 | 55a7fc58-ad0f-475c-88c7-369043ae2719 |          | 210   | 11       | 2016-02-22 16:29:01.778060 | finished |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-
-  Tests:
-
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | name                                                                                                                                     | time      | status  |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.38607   | success |
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.74194   | success |
-  | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 8.91734   | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 8.66925   | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 10.63581  | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.06276   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.05257   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.05940   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.12623   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.06809   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.09008   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.06098   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.07950   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.05546   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.12715   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.12835   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.10113   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.06587   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.17079   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.11263   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.06114   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.52524   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 0.45980   | success |
-  | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 0.95973   | success |
-  | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 7.95218   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 302.25007 | fail    |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.10296   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.18670   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 342.44729 | fail    |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00068   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 311.26623 | fail    |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.11079   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.20087   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 342.41636 | fail    |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.00101   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.07243   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 6.46736   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.16392   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.27404   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.17996   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 1.07085   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.17853   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.10615   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.09603   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.09373   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.09520   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.12248   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.51307   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00065   | skip    |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.14353   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.06854   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.01693   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.06418   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.06254   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.01346   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01475   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.03419   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.06726   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.04958   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.26188   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.01624   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.06862   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00048   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 7.97654   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 11.64967  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 310.79753 | fail    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.46854   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 326.22117 | fail    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 12.06790  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 19.04478  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 7.05743   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.07867   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.20214   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.59746   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.34277   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.33642   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.57047   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.60103   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.75531   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 2.75731   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 9.46973   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 13.28125  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 7.11541   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 7.96344   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 0.67669   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 1.77693   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 0.75065   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 1.78955   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 0.64498   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 1.71157   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 0.53460   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.49832   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.57201   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.46864   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 0.66619   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.72274   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.40295   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.58226   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.34041   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 0.75975   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.43415   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 0.42859   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 1.21474   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 1.25222   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.41021   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.09081   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.02184   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.96806   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.01307   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.46717   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.05568   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.09471   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.03604   | success |
-  | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 340.34367 | fail    |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.43241   | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.11064   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.11956   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.01137   | success |
-  | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.16401   | success |
-  | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.05961   | success |
-  | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.10927   | success |
-  | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.02540   | success |
-  | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.28040   | success |
-  | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.14755   | success |
-  | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.77153   | success |
-  | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.12106   | success |
-  | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.08473   | success |
-  | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.12668   | success |
-  | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.14400   | success |
-  | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 0.91996   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.05010   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.02297   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.04885   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.01587   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01260   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.01445   | success |
-  | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.04696   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 0.60138   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 0.21576   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 0.42759   | success |
-  | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 0.49116   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 0.79505   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 0.70780   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 0.56456   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 1.10523   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 3.54869   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 0.83123   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 1.58383   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 1.36920   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 1.08591   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.19026   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.07493   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.06495   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.02942   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.03500   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 1.05982   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.15572   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.10990   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.09926   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.04061   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.03720   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 1.04510   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 1.34649   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 0.59530   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.05189   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.04790   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.14770   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 1.11571   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 0.75502   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.04674   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.08023   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 3.25659   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 1.59393   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 1.18965   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 1.03248   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 2.64680   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 2.09130   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 1.43383   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 1.25843   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 0.66808   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 0.46888   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.03378   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 0.36912   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 0.76166   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.02877   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.36667   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 5.11422   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.02366   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.58931   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.43084   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.29860   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.48701   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.84124   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.35246   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.35082   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.02341   | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 0.86551   | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 1.65927   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.12480   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.76915   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 12.56546  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 9.57875   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 11.23806  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 11.53830  | success |
-  | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.09463   | success |
-  | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.38766   | success |
-  | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 358.88405 | fail    |
-  | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 327.24468 | fail    |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 327.82000 | fail    |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 500.15877 | fail    |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  run_tempest - INFO - Results: {'timestart': '2016-02-2216:29:01.778060', 'duration': 1082, 'tests': 210, 'failures': 11}
-  run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
-  run_tempest - INFO - Deleting tenant and user for Tempest suite)
-
-
-Rally
-^^^^^
-::
-
-  FUNCTEST.info: Running Rally benchmark suite...
-  run_rally - INFO - Starting test scenario "authenticate" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  2944fcc5-089f-4ed8-851f-446508c45024: started
-  Task 2944fcc5-089f-4ed8-851f-446508c45024: finished
-
-  test scenario Authenticate.validate_glance
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_glance     | 0.122 | 0.162  | 0.216  | 0.225  | 0.234 | 0.169 | 100.0%  | 10    |
-  | authenticate.validate_glance (2) | 0.039 | 0.042  | 0.052  | 0.072  | 0.092 | 0.047 | 100.0%  | 10    |
-  | total                            | 0.258 | 0.3    | 0.34   | 0.34   | 0.341 | 0.299 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.893048048019
-  Full duration: 3.09276199341
-
-  test scenario Authenticate.keystone
-  +-----------------------------------------------------------------------------+
-  |                            Response Times (sec)                             |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | total  | 0.066 | 0.072  | 0.074  | 0.074  | 0.074 | 0.071 | 100.0%  | 10    |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.233579874039
-  Full duration: 2.32735109329
-
-  test scenario Authenticate.validate_heat
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_heat     | 0.113 | 0.133  | 0.255  | 0.267  | 0.28  | 0.161 | 100.0%  | 10    |
-  | authenticate.validate_heat (2) | 0.021 | 0.09   | 0.147  | 0.163  | 0.179 | 0.085 | 100.0%  | 10    |
-  | total                          | 0.254 | 0.338  | 0.389  | 0.402  | 0.415 | 0.327 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.968546152115
-  Full duration: 3.10294985771
-
-  test scenario Authenticate.validate_nova
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_nova     | 0.111 | 0.119  | 0.17   | 0.179  | 0.187 | 0.133 | 100.0%  | 10    |
-  | authenticate.validate_nova (2) | 0.023 | 0.035  | 0.042  | 0.048  | 0.054 | 0.036 | 100.0%  | 10    |
-  | total                          | 0.214 | 0.225  | 0.291  | 0.291  | 0.292 | 0.243 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.725472211838
-  Full duration: 2.86061501503
-
-  test scenario Authenticate.validate_cinder
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_cinder     | 0.098 | 0.112  | 0.138  | 0.14   | 0.143 | 0.118 | 100.0%  | 10    |
-  | authenticate.validate_cinder (2) | 0.058 | 0.071  | 0.077  | 0.078  | 0.078 | 0.07  | 100.0%  | 10    |
-  | total                            | 0.221 | 0.256  | 0.312  | 0.313  | 0.313 | 0.267 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.797883033752
-  Full duration: 2.91927695274
-
-  test scenario Authenticate.validate_neutron
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_neutron     | 0.108 | 0.124  | 0.192  | 0.195  | 0.198 | 0.138 | 100.0%  | 10    |
-  | authenticate.validate_neutron (2) | 0.028 | 0.08   | 0.102  | 0.102  | 0.102 | 0.074 | 100.0%  | 10    |
-  | total                             | 0.207 | 0.273  | 0.346  | 0.353  | 0.359 | 0.281 | 100.0%  | 10    |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.847912073135
-  Full duration: 3.07389783859
-
-  run_rally - INFO - Test scenario: "authenticate" OK.
-
-  run_rally - INFO - Starting test scenario "glance" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  2fff3869-9689-44d4-b372-dd41fa2a38ec: started
-  Task 2fff3869-9689-44d4-b372-dd41fa2a38ec: finished
-
-  test scenario GlanceImages.list_images
-  +---------------------------------------------------------------------------------------+
-  |                                 Response Times (sec)                                  |
-  +--------------------+-------+--------+--------+--------+-----+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-----+-------+---------+-------+
-  | glance.list_images | 0.177 | 0.232  | 0.296  | 0.298  | 0.3 | 0.241 | 100.0%  | 10    |
-  | total              | 0.177 | 0.232  | 0.296  | 0.298  | 0.3 | 0.241 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-----+-------+---------+-------+
-  Load duration: 0.697636127472
-  Full duration: 3.5939040184
-
-  test scenario GlanceImages.create_image_and_boot_instances
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | glance.create_image | 2.763 | 2.903  | 3.45   | 3.45   | 3.45   | 3.052 | 100.0%  | 10    |
-  | nova.boot_servers   | 4.51  | 6.909  | 7.772  | 7.907  | 8.042  | 6.735 | 100.0%  | 10    |
-  | total               | 7.273 | 10.244 | 10.662 | 10.752 | 10.842 | 9.787 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 28.153493166
-  Full duration: 53.9921939373
-
-  test scenario GlanceImages.create_and_list_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 3.066 | 3.262  | 3.685  | 3.718  | 3.751 | 3.328 | 100.0%  | 10    |
-  | glance.list_images  | 0.04  | 0.047  | 0.059  | 0.063  | 0.066 | 0.049 | 100.0%  | 10    |
-  | total               | 3.107 | 3.324  | 3.734  | 3.767  | 3.8   | 3.376 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.83786201477
-  Full duration: 14.2525467873
-
-  test scenario GlanceImages.create_and_delete_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 2.758 | 3.01   | 3.624  | 3.641  | 3.658 | 3.096 | 100.0%  | 10    |
-  | glance.delete_image | 0.119 | 0.159  | 0.282  | 0.338  | 0.394 | 0.189 | 100.0%  | 10    |
-  | total               | 2.887 | 3.164  | 3.878  | 3.884  | 3.89  | 3.285 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.57883381844
-  Full duration: 12.357642889
-
-  run_rally - INFO - Test scenario: "glance" OK.
-
-  run_rally - INFO - Starting test scenario "cinder" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  76a5a912-68db-4001-b4a1-9beac5ae37ea: started
-  Task 76a5a912-68db-4001-b4a1-9beac5ae37ea: finished
-
-  test scenario CinderVolumes.create_and_attach_volume
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.boot_server     | 3.805  | 4.389  | 5.707  | 6.126  | 6.546  | 4.733 | 100.0%  | 10    |
-  | cinder.create_volume | 2.687  | 2.841  | 2.929  | 2.954  | 2.978  | 2.833 | 100.0%  | 10    |
-  | nova.attach_volume   | 7.618  | 7.963  | 8.416  | 9.348  | 10.28  | 8.167 | 100.0%  | 10    |
-  | nova.detach_volume   | 2.997  | 3.285  | 5.265  | 5.314  | 5.362  | 3.992 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.425  | 2.506  | 2.557  | 2.658  | 2.759  | 2.516 | 100.0%  | 10    |
-  | nova.delete_server   | 2.379  | 2.447  | 2.618  | 2.639  | 2.659  | 2.478 | 100.0%  | 10    |
-  | total                | 23.106 | 25.014 | 25.886 | 26.355 | 26.825 | 24.72 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 75.3569400311
-  Full duration: 87.994022131
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 5.261 | 5.355  | 5.486  | 5.512  | 5.539 | 5.367 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.069 | 0.121  | 0.135  | 0.151  | 0.168 | 0.12  | 100.0%  | 10    |
-  | total                | 5.351 | 5.501  | 5.595  | 5.626  | 5.658 | 5.487 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.505685091
-  Full duration: 27.6703879833
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.758 | 2.928  | 3.178  | 3.185  | 3.192 | 2.955 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.11  | 0.124  | 0.158  | 0.159  | 0.161 | 0.128 | 100.0%  | 10    |
-  | total                | 2.878 | 3.071  | 3.319  | 3.327  | 3.334 | 3.084 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.14664101601
-  Full duration: 20.325412035
-
-  test scenario CinderVolumes.create_and_list_snapshots
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.401 | 2.521  | 2.599  | 2.615  | 2.632 | 2.517 | 100.0%  | 10    |
-  | cinder.list_snapshots  | 0.022 | 0.083  | 0.12   | 0.15   | 0.18  | 0.089 | 100.0%  | 10    |
-  | total                  | 2.474 | 2.588  | 2.729  | 2.753  | 2.776 | 2.606 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 7.73569321632
-  Full duration: 31.2840220928
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.796 | 2.999  | 3.144  | 3.15   | 3.156 | 2.996 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.455 | 2.614  | 2.708  | 2.725  | 2.742 | 2.616 | 100.0%  | 10    |
-  | total                | 5.328 | 5.602  | 5.851  | 5.868  | 5.885 | 5.612 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.477782011
-  Full duration: 22.7058889866
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.919 | 5.48   | 5.628  | 5.639  | 5.649 | 5.227 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.526 | 2.693  | 2.72   | 2.755  | 2.79  | 2.663 | 100.0%  | 10    |
-  | total                | 5.62  | 8.087  | 8.341  | 8.375  | 8.409 | 7.89  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.1292200089
-  Full duration: 30.4960770607
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.85  | 2.948  | 3.049  | 3.07   | 3.09  | 2.953 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.464 | 2.529  | 2.614  | 2.615  | 2.615 | 2.54  | 100.0%  | 10    |
-  | total                | 5.325 | 5.506  | 5.652  | 5.656  | 5.661 | 5.493 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.3896708488
-  Full duration: 22.6766388416
-
-  test scenario CinderVolumes.create_and_upload_volume_to_image
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume          | 2.872  | 3.051  | 3.667  | 3.678  | 3.688  | 3.15   | 100.0%  | 10    |
-  | cinder.upload_volume_to_image | 28.915 | 62.489 | 77.495 | 77.616 | 77.736 | 60.612 | 100.0%  | 10    |
-  | cinder.delete_volume          | 2.362  | 2.491  | 2.538  | 2.611  | 2.684  | 2.494  | 100.0%  | 10    |
-  | nova.delete_image             | 0.209  | 0.455  | 0.893  | 0.906  | 0.919  | 0.514  | 100.0%  | 10    |
-  | total                         | 35.229 | 68.483 | 83.109 | 83.228 | 83.346 | 66.77  | 100.0%  | 10    |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 193.43104291
-  Full duration: 200.303003073
-
-  test scenario CinderVolumes.create_and_delete_snapshot
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.422 | 2.503  | 2.568  | 2.571  | 2.575 | 2.507 | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.313 | 2.444  | 2.482  | 2.492  | 2.501 | 2.427 | 100.0%  | 10    |
-  | total                  | 4.793 | 4.964  | 5.013  | 5.018  | 5.024 | 4.935 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.7233128548
-  Full duration: 33.1759068966
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.844 | 2.948  | 3.269  | 3.319  | 3.369 | 3.015 | 100.0%  | 10    |
-  | total                | 2.844 | 2.948  | 3.269  | 3.319  | 3.369 | 3.015 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 8.9167098999
-  Full duration: 18.3895540237
-
-  test scenario CinderVolumes.create_volume
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | cinder.create_volume | 2.854 | 2.953  | 3.096  | 3.121  | 3.146 | 2.98 | 100.0%  | 10    |
-  | total                | 2.854 | 2.953  | 3.096  | 3.121  | 3.146 | 2.98 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 8.90475797653
-  Full duration: 20.1169910431
-
-  test scenario CinderVolumes.list_volumes
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.list_volumes | 0.228 | 0.266  | 0.286  | 0.317  | 0.348 | 0.268 | 100.0%  | 10    |
-  | total               | 0.228 | 0.266  | 0.287  | 0.317  | 0.348 | 0.268 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.792151927948
-  Full duration: 47.0951080322
-
-  test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.829  | 2.905  | 2.967  | 2.969  | 2.971  | 2.899  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.302  | 2.402  | 2.432  | 2.455  | 2.478  | 2.392  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.72   | 7.953  | 11.462 | 12.036 | 12.61  | 8.943  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.903  | 4.153  | 5.343  | 5.534  | 5.724  | 4.179  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.258  | 2.311  | 2.403  | 2.446  | 2.49   | 2.331  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.387  | 2.497  | 2.6    | 2.623  | 2.647  | 2.496  | 100.0%  | 10    |
-  | total                  | 21.145 | 23.329 | 26.38  | 26.678 | 26.977 | 23.543 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 68.2392091751
-  Full duration: 106.915300131
-
-  test scenario CinderVolumes.create_from_volume_and_delete_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 7.712  | 12.285 | 17.231 | 18.187 | 19.144 | 12.995 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.494  | 2.633  | 4.76   | 4.808  | 4.856  | 3.025  | 100.0%  | 10    |
-  | total                | 10.216 | 16.032 | 19.868 | 20.756 | 21.645 | 16.019 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 44.5057139397
-  Full duration: 63.1546430588
-
-  test scenario CinderVolumes.create_and_extend_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 2.887 | 2.994  | 3.283  | 3.324  | 3.364 | 3.038 | 100.0%  | 10    |
-  | cinder.extend_volume | 2.593 | 2.748  | 2.812  | 2.924  | 3.037 | 2.754 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.417 | 2.569  | 2.707  | 2.724  | 2.74  | 2.562 | 100.0%  | 10    |
-  | total                | 8.03  | 8.369  | 8.538  | 8.631  | 8.723 | 8.353 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.8781170845
-  Full duration: 31.6701009274
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.736  | 2.972  | 3.155  | 3.173  | 3.19   | 2.98   | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.321  | 2.38   | 2.392  | 2.399  | 2.406  | 2.369  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.503  | 7.861  | 12.563 | 13.795 | 15.028 | 9.196  | 100.0%  | 10    |
-  | nova.detach_volume     | 3.269  | 5.314  | 5.356  | 5.366  | 5.375  | 4.908  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.21   | 2.305  | 2.435  | 2.442  | 2.45   | 2.323  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.413  | 2.499  | 2.584  | 2.597  | 2.611  | 2.505  | 100.0%  | 10    |
-  | total                  | 21.356 | 23.78  | 28.296 | 29.607 | 30.917 | 24.594 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 70.9472367764
-  Full duration: 114.492169142
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.736  | 2.845  | 3.037  | 3.081  | 3.125  | 2.876  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.343  | 2.399  | 2.462  | 2.479  | 2.495  | 2.405  | 100.0%  | 10    |
-  | nova.attach_volume     | 7.59   | 7.737  | 13.073 | 16.133 | 19.193 | 9.585  | 100.0%  | 10    |
-  | nova.detach_volume     | 2.916  | 5.205  | 5.382  | 5.39   | 5.397  | 4.608  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.203  | 2.364  | 2.427  | 2.455  | 2.483  | 2.347  | 100.0%  | 10    |
-  | cinder.delete_volume   | 2.421  | 2.547  | 2.613  | 2.662  | 2.71   | 2.55   | 100.0%  | 10    |
-  | total                  | 21.034 | 23.722 | 27.391 | 31.314 | 35.237 | 24.898 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 73.5739891529
-  Full duration: 116.225493908
-
-  run_rally - INFO - Test scenario: "cinder" OK.
-
-  run_rally - INFO - Starting test scenario "heat" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  c9827201-74f8-41fc-8510-938cca773ec1: started
-  Task c9827201-74f8-41fc-8510-938cca773ec1: finished
-
-  test scenario HeatStacks.create_suspend_resume_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack  | 2.872 | 3.106  | 3.406  | 3.484  | 3.562 | 3.155 | 100.0%  | 10    |
-  | heat.suspend_stack | 0.442 | 0.625  | 1.717  | 1.738  | 1.759 | 0.931 | 100.0%  | 10    |
-  | heat.resume_stack  | 0.537 | 1.658  | 1.746  | 1.816  | 1.886 | 1.424 | 100.0%  | 10    |
-  | heat.delete_stack  | 0.502 | 1.432  | 1.591  | 1.6    | 1.609 | 1.362 | 100.0%  | 10    |
-  | total              | 5.462 | 6.793  | 8.103  | 8.346  | 8.589 | 6.872 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 19.5646238327
-  Full duration: 22.7670919895
-
-  test scenario HeatStacks.create_and_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.903 | 3.075  | 3.47   | 3.485  | 3.501 | 3.168 | 100.0%  | 10    |
-  | heat.delete_stack | 0.399 | 1.444  | 1.664  | 1.668  | 1.672 | 1.316 | 100.0%  | 10    |
-  | total             | 3.367 | 4.479  | 4.942  | 5.031  | 5.12  | 4.484 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 13.5260851383
-  Full duration: 16.6767499447
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 10.422 | 12.344 | 12.812 | 13.47  | 14.128 | 12.097 | 100.0%  | 10    |
-  | heat.delete_stack | 6.869  | 8.251  | 9.518  | 9.918  | 10.317 | 8.407  | 100.0%  | 10    |
-  | total             | 18.742 | 20.619 | 22.144 | 22.228 | 22.313 | 20.504 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 60.1647601128
-  Full duration: 63.2413249016
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 12.861 | 14.13  | 16.111 | 16.328 | 16.545 | 14.294 | 100.0%  | 10    |
-  | heat.delete_stack | 8.256  | 8.951  | 9.675  | 9.958  | 10.241 | 8.968  | 100.0%  | 10    |
-  | total             | 21.289 | 22.778 | 24.964 | 25.875 | 26.786 | 23.262 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 70.9971709251
-  Full duration: 74.4355139732
-
-  test scenario HeatStacks.list_stacks_and_resources
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | heat.list_stacks                | 0.221 | 0.269  | 0.393  | 0.397  | 0.401 | 0.29 | 100.0%  | 10    |
-  | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0  | 100.0%  | 10    |
-  | total                           | 0.221 | 0.269  | 0.393  | 0.397  | 0.401 | 0.29 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 0.845721006393
-  Full duration: 3.40288186073
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.871 | 3.088  | 3.407  | 3.415  | 3.422 | 3.124 | 100.0%  | 10    |
-  | heat.update_stack | 2.568 | 3.106  | 3.925  | 3.953  | 3.981 | 3.187 | 100.0%  | 10    |
-  | heat.delete_stack | 1.369 | 1.555  | 1.647  | 1.686  | 1.724 | 1.55  | 100.0%  | 10    |
-  | total             | 7.072 | 7.871  | 8.535  | 8.749  | 8.963 | 7.861 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.2382650375
-  Full duration: 27.7685508728
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.836 | 3.105  | 3.233  | 3.257  | 3.281 | 3.098 | 100.0%  | 10    |
-  | heat.update_stack | 2.501 | 2.628  | 3.613  | 3.804  | 3.995 | 2.859 | 100.0%  | 10    |
-  | heat.delete_stack | 0.298 | 0.994  | 1.511  | 1.565  | 1.62  | 1.001 | 100.0%  | 10    |
-  | total             | 5.886 | 6.758  | 8.232  | 8.564  | 8.895 | 6.957 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 20.5952920914
-  Full duration: 23.9688129425
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.896 | 3.156  | 3.462  | 3.752  | 4.042 | 3.241 | 100.0%  | 10    |
-  | heat.update_stack | 4.942 | 5.218  | 5.956  | 6.09   | 6.224 | 5.42  | 100.0%  | 10    |
-  | heat.delete_stack | 1.551 | 1.665  | 2.721  | 2.788  | 2.856 | 2.038 | 100.0%  | 10    |
-  | total             | 9.408 | 10.658 | 11.602 | 11.761 | 11.92 | 10.7  | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 31.6187429428
-  Full duration: 35.1271891594
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------+
-  |                         Response Times (sec)                          |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | action | min | median | 90%ile | 95%ile | max | avg | success | count |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
-  +--------+-----+--------+--------+--------+-----+-----+---------+-------+
-  Load duration: 6.39157295227
-  Full duration: 14.0238859653
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-  | heat.create_stack | 2.944 | 3.08   | 3.202  | 3.309  | 3.415 | 3.09   | 100.0%  | 10    |
-  | heat.update_stack | 4.794 | 5.017  | 5.255  | 5.579  | 5.904 | 5.077  | 100.0%  | 10    |
-  | heat.delete_stack | 1.435 | 1.866  | 2.632  | 2.657  | 2.682 | 1.998  | 100.0%  | 10    |
-  | total             | 9.394 | 10.052 | 10.876 | 10.903 | 10.93 | 10.165 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-  Load duration: 30.0142600536
-  Full duration: 33.6354219913
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.874 | 3.099  | 3.257  | 3.296  | 3.334 | 3.084 | 100.0%  | 10    |
-  | heat.update_stack | 3.576 | 3.724  | 4.103  | 4.118  | 4.132 | 3.804 | 100.0%  | 10    |
-  | heat.delete_stack | 0.597 | 1.497  | 1.641  | 1.685  | 1.73  | 1.368 | 100.0%  | 10    |
-  | total             | 7.498 | 8.373  | 8.618  | 8.72   | 8.823 | 8.256 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 24.9089329243
-  Full duration: 28.905012846
-
-  test scenario HeatStacks.create_and_list_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.986 | 3.186  | 3.26   | 3.309  | 3.358 | 3.166 | 100.0%  | 10    |
-  | heat.list_stacks  | 0.035 | 0.163  | 0.192  | 0.205  | 0.218 | 0.128 | 100.0%  | 10    |
-  | total             | 3.039 | 3.305  | 3.472  | 3.495  | 3.518 | 3.294 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 9.91034293175
-  Full duration: 16.8483679295
-
-  test scenario HeatStacks.create_check_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 2.822 | 3.0    | 3.403  | 3.446  | 3.489 | 3.098 | 100.0%  | 10    |
-  | heat.check_stack  | 0.309 | 0.676  | 0.899  | 0.908  | 0.917 | 0.632 | 100.0%  | 10    |
-  | heat.delete_stack | 0.504 | 1.466  | 1.619  | 1.685  | 1.751 | 1.235 | 100.0%  | 10    |
-  | total             | 3.978 | 5.166  | 5.376  | 5.433  | 5.49  | 4.964 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 15.3095350266
-  Full duration: 19.0696201324
-
-  run_rally - INFO - Test scenario: "heat" Failed.
-
-  run_rally - INFO - Starting test scenario "keystone" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  b0246610-2dd7-4817-be66-9315ab169066: started
-  Task b0246610-2dd7-4817-be66-9315ab169066: finished
-
-  test scenario KeystoneBasic.create_tenant_with_users
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.11  | 0.13   | 0.144  | 0.153  | 0.161 | 0.131 | 100.0%  | 10    |
-  | keystone.create_users  | 0.628 | 0.692  | 0.803  | 0.847  | 0.89  | 0.717 | 100.0%  | 10    |
-  | total                  | 0.755 | 0.826  | 0.934  | 0.979  | 1.025 | 0.849 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.49157500267
-  Full duration: 12.6573908329
-
-  test scenario KeystoneBasic.create_add_and_list_user_roles
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.11  | 0.114  | 0.125  | 0.127  | 0.129 | 0.117 | 100.0%  | 10    |
-  | keystone.add_role    | 0.087 | 0.099  | 0.117  | 0.134  | 0.152 | 0.105 | 100.0%  | 10    |
-  | keystone.list_roles  | 0.049 | 0.053  | 0.068  | 0.084  | 0.101 | 0.059 | 100.0%  | 10    |
-  | total                | 0.261 | 0.277  | 0.302  | 0.307  | 0.313 | 0.281 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.859135150909
-  Full duration: 5.88745498657
-
-  test scenario KeystoneBasic.add_and_remove_user_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.109 | 0.188  | 0.253  | 0.27   | 0.287 | 0.184 | 100.0%  | 10    |
-  | keystone.add_role    | 0.087 | 0.1    | 0.119  | 0.125  | 0.13  | 0.103 | 100.0%  | 10    |
-  | keystone.remove_role | 0.06  | 0.069  | 0.173  | 0.196  | 0.218 | 0.102 | 100.0%  | 10    |
-  | total                | 0.263 | 0.393  | 0.518  | 0.556  | 0.594 | 0.39  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.32334089279
-  Full duration: 6.50031495094
-
-  test scenario KeystoneBasic.create_update_and_delete_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.108 | 0.217  | 0.267  | 0.272  | 0.277 | 0.192 | 100.0%  | 10    |
-  | keystone.update_tenant | 0.05  | 0.057  | 0.062  | 0.068  | 0.074 | 0.058 | 100.0%  | 10    |
-  | keystone.delete_tenant | 0.119 | 0.132  | 0.141  | 0.142  | 0.142 | 0.132 | 100.0%  | 10    |
-  | total                  | 0.289 | 0.392  | 0.46   | 0.462  | 0.465 | 0.381 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.16795897484
-  Full duration: 5.16257286072
-
-  test scenario KeystoneBasic.create_and_delete_service
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_service | 0.105 | 0.121  | 0.153  | 0.169  | 0.185 | 0.13  | 100.0%  | 10    |
-  | keystone.delete_service | 0.053 | 0.06   | 0.065  | 0.072  | 0.079 | 0.061 | 100.0%  | 10    |
-  | total                   | 0.169 | 0.182  | 0.23   | 0.234  | 0.239 | 0.191 | 100.0%  | 10    |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.56450510025
-  Full duration: 4.22321987152
-
-  test scenario KeystoneBasic.create_tenant
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  | keystone.create_tenant | 0.112 | 0.138  | 0.161  | 0.165  | 0.168 | 0.14 | 100.0%  | 10    |
-  | total                  | 0.112 | 0.138  | 0.161  | 0.165  | 0.168 | 0.14 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 0.417885065079
-  Full duration: 4.0450899601
-
-  test scenario KeystoneBasic.create_user
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.126 | 0.177  | 0.186  | 0.189  | 0.191 | 0.164 | 100.0%  | 10    |
-  | total                | 0.126 | 0.177  | 0.186  | 0.189  | 0.191 | 0.164 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.485447883606
-  Full duration: 4.35393500328
-
-  test scenario KeystoneBasic.create_and_list_tenants
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.117 | 0.13   | 0.139  | 0.139  | 0.14  | 0.129 | 100.0%  | 10    |
-  | keystone.list_tenants  | 0.047 | 0.053  | 0.094  | 0.107  | 0.121 | 0.063 | 100.0%  | 10    |
-  | total                  | 0.167 | 0.186  | 0.212  | 0.233  | 0.253 | 0.192 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.566509962082
-  Full duration: 5.80973696709
-
-  test scenario KeystoneBasic.create_and_delete_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.109 | 0.227  | 0.291  | 0.3    | 0.308 | 0.205 | 100.0%  | 10    |
-  | keystone.delete_role | 0.106 | 0.114  | 0.238  | 0.25   | 0.263 | 0.14  | 100.0%  | 10    |
-  | total                | 0.222 | 0.34   | 0.544  | 0.548  | 0.552 | 0.345 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.969199895859
-  Full duration: 5.0005710125
-
-  test scenario KeystoneBasic.get_entities
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.115 | 0.13   | 0.153  | 0.154  | 0.154 | 0.131 | 100.0%  | 10    |
-  | keystone.create_user   | 0.059 | 0.063  | 0.068  | 0.075  | 0.083 | 0.065 | 100.0%  | 10    |
-  | keystone.create_role   | 0.046 | 0.06   | 0.085  | 0.085  | 0.086 | 0.061 | 100.0%  | 10    |
-  | keystone.get_tenant    | 0.044 | 0.051  | 0.058  | 0.06   | 0.062 | 0.051 | 100.0%  | 10    |
-  | keystone.get_user      | 0.052 | 0.067  | 0.103  | 0.106  | 0.109 | 0.07  | 100.0%  | 10    |
-  | keystone.get_role      | 0.042 | 0.049  | 0.066  | 0.067  | 0.068 | 0.052 | 100.0%  | 10    |
-  | keystone.service_list  | 0.044 | 0.05   | 0.067  | 0.083  | 0.099 | 0.055 | 100.0%  | 10    |
-  | keystone.get_service   | 0.041 | 0.044  | 0.051  | 0.052  | 0.054 | 0.046 | 100.0%  | 10    |
-  | total                  | 0.489 | 0.533  | 0.57   | 0.572  | 0.574 | 0.532 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.58059597015
-  Full duration: 9.58514809608
-
-  test scenario KeystoneBasic.create_and_list_users
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.129 | 0.139  | 0.153  | 0.167  | 0.181 | 0.143 | 100.0%  | 10    |
-  | keystone.list_users  | 0.046 | 0.054  | 0.073  | 0.079  | 0.084 | 0.06  | 100.0%  | 10    |
-  | total                | 0.185 | 0.198  | 0.222  | 0.227  | 0.232 | 0.203 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.615728855133
-  Full duration: 4.46038007736
-
-  run_rally - INFO - Test scenario: "keystone" OK.
-
-  run_rally - INFO - Starting test scenario "neutron" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  60b0f938-d4b3-4eae-9392-3ac4c8a6a4b7: started
-  Task 60b0f938-d4b3-4eae-9392-3ac4c8a6a4b7: finished
-
-  test scenario NeutronNetworks.create_and_delete_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.448 | 0.508  | 0.67   | 0.679  | 0.687 | 0.525 | 100.0%  | 10    |
-  | neutron.delete_port | 0.152 | 0.299  | 0.373  | 0.376  | 0.378 | 0.301 | 100.0%  | 10    |
-  | total               | 0.6   | 0.817  | 0.958  | 0.977  | 0.995 | 0.826 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.44042801857
-  Full duration: 24.5799560547
-
-  test scenario NeutronNetworks.create_and_list_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.392 | 0.512  | 0.61   | 0.629  | 0.649 | 0.519 | 100.0%  | 10    |
-  | neutron.create_router        | 0.032 | 0.176  | 0.253  | 0.254  | 0.256 | 0.156 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.227 | 0.375  | 0.444  | 0.468  | 0.492 | 0.366 | 100.0%  | 10    |
-  | neutron.list_routers         | 0.03  | 0.151  | 0.184  | 0.196  | 0.207 | 0.115 | 100.0%  | 10    |
-  | total                        | 0.942 | 1.153  | 1.326  | 1.377  | 1.429 | 1.157 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.41682577133
-  Full duration: 27.1603848934
-
-  test scenario NeutronNetworks.create_and_delete_routers
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet           | 0.406 | 0.478  | 0.571  | 0.602  | 0.634 | 0.488 | 100.0%  | 10    |
-  | neutron.create_router           | 0.032 | 0.189  | 0.275  | 0.28   | 0.284 | 0.183 | 100.0%  | 10    |
-  | neutron.add_interface_router    | 0.232 | 0.326  | 0.474  | 0.479  | 0.484 | 0.337 | 100.0%  | 10    |
-  | neutron.remove_interface_router | 0.163 | 0.25   | 0.492  | 0.5    | 0.508 | 0.288 | 100.0%  | 10    |
-  | neutron.delete_router           | 0.126 | 0.229  | 0.301  | 0.356  | 0.41  | 0.224 | 100.0%  | 10    |
-  | total                           | 1.294 | 1.49   | 1.698  | 1.753  | 1.807 | 1.52  | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.38407206535
-  Full duration: 28.0664179325
-
-  test scenario NeutronNetworks.create_and_list_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.433 | 0.663  | 0.718  | 0.718  | 0.719 | 0.601 | 100.0%  | 10    |
-  | neutron.list_ports  | 0.089 | 0.231  | 0.345  | 0.385  | 0.425 | 0.243 | 100.0%  | 10    |
-  | total               | 0.524 | 0.843  | 1.028  | 1.072  | 1.117 | 0.844 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.59062600136
-  Full duration: 25.9457578659
-
-  test scenario NeutronNetworks.create_and_delete_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.387 | 0.429  | 0.52   | 0.533  | 0.545 | 0.452 | 100.0%  | 10    |
-  | neutron.delete_subnet | 0.144 | 0.296  | 0.356  | 0.367  | 0.378 | 0.275 | 100.0%  | 10    |
-  | total                 | 0.573 | 0.733  | 0.811  | 0.829  | 0.846 | 0.727 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.22101807594
-  Full duration: 24.9812419415
-
-  test scenario NeutronNetworks.create_and_delete_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.293 | 0.395  | 0.476  | 0.482  | 0.488 | 0.397 | 100.0%  | 10    |
-  | neutron.delete_network | 0.103 | 0.24   | 0.332  | 0.344  | 0.357 | 0.228 | 100.0%  | 10    |
-  | total                  | 0.471 | 0.585  | 0.766  | 0.798  | 0.829 | 0.625 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.84316086769
-  Full duration: 14.2107710838
-
-  test scenario NeutronNetworks.create_and_list_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.31  | 0.347  | 0.452  | 0.454  | 0.455 | 0.362 | 100.0%  | 10    |
-  | neutron.list_networks  | 0.042 | 0.111  | 0.199  | 0.24   | 0.281 | 0.124 | 100.0%  | 10    |
-  | total                  | 0.358 | 0.493  | 0.603  | 0.624  | 0.644 | 0.486 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.45903801918
-  Full duration: 15.4646441936
-
-  test scenario NeutronNetworks.create_and_update_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.382 | 0.419  | 0.612  | 0.613  | 0.614 | 0.478 | 100.0%  | 10    |
-  | neutron.create_router        | 0.033 | 0.176  | 0.22   | 0.239  | 0.258 | 0.149 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.229 | 0.272  | 0.394  | 0.458  | 0.522 | 0.307 | 100.0%  | 10    |
-  | neutron.update_router        | 0.091 | 0.252  | 0.307  | 0.324  | 0.342 | 0.221 | 100.0%  | 10    |
-  | total                        | 0.938 | 1.105  | 1.328  | 1.406  | 1.484 | 1.156 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.27084898949
-  Full duration: 27.761991024
-
-  test scenario NeutronNetworks.create_and_update_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.306 | 0.356  | 0.425  | 0.429  | 0.433 | 0.366 | 100.0%  | 10    |
-  | neutron.update_network | 0.113 | 0.27   | 0.33   | 0.337  | 0.343 | 0.24  | 100.0%  | 10    |
-  | total                  | 0.423 | 0.611  | 0.763  | 0.763  | 0.764 | 0.606 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.81449484825
-  Full duration: 15.7938911915
-
-  test scenario NeutronNetworks.create_and_update_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.431 | 0.488  | 0.702  | 0.707  | 0.711 | 0.521 | 100.0%  | 10    |
-  | neutron.update_port | 0.11  | 0.256  | 0.37   | 0.39   | 0.409 | 0.23  | 100.0%  | 10    |
-  | total               | 0.541 | 0.758  | 0.865  | 0.987  | 1.11  | 0.752 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.09433794022
-  Full duration: 26.3668129444
-
-  test scenario NeutronNetworks.create_and_list_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.391 | 0.421  | 0.542  | 0.558  | 0.574 | 0.449 | 100.0%  | 10    |
-  | neutron.list_subnets  | 0.059 | 0.135  | 0.295  | 0.332  | 0.37  | 0.163 | 100.0%  | 10    |
-  | total                 | 0.45  | 0.631  | 0.736  | 0.752  | 0.769 | 0.612 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.75437092781
-  Full duration: 25.2292289734
-
-  test scenario NeutronNetworks.create_and_update_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.4   | 0.45   | 0.535  | 0.536  | 0.537 | 0.462 | 100.0%  | 10    |
-  | neutron.update_subnet | 0.158 | 0.306  | 0.397  | 0.412  | 0.427 | 0.3   | 100.0%  | 10    |
-  | total                 | 0.564 | 0.773  | 0.88   | 0.904  | 0.929 | 0.763 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.266477108
-  Full duration: 25.2276790142
-
-  run_rally - INFO - Test scenario: "neutron" OK.
-
-  run_rally - INFO - Starting test scenario "nova" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  51b9485f-50cd-43c0-89c7-901e4b55ffa4: started
-  Task 51b9485f-50cd-43c0-89c7-901e4b55ffa4: finished
-
-  test scenario NovaKeypair.create_and_delete_keypair
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.378 | 0.469  | 0.572  | 0.585  | 0.599 | 0.487 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.018 | 0.021  | 0.031  | 0.032  | 0.032 | 0.023 | 100.0%  | 10    |
-  | total               | 0.41  | 0.487  | 0.592  | 0.607  | 0.621 | 0.51  | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.44199299812
-  Full duration: 14.8640050888
-
-  test scenario NovaServers.snapshot_server
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
-  | action                 | min    | median | 90%ile  | 95%ile  | max     | avg    | success | count |
-  +------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
-  | nova.boot_server       | 3.252  | 5.309  | 6.304   | 6.39    | 6.476   | 5.049  | 100.0%  | 10    |
-  | nova.create_image      | 27.858 | 48.811 | 65.726  | 65.73   | 65.734  | 47.725 | 100.0%  | 10    |
-  | nova.delete_server     | 2.519  | 2.96   | 5.038   | 5.043   | 5.047   | 3.302  | 100.0%  | 10    |
-  | nova.boot_server (2)   | 14.132 | 28.496 | 38.684  | 44.307  | 49.929  | 28.943 | 100.0%  | 10    |
-  | nova.delete_server (2) | 2.39   | 4.627  | 7.042   | 7.135   | 7.229   | 4.368  | 100.0%  | 10    |
-  | nova.delete_image      | 0.317  | 0.482  | 1.285   | 1.976   | 2.667   | 0.749  | 100.0%  | 10    |
-  | total                  | 61.01  | 97.217 | 121.154 | 121.205 | 121.255 | 90.137 | 100.0%  | 10    |
-  +------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
-  Load duration: 248.724915028
-  Full duration: 271.744755983
-
-  test scenario NovaKeypair.boot_and_delete_server_with_keypair
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.create_keypair | 0.436 | 0.508  | 0.611  | 0.618  | 0.624  | 0.52  | 100.0%  | 10    |
-  | nova.boot_server    | 3.084 | 4.238  | 6.002  | 6.114  | 6.226  | 4.436 | 100.0%  | 10    |
-  | nova.delete_server  | 2.385 | 2.558  | 3.021  | 3.844  | 4.667  | 2.752 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.015 | 0.02   | 0.024  | 0.024  | 0.025  | 0.02  | 100.0%  | 10    |
-  | total               | 5.997 | 7.197  | 9.438  | 10.178 | 10.917 | 7.728 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 22.9343290329
-  Full duration: 44.7740108967
-
-  test scenario NovaKeypair.create_and_list_keypairs
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.367 | 0.477  | 0.546  | 0.584  | 0.622 | 0.473 | 100.0%  | 10    |
-  | nova.list_keypairs  | 0.014 | 0.019  | 0.025  | 0.028  | 0.03  | 0.021 | 100.0%  | 10    |
-  | total               | 0.384 | 0.501  | 0.565  | 0.601  | 0.636 | 0.494 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.53178596497
-  Full duration: 16.4732458591
-
-  test scenario NovaServers.list_servers
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.list_servers | 0.588 | 0.656  | 0.754  | 0.774  | 0.795 | 0.663 | 100.0%  | 10    |
-  | total             | 0.589 | 0.656  | 0.754  | 0.775  | 0.795 | 0.663 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.98694491386
-  Full duration: 47.495290041
-
-  test scenario NovaServers.resize_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.412  | 4.572  | 6.064  | 6.069  | 6.073  | 4.644  | 100.0%  | 10    |
-  | nova.resize         | 21.205 | 34.251 | 42.136 | 42.238 | 42.34  | 31.684 | 100.0%  | 10    |
-  | nova.resize_confirm | 2.364  | 2.437  | 2.588  | 2.638  | 2.688  | 2.479  | 100.0%  | 10    |
-  | nova.delete_server  | 2.38   | 2.427  | 2.64   | 2.727  | 2.814  | 2.475  | 100.0%  | 10    |
-  | total               | 29.399 | 43.496 | 53.296 | 53.299 | 53.302 | 41.282 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 112.265089989
-  Full duration: 126.299309015
-
-  test scenario NovaServers.boot_server_from_volume_and_delete
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 3.376  | 4.574  | 6.275  | 6.295  | 6.315  | 4.705  | 100.0%  | 10    |
-  | nova.boot_server     | 8.443  | 9.25   | 11.22  | 11.494 | 11.768 | 9.658  | 100.0%  | 10    |
-  | nova.delete_server   | 4.478  | 4.614  | 4.912  | 5.81   | 6.708  | 4.799  | 100.0%  | 10    |
-  | total                | 16.358 | 19.136 | 21.665 | 22.113 | 22.56  | 19.163 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 56.0801298618
-  Full duration: 85.6200530529
-
-  test scenario NovaServers.boot_and_migrate_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.498  | 4.001  | 5.998  | 6.132  | 6.267  | 4.49   | 100.0%  | 10    |
-  | nova.stop_server    | 4.649  | 13.73  | 15.606 | 15.699 | 15.791 | 11.515 | 100.0%  | 10    |
-  | nova.migrate        | 15.233 | 21.214 | 29.778 | 29.939 | 30.099 | 22.004 | 100.0%  | 10    |
-  | nova.resize_confirm | 2.366  | 2.398  | 2.559  | 2.699  | 2.838  | 2.451  | 100.0%  | 10    |
-  | nova.delete_server  | 2.384  | 2.428  | 2.527  | 2.567  | 2.606  | 2.444  | 100.0%  | 10    |
-  | total               | 35.813 | 43.101 | 49.38  | 49.998 | 50.616 | 42.904 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 121.644474983
-  Full duration: 135.548355818
-
-  test scenario NovaServers.boot_and_delete_server
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.boot_server   | 3.484 | 6.119  | 7.588  | 7.617  | 7.647  | 5.778 | 100.0%  | 10    |
-  | nova.delete_server | 2.393 | 2.758  | 4.763  | 4.817  | 4.872  | 3.438 | 100.0%  | 10    |
-  | total              | 5.885 | 8.701  | 12.336 | 12.358 | 12.379 | 9.216 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 26.0077610016
-  Full duration: 48.9747579098
-
-  test scenario NovaServers.boot_and_rebuild_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.5    | 4.786  | 6.225  | 6.257  | 6.289  | 4.859  | 100.0%  | 10    |
-  | nova.rebuild_server | 6.349  | 11.303 | 17.156 | 17.218 | 17.279 | 11.611 | 100.0%  | 10    |
-  | nova.delete_server  | 2.381  | 2.441  | 2.549  | 2.55   | 2.552  | 2.464  | 100.0%  | 10    |
-  | total               | 13.553 | 18.971 | 23.648 | 24.245 | 24.842 | 18.934 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 52.6579520702
-  Full duration: 75.2351601124
-
-  test scenario NovaSecGroup.create_and_list_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 1.386  | 2.017  | 2.077  | 2.091  | 2.106  | 1.84   | 100.0%  | 10    |
-  | nova.create_100_rules          | 8.891  | 10.215 | 10.514 | 10.722 | 10.929 | 10.096 | 100.0%  | 10    |
-  | nova.list_security_groups      | 0.107  | 0.152  | 0.269  | 0.288  | 0.307  | 0.171  | 100.0%  | 10    |
-  | total                          | 10.858 | 12.348 | 12.575 | 12.61  | 12.645 | 12.108 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 35.6299619675
-  Full duration: 63.5884320736
-
-  test scenario NovaSecGroup.create_and_delete_secgroups
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 1.387 | 1.712  | 2.11   | 2.114  | 2.118  | 1.782  | 100.0%  | 10    |
-  | nova.create_100_rules          | 8.912 | 9.991  | 10.333 | 10.39  | 10.447 | 9.849  | 100.0%  | 10    |
-  | nova.delete_10_security_groups | 0.735 | 0.953  | 1.042  | 1.101  | 1.161  | 0.955  | 100.0%  | 10    |
-  | total                          | 11.2  | 12.869 | 13.019 | 13.049 | 13.079 | 12.586 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 37.0498371124
-  Full duration: 51.703150034
-
-  test scenario NovaServers.boot_and_bounce_server
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  | action                  | min    | median | 90%ile | 95%ile  | max     | avg    | success | count |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  | nova.boot_server        | 3.232  | 4.745  | 6.322  | 6.339   | 6.356   | 4.884  | 100.0%  | 10    |
-  | nova.reboot_server      | 4.43   | 4.579  | 4.667  | 4.687   | 4.707   | 4.59   | 100.0%  | 10    |
-  | nova.soft_reboot_server | 4.722  | 6.782  | 18.815 | 72.233  | 125.65  | 18.46  | 100.0%  | 10    |
-  | nova.stop_server        | 4.631  | 4.711  | 6.14   | 10.834  | 15.527  | 5.852  | 100.0%  | 10    |
-  | nova.start_server       | 2.625  | 2.712  | 3.141  | 3.595   | 4.048   | 2.891  | 100.0%  | 10    |
-  | nova.rescue_server      | 6.624  | 11.131 | 17.578 | 17.69   | 17.803  | 11.544 | 100.0%  | 10    |
-  | nova.unrescue_server    | 2.293  | 4.467  | 4.631  | 4.634   | 4.636   | 3.681  | 100.0%  | 10    |
-  | nova.delete_server      | 2.346  | 2.407  | 2.563  | 2.572   | 2.581   | 2.442  | 100.0%  | 10    |
-  | total                   | 35.909 | 44.054 | 60.343 | 108.964 | 157.584 | 54.354 | 100.0%  | 10    |
-  +-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
-  Load duration: 157.603001118
-  Full duration: 179.857326031
-
-  test scenario NovaServers.boot_server
-  +---------------------------------------------------------------------------------------+
-  |                                 Response Times (sec)                                  |
-  +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server | 3.435 | 4.325  | 6.075  | 6.183  | 6.292 | 4.629 | 100.0%  | 10    |
-  | total            | 3.435 | 4.325  | 6.075  | 6.183  | 6.292 | 4.629 | 100.0%  | 10    |
-  +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 13.5383079052
-  Full duration: 36.4747169018
-
-  test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-  +-----------------------------------------------------------------------------------------------------------+
-  |                                           Response Times (sec)                                            |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups    | 1.622  | 1.87   | 1.968  | 2.066  | 2.163  | 1.846  | 100.0%  | 10    |
-  | nova.create_100_rules             | 8.778  | 9.885  | 10.429 | 10.484 | 10.538 | 9.786  | 100.0%  | 10    |
-  | nova.boot_server                  | 4.372  | 5.705  | 6.744  | 6.784  | 6.825  | 5.534  | 100.0%  | 10    |
-  | nova.get_attached_security_groups | 0.145  | 0.15   | 0.163  | 0.171  | 0.179  | 0.154  | 100.0%  | 10    |
-  | nova.delete_server                | 2.392  | 2.532  | 4.639  | 4.677  | 4.715  | 3.324  | 100.0%  | 10    |
-  | nova.delete_10_security_groups    | 0.762  | 0.811  | 1.001  | 1.056  | 1.112  | 0.864  | 100.0%  | 10    |
-  | total                             | 18.434 | 20.813 | 24.815 | 24.847 | 24.879 | 21.508 | 100.0%  | 10    |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 64.179831028
-  Full duration: 87.2896039486
-
-  test scenario NovaServers.pause_and_unpause_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 3.419  | 4.899  | 6.417  | 6.437  | 6.457  | 4.897  | 100.0%  | 10    |
-  | nova.pause_server   | 2.319  | 2.452  | 2.541  | 2.574  | 2.607  | 2.443  | 100.0%  | 10    |
-  | nova.unpause_server | 2.291  | 2.397  | 2.512  | 2.565  | 2.619  | 2.409  | 100.0%  | 10    |
-  | nova.delete_server  | 2.36   | 2.542  | 3.024  | 3.769  | 4.514  | 2.719  | 100.0%  | 10    |
-  | total               | 10.572 | 12.299 | 14.07  | 14.773 | 15.475 | 12.469 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 36.6686770916
-  Full duration: 59.3664259911
-
-  test scenario NovaServers.boot_server_from_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 3.258  | 3.501  | 5.924  | 5.949  | 5.974  | 4.155  | 100.0%  | 10    |
-  | nova.boot_server     | 7.572  | 8.821  | 12.368 | 12.983 | 13.598 | 9.51   | 100.0%  | 10    |
-  | total                | 11.135 | 12.15  | 18.14  | 18.856 | 19.572 | 13.665 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 38.717217207
-  Full duration: 73.4654810429
-
-  test scenario NovaServers.boot_and_list_server
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.boot_server  | 3.569 | 4.788  | 6.354  | 6.43   | 6.506 | 4.924 | 100.0%  | 10    |
-  | nova.list_servers | 0.189 | 0.37   | 0.447  | 0.453  | 0.46  | 0.346 | 100.0%  | 10    |
-  | total             | 3.757 | 5.231  | 6.727  | 6.745  | 6.763 | 5.27  | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.4698469639
-  Full duration: 47.3727209568
-
-  run_rally - INFO - Test scenario: "nova" OK.
-
-  run_rally - INFO - Starting test scenario "quotas" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  9226e59f-9bfb-44aa-8641-99f492cd92a9: started
-  Task 9226e59f-9bfb-44aa-8641-99f492cd92a9: finished
-
-  test scenario Quotas.cinder_update
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.6 | 0.64   | 0.688  | 0.721  | 0.754 | 0.649 | 100.0%  | 10    |
-  | total                | 0.6 | 0.64   | 0.688  | 0.721  | 0.754 | 0.649 | 100.0%  | 10    |
-  +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.92687010765
-  Full duration: 7.31987595558
-
-  test scenario Quotas.neutron_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.217 | 0.255  | 0.377  | 0.401  | 0.424 | 0.28  | 100.0%  | 10    |
-  | total                | 0.28  | 0.325  | 0.445  | 0.469  | 0.492 | 0.346 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.03654098511
-  Full duration: 6.59040594101
-
-  test scenario Quotas.cinder_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.588 | 0.651  | 0.699  | 0.702  | 0.705 | 0.652 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.389 | 0.434  | 0.5    | 0.527  | 0.554 | 0.449 | 100.0%  | 10    |
-  | total                | 1.011 | 1.097  | 1.176  | 1.179  | 1.182 | 1.101 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.32944512367
-  Full duration: 8.96466994286
-
-  test scenario Quotas.nova_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.322 | 0.358  | 0.54   | 0.633  | 0.726 | 0.407 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.016 | 0.022  | 0.028  | 0.029  | 0.03  | 0.022 | 100.0%  | 10    |
-  | total                | 0.344 | 0.383  | 0.557  | 0.652  | 0.747 | 0.429 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.20111894608
-  Full duration: 6.32782506943
-
-  test scenario Quotas.nova_update
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +----------------------+------+--------+--------+--------+-------+------+---------+-------+
-  | action               | min  | median | 90%ile | 95%ile | max   | avg  | success | count |
-  +----------------------+------+--------+--------+--------+-------+------+---------+-------+
-  | quotas.update_quotas | 0.32 | 0.373  | 0.485  | 0.499  | 0.513 | 0.39 | 100.0%  | 10    |
-  | total                | 0.32 | 0.373  | 0.485  | 0.499  | 0.513 | 0.39 | 100.0%  | 10    |
-  +----------------------+------+--------+--------+--------+-------+------+---------+-------+
-  Load duration: 1.11949706078
-  Full duration: 6.58456206322
-
-  run_rally - INFO - Test scenario: "quotas" OK.
-
-  run_rally - INFO - Starting test scenario "requests" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  2e77e5dd-e2ca-466a-9edb-4f5f741dd55b: started
-  Task 2e77e5dd-e2ca-466a-9edb-4f5f741dd55b: finished
-
-  test scenario HttpRequests.check_random_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 0.462 | 0.483  | 1.478  | 3.509  | 5.541 | 1.102 | 100.0%  | 10    |
-  | total                  | 0.462 | 0.483  | 1.478  | 3.509  | 5.541 | 1.102 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 6.3974840641
-  Full duration: 8.66475987434
-
-  test scenario HttpRequests.check_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 0.453 | 0.458  | 0.477  | 0.494  | 0.511 | 0.465 | 100.0%  | 10    |
-  | total                  | 0.453 | 0.458  | 0.477  | 0.494  | 0.512 | 0.465 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.39966082573
-  Full duration: 3.74285912514
-
-  run_rally - INFO - Test scenario: "requests" OK.
-
-  run_rally - INFO -
-
-                       Rally Summary Report
-  +===================+============+===============+===========+
-  | Module            | Duration   | nb. Test Run  | Success   |
-  +===================+============+===============+===========+
-  | authenticate      | 00:17      | 10            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | glance            | 01:24      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | cinder            | 16:34      | 50            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | heat              | 06:19      | 32            | 92.31%    |
-  +-------------------+------------+---------------+-----------+
-  | keystone          | 01:07      | 29            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | neutron           | 04:40      | 31            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | nova              | 24:26      | 61            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | quotas            | 00:35      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | requests          | 00:12      | 2             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  +===================+============+===============+===========+
-  | TOTAL:            | 00:55:38   | 229           | 99.15%    |
-  +===================+============+===============+===========+
-
-
-SDN Controller
---------------
-
-ONOS
-^^^^
-::
-
-  FUNCTEST.info: Running ONOS test case...
-  Cloning into '/home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest'...
-  FUNCvirNetNB - INFO - Creating component Handle: ONOSrest
-
-                                  +----------------+
-  ------------------------------ { Script And Files }  ------------------------------
-                                  +----------------+
-  Script Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNB_22_Feb_2016_16_47_23/FUNCvirNetNB_22_Feb_2016_16_47_23.log
-  Report Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNB_22_Feb_2016_16_47_23/FUNCvirNetNB_22_Feb_2016_16_47_23.rpt
-  ONOSrest Session Log : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNB_22_Feb_2016_16_47_23/ONOSrest.session
-  Test Script :/home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNB.py
-  Test Params : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNB.params
-  Topology : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNB.topo
-                                +------------------+
-  ---------------------------  { Script Exec Params }  ---------------------------
-                                +------------------+
-  'MININET':
-  'switch': '7'
-  'links': '20'
-
-  'GIT':
-  'pull': 'False'
-  'branch': 'master'
-
-  'HTTP':
-  'path': '/onos/vtn/'
-  'port': '8181'
-
-  'CTRL':
-  'ip1': 'OC1'
-  'port1': '6633'
-
-  'testcases': '2
-  3
-  4
-  5
-  6
-  7
-  8
-  9
-  10'
-  'SLEEP':
-  'startup': '15'
-
-  'ENV':
-  'cellApps': 'drivers
-  openflow
-  proxyarp
-  mobility'
-  'cellName': 'singlenode'
-
-                                 +---------------+
-  ----------------------------- { Components Used }  -----------------------------
-                                 +---------------+
-  ONOSrest
-
-                                +--------+
-  ---------------------------- { Topology }  ----------------------------
-                                +--------+
-
-  'ONOSrest':
-  'connect_order': '4'
-  'host': 'OC1'
-  'user': 'root'
-  'COMPONENTS': ''
-  'password': 'r00tme'
-  'type': 'OnosRestDriver'
-
-  ------------------------------------------------------------
-
-  ******************************
-   CASE INIT
-  ******************************
-
-  ['ONOSrest']
-
-  ******************************
-   Result summary for Testcase2
-  ******************************
-
-  Network Post
-   2.1: Generate Post Data
-   2.2: Post Data via HTTP
-   2.3: Get Data via HTTP
-   2.4: Compare Send Id and Get Id
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase3
-  ******************************
-
-  Network Update
-   3.1: Generate Post Data
-   3.2: Post Data via HTTP
-   3.3: Update Data via HTTP
-   3.4: Get Data via HTTP
-   3.5: Compare Update data.
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase4
-  ******************************
-
-  Network Delete
-   4.1: Generate Post Data
-   4.2: Post Data via HTTP
-   4.3: Delete Data via HTTP
-   4.4: Get Data is NULL
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase5
-  ******************************
-
-  Subnet Post
-   5.1: Generate Post Data
-   5.2: Post Network Data via HTTP(Post Subnet need post network)
-   5.3: Post Subnet Data via HTTP
-   5.4: Get Subnet Data via HTTP
-   5.5: Compare Post Subnet Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase6
-  ******************************
-
-  Subnet Update
-   6.1: Generate Post Data
-   6.2: Post Network Data via HTTP(Post Subnet need post network)
-   6.3: Post Subnet Data via HTTP
-   6.4: Update Subnet Data via HTTP
-   6.5: Get Subnet Data via HTTP
-   6.6: Compare Subnet Data
-   6.7: Delete Subnet via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase7
-  ******************************
-
-  Subnet Delete
-   7.1: Generate Post Data
-   7.2: Post Network Data via HTTP(Post Subnet need post network)
-   7.3: Post Subnet Data via HTTP
-   7.4: Delete Subnet Data via HTTP
-   7.5: Get Subnet Data is NULL
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase8
-  ******************************
-
-  Port Post
-   8.1: Generate Post Data
-   8.2: Post Network Data via HTTP(Post port need post network)
-   8.3: Post Subnet Data via HTTP(Post port need post subnet)
-   8.4: Post Port Data via HTTP
-   8.5: Get Port Data via HTTP
-   8.6: Compare Post Port Data
-   8.7: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase9
-  ******************************
-
-  Port Update
-   9.1: Generate Post Data
-   9.2: Post Network Data via HTTP(Post port need post network)
-   9.3: Post Subnet Data via HTTP(Post port need post subnet)
-   9.4: Post Port Data via HTTP
-   9.5: Update Port Data via HTTP
-   9.6: Get Port Data via HTTP
-   9.7: Compare Update Port Data
-   9.8: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase10
-  ******************************
-
-  Port Delete
-   10.1: Generate Post Data
-   10.2: Post Network Data via HTTP(Post port need post network)
-   10.3: Post Subnet Data via HTTP(Post port need post subnet)
-   10.4: Post Port Data via HTTP
-   10.5: Delete Port Data via HTTP
-   10.6: Get Port Data is NULL
-   10.7: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  *************************************
-  Test Execution Summary
-  *************************************
-
-   Test Start           : 22 Feb 2016 16:47:23
-   Test End             : 22 Feb 2016 16:47:39
-   Execution Time       : 0:00:15.597834
-   Total tests planned  : 9
-   Total tests RUN      : 9
-   Total Pass           : 9
-   Total Fail           : 0
-   Total No Result      : 0
-   Success Percentage   : 100%
-   Execution Result     : 100%
-  Disconnecting from ONOSrest: <drivers.common.api.controller.onosrestdriver.OnosRestDriver object at 0x7f848e052a50>
-  FUNCvirNetNBL3 - INFO - Creating component Handle: ONOSrest
-
-                                  +----------------+
-  ------------------------------ { Script And Files }  ------------------------------
-                                  +----------------+
-
-  Script Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNBL3_22_Feb_2016_16_47_39/FUNCvirNetNBL3_22_Feb_2016_16_47_39.log
-  Report Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNBL3_22_Feb_2016_16_47_39/FUNCvirNetNBL3_22_Feb_2016_16_47_39.rpt
-  ONOSrest Session Log : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNBL3_22_Feb_2016_16_47_39/ONOSrest.session
-  Test Script :/home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNBL3.py
-  Test Params : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNBL3.params
-  Topology : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNBL3.topo
-                                +------------------+
-  ---------------------------  { Script Exec Params }  ---------------------------
-                                +------------------+
-
-  'MININET':
-  'switch': '7'
-  'links': '20'
-
-  'GIT':
-  'pull': 'False'
-  'branch': 'master'
-
-  'HTTP':
-  'path': '/onos/vtn/'
-  'port': '8181'
-
-  'CTRL':
-  'ip1': 'OC1'
-  'port1': '6653'
-
-  'testcases': '2
-  3
-  4
-  5
-  6
-  7
-  8
-  9
-  10
-  11
-  12'
-  'SLEEP':
-  'startup': '15'
-
-  'ENV':
-  'cellApps': 'drivers
-  openflow
-  proxyarp
-  mobility'
-  'cellName': 'singlenode'
-
-                                 +---------------+
-  ----------------------------- { Components Used }  -----------------------------
-                                 +---------------+
-  ONOSrest
-
-                                +--------+
-  ---------------------------- { Topology }  ----------------------------
-                                +--------+
-
-  'ONOSrest':
-  'connect_order': '4'
-   'host': 'OC1'
-   'user': 'root'
-   'COMPONENTS': ''
-   'password': 'root'
-   'type': 'OnosRestDriver'
-
-  ------------------------------------------------------------
-
-  ******************************
-   CASE INIT
-  ******************************
-
-  ['ONOSrest']
-
-  ******************************
-   Result summary for Testcase2
-  ******************************
-
-  Router Post
-   2.1: Post Network Data via HTTP(Post Router need post network)
-   2.2: Post Router Data via HTTP
-   2.3: Get Router Data via HTTP
-   2.4: Compare Post Router Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase3
-  ******************************
-
-  Router Update
-   3.1: Post Network Data via HTTP(Post Router need post network)
-   3.2: Post Router Data via HTTP
-   3.3: Update Router Data via HTTP
-   3.4: Get Router Data via HTTP
-   3.5: Compare Router Data
-   3.6: Delete Router via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase4
-  ******************************
-
-  Router Delete
-   4.1: Post Network Data via HTTP(Post Router need post network)
-   4.2: Post Router Data via HTTP
-   4.3: Delete Router Data via HTTP
-   4.4: Get Router Data is NULL
-  Verify the Router status
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase5
-  ******************************
-
-  RouterInterface Post
-   5.1: Post Network Data via HTTP(Post port need post network)
-   5.2: Post Subnet Data via HTTP(Post port need post subnet)
-   5.3: Post Port Data via HTTP
-   5.4: Post Router Data via HTTP
-   5.5: Put RouterInterface Data via HTTP
-   5.6: Get RouterInterface Data via HTTP
-   5.7: Compare Post Port Data
-   5.8: Del RouterInterface Data via HTTP
-   5.9: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase6
-  ******************************
-
-  RouterInterface Delete
-   6.1: Post Network Data via HTTP(Post port need post network)
-   6.2: Post Subnet Data via HTTP(Post port need post subnet)
-   6.3: Post Port Data via HTTP
-   6.4: Post Router Data via HTTP
-   6.5: Post RouterInterface Data via HTTP
-   6.6: Del RouterInterface Data via HTTP
-   6.7: Delete Port Data via HTTP
-   6.8: Get Port Data is NULL
-   6.9: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase7
-  ******************************
-
-  FloatingIp Post
-   7.1: Post Network Data via HTTP(Post port need post network)
-   7.2: Post Subnet Data via HTTP(Post port need post subnet)
-   7.3: Post Port Data via HTTP
-   7.4: Post Router Data via HTTP
-   7.5: Get Port Data via HTTP
-   7.6: Post FloatingIp Data via HTTP
-   7.7: Get Port Data via HTTP
-   7.8: Get FloatingIp Data via HTTP
-   7.9: Get FloatingIp Data via HTTP
-   7.10: Compare Post FloatingIp Data
-   7.11: Post FloatingIp Clean Data via HTTP
-   7.12: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase8
-  ******************************
-
-  FloatingIp Update
-   8.1: Post Network Data via HTTP(Post port need post network)
-   8.2: Post Subnet Data via HTTP(Post port need post subnet)
-   8.3: Post Port Data via HTTP
-   8.4: Post Router Data via HTTP
-   8.5: Post FloatingIp Data via HTTP
-   8.6: Post Delete Data via HTTP
-   8.7: Post NewPort Data via HTTP
-   8.8: Post NewFloatingIp Data via HTTP
-   8.9: Get NewFloatingIp Data via HTTP
-   8.10: Compare Post FloatingIp Data
-   8.11: Post FloatingIp Clean Data via HTTP
-   8.12: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase9
-  ******************************
-
-  FloatingIp Delete
-   9.1: Post Network Data via HTTP(Post port need post network)
-   9.2: Post Subnet Data via HTTP(Post port need post subnet)
-   9.3: Post Port Data via HTTP
-   9.4: Post Router Data via HTTP
-   9.5: Post FloatingIp Data via HTTP
-   9.6: Post FloatingIp Clean Data via HTTP
-   9.7: Get FloatingIp Data is NULL
-   9.8: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase10
-  ******************************
-
-  Gateway Post
-   10.1: Post Network Data via HTTP(Post port need post network)
-   10.2: Post Subnet Data via HTTP(Post port need post subnet)
-   10.3: Post Port Data via HTTP
-   10.4: Post Router Data via HTTP
-   10.5: Get Gateway Data via HTTP
-   10.6: Compare Post Gateway Data
-   10.7: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase11
-  ******************************
-
-  Gateway Update
-   11.1: Post Network Data via HTTP(Post port need post network)
-   11.2: Post Subnet Data via HTTP(Post port need post subnet)
-   11.3: Post Port Data via HTTP
-   11.4: Post Router Data via HTTP
-   11.5: Post New Router Data via HTTP
-   11.6: Get Gateway Data via HTTP
-   11.7: Compare Post Gateway Data
-   11.8: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  ******************************
-   Result summary for Testcase12
-  ******************************
-
-  Gateway Delete
-   12.1: Post Network Data via HTTP(Post port need post network)
-   12.2: Post Subnet Data via HTTP(Post port need post subnet)
-   12.3: Post Port Data via HTTP
-   12.4: Post Router Data via HTTP
-   12.5: Post Del Gateway Data via HTTP
-   12.6: Get Gateway Data via HTTP
-   12.7: If Gateway Data is NULL
-   12.8: Clean Data via HTTP
-
-  *****************************
-   Result: Pass
-  *****************************
-
-  *************************************
-  Test Execution Summary
-  *************************************
-
-   Test Start           : 22 Feb 2016 16:47:39
-   Test End             : 22 Feb 2016 16:47:59
-   Execution Time       : 0:00:20.564415
-   Total tests planned  : 11
-   Total tests RUN      : 11
-   Total Pass           : 11
-   Total Fail           : 0
-   Total No Result      : 0
-   Success Percentage   : 100%
-   Execution Result     : 100%
-  Disconnecting from ONOSrest: <drivers.common.api.controller.onosrestdriver.OnosRestDriver object at 0x7fcc82fc7ad0>
diff --git a/docs/results/fuel-os-nosdn-kvm-ha.rst b/docs/results/fuel-os-nosdn-kvm-ha.rst
deleted file mode 100644 (file)
index 1693ad5..0000000
+++ /dev/null
@@ -1,1521 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-nosdn-kvm-ha
-----------------------------------------------
-
-VIM
----
-
-Tempest
-^^^^^^^
-::
-
-    +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | name                                                                                                                      | time      | status  |
-    +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                | 0.37487   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                              | 0.09209   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.94115   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list   | 1.59631   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete   | 3.03178   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                      | 11.13795  | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                          | 0.07863   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                 | 0.00116   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                    | 0.08504   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                           | 0.00099   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                             | 7.63607   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                      | 0.06693   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network           | 0.13367   | success |
-    | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_create                       | 0.0       | skip    |
-    | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_delete                       | 0.0       | skip    |
-    | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_get                          | 0.0       | skip    |
-    | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_list                         | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_create                        | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_delete                        | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_get                           | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_list                          | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_create                           | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_delete                           | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_get                              | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_list                             | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_create                                | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_delete                                | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_get                                   | 0.0       | skip    |
-    | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_list                                  | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_create                            | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_delete                            | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_get                               | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_list                              | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_job_binary_get_data                                      | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_create                                  | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_delete                                  | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_get                                     | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_list                                    | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_create               | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_delete               | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_get                  | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_get_data             | 0.0       | skip    |
-    | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_list                 | 0.0       | skip    |
-    | tempest.api.data_processing.test_jobs.JobTest.test_job_create                                                             | 0.0       | skip    |
-    | tempest.api.data_processing.test_jobs.JobTest.test_job_delete                                                             | 0.0       | skip    |
-    | tempest.api.data_processing.test_jobs.JobTest.test_job_get                                                                | 0.0       | skip    |
-    | tempest.api.data_processing.test_jobs.JobTest.test_job_list                                                               | 0.0       | skip    |
-    | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_create               | 0.0       | skip    |
-    | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_delete               | 0.0       | skip    |
-    | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_get                  | 0.0       | skip    |
-    | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_list                 | 0.0       | skip    |
-    | tempest.api.data_processing.test_plugins.PluginsTest.test_plugin_get                                                      | 0.0       | skip    |
-    | tempest.api.data_processing.test_plugins.PluginsTest.test_plugin_list                                                     | 0.0       | skip    |
-    | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_compare_db_flavors_with_os                             | 0.0       | skip    |
-    | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_get_db_flavor                                          | 0.0       | skip    |
-    | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_list_db_flavors                                        | 0.0       | skip    |
-    | tempest.api.database.limits.test_limits.DatabaseLimitsTest.test_absolute_limits                                           | 0.0       | skip    |
-    | tempest.api.database.versions.test_versions.DatabaseVersionsTest.test_list_db_versions                                    | 0.0       | skip    |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                           | 0.57347   | success |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                   | 0.17627   | success |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete              | 0.33315   | success |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                               | 0.08263   | success |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                               | 0.82181   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                       | 0.42812   | success |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                               | 1.89984   | success |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                             | 0.33804   | success |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                            | 0.26122   | success |
-    | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list                                | 0.43116   | success |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                               | 0.40022   | success |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                            | 1.70626   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                          | 0.07075   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                    | 0.06209   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                     | 0.06225   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                          | 0.08494   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                    | 0.04772   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                     | 0.05578   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                              | 1.27065   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                            | 2.38206   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                              | 2.46710   | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                          | 2.88813   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address            | 0.91435   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                  | 1.63719   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network                                  | 1.30351   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port                                     | 1.98554   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet                                   | 3.09141   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network                                      | 1.40844   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port                                         | 1.67281   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet                                       | 2.34230   | success |
-    | tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet                               | 1.77383   | success |
-    | tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility                                       | 0.27369   | success |
-    | tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks                                                     | 0.21206   | success |
-    | tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets                                                      | 0.05304   | success |
-    | tempest.api.network.test_networks.NetworksIpV6Test.test_show_network                                                      | 0.03923   | success |
-    | tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet                                                       | 0.21345   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                          | 1.96905   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                  | 0.41775   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                | 0.04545   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                 | 0.03878   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                 | 0.03483   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                  | 0.19582   | success |
-    | tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet                                   | 1.74789   | success |
-    | tempest.api.network.test_networks.NetworksTest.test_external_network_visibility                                           | 0.23307   | success |
-    | tempest.api.network.test_networks.NetworksTest.test_list_networks                                                         | 0.05593   | success |
-    | tempest.api.network.test_networks.NetworksTest.test_list_subnets                                                          | 0.03420   | success |
-    | tempest.api.network.test_networks.NetworksTest.test_show_network                                                          | 0.22495   | success |
-    | tempest.api.network.test_networks.NetworksTest.test_show_subnet                                                           | 0.04874   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                             | 1.87449   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                  | 1.73660   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                           | 1.47535   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                          | 0.07632   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                           | 0.22105   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                 | 1.88100   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                      | 2.43974   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                               | 0.73850   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                              | 0.23058   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                               | 0.22952   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                      | 4.10475   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                            | 2.05694   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                          | 1.35753   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                               | 1.43959   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                          | 3.83507   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                | 2.17349   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                              | 1.93067   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                   | 1.12709   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group              | 1.29264   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                     | 1.59275   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                       | 0.03756   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                  | 1.57130   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                         | 1.52547   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                           | 0.05488   | success |
-    | tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools       | 1.47037   | success |
-    | tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota                                  | 0.0       | fail    |
-    | tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object                                 | 0.0       | fail    |
-    | tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata                                   | 0.0       | fail    |
-    | tempest.api.object_storage.test_account_services.AccountTest.test_list_containers                                         | 0.0       | fail    |
-    | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object                             | 0.32095   | fail    |
-    | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects                         | 0.02198   | fail    |
-    | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object                             | 0.01216   | fail    |
-    | tempest.api.object_storage.test_container_services.ContainerTest.test_create_container                                    | 0.36258   | fail    |
-    | tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents                             | 0.01330   | fail    |
-    | tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata                             | 0.01521   | fail    |
-    | tempest.api.object_storage.test_object_services.ObjectTest.test_create_object                                             | 0.0       | fail    |
-    | tempest.api.object_storage.test_object_services.ObjectTest.test_get_object                                                | 0.0       | fail    |
-    | tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata                                      | 0.0       | fail    |
-    | tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata                                    | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                            | 0.40358   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                            | 4.40282   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                        | 0.04414   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                               | 1.05533   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                           | 0.48932   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                               | 0.49844   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate               | 0.49092   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change     | 0.60408   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change   | 0.63262   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                  | 2.74910   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                      | 0.04588   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 5.96533   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 2.93564   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                        | 2.06137   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                        | 2.08282   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                 | 7.85484   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                      | 13.98156  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                 | 7.31661   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                      | 14.01416  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                               | 0.06604   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                               | 0.25951   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                        | 49.36369  | success |
-    | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops                                           | 25.33085  | success |
-    | tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes                                     | 0.0       | skip    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                  | 103.45858 | success |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                | 76.91454  | success |
-    +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    2016-04-26 01:22:55,788 - run_tempest - INFO - Results: {'timestart': '2016-04-2601:09:10.555191', 'duration': 824, 'tests': 171, 'failures': 14}
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    2016-04-26 01:24:50,982 - run_rally - INFO - Starting test scenario "authenticate" ...
-    2016-04-26 01:25:56,731 - run_rally - INFO -
-     Preparing input task
-     Task  8204ef26-e392-473b-b607-fe79c30f3c6c: started
-    Task 8204ef26-e392-473b-b607-fe79c30f3c6c: finished
-
-    test scenario Authenticate.validate_glance
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_glance_2_times | 0.823     | 0.883        | 0.951        | 0.954        | 0.957     | 0.885     | 100.0%  | 10    |
-    | total                                | 1.01      | 1.089        | 1.144        | 1.158        | 1.172     | 1.085     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.33679389954
-    Full duration: 10.0142049789
-
-    test scenario Authenticate.keystone
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.keystone | 0.173     | 0.191        | 0.195        | 0.201        | 0.206     | 0.189     | 100.0%  | 10    |
-    | total                 | 0.173     | 0.191        | 0.195        | 0.201        | 0.206     | 0.189     | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.59915304184
-    Full duration: 6.89671802521
-
-    test scenario Authenticate.validate_heat
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_heat_2_times | 0.436     | 0.468        | 0.496        | 0.499        | 0.502     | 0.47      | 100.0%  | 10    |
-    | total                              | 0.637     | 0.668        | 0.704        | 0.705        | 0.707     | 0.671     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.02648496628
-    Full duration: 8.63242101669
-
-    test scenario Authenticate.validate_nova
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_nova_2_times | 0.245     | 0.281        | 0.405        | 0.41         | 0.416     | 0.301     | 100.0%  | 10    |
-    | total                              | 0.423     | 0.459        | 0.585        | 0.607        | 0.628     | 0.488     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.44381713867
-    Full duration: 8.15497398376
-
-    test scenario Authenticate.validate_cinder
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_cinder_2_times | 0.245     | 0.435        | 0.501        | 0.598        | 0.695     | 0.446     | 100.0%  | 10    |
-    | total                                | 0.416     | 0.662        | 0.692        | 0.777        | 0.862     | 0.642     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.90059304237
-    Full duration: 8.63323712349
-
-    test scenario Authenticate.validate_neutron
-    +------------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                           Response Times (sec)                                                           |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_neutron_2_times | 0.312     | 0.491        | 0.599        | 0.608        | 0.617     | 0.493     | 100.0%  | 10    |
-    | total                                 | 0.512     | 0.69         | 0.788        | 0.798        | 0.808     | 0.69      | 100.0%  | 10    |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.07425689697
-    Full duration: 8.5414249897
-
-    2016-04-26 01:25:58,048 - run_rally - INFO - Test scenario: "authenticate" OK.
-
-    2016-04-26 01:25:58,314 - run_rally - INFO - Starting test scenario "glance" ...
-    2016-04-26 01:29:06,596 - run_rally - INFO -
-     Preparing input task
-     Task  4929df57-a129-42f5-bf1e-e1acf761f7dd: started
-    Task 4929df57-a129-42f5-bf1e-e1acf761f7dd: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                  |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.list_images | 0.629     | 0.677        | 0.844        | 0.862        | 0.879     | 0.706     | 100.0%  | 10    |
-    | total              | 0.629     | 0.677        | 0.844        | 0.862        | 0.879     | 0.706     | 100.0%  | 10    |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.06210279465
-    Full duration: 11.1119971275
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 6.132     | 6.43         | 6.695        | 6.801        | 6.907     | 6.444     | 100.0%  | 10    |
-    | nova.boot_servers   | 12.665    | 13.469       | 14.176       | 14.374       | 14.573    | 13.486    | 100.0%  | 10    |
-    | total               | 19.057    | 19.947       | 20.84        | 20.94        | 21.039    | 19.931    | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 58.8742520809
-    Full duration: 95.2440040112
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 6.278     | 6.53         | 7.761        | 11.222       | 14.683    | 7.394     | 100.0%  | 10    |
-    | glance.list_images  | 0.299     | 0.472        | 0.515        | 0.522        | 0.529     | 0.462     | 100.0%  | 10    |
-    | total               | 6.752     | 7.034        | 8.227        | 11.691       | 15.154    | 7.856     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 22.2857620716
-    Full duration: 34.3181619644
-
-    test scenario GlanceImages.create_and_delete_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 6.137     | 6.554        | 6.898        | 6.924        | 6.95      | 6.58      | 100.0%  | 10    |
-    | glance.delete_image | 1.285     | 1.713        | 1.917        | 1.962        | 2.006     | 1.713     | 100.0%  | 10    |
-    | total               | 7.602     | 8.362        | 8.696        | 8.748        | 8.799     | 8.292     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 25.0005450249
-    Full duration: 34.4151468277
-
-    2016-04-26 01:29:07,930 - run_rally - INFO - Test scenario: "glance" OK.
-
-    2016-04-26 01:29:08,087 - run_rally - INFO - Starting test scenario "cinder" ...
-    2016-04-26 02:24:09,641 - run_rally - INFO - Percentage error: n/a, | total                | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-
-    2016-04-26 02:24:09,661 - run_rally - INFO - Percentage error: n/a, | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-
-    2016-04-26 02:24:09,663 - run_rally - INFO - Percentage error: n/a, | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-
-    2016-04-26 02:24:09,666 - run_rally - INFO - Percentage error: n/a, | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-
-    2016-04-26 02:24:09,780 - run_rally - INFO -
-     Preparing input task
-     Task  3d8fb27f-5dfb-4a07-ad7d-cec99384404f: started
-    Task 3d8fb27f-5dfb-4a07-ad7d-cec99384404f: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | cinder.create_volume | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.attach_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.detach_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | total                | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 438.78555584
-    Full duration: 476.062150002
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 7.312     | 9.44         | 9.821        | 9.964        | 10.107    | 9.128     | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.058     | 0.27         | 0.297        | 0.324        | 0.35      | 0.215     | 100.0%  | 10    |
-    | total                | 7.37      | 9.626        | 10.164       | 10.275       | 10.386    | 9.343     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 28.7357289791
-    Full duration: 47.5475459099
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.202     | 3.516        | 3.662        | 3.711        | 3.761     | 3.5       | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.05      | 0.224        | 0.315        | 0.344        | 0.372     | 0.193     | 100.0%  | 10    |
-    | total                | 3.298     | 3.743        | 3.868        | 3.888        | 3.907     | 3.693     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.2217340469
-    Full duration: 27.984375
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 2.92      | 3.143        | 4.9          | 4.966        | 5.032     | 3.472     | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.023     | 0.029        | 0.218        | 0.233        | 0.248     | 0.072     | 100.0%  | 10    |
-    | total                  | 2.955     | 3.197        | 4.927        | 4.993        | 5.06      | 3.545     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 9.69527101517
-    Full duration: 42.2511930466
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.018     | 3.457        | 3.685        | 3.737        | 3.788     | 3.413     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.914     | 2.612        | 3.053        | 3.069        | 3.085     | 2.563     | 100.0%  | 10    |
-    | total                | 3.932     | 6.16         | 6.58         | 6.669        | 6.759     | 5.977     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 17.8796432018
-    Full duration: 31.8870809078
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 8.958     | 9.585        | 9.884        | 10.249       | 10.614    | 9.589     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.775     | 2.647        | 3.059        | 3.255        | 3.451     | 2.387     | 100.0%  | 10    |
-    | total                | 10.49     | 12.128       | 12.864       | 13.066       | 13.269    | 11.977    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 35.2168581486
-    Full duration: 50.825067997
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.192     | 3.607        | 4.26         | 4.265        | 4.27      | 3.682     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.551     | 2.625        | 3.0          | 3.039        | 3.079     | 2.731     | 100.0%  | 10    |
-    | total                | 5.766     | 6.169        | 7.217        | 7.239        | 7.262     | 6.413     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 19.1643960476
-    Full duration: 32.8357338905
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +----------------------------------------------------------------------------------------------------------------------------------+
-    |                                                       Response Times (sec)                                                       |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume          | 3.223     | 3.533        | 3.679        | 3.775        | 3.87      | 3.545     | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 24.815    | 36.631       | 39.206       | 39.953       | 40.701    | 34.888    | 100.0%  | 10    |
-    | cinder.delete_volume          | 2.335     | 2.578        | 2.734        | 2.742        | 2.75      | 2.535     | 100.0%  | 10    |
-    | nova.delete_image             | 1.988     | 2.228        | 2.551        | 2.734        | 2.917     | 2.296     | 100.0%  | 10    |
-    | total                         | 32.77     | 45.39        | 47.552       | 48.244       | 48.935    | 43.265    | 100.0%  | 10    |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 124.777842999
-    Full duration: 139.828857899
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.281     | 3.509        | 3.788        | 3.8          | 3.812     | 3.517     | 100.0%  | 10    |
-    | total                | 3.281     | 3.509        | 3.788        | 3.8          | 3.813     | 3.517     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 10.4726939201
-    Full duration: 25.0890491009
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.219     | 3.547        | 3.845        | 3.858        | 3.872     | 3.556     | 100.0%  | 10    |
-    | total                | 3.22      | 3.548        | 3.845        | 3.858        | 3.872     | 3.556     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 10.6221859455
-    Full duration: 28.0074269772
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.list_volumes | 0.459     | 0.521        | 0.574        | 0.58         | 0.585     | 0.523     | 100.0%  | 10    |
-    | total               | 0.459     | 0.521        | 0.574        | 0.58         | 0.586     | 0.523     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.56029701233
-    Full duration: 54.4247999191
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | cinder.create_snapshot | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.attach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.detach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 428.079464197
-    Full duration: 524.52899909
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | cinder.create_snapshot | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.attach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.detach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 423.273214102
-    Full duration: 1129.47603798
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | cinder.create_snapshot | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.attach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | nova.detach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 426.579771996
-    Full duration: 529.032740116
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 2.8       | 2.961        | 3.287        | 4.217        | 5.148     | 3.157     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.364     | 2.643        | 2.86         | 2.881        | 2.902     | 2.611     | 100.0%  | 10    |
-    | total                  | 5.173     | 5.494        | 6.148        | 7.099        | 8.05      | 5.769     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 16.4653530121
-    Full duration: 44.3639709949
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.119     | 3.685        | 4.169        | 4.22         | 4.27      | 3.741     | 100.0%  | 10    |
-    | cinder.extend_volume | 2.536     | 3.106        | 3.175        | 3.189        | 3.203     | 3.023     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.42      | 2.895        | 3.05         | 3.068        | 3.087     | 2.822     | 100.0%  | 10    |
-    | total                | 8.68      | 9.571        | 10.355       | 10.358       | 10.362    | 9.586     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 28.6492631435
-    Full duration: 42.1216299534
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.108     | 3.632        | 3.846        | 3.968        | 4.089     | 3.621     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.54      | 2.847        | 3.276        | 3.29         | 3.304     | 2.881     | 100.0%  | 10    |
-    | total                | 6.172     | 6.512        | 6.734        | 6.756        | 6.778     | 6.502     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 19.1909890175
-    Full duration: 46.976804018
-
-    2016-04-26 02:24:11,068 - run_rally - INFO - Test scenario: "cinder" Failed.
-
-    2016-04-26 02:24:12,074 - run_rally - INFO - Starting test scenario "heat" ...
-    2016-04-26 04:42:36,239 - run_rally - INFO - Percentage error: n/a, | total             | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
-
-    2016-04-26 04:42:36,363 - run_rally - INFO -
-     Preparing input task
-     Task  e9e698b5-79f5-41a7-be5f-04761a3c0034: started
-    Task e9e698b5-79f5-41a7-be5f-04761a3c0034: finished
-
-    test scenario HeatStacks.create_suspend_resume_delete_stack
-    +-----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                  |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack  | 3.62      | 3.722        | 4.104        | 4.115        | 4.126     | 3.846     | 100.0%  | 10    |
-    | heat.suspend_stack | 1.392     | 1.475        | 1.609        | 1.616        | 1.623     | 1.493     | 100.0%  | 10    |
-    | heat.resume_stack  | 1.339     | 1.369        | 1.514        | 1.533        | 1.553     | 1.406     | 100.0%  | 10    |
-    | heat.delete_stack  | 1.283     | 1.429        | 1.447        | 1.461        | 1.474     | 1.382     | 100.0%  | 10    |
-    | total              | 7.77      | 8.014        | 8.597        | 8.614        | 8.631     | 8.127     | 100.0%  | 10    |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 24.2256169319
-    Full duration: 33.6042699814
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.528     | 3.756        | 3.905        | 3.933        | 3.961     | 3.764     | 100.0%  | 10    |
-    | heat.delete_stack | 1.311     | 1.341        | 1.386        | 1.503        | 1.62      | 1.366     | 100.0%  | 10    |
-    | total             | 5.037     | 5.102        | 5.246        | 5.271        | 5.296     | 5.13      | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 15.2723751068
-    Full duration: 24.6334218979
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 20.555    | 22.623       | 23.694       | 23.77        | 23.845    | 22.663    | 100.0%  | 10    |
-    | heat.delete_stack | 9.082     | 10.25        | 10.461       | 10.929       | 11.397    | 9.938     | 100.0%  | 10    |
-    | total             | 29.655    | 32.918       | 33.982       | 33.989       | 33.997    | 32.602    | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 97.7232019901
-    Full duration: 107.206387043
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
-    | heat.delete_stack | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
-    | total             | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 7201.48637915
-    Full duration: 7812.01388121
-
-    test scenario HeatStacks.list_stacks_and_resources
-    +------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                        Response Times (sec)                                                        |
-    +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.list_stacks                | 0.371     | 0.401        | 0.42         | 0.421        | 0.423     | 0.4       | 100.0%  | 10    |
-    | heat.list_resources_of_0_stacks | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
-    | total                           | 0.371     | 0.401        | 0.42         | 0.422        | 0.423     | 0.4       | 100.0%  | 10    |
-    +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.24707102776
-    Full duration: 7.24165606499
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.41      | 3.442        | 3.472        | 3.481        | 3.49      | 3.444     | 100.0%  | 10    |
-    | heat.update_stack | 3.427     | 3.453        | 3.509        | 3.599        | 3.69      | 3.475     | 100.0%  | 10    |
-    | heat.delete_stack | 1.295     | 1.311        | 1.326        | 1.329        | 1.332     | 1.312     | 100.0%  | 10    |
-    | total             | 8.162     | 8.205        | 8.277        | 8.357        | 8.436     | 8.231     | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 24.6856651306
-    Full duration: 32.1383240223
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.326     | 3.417        | 3.624        | 3.676        | 3.728     | 3.459     | 100.0%  | 10    |
-    | heat.update_stack | 3.408     | 3.52         | 3.811        | 3.819        | 3.828     | 3.573     | 100.0%  | 10    |
-    | heat.delete_stack | 1.276     | 1.302        | 1.335        | 1.398        | 1.46      | 1.317     | 100.0%  | 10    |
-    | total             | 8.14      | 8.309        | 8.56         | 8.596        | 8.632     | 8.349     | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 25.028924942
-    Full duration: 32.9079070091
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.527     | 4.137        | 4.746        | 4.747        | 4.748     | 4.133     | 100.0%  | 10    |
-    | heat.update_stack | 5.668     | 5.712        | 5.744        | 5.767        | 5.789     | 5.712     | 100.0%  | 10    |
-    | heat.delete_stack | 2.413     | 2.431        | 2.441        | 2.446        | 2.451     | 2.431     | 100.0%  | 10    |
-    | total             | 11.652    | 12.305       | 12.891       | 12.9         | 12.909    | 12.276    | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 37.3458311558
-    Full duration: 45.2056248188
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 4.501     | 4.64         | 4.77         | 4.782        | 4.793     | 4.64      | 100.0%  | 10    |
-    | heat.update_stack | 7.947     | 9.065        | 9.146        | 9.207        | 9.269     | 8.97      | 100.0%  | 10    |
-    | heat.delete_stack | 2.4       | 2.442        | 2.645        | 3.133        | 3.62      | 2.563     | 100.0%  | 10    |
-    | total             | 14.999    | 16.132       | 16.488       | 16.984       | 17.479    | 16.174    | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 49.7609598637
-    Full duration: 58.2143821716
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.481     | 3.63         | 4.77         | 4.771        | 4.772     | 4.024     | 100.0%  | 10    |
-    | heat.update_stack | 5.615     | 5.681        | 5.721        | 5.745        | 5.77      | 5.683     | 100.0%  | 10    |
-    | heat.delete_stack | 2.4       | 2.433        | 2.467        | 2.492        | 2.516     | 2.438     | 100.0%  | 10    |
-    | total             | 11.536    | 11.803       | 12.864       | 12.933       | 13.001    | 12.145    | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 36.3764190674
-    Full duration: 44.1169888973
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.513     | 3.601        | 3.641        | 3.658        | 3.674     | 3.59      | 100.0%  | 10    |
-    | heat.update_stack | 3.405     | 3.427        | 3.437        | 3.457        | 3.477     | 3.427     | 100.0%  | 10    |
-    | heat.delete_stack | 1.298     | 1.326        | 1.353        | 1.356        | 1.358     | 1.328     | 100.0%  | 10    |
-    | total             | 8.251     | 8.353        | 8.412        | 8.416        | 8.42      | 8.345     | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 25.0552000999
-    Full duration: 33.6825659275
-
-    test scenario HeatStacks.create_and_list_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.53      | 3.568        | 3.594        | 3.61         | 3.626     | 3.57      | 100.0%  | 10    |
-    | heat.list_stacks  | 0.047     | 0.073        | 0.102        | 0.107        | 0.111     | 0.075     | 100.0%  | 10    |
-    | total             | 3.6       | 3.639        | 3.69         | 3.696        | 3.702     | 3.646     | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.0165708065
-    Full duration: 22.4389858246
-
-    test scenario HeatStacks.create_check_delete_stack
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | heat.create_stack | 3.561     | 3.575        | 3.625        | 3.627        | 3.63      | 3.585     | 100.0%  | 10    |
-    | heat.check_stack  | 1.396     | 1.41         | 1.433        | 1.439        | 1.445     | 1.413     | 100.0%  | 10    |
-    | heat.delete_stack | 1.266     | 1.309        | 1.32         | 1.323        | 1.327     | 1.302     | 100.0%  | 10    |
-    | total             | 6.234     | 6.289        | 6.339        | 6.347        | 6.355     | 6.3       | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 18.943114996
-    Full duration: 27.5446438789
-
-    2016-04-26 04:42:37,867 - run_rally - INFO - Test scenario: "heat" Failed.
-
-    2016-04-26 04:42:38,263 - run_rally - INFO - Starting test scenario "keystone" ...
-    2016-04-26 04:44:49,615 - run_rally - INFO -
-     Preparing input task
-     Task  20bc8dfd-1a51-488b-97df-c30ea71319be: started
-    Task 20bc8dfd-1a51-488b-97df-c30ea71319be: finished
-
-    test scenario KeystoneBasic.create_tenant_with_users
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_tenant | 0.27      | 0.29         | 0.299        | 0.303        | 0.308     | 0.289     | 100.0%  | 10    |
-    | keystone.create_users  | 1.059     | 1.132        | 1.206        | 1.212        | 1.218     | 1.138     | 100.0%  | 10    |
-    | total                  | 1.348     | 1.431        | 1.504        | 1.507        | 1.51      | 1.427     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 4.29734396935
-    Full duration: 16.6833910942
-
-    test scenario KeystoneBasic.create_add_and_list_user_roles
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_role | 0.241     | 0.277        | 0.302        | 0.303        | 0.303     | 0.275     | 100.0%  | 10    |
-    | keystone.add_role    | 0.16      | 0.176        | 0.19         | 0.193        | 0.196     | 0.177     | 100.0%  | 10    |
-    | keystone.list_roles  | 0.085     | 0.095        | 0.1          | 0.104        | 0.108     | 0.095     | 100.0%  | 10    |
-    | total                | 0.501     | 0.55         | 0.583        | 0.589        | 0.595     | 0.547     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.68035697937
-    Full duration: 10.5181751251
-
-    test scenario KeystoneBasic.add_and_remove_user_role
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_role | 0.267     | 0.289        | 0.32         | 0.322        | 0.324     | 0.294     | 100.0%  | 10    |
-    | keystone.add_role    | 0.148     | 0.172        | 0.194        | 0.195        | 0.196     | 0.172     | 100.0%  | 10    |
-    | keystone.remove_role | 0.093     | 0.132        | 0.166        | 0.168        | 0.169     | 0.133     | 100.0%  | 10    |
-    | total                | 0.527     | 0.616        | 0.63         | 0.638        | 0.646     | 0.599     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.79448008537
-    Full duration: 10.6772811413
-
-    test scenario KeystoneBasic.create_update_and_delete_tenant
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_tenant | 0.277     | 0.31         | 0.398        | 0.421        | 0.443     | 0.33      | 100.0%  | 10    |
-    | keystone.update_tenant | 0.083     | 0.097        | 0.116        | 0.117        | 0.118     | 0.1       | 100.0%  | 10    |
-    | keystone.delete_tenant | 0.198     | 0.236        | 0.247        | 0.249        | 0.251     | 0.232     | 100.0%  | 10    |
-    | total                  | 0.598     | 0.643        | 0.731        | 0.761        | 0.791     | 0.662     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.00753998756
-    Full duration: 9.88667607307
-
-    test scenario KeystoneBasic.create_and_delete_service
-    +----------------------------------------------------------------------------------------------------------------------------+
-    |                                                    Response Times (sec)                                                    |
-    +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_service | 0.276     | 0.302        | 0.313        | 0.344        | 0.374     | 0.305     | 100.0%  | 10    |
-    | keystone.delete_service | 0.092     | 0.105        | 0.118        | 0.118        | 0.119     | 0.106     | 100.0%  | 10    |
-    | total                   | 0.369     | 0.41         | 0.421        | 0.444        | 0.467     | 0.411     | 100.0%  | 10    |
-    +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.31590604782
-    Full duration: 9.7633960247
-
-    test scenario KeystoneBasic.create_tenant
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_tenant | 0.283     | 0.314        | 0.348        | 0.359        | 0.371     | 0.32      | 100.0%  | 10    |
-    | total                  | 0.283     | 0.315        | 0.348        | 0.36         | 0.371     | 0.32      | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.971438169479
-    Full duration: 6.68577694893
-
-    test scenario KeystoneBasic.create_user
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_user | 0.308     | 0.325        | 0.341        | 0.345        | 0.349     | 0.326     | 100.0%  | 10    |
-    | total                | 0.308     | 0.326        | 0.341        | 0.345        | 0.349     | 0.326     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.01120591164
-    Full duration: 6.84676504135
-
-    test scenario KeystoneBasic.create_and_list_tenants
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_tenant | 0.26      | 0.276        | 0.295        | 0.297        | 0.3       | 0.277     | 100.0%  | 10    |
-    | keystone.list_tenants  | 0.071     | 0.082        | 0.09         | 0.094        | 0.098     | 0.083     | 100.0%  | 10    |
-    | total                  | 0.333     | 0.361        | 0.378        | 0.38         | 0.383     | 0.36      | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.12287592888
-    Full duration: 9.86326503754
-
-    test scenario KeystoneBasic.create_and_delete_role
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_role | 0.285     | 0.323        | 0.381        | 0.382        | 0.382     | 0.33      | 100.0%  | 10    |
-    | keystone.delete_role | 0.167     | 0.191        | 0.225        | 0.226        | 0.228     | 0.194     | 100.0%  | 10    |
-    | total                | 0.47      | 0.513        | 0.582        | 0.595        | 0.609     | 0.524     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.57796812057
-    Full duration: 9.51138591766
-
-    test scenario KeystoneBasic.get_entities
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_tenant | 0.282     | 0.31         | 0.334        | 0.364        | 0.395     | 0.315     | 100.0%  | 10    |
-    | keystone.create_user   | 0.1       | 0.104        | 0.122        | 0.122        | 0.123     | 0.108     | 100.0%  | 10    |
-    | keystone.create_role   | 0.079     | 0.092        | 0.102        | 0.107        | 0.112     | 0.094     | 100.0%  | 10    |
-    | keystone.get_tenant    | 0.072     | 0.08         | 0.087        | 0.089        | 0.092     | 0.081     | 100.0%  | 10    |
-    | keystone.get_user      | 0.087     | 0.091        | 0.114        | 0.139        | 0.163     | 0.099     | 100.0%  | 10    |
-    | keystone.get_role      | 0.07      | 0.078        | 0.085        | 0.086        | 0.088     | 0.078     | 100.0%  | 10    |
-    | keystone.service_list  | 0.079     | 0.086        | 0.103        | 0.124        | 0.145     | 0.093     | 100.0%  | 10    |
-    | keystone.get_service   | 0.069     | 0.086        | 0.093        | 0.096        | 0.098     | 0.084     | 100.0%  | 10    |
-    | total                  | 0.889     | 0.939        | 1.023        | 1.035        | 1.048     | 0.952     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.919891119
-    Full duration: 15.3317778111
-
-    test scenario KeystoneBasic.create_and_list_users
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | keystone.create_user | 0.287     | 0.314        | 0.336        | 0.345        | 0.354     | 0.316     | 100.0%  | 10    |
-    | keystone.list_users  | 0.072     | 0.081        | 0.096        | 0.097        | 0.097     | 0.083     | 100.0%  | 10    |
-    | total                | 0.365     | 0.393        | 0.424        | 0.431        | 0.437     | 0.399     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.23520803452
-    Full duration: 7.35707998276
-
-    2016-04-26 04:44:50,952 - run_rally - INFO - Test scenario: "keystone" OK.
-
-    2016-04-26 04:44:51,319 - run_rally - INFO - Starting test scenario "neutron" ...
-    2016-04-26 04:51:16,265 - run_rally - INFO -
-     Preparing input task
-     Task  256bf66d-8312-4077-869b-394a1574c2e3: started
-    Task 256bf66d-8312-4077-869b-394a1574c2e3: finished
-
-    test scenario NeutronNetworks.create_and_delete_ports
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_port | 0.607     | 0.653        | 0.721        | 0.75         | 0.78      | 0.666     | 100.0%  | 10    |
-    | neutron.delete_port | 0.175     | 0.407        | 0.455        | 0.462        | 0.469     | 0.37      | 100.0%  | 10    |
-    | total               | 0.814     | 1.09         | 1.137        | 1.137        | 1.137     | 1.036     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.12694001198
-    Full duration: 32.3510808945
-
-    test scenario NeutronNetworks.create_and_list_routers
-    +---------------------------------------------------------------------------------------------------------------------------------+
-    |                                                      Response Times (sec)                                                       |
-    +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_subnet        | 0.578     | 0.606        | 0.635        | 0.643        | 0.65      | 0.609     | 100.0%  | 10    |
-    | neutron.create_router        | 0.06      | 0.256        | 0.307        | 0.341        | 0.376     | 0.237     | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.244     | 0.508        | 0.566        | 0.589        | 0.612     | 0.476     | 100.0%  | 10    |
-    | neutron.list_routers         | 0.04      | 0.238        | 0.271        | 0.275        | 0.278     | 0.194     | 100.0%  | 10    |
-    | total                        | 1.169     | 1.517        | 1.722        | 1.742        | 1.762     | 1.517     | 100.0%  | 10    |
-    +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 4.54089903831
-    Full duration: 35.4128360748
-
-    test scenario NeutronNetworks.create_and_update_networks
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_network | 0.523     | 0.561        | 0.635        | 0.642        | 0.648     | 0.573     | 100.0%  | 10    |
-    | neutron.update_network | 0.106     | 0.337        | 0.376        | 0.391        | 0.406     | 0.303     | 100.0%  | 10    |
-    | total                  | 0.691     | 0.877        | 1.006        | 1.007        | 1.008     | 0.876     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.54131317139
-    Full duration: 19.3984429836
-
-    test scenario NeutronNetworks.create_and_list_ports
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_port | 0.581     | 0.643        | 0.971        | 1.006        | 1.042     | 0.712     | 100.0%  | 10    |
-    | neutron.list_ports  | 0.102     | 0.365        | 0.455        | 0.469        | 0.483     | 0.307     | 100.0%  | 10    |
-    | total               | 0.725     | 1.086        | 1.149        | 1.292        | 1.435     | 1.019     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.83818507195
-    Full duration: 32.8225178719
-
-    test scenario NeutronNetworks.create_and_delete_subnets
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_subnet | 0.571     | 0.62         | 0.673        | 0.682        | 0.69      | 0.626     | 100.0%  | 10    |
-    | neutron.delete_subnet | 0.136     | 0.358        | 0.5          | 0.571        | 0.642     | 0.333     | 100.0%  | 10    |
-    | total                 | 0.724     | 0.978        | 1.14         | 1.183        | 1.227     | 0.959     | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.04690408707
-    Full duration: 31.1584250927
-
-    test scenario NeutronNetworks.create_and_update_subnets
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_subnet | 0.579     | 0.74         | 0.789        | 0.831        | 0.873     | 0.728     | 100.0%  | 10    |
-    | neutron.update_subnet | 0.166     | 0.4          | 0.491        | 0.516        | 0.541     | 0.378     | 100.0%  | 10    |
-    | total                 | 0.789     | 1.155        | 1.275        | 1.279        | 1.283     | 1.106     | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.20878195763
-    Full duration: 31.9853599072
-
-    test scenario NeutronNetworks.create_and_list_networks
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_network | 0.524     | 0.589        | 0.694        | 0.736        | 0.779     | 0.613     | 100.0%  | 10    |
-    | neutron.list_networks  | 0.046     | 0.171        | 0.409        | 0.461        | 0.513     | 0.211     | 100.0%  | 10    |
-    | total                  | 0.58      | 0.747        | 1.083        | 1.09         | 1.096     | 0.824     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.37781405449
-    Full duration: 19.9551098347
-
-    test scenario NeutronNetworks.create_and_update_routers
-    +---------------------------------------------------------------------------------------------------------------------------------+
-    |                                                      Response Times (sec)                                                       |
-    +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_subnet        | 0.592     | 0.623        | 0.664        | 0.665        | 0.667     | 0.628     | 100.0%  | 10    |
-    | neutron.create_router        | 0.269     | 0.279        | 0.31         | 0.32         | 0.329     | 0.287     | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.28      | 0.484        | 0.653        | 0.671        | 0.688     | 0.477     | 100.0%  | 10    |
-    | neutron.update_router        | 0.156     | 0.389        | 0.45         | 0.456        | 0.462     | 0.361     | 100.0%  | 10    |
-    | total                        | 1.388     | 1.739        | 1.953        | 1.981        | 2.009     | 1.754     | 100.0%  | 10    |
-    +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 5.26099705696
-    Full duration: 37.1857252121
-
-    test scenario NeutronNetworks.create_and_delete_routers
-    +------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                        Response Times (sec)                                                        |
-    +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_subnet           | 0.558     | 0.624        | 0.707        | 0.736        | 0.765     | 0.637     | 100.0%  | 10    |
-    | neutron.create_router           | 0.044     | 0.288        | 0.341        | 0.362        | 0.383     | 0.253     | 100.0%  | 10    |
-    | neutron.add_interface_router    | 0.299     | 0.527        | 0.563        | 0.573        | 0.583     | 0.502     | 100.0%  | 10    |
-    | neutron.remove_interface_router | 0.241     | 0.46         | 0.559        | 0.56         | 0.561     | 0.444     | 100.0%  | 10    |
-    | neutron.delete_router           | 0.15      | 0.392        | 0.469        | 0.487        | 0.505     | 0.343     | 100.0%  | 10    |
-    | total                           | 1.845     | 2.118        | 2.453        | 2.507        | 2.56      | 2.179     | 100.0%  | 10    |
-    +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 6.46906304359
-    Full duration: 37.6224770546
-
-    test scenario NeutronNetworks.create_and_update_ports
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_port | 0.605     | 0.665        | 0.825        | 0.85         | 0.876     | 0.691     | 100.0%  | 10    |
-    | neutron.update_port | 0.126     | 0.359        | 0.409        | 0.423        | 0.437     | 0.325     | 100.0%  | 10    |
-    | total               | 0.731     | 1.054        | 1.179        | 1.192        | 1.205     | 1.017     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.16282176971
-    Full duration: 34.5440177917
-
-    test scenario NeutronNetworks.create_and_list_subnets
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_subnet | 0.578     | 0.613        | 0.667        | 0.678        | 0.689     | 0.622     | 100.0%  | 10    |
-    | neutron.list_subnets  | 0.23      | 0.266        | 0.336        | 0.34         | 0.344     | 0.276     | 100.0%  | 10    |
-    | total                 | 0.835     | 0.9          | 0.963        | 0.966        | 0.969     | 0.898     | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.74195313454
-    Full duration: 32.8288888931
-
-    test scenario NeutronNetworks.create_and_delete_networks
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | neutron.create_network | 0.525     | 0.612        | 0.729        | 0.735        | 0.74      | 0.626     | 100.0%  | 10    |
-    | neutron.delete_network | 0.133     | 0.375        | 0.446        | 0.474        | 0.501     | 0.35      | 100.0%  | 10    |
-    | total                  | 0.739     | 1.004        | 1.113        | 1.177        | 1.242     | 0.976     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.94529485703
-    Full duration: 19.0619311333
-
-    2016-04-26 04:51:17,592 - run_rally - INFO - Test scenario: "neutron" OK.
-
-    2016-04-26 04:51:18,073 - run_rally - INFO - Starting test scenario "nova" ...
-    2016-04-26 07:03:18,875 - run_rally - INFO -
-     Preparing input task
-     Task  a238f5f4-fd3d-4015-95c9-2b0ba5d314b6: started
-    Task a238f5f4-fd3d-4015-95c9-2b0ba5d314b6: finished
-
-    test scenario NovaKeypair.create_and_delete_keypair
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.create_keypair | 0.579     | 0.646        | 0.774        | 0.918        | 1.062     | 0.695     | 100.0%  | 10    |
-    | nova.delete_keypair | 0.023     | 0.027        | 0.048        | 0.051        | 0.054     | 0.033     | 100.0%  | 10    |
-    | total               | 0.627     | 0.687        | 0.8          | 0.943        | 1.085     | 0.728     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.11327505112
-    Full duration: 24.7004601955
-
-    test scenario NovaServers.snapshot_server
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server       | 9.939     | 11.728       | 13.031       | 13.319       | 13.606    | 11.722    | 100.0%  | 10    |
-    | nova.create_image      | 9.473     | 9.734        | 10.003       | 10.052       | 10.1      | 9.728     | 100.0%  | 10    |
-    | nova.delete_server     | 2.63      | 2.927        | 3.279        | 3.899        | 4.52      | 3.033     | 100.0%  | 10    |
-    | nova.boot_server (2)   | 9.986     | 10.959       | 11.567       | 11.737       | 11.907    | 10.921    | 100.0%  | 10    |
-    | nova.delete_server (2) | 2.41      | 2.772        | 2.958        | 2.963        | 2.968     | 2.712     | 100.0%  | 10    |
-    | nova.delete_image      | 1.467     | 2.001        | 2.188        | 2.332        | 2.477     | 1.95      | 100.0%  | 10    |
-    | total                  | 37.87     | 39.802       | 41.419       | 42.304       | 43.189    | 40.067    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 120.693696976
-    Full duration: 164.095020056
-
-    test scenario NovaKeypair.boot_and_delete_server_with_keypair
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.create_keypair | 0.515     | 0.637        | 0.702        | 0.714        | 0.726     | 0.631     | 100.0%  | 10    |
-    | nova.boot_server    | 10.03     | 11.695       | 12.539       | 12.808       | 13.076    | 11.597    | 100.0%  | 10    |
-    | nova.delete_server  | 2.581     | 2.755        | 2.899        | 3.003        | 3.108     | 2.769     | 100.0%  | 10    |
-    | nova.delete_keypair | 0.026     | 0.036        | 0.044        | 0.044        | 0.045     | 0.036     | 100.0%  | 10    |
-    | total               | 13.194    | 15.135       | 15.888       | 16.111       | 16.334    | 15.033    | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 43.7031610012
-    Full duration: 84.4934301376
-
-    test scenario NovaKeypair.create_and_list_keypairs
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.create_keypair | 0.613     | 0.68         | 0.8          | 0.83         | 0.859     | 0.701     | 100.0%  | 10    |
-    | nova.list_keypairs  | 0.017     | 0.029        | 0.055        | 0.132        | 0.209     | 0.045     | 100.0%  | 10    |
-    | total               | 0.631     | 0.715        | 0.893        | 0.919        | 0.945     | 0.746     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.10457396507
-    Full duration: 25.5227000713
-
-    test scenario NovaServers.list_servers
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.list_servers | 0.963     | 1.205        | 1.239        | 1.272        | 1.304     | 1.187     | 100.0%  | 10    |
-    | total             | 0.963     | 1.205        | 1.239        | 1.272        | 1.305     | 1.187     | 100.0%  | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.61515402794
-    Full duration: 89.3156220913
-
-    test scenario NovaServers.resize_server
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server    | 11.077    | 11.648       | 13.586       | 13.788       | 13.99     | 12.144    | 100.0%  | 10    |
-    | nova.resize         | 97.438    | 98.364       | 99.784       | 101.736      | 103.687   | 98.895    | 100.0%  | 10    |
-    | nova.resize_confirm | 2.462     | 2.85         | 3.013        | 3.032        | 3.052     | 2.81      | 100.0%  | 10    |
-    | nova.delete_server  | 2.362     | 2.635        | 2.717        | 2.759        | 2.802     | 2.576     | 100.0%  | 10    |
-    | total               | 114.396   | 116.205      | 117.751      | 119.281      | 120.811   | 116.425   | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 352.596132994
-    Full duration: 373.961167812
-
-    test scenario NovaServers.boot_server_from_volume_and_delete
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 9.652     | 10.151       | 10.573       | 10.621       | 10.669    | 10.165    | 100.0%  | 10    |
-    | nova.boot_server     | 10.713    | 13.21        | 14.394       | 14.695       | 14.996    | 13.013    | 100.0%  | 10    |
-    | nova.delete_server   | 4.701     | 4.969        | 5.039        | 5.159        | 5.279     | 4.942     | 100.0%  | 10    |
-    | total                | 25.26     | 27.982       | 30.104       | 30.137       | 30.17     | 28.121    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 83.7665529251
-    Full duration: 133.76401782
-
-    test scenario NovaServers.boot_and_migrate_server
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server    | 9.342     | 11.196       | 12.987       | 13.225       | 13.463    | 11.305    | 80.0%   | 10    |
-    | nova.stop_server    | 61.257    | 62.345       | 63.163       | 63.249       | 63.336    | 62.301    | 80.0%   | 10    |
-    | nova.migrate        | 8.224     | 9.522        | 11.336       | 11.478       | 11.62     | 9.663     | 80.0%   | 10    |
-    | nova.resize_confirm | 2.413     | 2.724        | 3.003        | 3.108        | 3.213     | 2.704     | 100.0%  | 8     |
-    | nova.delete_server  | 2.397     | 2.418        | 2.638        | 2.652        | 2.666     | 2.495     | 100.0%  | 8     |
-    | total               | 85.3      | 88.008       | 91.856       | 92.68        | 93.504    | 88.469    | 80.0%   | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 282.145553112
-    Full duration: 310.275305033
-
-    test scenario NovaServers.boot_and_delete_server
-    +-----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                  |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server   | 10.164    | 10.763       | 21.145       | 31.824       | 42.503    | 14.815    | 80.0%   | 10    |
-    | nova.delete_server | 2.439     | 2.701        | 2.959        | 2.97         | 2.982     | 2.728     | 88.9%   | 9     |
-    | total              | 12.997    | 13.446       | 23.964       | 34.453       | 44.942    | 17.544    | 80.0%   | 10    |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 352.537348986
-    Full duration: 997.781033993
-
-    test scenario NovaServers.boot_and_rebuild_server
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server    | 10.618    | 11.665       | 12.726       | 12.764       | 12.802    | 11.718    | 70.0%   | 10    |
-    | nova.rebuild_server | 69.264    | 71.18        | 72.314       | 72.575       | 72.836    | 71.097    | 100.0%  | 7     |
-    | nova.delete_server  | 2.391     | 2.632        | 2.88         | 2.883        | 2.886     | 2.639     | 100.0%  | 7     |
-    | total               | 83.337    | 85.019       | 87.645       | 87.923       | 88.201    | 85.454    | 70.0%   | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 477.006741047
-    Full duration: 1121.04293394
-
-    test scenario NovaSecGroup.create_and_list_secgroups
-    +-----------------------------------------------------------------------------------------------------------------------------------+
-    |                                                       Response Times (sec)                                                        |
-    +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                         | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.create_10_security_groups | 3.03      | 3.488        | 3.933        | 3.989        | 4.044     | 3.487     | 100.0%  | 10    |
-    | nova.create_100_rules          | 22.925    | 23.261       | 23.92        | 24.188       | 24.456    | 23.425    | 100.0%  | 10    |
-    | nova.list_security_groups      | 0.126     | 0.16         | 0.213        | 0.294        | 0.376     | 0.18      | 100.0%  | 10    |
-    | total                          | 26.54     | 26.984       | 27.591       | 27.704       | 27.817    | 27.092    | 100.0%  | 10    |
-    +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 81.6362090111
-    Full duration: 118.557869911
-
-    test scenario NovaSecGroup.create_and_delete_secgroups
-    +-----------------------------------------------------------------------------------------------------------------------------------+
-    |                                                       Response Times (sec)                                                        |
-    +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                         | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.create_10_security_groups | 2.934     | 3.533        | 3.804        | 3.912        | 4.021     | 3.522     | 100.0%  | 10    |
-    | nova.create_100_rules          | 22.89     | 23.403       | 23.74        | 23.847       | 23.953    | 23.394    | 100.0%  | 10    |
-    | nova.delete_10_security_groups | 1.219     | 1.282        | 1.629        | 1.634        | 1.64      | 1.372     | 100.0%  | 10    |
-    | total                          | 27.6      | 28.387       | 28.547       | 28.634       | 28.722    | 28.288    | 100.0%  | 10    |
-    +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 85.2456521988
-    Full duration: 109.930608988
-
-    test scenario NovaServers.boot_and_bounce_server
-    +----------------------------------------------------------------------------------------------------------------------------+
-    |                                                    Response Times (sec)                                                    |
-    +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server        | 10.584    | 11.76        | 12.966       | 13.02        | 13.073    | 11.794    | 57.1%   | 7     |
-    | nova.reboot_server      | 4.802     | 5.11         | 5.257        | 5.278        | 5.299     | 5.08      | 100.0%  | 4     |
-    | nova.soft_reboot_server | 123.97    | 124.161      | 125.321      | 125.531      | 125.741   | 124.508   | 100.0%  | 4     |
-    | nova.stop_server        | 61.413    | 62.307       | 63.351       | 63.532       | 63.713    | 62.435    | 100.0%  | 4     |
-    | nova.start_server       | 2.747     | 2.775        | 2.996        | 3.039        | 3.082     | 2.845     | 100.0%  | 4     |
-    | nova.rescue_server      | 64.447    | 66.021       | 66.521       | 66.564       | 66.607    | 65.774    | 100.0%  | 4     |
-    | nova.unrescue_server    | 2.368     | 4.579        | 4.599        | 4.6          | 4.601     | 4.032     | 100.0%  | 4     |
-    | nova.delete_server      | 2.398     | 2.511        | 2.663        | 2.679        | 2.694     | 2.528     | 100.0%  | 4     |
-    | total                   | 274.414   | 278.786      | 282.788      | 283.426      | 284.064   | 279.013   | 57.1%   | 7     |
-    +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 584.260617018
-    Full duration: 1223.11469412
-
-    test scenario NovaServers.boot_server
-    +---------------------------------------------------------------------------------------------------------------------+
-    |                                                Response Times (sec)                                                 |
-    +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action           | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server | 11.343    | 11.648       | 12.248       | 12.342       | 12.435    | 11.804    | 55.6%   | 9     |
-    | total            | 11.344    | 11.648       | 12.249       | 12.342       | 12.435    | 11.804    | 55.6%   | 9     |
-    +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 339.613210917
-    Full duration: 959.207664013
-
-    test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-    +--------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                         |
-    +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.create_10_security_groups    | 2.471     | 2.641        | 2.886        | 2.916        | 2.947     | 2.686     | 37.5%   | 8     |
-    | nova.create_100_rules             | 20.403    | 20.759       | 21.005       | 21.036       | 21.067    | 20.743    | 37.5%   | 8     |
-    | nova.boot_server                  | 8.329     | 10.397       | 10.543       | 10.561       | 10.58     | 9.768     | 37.5%   | 8     |
-    | nova.get_attached_security_groups | 0.177     | 0.18         | 0.189        | 0.19         | 0.191     | 0.183     | 100.0%  | 3     |
-    | nova.delete_server                | 2.417     | 2.424        | 2.563        | 2.58         | 2.597     | 2.48      | 100.0%  | 3     |
-    | nova.delete_10_security_groups    | 1.146     | 1.185        | 1.295        | 1.309        | 1.323     | 1.218     | 100.0%  | 3     |
-    | total                             | 35.785    | 37.72        | 37.728       | 37.729       | 37.73     | 37.079    | 37.5%   | 8     |
-    +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 653.787332058
-    Full duration: 698.373892784
-
-    test scenario NovaServers.pause_and_unpause_server
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server    | 9.228     | 10.626       | 10.698       | 10.707       | 10.715    | 10.19     | 37.5%   | 8     |
-    | nova.pause_server   | 2.325     | 2.628        | 2.631        | 2.631        | 2.631     | 2.528     | 100.0%  | 3     |
-    | nova.unpause_server | 2.624     | 2.647        | 2.691        | 2.697        | 2.702     | 2.658     | 100.0%  | 3     |
-    | nova.delete_server  | 2.596     | 2.732        | 2.747        | 2.749        | 2.751     | 2.693     | 100.0%  | 3     |
-    | total               | 16.772    | 18.711       | 18.72        | 18.722       | 18.723    | 18.069    | 37.5%   | 8     |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 607.316802025
-    Full duration: 645.979089022
-
-    test scenario NovaServers.boot_server_from_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 8.57      | 9.398        | 10.796       | 10.932       | 11.068    | 9.692     | 60.0%   | 10    |
-    | nova.boot_server     | 11.064    | 12.084       | 12.627       | 12.859       | 13.092    | 12.061    | 60.0%   | 10    |
-    | total                | 20.261    | 21.884       | 22.881       | 22.979       | 23.078    | 21.754    | 60.0%   | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 377.391654015
-    Full duration: 411.411114931
-
-    test scenario NovaServers.boot_and_list_server
-    +----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                 |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server  | 9.689     | 10.784       | 12.049       | 12.245       | 12.44     | 10.872    | 60.0%   | 10    |
-    | nova.list_servers | 0.2       | 0.431        | 0.5          | 0.513        | 0.526     | 0.414     | 100.0%  | 6     |
-    | total             | 10.11     | 11.216       | 12.386       | 12.649       | 12.913    | 11.286    | 60.0%   | 10    |
-    +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 339.637984037
-    Full duration: 382.637588978
-
-    2016-04-26 07:03:20,320 - run_rally - INFO - Test scenario: "nova" Failed.
-    2016-04-26 07:03:20,864 - run_rally - INFO - Starting test scenario "quotas" ...
-    2016-04-26 07:04:24,690 - run_rally - INFO -
-     Preparing input task
-     Task  31d451cc-0c33-44e6-8ce1-a226ec4d3747: started
-    Task 31d451cc-0c33-44e6-8ce1-a226ec4d3747: finished
-
-    test scenario Quotas.cinder_update
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | quotas.update_quotas | 0.676     | 0.77         | 1.004        | 1.007        | 1.01      | 0.823     | 100.0%  | 10    |
-    | total                | 0.676     | 0.77         | 1.005        | 1.007        | 1.01      | 0.823     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.49713397026
-    Full duration: 10.5032558441
-
-    test scenario Quotas.neutron_update
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | quotas.update_quotas | 0.214     | 0.235        | 0.26         | 0.262        | 0.263     | 0.238     | 100.0%  | 10    |
-    | total                | 0.372     | 0.415        | 0.426        | 0.427        | 0.428     | 0.408     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.27715206146
-    Full duration: 8.95948386192
-
-    test scenario Quotas.cinder_update_and_delete
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | quotas.update_quotas | 0.77      | 0.834        | 0.965        | 0.99         | 1.015     | 0.857     | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.345     | 0.54         | 0.562        | 0.581        | 0.6       | 0.505     | 100.0%  | 10    |
-    | total                | 1.127     | 1.365        | 1.437        | 1.498        | 1.56      | 1.362     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 4.07208108902
-    Full duration: 12.2027239799
-
-    test scenario Quotas.nova_update_and_delete
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | quotas.update_quotas | 0.448     | 0.48         | 0.54         | 0.679        | 0.819     | 0.511     | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.012     | 0.019        | 0.024        | 0.025        | 0.027     | 0.019     | 100.0%  | 10    |
-    | total                | 0.463     | 0.499        | 0.563        | 0.699        | 0.836     | 0.53      | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.53432106972
-    Full duration: 9.25113201141
-
-    test scenario Quotas.nova_update
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | quotas.update_quotas | 0.395     | 0.469        | 0.541        | 0.549        | 0.557     | 0.47      | 100.0%  | 10    |
-    | total                | 0.395     | 0.469        | 0.541        | 0.549        | 0.557     | 0.47      | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.49797797203
-    Full duration: 8.86192798615
-
-    2016-04-26 07:04:26,066 - run_rally - INFO - Test scenario: "quotas" OK.
-    2016-04-26 07:04:26,381 - run_rally - INFO - Starting test scenario "requests" ...
-    2016-04-26 07:04:56,876 - run_rally - INFO -
-     Preparing input task
-     Task  1c6ea3eb-b807-414a-b07a-d9ecf1aa2344: started
-    Task 1c6ea3eb-b807-414a-b07a-d9ecf1aa2344: finished
-
-    test scenario HttpRequests.check_random_request
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | requests.check_request | 0.018     | 0.542        | 5.956        | 8.184        | 10.411    | 2.811     | 100.0%  | 10    |
-    | total                  | 0.018     | 0.542        | 5.956        | 8.184        | 10.411    | 2.812     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 10.5026738644
-    Full duration: 13.9263000488
-
-    test scenario HttpRequests.check_request
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | requests.check_request | 0.016     | 0.059        | 5.062        | 5.063        | 5.065     | 2.047     | 100.0%  | 10    |
-    | total                  | 0.016     | 0.059        | 5.062        | 5.063        | 5.065     | 2.047     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 5.16210699081
-    Full duration: 8.87197899818
-
-    2016-04-26 07:04:58,210 - run_rally - INFO - Test scenario: "requests" OK.
-    2016-04-26 07:04:58,402 - run_rally - INFO -
-
-                         Rally Summary Report
-
-    +===================+============+===============+===========+
-    | Module            | Duration   | nb. Test Run  | Success   |
-    +===================+============+===============+===========+
-    | authenticate      | 00:50      | 12            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | glance            | 02:55      | 11            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | cinder            | 54:33      | 59            | 76.47%    |
-    +-------------------+------------+---------------+-----------+
-    | heat              | 18:00      | 48            | 92.31%    |
-    +-------------------+------------+---------------+-----------+
-    | keystone          | 01:53      | 40            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | neutron           | 06:04      | 43            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | nova              | 11:14      | 79            | 79.87%    |
-    +-------------------+------------+---------------+-----------+
-    | quotas            | 00:49      | 12            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | requests          | 00:22      | 4             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    +===================+============+===============+===========+
-    | TOTAL:            | 05:36:44   | 308           | 94.29%    |
-    +===================+============+===============+===========+
-
-Feature tests
--------------
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    2016-04-26 01:23:01,296 - Promise- INFO - Creating tenant 'promise'...
-    2016-04-26 01:23:01,461 - Promise- INFO - Adding role 'a6da18e9c7e94ee9975e85b6f26c974a' to tenant 'promise'...
-    2016-04-26 01:23:01,553 - Promise- INFO - Creating user 'promiser'...
-    2016-04-26 01:23:01,666 - Promise- INFO - Updating OpenStack credentials...
-    2016-04-26 01:23:01,687 - Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    2016-04-26 01:23:05,215 - Promise- INFO - Creating flavor 'promise-flavor'...
-    2016-04-26 01:23:05,871 - Promise- INFO - Exporting environment variables...
-    2016-04-26 01:23:05,871 - Promise- INFO - Running command: npm run -s test -- --reporter json
-    2016-04-26 01:23:12,658 - Promise- INFO - The test succeeded.
-    2016-04-26 01:23:12,660 - Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:   23
-     Tests:    33
-     Passes:   33
-     Pending:  0
-     Failures: 0
-     Start:    2016-04-26T01:23:08.348Z
-     End:      2016-04-26T01:23:12.610Z
-     Duration: 4.262
diff --git a/docs/results/fuel-os-nosdn-nofeature-ha.rst b/docs/results/fuel-os-nosdn-nofeature-ha.rst
deleted file mode 100644 (file)
index e526d82..0000000
+++ /dev/null
@@ -1,2283 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-nosdn-nofeature-ha
-----------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-SSH test...
-    vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_ssh- INFO - Creating neutron network vping-net...
-    vPing_ssh- INFO - Creating security group  'vPing-sg'...
-    vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-    vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-    vPing_ssh- INFO - Floating IP created: '10.118.101.200'
-    vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
-    vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
-    vPing_ssh- INFO - Waiting for ping...
-    vPing_ssh- INFO - vPing detected!
-    vPing_ssh- INFO - vPing duration:'42.1' s.
-    vPing_ssh- INFO - Cleaning up...
-    vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-userdata test...
-    vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_userdata- INFO - Creating neutron network vping-net...
-    vPing_userdata- INFO - Creating security group  'vPing-sg'...
-    vPing_userdata- INFO - Flavor found 'm1.small'
-    vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-     userdata=
-    #!/bin/sh
-
-    while true; do
-     ping -c 1 192.168.130.4 2>&1 >/dev/null
-     RES=$?
-     if [ "Z$RES" = "Z0" ] ; then
-      echo 'vPing OK'
-     break
-     else
-      echo 'vPing KO'
-     fi
-     sleep 1
-    done
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_userdata- INFO - Waiting for ping...
-    vPing_userdata- INFO - vPing detected!
-    vPing_userdata- INFO - vPing duration:'28.6'
-    vPing_userdata- INFO - vPing OK
-    vPing_userdata- INFO - Cleaning up...
-    vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | name                                                                                                                                     | time      | status  |
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.29312   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.12976   | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 23.95577  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 32.53650  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 22.68958  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.54691   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.30066   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.57103   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.97553   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.37256   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.33110   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.34175   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.35964   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.62128   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.88552   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.35258   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 1.14056   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.64330   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 1.59904   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.85262   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.89806   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.43298   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 2.74835   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 7.51973   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 17.31905  | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.11526   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 4.43153   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.49287   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.32071   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.24839   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.62886   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.45498   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.11221   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.07743   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.07866   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.08414   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.09610   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.87584   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00178   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.18671   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.07254   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.02355   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.09336   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08789   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.02832   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01969   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.05608   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.09405   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.07124   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 1.09862   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.02806   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.10085   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00074   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 7.05293   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 12.83974  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 75.96327  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.89960   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 86.10969  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 14.36274  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 25.20801  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 9.79668   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.10422   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.45171   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.71962   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.37393   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.39671   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.67878   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.96139   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.70247   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 5.01425   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 21.66147  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 29.15375  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 17.01011  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 15.12162  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 2.32047   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 2.43351   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 3.54755   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 3.49832   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 1.66971   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.67563   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 1.52468   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 2.11125   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 1.11519   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 1.59954   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 2.71532   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.67781   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.80861   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 1.12394   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.98070   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.95038   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.58962   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.76753   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.92874   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 1.98170   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.09696   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.23813   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.02568   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.73035   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.03287   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.61622   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.10251   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.32244   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05310   | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 46.35639  | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 1.19554   | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.13783   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.28038   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.02405   | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.0       | fail    |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 1.06799   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.70652   | success |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.56777   | success |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.34317   | success |
-    | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.61946   | success |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.55157   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.10777   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.09198   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.08536   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.12301   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.19557   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.11454   | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.58158   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.96230   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 3.11881   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 31.78599  | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 6.18197   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 0.36573   | fail    |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 4.19923   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 2.05001   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 2.85155   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 4.85758   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 2.47936   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 4.29082   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 4.14373   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 2.85702   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.63578   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.44139   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.31069   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.31575   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.34149   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 2.96967   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.61978   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.30406   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.29284   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.07605   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.28866   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 3.34364   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 2.65709   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.51327   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.34515   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.34468   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 3.78910   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 3.78827   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 2.58076   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.35346   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.38372   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 8.02302   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 5.55884   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 4.89503   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 3.13616   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 7.91220   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 4.35397   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 4.24212   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 3.20634   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 2.00386   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 3.26379   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.29497   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 2.34355   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.27875   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.05434   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.63001   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 7.10424   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.06177   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.98140   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.05857   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 19.61269  | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 4.21790   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.96832   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.59962   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 14.77900  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 19.28760  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 14.36310  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 24.02107  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.05931   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.31742   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 54.55460  | success |
-    | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 41.67013  | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 109.37734 | success |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 61.05784  | fail    |
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    run_tempest - INFO - Results: {'timestart': '2016-02-1813:29:52.500975', 'duration': 416, 'tests': 210, 'failures': 25}
-
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    run_rally - INFO - Starting test scenario "authenticate" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  2ff4981a-75d9-4de4-a111-3194115c4a00: started
-    Task 2ff4981a-75d9-4de4-a111-3194115c4a00: finished
-
-    test scenario Authenticate.validate_glance
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_glance     | 0.534 | 0.569  | 0.722  | 0.818  | 0.914 | 0.618 | 100.0%  | 10    |
-    | authenticate.validate_glance (2) | 0.512 | 0.609  | 0.713  | 0.766  | 0.818 | 0.631 | 100.0%  | 10    |
-    | total                            | 1.257 | 1.358  | 1.703  | 1.715  | 1.726 | 1.418 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.01803302765
-    Full duration: 11.7534348965
-
-
-
-    test scenario Authenticate.keystone
-    +-----------------------------------------------------------------------------+
-    |                            Response Times (sec)                             |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | total  | 0.132 | 0.154  | 0.172  | 0.172  | 0.173 | 0.155 | 100.0%  | 10    |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.491301059723
-    Full duration: 8.25924301147
-
-
-
-    test scenario Authenticate.validate_heat
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_heat     | 0.297 | 0.32   | 0.355  | 0.359  | 0.363 | 0.324 | 100.0%  | 10    |
-    | authenticate.validate_heat (2) | 0.043 | 0.056  | 0.302  | 0.304  | 0.307 | 0.127 | 100.0%  | 10    |
-    | total                          | 0.499 | 0.607  | 0.769  | 0.82   | 0.87  | 0.629 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.91573691368
-    Full duration: 10.0396120548
-
-
-
-    test scenario Authenticate.validate_nova
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_nova     | 0.306 | 0.35   | 0.534  | 0.554  | 0.574 | 0.407 | 100.0%  | 10    |
-    | authenticate.validate_nova (2) | 0.037 | 0.059  | 0.07   | 0.081  | 0.092 | 0.059 | 100.0%  | 10    |
-    | total                          | 0.526 | 0.596  | 0.771  | 0.782  | 0.792 | 0.639 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.9150788784
-    Full duration: 9.77701401711
-
-
-
-    test scenario Authenticate.validate_cinder
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_cinder     | 0.268 | 0.315  | 0.353  | 0.475  | 0.596 | 0.334 | 100.0%  | 10    |
-    | authenticate.validate_cinder (2) | 0.025 | 0.282  | 0.314  | 0.323  | 0.331 | 0.264 | 100.0%  | 10    |
-    | total                            | 0.721 | 0.78   | 0.827  | 0.837  | 0.847 | 0.779 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.34766292572
-    Full duration: 10.0672118664
-
-
-
-    test scenario Authenticate.validate_neutron
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_neutron     | 0.266 | 0.305  | 0.386  | 0.399  | 0.411 | 0.319 | 100.0%  | 10    |
-    | authenticate.validate_neutron (2) | 0.043 | 0.291  | 0.375  | 0.403  | 0.432 | 0.241 | 100.0%  | 10    |
-    | total                             | 0.483 | 0.76   | 0.908  | 0.914  | 0.92  | 0.729 | 100.0%  | 10    |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.25539779663
-    Full duration: 9.62706780434
-
-
-
-    run_rally - INFO - Test scenario: "authenticate" OK.
-
-    run_rally - INFO - Starting test scenario "glance" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  9fb726cd-f20e-4f95-b32f-5928c72cf58d: started
-    Task 9fb726cd-f20e-4f95-b32f-5928c72cf58d: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | glance.list_images | 0.72  | 0.85   | 0.942  | 0.947  | 0.951 | 0.833 | 100.0%  | 10    |
-    | total              | 0.721 | 0.85   | 0.943  | 0.947  | 0.951 | 0.834 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.45959687233
-    Full duration: 12.9740490913
-
-
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | glance.create_image | 7.498  | 7.743  | 17.964 | 19.73  | 21.495 | 10.171 | 100.0%  | 10    |
-    | nova.boot_servers   | 13.174 | 14.424 | 15.318 | 15.539 | 15.76  | 14.34  | 100.0%  | 10    |
-    | total               | 20.863 | 22.368 | 32.383 | 33.741 | 35.099 | 24.511 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 68.7006659508
-    Full duration: 127.436779022
-
-
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | glance.create_image | 7.303 | 7.684  | 7.837  | 7.911  | 7.984 | 7.63  | 100.0%  | 10    |
-    | glance.list_images  | 0.328 | 0.583  | 0.697  | 0.698  | 0.699 | 0.574 | 100.0%  | 10    |
-    | total               | 7.862 | 8.283  | 8.38   | 8.472  | 8.564 | 8.205 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 24.5710179806
-    Full duration: 37.9533209801
-
-
-
-    test scenario GlanceImages.create_and_delete_image
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | glance.create_image | 7.448 | 7.605  | 7.805  | 7.817  | 7.829  | 7.617 | 100.0%  | 10    |
-    | glance.delete_image | 2.01  | 2.372  | 2.628  | 2.686  | 2.743  | 2.393 | 100.0%  | 10    |
-    | total               | 9.506 | 9.976  | 10.387 | 10.466 | 10.545 | 10.01 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 30.0124220848
-    Full duration: 40.2773120403
-
-
-
-    run_rally - INFO - Test scenario: "glance" OK.
-
-    run_rally - INFO - Starting test scenario "cinder" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  a724f287-e014-40ef-8e87-173e5eb2b0a2: started
-    Task a724f287-e014-40ef-8e87-173e5eb2b0a2: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server     | 10.889 | 13.965 | 14.695 | 14.724 | 14.752 | 13.234 | 100.0%  | 10    |
-    | cinder.create_volume | 3.218  | 3.812  | 4.128  | 4.214  | 4.3    | 3.776  | 100.0%  | 10    |
-    | nova.attach_volume   | 3.737  | 4.69   | 4.963  | 5.092  | 5.222  | 4.612  | 100.0%  | 10    |
-    | nova.detach_volume   | 3.18   | 3.917  | 4.273  | 4.325  | 4.377  | 3.867  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.489  | 2.54   | 2.801  | 2.886  | 2.972  | 2.261  | 100.0%  | 10    |
-    | nova.delete_server   | 2.527  | 2.94   | 3.218  | 3.228  | 3.239  | 2.926  | 100.0%  | 10    |
-    | total                | 26.351 | 30.9   | 32.731 | 33.273 | 33.815 | 30.677 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 91.1857719421
-    Full duration: 133.454293013
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | cinder.create_volume | 7.415 | 9.652  | 10.383 | 10.548 | 10.713 | 9.48  | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.072 | 0.328  | 0.4    | 0.407  | 0.415  | 0.295 | 100.0%  | 10    |
-    | total                | 7.76  | 10.022 | 10.706 | 10.88  | 11.054 | 9.775 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 28.0870580673
-    Full duration: 51.2606179714
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.521 | 4.03   | 4.785  | 4.869  | 4.953 | 4.19  | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.062 | 0.347  | 0.411  | 0.426  | 0.44  | 0.308 | 100.0%  | 10    |
-    | total                | 3.852 | 4.421  | 5.139  | 5.227  | 5.315 | 4.499 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 13.1967639923
-    Full duration: 35.2137930393
-
-
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 2.957 | 3.349  | 5.449  | 5.627  | 5.805 | 3.738 | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.028 | 0.304  | 0.348  | 0.382  | 0.416 | 0.213 | 100.0%  | 10    |
-    | total                  | 3.259 | 3.42   | 5.776  | 5.945  | 6.113 | 3.952 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 10.5537779331
-    Full duration: 49.7043690681
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.281 | 3.907  | 4.106  | 4.128  | 4.15  | 3.806 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.788 | 2.667  | 3.082  | 3.16   | 3.239 | 2.256 | 100.0%  | 10    |
-    | total                | 4.617 | 6.29   | 6.997  | 7.066  | 7.135 | 6.063 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.3220980167
-    Full duration: 36.1331720352
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 8.901 | 9.932  | 10.338 | 10.395 | 10.452 | 9.781  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.579 | 1.672  | 2.856  | 2.952  | 3.049  | 1.773  | 100.0%  | 10    |
-    | total                | 9.725 | 11.645 | 12.996 | 13.017 | 13.039 | 11.554 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 35.517152071
-    Full duration: 54.0071978569
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.596 | 3.887  | 4.71   | 4.712  | 4.715 | 4.08  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.512 | 0.923  | 1.297  | 2.319  | 3.341 | 1.114 | 100.0%  | 10    |
-    | total                | 4.381 | 4.91   | 5.923  | 6.573  | 7.223 | 5.195 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 15.0102190971
-    Full duration: 33.4934709072
-
-
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume          | 3.512  | 3.838  | 4.155  | 4.202  | 4.249  | 3.861  | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 16.283 | 24.737 | 33.632 | 38.034 | 42.436 | 26.102 | 100.0%  | 10    |
-    | cinder.delete_volume          | 0.583  | 1.719  | 3.056  | 3.165  | 3.274  | 1.853  | 100.0%  | 10    |
-    | nova.delete_image             | 2.514  | 2.856  | 13.194 | 14.749 | 16.305 | 5.182  | 100.0%  | 10    |
-    | total                         | 23.887 | 34.293 | 49.972 | 51.48  | 52.988 | 36.998 | 100.0%  | 10    |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 107.503821135
-    Full duration: 129.166619062
-
-
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 3.064 | 3.257  | 3.408  | 3.415  | 3.422 | 3.261 | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.586 | 2.915  | 3.148  | 3.165  | 3.181 | 2.938 | 100.0%  | 10    |
-    | total                  | 5.837 | 6.18   | 6.465  | 6.534  | 6.603 | 6.199 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.601981163
-    Full duration: 53.3941659927
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.424 | 3.854  | 4.025  | 4.05   | 4.075 | 3.808 | 100.0%  | 10    |
-    | total                | 3.424 | 3.854  | 4.025  | 4.05   | 4.075 | 3.808 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.3824880123
-    Full duration: 30.7913680077
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.391 | 3.979  | 4.585  | 4.6    | 4.616 | 3.999 | 100.0%  | 10    |
-    | total                | 3.391 | 3.979  | 4.585  | 4.601  | 4.616 | 3.999 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 12.107943058
-    Full duration: 36.5596921444
-
-
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.list_volumes | 0.478 | 0.562  | 0.711  | 0.746  | 0.781 | 0.587 | 100.0%  | 10    |
-    | total               | 0.479 | 0.562  | 0.711  | 0.746  | 0.781 | 0.587 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.79518508911
-    Full duration: 65.9313700199
-
-
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +-----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                      |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.557 | 3.914  | 4.206  | 4.213  | 4.22   | 3.884  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.701 | 3.063  | 3.248  | 3.251  | 3.254  | 3.06   | 100.0%  | 10    |
-    | nova.attach_volume     | 3.75  | 4.986  | 6.112  | 6.385  | 6.658  | 5.059  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.149 | 3.81   | 4.11   | 4.168  | 4.225  | 3.762  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.241 | 2.766  | 3.077  | 3.102  | 3.128  | 2.725  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.748 | 2.428  | 2.712  | 2.772  | 2.831  | 1.912  | 100.0%  | 10    |
-    | total                  | 19.22 | 21.354 | 24.347 | 24.725 | 25.102 | 21.684 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 64.028840065
-    Full duration: 186.598311901
-
-
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.539 | 4.149  | 4.62   | 4.622  | 4.623 | 4.106 | 100.0%  | 10    |
-    | cinder.delete_volume | 2.844 | 3.223  | 3.604  | 3.609  | 3.614 | 3.235 | 100.0%  | 10    |
-    | total                | 6.383 | 7.559  | 7.85   | 7.868  | 7.886 | 7.341 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 21.6859838963
-    Full duration: 55.5635709763
-
-
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | cinder.create_volume | 3.434 | 3.852  | 3.99   | 4.004  | 4.018  | 3.842 | 100.0%  | 10    |
-    | cinder.extend_volume | 0.955 | 2.236  | 3.552  | 3.564  | 3.576  | 2.281 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.868 | 3.015  | 3.332  | 3.398  | 3.465  | 2.861 | 100.0%  | 10    |
-    | total                | 5.962 | 9.186  | 10.497 | 10.52  | 10.544 | 8.984 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 28.1479110718
-    Full duration: 47.0005409718
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.595  | 3.868  | 4.206  | 4.208  | 4.211  | 3.886  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.595  | 3.131  | 3.249  | 3.258  | 3.267  | 3.037  | 100.0%  | 10    |
-    | nova.attach_volume     | 4.101  | 4.563  | 5.363  | 7.225  | 9.087  | 4.928  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.299  | 3.896  | 4.226  | 4.274  | 4.323  | 3.816  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.27   | 2.573  | 2.884  | 3.105  | 3.325  | 2.635  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.611  | 2.479  | 2.742  | 2.863  | 2.983  | 2.239  | 100.0%  | 10    |
-    | total                  | 19.728 | 21.533 | 22.719 | 24.643 | 26.568 | 21.737 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 62.6771988869
-    Full duration: 187.817504883
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.255  | 3.476  | 4.793  | 4.86   | 4.926  | 3.766  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.387  | 2.868  | 3.304  | 3.311  | 3.318  | 2.906  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.864  | 4.167  | 4.94   | 5.864  | 6.787  | 4.392  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.699  | 4.047  | 4.388  | 4.408  | 4.428  | 4.066  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.492  | 2.621  | 2.825  | 2.828  | 2.831  | 2.651  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.65   | 2.735  | 3.048  | 3.123  | 3.198  | 2.567  | 100.0%  | 10    |
-    | total                  | 18.915 | 21.629 | 24.215 | 25.025 | 25.835 | 22.025 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 64.388502121
-    Full duration: 192.928286076
-
-
-
-    run_rally - INFO - Test scenario: "cinder" OK.
-
-    run_rally - INFO - Starting test scenario "heat" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: started
-    Task 44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: finished
-
-    test scenario HeatStacks.create_suspend_resume_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack  | 4.131 | 4.448  | 4.579  | 4.616  | 4.652  | 4.417 | 100.0%  | 10    |
-    | heat.suspend_stack | 1.521 | 1.721  | 1.772  | 1.792  | 1.812  | 1.701 | 100.0%  | 10    |
-    | heat.resume_stack  | 1.454 | 1.625  | 1.703  | 1.708  | 1.713  | 1.63  | 100.0%  | 10    |
-    | heat.delete_stack  | 1.387 | 1.57   | 2.717  | 2.724  | 2.731  | 1.88  | 100.0%  | 10    |
-    | total              | 8.994 | 9.448  | 10.723 | 10.75  | 10.777 | 9.627 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 28.125330925
-    Full duration: 37.9011991024
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.098 | 4.267  | 4.383  | 4.452  | 4.52  | 4.266 | 100.0%  | 10    |
-    | heat.delete_stack | 1.423 | 1.468  | 1.536  | 1.679  | 1.822 | 1.505 | 100.0%  | 10    |
-    | total             | 5.574 | 5.769  | 5.922  | 5.933  | 5.944 | 5.77  | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 17.2579169273
-    Full duration: 27.4368560314
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 25.037 | 28.231 | 29.801 | 29.828 | 29.856 | 27.99  | 100.0%  | 10    |
-    | heat.delete_stack | 10.707 | 11.831 | 13.046 | 13.573 | 14.099 | 12.249 | 100.0%  | 10    |
-    | total             | 36.902 | 40.321 | 42.736 | 42.79  | 42.844 | 40.24  | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 119.344232082
-    Full duration: 129.710185051
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 21.352 | 24.853 | 26.526 | 26.562 | 26.598 | 24.433 | 100.0%  | 10    |
-    | heat.delete_stack | 9.51   | 10.67  | 10.95  | 11.42  | 11.889 | 10.684 | 100.0%  | 10    |
-    | total             | 31.928 | 35.457 | 37.299 | 37.449 | 37.598 | 35.117 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 106.840685844
-    Full duration: 117.40921998
-
-
-
-    test scenario HeatStacks.list_stacks_and_resources
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.list_stacks                | 0.488 | 0.522  | 0.539  | 0.54   | 0.54  | 0.522 | 100.0%  | 10    |
-    | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-    | total                           | 0.488 | 0.522  | 0.539  | 0.54   | 0.541 | 0.522 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.59450078011
-    Full duration: 9.86936807632
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 3.845 | 4.214  | 4.356  | 4.377  | 4.397  | 4.193  | 100.0%  | 10    |
-    | heat.update_stack | 3.558 | 3.774  | 3.853  | 3.855  | 3.857  | 3.726  | 100.0%  | 10    |
-    | heat.delete_stack | 1.56  | 2.57   | 2.756  | 2.776  | 2.797  | 2.512  | 100.0%  | 10    |
-    | total             | 9.445 | 10.455 | 10.866 | 10.915 | 10.963 | 10.431 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 31.3620579243
-    Full duration: 42.2799968719
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 4.133 | 4.157  | 4.354  | 4.413  | 4.472  | 4.209 | 100.0%  | 10    |
-    | heat.update_stack | 3.534 | 3.713  | 3.821  | 3.958  | 4.096  | 3.717 | 100.0%  | 10    |
-    | heat.delete_stack | 1.383 | 1.402  | 1.736  | 2.156  | 2.575  | 1.556 | 100.0%  | 10    |
-    | total             | 9.126 | 9.41   | 9.772  | 10.018 | 10.263 | 9.482 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 29.0769648552
-    Full duration: 39.4647920132
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 4.275  | 4.465  | 4.666  | 4.855  | 5.044  | 4.509 | 100.0%  | 10    |
-    | heat.update_stack | 5.801  | 5.876  | 6.0    | 6.166  | 6.332  | 5.928 | 100.0%  | 10    |
-    | heat.delete_stack | 2.525  | 2.564  | 3.649  | 3.683  | 3.717  | 2.793 | 100.0%  | 10    |
-    | total             | 12.743 | 13.005 | 13.996 | 14.01  | 14.023 | 13.23 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 39.5067877769
-    Full duration: 50.3663468361
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 4.517  | 5.462  | 5.602  | 5.608  | 5.614  | 5.389 | 100.0%  | 10    |
-    | heat.update_stack | 8.345  | 9.324  | 9.403  | 9.411  | 9.42   | 9.245 | 100.0%  | 10    |
-    | heat.delete_stack | 3.69   | 3.723  | 3.746  | 3.755  | 3.763  | 3.725 | 100.0%  | 10    |
-    | total             | 17.515 | 18.525 | 18.645 | 18.683 | 18.722 | 18.36 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 54.7039349079
-    Full duration: 65.6854679585
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.122  | 4.348  | 4.549  | 4.597  | 4.645  | 4.358  | 100.0%  | 10    |
-    | heat.update_stack | 5.791  | 5.87   | 5.92   | 5.932  | 5.944  | 5.864  | 100.0%  | 10    |
-    | heat.delete_stack | 2.506  | 2.55   | 3.704  | 3.778  | 3.853  | 2.791  | 100.0%  | 10    |
-    | total             | 12.485 | 12.814 | 13.98  | 14.075 | 14.169 | 13.013 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 38.5906641483
-    Full duration: 49.8386061192
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 4.062 | 4.33   | 4.493  | 4.501  | 4.508  | 4.317 | 100.0%  | 10    |
-    | heat.update_stack | 3.553 | 3.585  | 3.783  | 3.936  | 4.088  | 3.648 | 100.0%  | 10    |
-    | heat.delete_stack | 1.376 | 1.418  | 2.552  | 2.555  | 2.558  | 1.856 | 100.0%  | 10    |
-    | total             | 9.179 | 9.535  | 10.607 | 10.678 | 10.749 | 9.822 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 29.5593960285
-    Full duration: 40.873290062
-
-
-
-    test scenario HeatStacks.create_and_list_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.105 | 4.264  | 4.394  | 4.43   | 4.466 | 4.276 | 100.0%  | 10    |
-    | heat.list_stacks  | 0.062 | 0.103  | 0.113  | 0.116  | 0.119 | 0.096 | 100.0%  | 10    |
-    | total             | 4.18  | 4.373  | 4.501  | 4.531  | 4.561 | 4.371 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 13.1703698635
-    Full duration: 29.690456152
-
-
-
-    test scenario HeatStacks.create_check_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.194 | 4.357  | 4.595  | 4.64   | 4.684 | 4.393 | 100.0%  | 10    |
-    | heat.check_stack  | 1.511 | 1.542  | 1.627  | 1.753  | 1.88  | 1.58  | 100.0%  | 10    |
-    | heat.delete_stack | 1.402 | 2.55   | 2.707  | 2.749  | 2.791 | 2.257 | 100.0%  | 10    |
-    | total             | 7.411 | 8.429  | 8.66   | 8.745  | 8.829 | 8.23  | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 24.4679090977
-    Full duration: 35.6907479763
-
-
-
-    run_rally - INFO - Test scenario: "heat" OK.
-
-    run_rally - INFO - Starting test scenario "keystone" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  416065d0-3811-4bee-9b53-37743e1f179c: started
-    Task 416065d0-3811-4bee-9b53-37743e1f179c: finished
-
-    test scenario KeystoneBasic.create_tenant_with_users
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.285 | 0.297  | 0.328  | 0.336  | 0.343 | 0.305 | 100.0%  | 10    |
-    | keystone.create_users  | 1.651 | 1.673  | 1.73   | 1.749  | 1.768 | 1.688 | 100.0%  | 10    |
-    | total                  | 1.952 | 1.986  | 2.027  | 2.061  | 2.095 | 1.993 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 5.98874807358
-    Full duration: 22.4405510426
-
-
-
-    test scenario KeystoneBasic.create_add_and_list_user_roles
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.287 | 0.308  | 0.404  | 0.428  | 0.452 | 0.331 | 100.0%  | 10    |
-    | keystone.add_role    | 0.276 | 0.31   | 0.371  | 0.379  | 0.388 | 0.319 | 100.0%  | 10    |
-    | keystone.list_roles  | 0.137 | 0.151  | 0.175  | 0.207  | 0.239 | 0.16  | 100.0%  | 10    |
-    | total                | 0.732 | 0.775  | 0.951  | 0.962  | 0.972 | 0.809 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.38230800629
-    Full duration: 15.068157196
-
-
-
-    test scenario KeystoneBasic.add_and_remove_user_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.263 | 0.3    | 0.41   | 0.455  | 0.499 | 0.336 | 100.0%  | 10    |
-    | keystone.add_role    | 0.265 | 0.28   | 0.342  | 0.405  | 0.468 | 0.302 | 100.0%  | 10    |
-    | keystone.remove_role | 0.151 | 0.182  | 0.347  | 0.35   | 0.354 | 0.226 | 100.0%  | 10    |
-    | total                | 0.713 | 0.844  | 1.002  | 1.019  | 1.036 | 0.864 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.52822303772
-    Full duration: 15.38514781
-
-
-
-    test scenario KeystoneBasic.create_update_and_delete_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.267 | 0.354  | 0.411  | 0.421  | 0.432 | 0.346 | 100.0%  | 10    |
-    | keystone.update_tenant | 0.139 | 0.15   | 0.185  | 0.223  | 0.262 | 0.164 | 100.0%  | 10    |
-    | keystone.delete_tenant | 0.302 | 0.333  | 0.418  | 0.448  | 0.477 | 0.35  | 100.0%  | 10    |
-    | total                  | 0.738 | 0.879  | 0.917  | 0.961  | 1.006 | 0.86  | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.55070900917
-    Full duration: 14.2816069126
-
-
-
-    test scenario KeystoneBasic.create_and_delete_service
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_service | 0.279 | 0.303  | 0.408  | 0.41   | 0.412 | 0.322 | 100.0%  | 10    |
-    | keystone.delete_service | 0.15  | 0.168  | 0.188  | 0.192  | 0.196 | 0.169 | 100.0%  | 10    |
-    | total                   | 0.443 | 0.471  | 0.584  | 0.594  | 0.604 | 0.491 | 100.0%  | 10    |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.47291088104
-    Full duration: 12.6235470772
-
-
-
-    test scenario KeystoneBasic.create_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.274 | 0.302  | 0.315  | 0.324  | 0.334 | 0.301 | 100.0%  | 10    |
-    | total                  | 0.274 | 0.302  | 0.315  | 0.325  | 0.334 | 0.301 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.926929950714
-    Full duration: 9.11541318893
-
-
-
-    test scenario KeystoneBasic.create_user
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.285 | 0.312  | 0.353  | 0.392  | 0.431 | 0.323 | 100.0%  | 10    |
-    | total                | 0.285 | 0.313  | 0.353  | 0.392  | 0.431 | 0.323 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.09427213669
-    Full duration: 9.44248485565
-
-
-
-    test scenario KeystoneBasic.create_and_list_tenants
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.276 | 0.302  | 0.312  | 0.315  | 0.318 | 0.299 | 100.0%  | 10    |
-    | keystone.list_tenants  | 0.133 | 0.141  | 0.147  | 0.149  | 0.15  | 0.141 | 100.0%  | 10    |
-    | total                  | 0.416 | 0.441  | 0.462  | 0.463  | 0.463 | 0.44  | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.356580019
-    Full duration: 14.5843369961
-
-
-
-    test scenario KeystoneBasic.create_and_delete_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.271 | 0.306  | 0.517  | 0.532  | 0.547 | 0.37  | 100.0%  | 10    |
-    | keystone.delete_role | 0.295 | 0.305  | 0.621  | 0.655  | 0.689 | 0.401 | 100.0%  | 10    |
-    | total                | 0.572 | 0.743  | 0.991  | 1.076  | 1.16  | 0.771 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.24743795395
-    Full duration: 14.336769104
-
-
-
-    test scenario KeystoneBasic.get_entities
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.284 | 0.313  | 0.395  | 0.4    | 0.405 | 0.328 | 100.0%  | 10    |
-    | keystone.create_user   | 0.141 | 0.155  | 0.176  | 0.176  | 0.177 | 0.159 | 100.0%  | 10    |
-    | keystone.create_role   | 0.136 | 0.155  | 0.173  | 0.209  | 0.245 | 0.16  | 100.0%  | 10    |
-    | keystone.get_tenant    | 0.124 | 0.132  | 0.143  | 0.144  | 0.144 | 0.133 | 100.0%  | 10    |
-    | keystone.get_user      | 0.124 | 0.141  | 0.232  | 0.234  | 0.237 | 0.158 | 100.0%  | 10    |
-    | keystone.get_role      | 0.122 | 0.125  | 0.142  | 0.144  | 0.147 | 0.129 | 100.0%  | 10    |
-    | keystone.service_list  | 0.121 | 0.13   | 0.138  | 0.139  | 0.139 | 0.13  | 100.0%  | 10    |
-    | keystone.get_service   | 0.118 | 0.132  | 0.158  | 0.16   | 0.161 | 0.136 | 100.0%  | 10    |
-    | total                  | 1.253 | 1.315  | 1.403  | 1.449  | 1.495 | 1.334 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.18330001831
-    Full duration: 21.2465929985
-
-
-
-    test scenario KeystoneBasic.create_and_list_users
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.27  | 0.324  | 0.381  | 0.409  | 0.436 | 0.33  | 100.0%  | 10    |
-    | keystone.list_users  | 0.125 | 0.142  | 0.183  | 0.233  | 0.283 | 0.157 | 100.0%  | 10    |
-    | total                | 0.409 | 0.47   | 0.53   | 0.625  | 0.719 | 0.487 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.41358304024
-    Full duration: 9.46058607101
-
-
-
-    run_rally - INFO - Test scenario: "keystone" OK.
-
-    run_rally - INFO - Starting test scenario "neutron" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  66bee4c3-3b3f-4215-9910-63425b400d9a: started
-    Task 66bee4c3-3b3f-4215-9910-63425b400d9a: finished
-
-    test scenario NeutronNetworks.create_and_delete_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.762 | 0.83   | 0.953  | 0.983  | 1.014 | 0.858 | 100.0%  | 10    |
-    | neutron.delete_port | 0.224 | 0.62   | 0.763  | 0.78   | 0.797 | 0.582 | 100.0%  | 10    |
-    | total               | 1.011 | 1.549  | 1.599  | 1.603  | 1.607 | 1.441 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.14246201515
-    Full duration: 53.9938690662
-
-
-
-    test scenario NeutronNetworks.create_and_list_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.718 | 0.792  | 0.884  | 0.89   | 0.895 | 0.801 | 100.0%  | 10    |
-    | neutron.create_router        | 0.435 | 0.451  | 0.555  | 0.56   | 0.565 | 0.474 | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.341 | 0.776  | 1.004  | 1.11   | 1.215 | 0.789 | 100.0%  | 10    |
-    | neutron.list_routers         | 0.066 | 0.42   | 0.477  | 0.491  | 0.505 | 0.367 | 100.0%  | 10    |
-    | total                        | 1.661 | 2.48   | 2.738  | 2.797  | 2.855 | 2.431 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.12932991982
-    Full duration: 59.6318800449
-
-
-
-    test scenario NeutronNetworks.create_and_delete_routers
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet           | 0.739 | 0.812  | 0.936  | 0.949  | 0.963 | 0.833 | 100.0%  | 10    |
-    | neutron.create_router           | 0.073 | 0.467  | 0.548  | 0.564  | 0.58  | 0.447 | 100.0%  | 10    |
-    | neutron.add_interface_router    | 0.32  | 0.758  | 0.881  | 0.901  | 0.92  | 0.737 | 100.0%  | 10    |
-    | neutron.remove_interface_router | 0.632 | 0.723  | 0.767  | 0.788  | 0.808 | 0.719 | 100.0%  | 10    |
-    | neutron.delete_router           | 0.575 | 0.622  | 0.72   | 0.74   | 0.759 | 0.639 | 100.0%  | 10    |
-    | total                           | 2.939 | 3.398  | 3.635  | 3.725  | 3.814 | 3.375 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 10.4781250954
-    Full duration: 61.2645328045
-
-
-
-    test scenario NeutronNetworks.create_and_list_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.728 | 0.859  | 0.909  | 0.944  | 0.978 | 0.857 | 100.0%  | 10    |
-    | neutron.list_ports  | 0.52  | 0.599  | 0.71   | 0.735  | 0.76  | 0.618 | 100.0%  | 10    |
-    | total               | 1.37  | 1.459  | 1.597  | 1.611  | 1.624 | 1.475 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.50073218346
-    Full duration: 55.2021510601
-
-
-
-    test scenario NeutronNetworks.create_and_delete_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.749 | 0.788  | 0.939  | 0.956  | 0.972 | 0.824 | 100.0%  | 10    |
-    | neutron.delete_subnet | 0.556 | 0.673  | 0.778  | 0.819  | 0.859 | 0.687 | 100.0%  | 10    |
-    | total                 | 1.361 | 1.521  | 1.693  | 1.697  | 1.702 | 1.511 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.66956591606
-    Full duration: 54.1284301281
-
-
-
-    test scenario NeutronNetworks.create_and_delete_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.62  | 0.643  | 0.756  | 0.784  | 0.812 | 0.672 | 100.0%  | 10    |
-    | neutron.delete_network | 0.481 | 0.54   | 0.616  | 0.686  | 0.756 | 0.558 | 100.0%  | 10    |
-    | total                  | 1.101 | 1.206  | 1.363  | 1.377  | 1.391 | 1.23  | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.73822879791
-    Full duration: 33.2811751366
-
-
-
-    test scenario NeutronNetworks.create_and_list_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.583 | 0.675  | 0.782  | 0.782  | 0.783 | 0.691 | 100.0%  | 10    |
-    | neutron.list_networks  | 0.058 | 0.395  | 0.517  | 0.522  | 0.528 | 0.364 | 100.0%  | 10    |
-    | total                  | 0.834 | 1.066  | 1.187  | 1.242  | 1.298 | 1.055 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.09279990196
-    Full duration: 33.633177042
-
-
-
-    test scenario NeutronNetworks.create_and_update_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.713 | 0.8    | 0.903  | 0.913  | 0.922 | 0.811 | 100.0%  | 10    |
-    | neutron.create_router        | 0.434 | 0.449  | 0.476  | 0.497  | 0.519 | 0.458 | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.666 | 0.749  | 0.912  | 0.954  | 0.996 | 0.791 | 100.0%  | 10    |
-    | neutron.update_router        | 0.222 | 0.579  | 0.659  | 0.678  | 0.697 | 0.556 | 100.0%  | 10    |
-    | total                        | 2.156 | 2.643  | 2.768  | 2.799  | 2.83  | 2.617 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.76268601418
-    Full duration: 57.6214001179
-
-
-
-    test scenario NeutronNetworks.create_and_update_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.606 | 0.672  | 0.761  | 0.785  | 0.81  | 0.681 | 100.0%  | 10    |
-    | neutron.update_network | 0.137 | 0.518  | 0.538  | 0.542  | 0.547 | 0.482 | 100.0%  | 10    |
-    | total                  | 0.893 | 1.183  | 1.261  | 1.288  | 1.315 | 1.164 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.59189605713
-    Full duration: 34.8437690735
-
-
-
-    test scenario NeutronNetworks.create_and_update_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.738 | 0.792  | 0.889  | 0.921  | 0.952 | 0.815 | 100.0%  | 10    |
-    | neutron.update_port | 0.161 | 0.551  | 0.596  | 0.6    | 0.605 | 0.516 | 100.0%  | 10    |
-    | total               | 1.044 | 1.339  | 1.429  | 1.482  | 1.536 | 1.331 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.11195087433
-    Full duration: 53.0145220757
-
-
-
-    test scenario NeutronNetworks.create_and_list_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.703 | 0.748  | 0.832  | 0.861  | 0.89  | 0.764 | 100.0%  | 10    |
-    | neutron.list_subnets  | 0.054 | 0.396  | 0.445  | 0.479  | 0.513 | 0.374 | 100.0%  | 10    |
-    | total                 | 0.757 | 1.159  | 1.256  | 1.272  | 1.287 | 1.138 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.5137629509
-    Full duration: 52.7622568607
-
-
-
-    test scenario NeutronNetworks.create_and_update_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.742 | 0.813  | 0.947  | 0.948  | 0.949 | 0.838 | 100.0%  | 10    |
-    | neutron.update_subnet | 0.234 | 0.583  | 0.695  | 0.696  | 0.696 | 0.58  | 100.0%  | 10    |
-    | total                 | 1.043 | 1.427  | 1.587  | 1.596  | 1.604 | 1.418 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.36762094498
-    Full duration: 54.1341950893
-
-
-
-    run_rally - INFO - Test scenario: "neutron" OK.
-
-    run_rally - INFO - Starting test scenario "nova" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  c631be68-64eb-462f-af72-0946f649719e: started
-    Task c631be68-64eb-462f-af72-0946f649719e: finished
-
-    test scenario NovaKeypair.create_and_delete_keypair
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.689 | 0.825  | 1.389  | 1.414  | 1.439 | 0.956 | 100.0%  | 10    |
-    | nova.delete_keypair | 0.034 | 0.045  | 0.058  | 0.058  | 0.059 | 0.046 | 100.0%  | 10    |
-    | total               | 0.734 | 0.868  | 1.43   | 1.458  | 1.487 | 1.002 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.95623397827
-    Full duration: 43.0288610458
-
-
-
-    test scenario NovaServers.snapshot_server
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server       | 13.069 | 14.075 | 14.775 | 15.063 | 15.35  | 14.118 | 100.0%  | 10    |
-    | nova.create_image      | 10.992 | 11.363 | 11.948 | 12.03  | 12.112 | 11.402 | 100.0%  | 10    |
-    | nova.delete_server     | 2.878  | 3.026  | 3.413  | 3.454  | 3.495  | 3.121  | 100.0%  | 10    |
-    | nova.boot_server (2)   | 10.807 | 12.891 | 14.009 | 14.098 | 14.188 | 12.932 | 100.0%  | 10    |
-    | nova.delete_server (2) | 2.914  | 3.356  | 4.738  | 4.974  | 5.21   | 3.557  | 100.0%  | 10    |
-    | nova.delete_image      | 2.769  | 3.227  | 3.659  | 3.685  | 3.711  | 3.238  | 100.0%  | 10    |
-    | total                  | 44.842 | 48.482 | 49.94  | 50.257 | 50.573 | 48.369 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 145.116047144
-    Full duration: 218.130707026
-
-
-
-    test scenario NovaKeypair.boot_and_delete_server_with_keypair
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_keypair | 0.67   | 0.815  | 1.452  | 1.483  | 1.515  | 0.945  | 100.0%  | 10    |
-    | nova.boot_server    | 11.229 | 12.914 | 14.714 | 15.148 | 15.581 | 13.075 | 100.0%  | 10    |
-    | nova.delete_server  | 2.87   | 3.313  | 3.4    | 3.451  | 3.502  | 3.214  | 100.0%  | 10    |
-    | nova.delete_keypair | 0.034  | 0.048  | 0.056  | 0.056  | 0.057  | 0.046  | 100.0%  | 10    |
-    | total               | 15.3   | 17.062 | 18.916 | 19.109 | 19.302 | 17.281 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 51.5624389648
-    Full duration: 121.866284132
-
-
-
-    test scenario NovaKeypair.create_and_list_keypairs
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.681 | 0.825  | 1.368  | 1.468  | 1.568 | 0.975 | 100.0%  | 10    |
-    | nova.list_keypairs  | 0.021 | 0.027  | 0.038  | 0.038  | 0.039 | 0.03  | 100.0%  | 10    |
-    | total               | 0.715 | 0.855  | 1.394  | 1.494  | 1.593 | 1.005 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.00225996971
-    Full duration: 44.8396139145
-
-
-
-    test scenario NovaServers.list_servers
-    +---------------------------------------------------------------------------------------+
-    |                                 Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-    +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    | nova.list_servers | 1.385 | 1.648  | 1.794  | 1.8    | 1.806 | 1.64 | 100.0%  | 10    |
-    | total             | 1.386 | 1.648  | 1.794  | 1.8    | 1.807 | 1.64 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    Load duration: 4.86725592613
-    Full duration: 144.563478947
-
-
-
-    test scenario NovaServers.resize_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 11.794 | 13.235 | 14.683 | 15.23  | 15.778 | 13.569 | 100.0%  | 10    |
-    | nova.resize         | 40.775 | 43.909 | 47.803 | 47.888 | 47.973 | 44.294 | 100.0%  | 10    |
-    | nova.resize_confirm | 2.664  | 3.406  | 5.701  | 5.894  | 6.087  | 3.777  | 100.0%  | 10    |
-    | nova.delete_server  | 2.831  | 2.964  | 3.671  | 4.355  | 5.038  | 3.264  | 100.0%  | 10    |
-    | total               | 59.51  | 64.72  | 68.963 | 69.477 | 69.991 | 64.905 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 193.15106678
-    Full duration: 234.439800978
-
-
-
-    test scenario NovaServers.boot_server_from_volume_and_delete
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.703  | 10.351 | 11.374 | 12.306 | 13.237 | 10.631 | 100.0%  | 10    |
-    | nova.boot_server     | 13.02  | 14.474 | 15.965 | 16.121 | 16.276 | 14.667 | 100.0%  | 10    |
-    | nova.delete_server   | 3.826  | 5.813  | 5.967  | 6.081  | 6.196  | 5.561  | 100.0%  | 10    |
-    | total                | 27.612 | 30.787 | 32.582 | 32.736 | 32.891 | 30.859 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 92.1244728565
-    Full duration: 176.439888954
-
-
-
-    test scenario NovaServers.boot_and_migrate_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 12.068 | 13.808 | 14.866 | 14.966 | 15.067 | 13.788 | 100.0%  | 10    |
-    | nova.stop_server    | 4.417  | 6.774  | 7.032  | 7.224  | 7.416  | 6.512  | 100.0%  | 10    |
-    | nova.migrate        | 10.786 | 11.454 | 11.957 | 11.999 | 12.04  | 11.487 | 100.0%  | 10    |
-    | nova.resize_confirm | 3.328  | 3.614  | 3.822  | 3.905  | 3.988  | 3.621  | 100.0%  | 10    |
-    | nova.delete_server  | 2.862  | 3.057  | 3.364  | 3.454  | 3.544  | 3.116  | 100.0%  | 10    |
-    | total               | 34.85  | 38.711 | 40.179 | 40.344 | 40.508 | 38.525 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 115.221567869
-    Full duration: 156.790792227
-
-
-
-    test scenario NovaServers.boot_and_delete_server
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server   | 12.492 | 13.618 | 14.995 | 15.0   | 15.004 | 13.701 | 100.0%  | 10    |
-    | nova.delete_server | 2.88   | 3.033  | 3.371  | 3.49   | 3.61   | 3.125  | 100.0%  | 10    |
-    | total              | 15.773 | 16.838 | 17.914 | 18.089 | 18.264 | 16.827 | 100.0%  | 10    |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 50.1218390465
-    Full duration: 119.306482077
-
-
-
-    test scenario NovaServers.boot_and_rebuild_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 12.196 | 13.798 | 15.074 | 15.293 | 15.511 | 13.812 | 100.0%  | 10    |
-    | nova.rebuild_server | 12.036 | 13.891 | 15.523 | 15.599 | 15.676 | 13.972 | 100.0%  | 10    |
-    | nova.delete_server  | 2.645  | 3.268  | 3.55   | 3.589  | 3.628  | 3.208  | 100.0%  | 10    |
-    | total               | 28.349 | 31.175 | 32.771 | 33.141 | 33.511 | 30.993 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 92.8703818321
-    Full duration: 164.587569952
-
-
-
-    test scenario NovaSecGroup.create_and_list_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.388  | 5.032  | 5.224  | 5.25   | 5.277  | 4.975  | 100.0%  | 10    |
-    | nova.create_100_rules          | 42.993 | 44.613 | 45.762 | 45.785 | 45.808 | 44.39  | 100.0%  | 10    |
-    | nova.list_security_groups      | 0.153  | 0.195  | 0.36   | 0.486  | 0.613  | 0.251  | 100.0%  | 10    |
-    | total                          | 48.225 | 50.01  | 50.441 | 50.635 | 50.83  | 49.616 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 149.417917013
-    Full duration: 217.353839159
-
-
-
-    test scenario NovaSecGroup.create_and_delete_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.382  | 5.191  | 5.496  | 5.608  | 5.72   | 5.12   | 100.0%  | 10    |
-    | nova.create_100_rules          | 43.059 | 44.368 | 45.778 | 46.029 | 46.28  | 44.458 | 100.0%  | 10    |
-    | nova.delete_10_security_groups | 1.662  | 2.265  | 2.495  | 2.664  | 2.832  | 2.215  | 100.0%  | 10    |
-    | total                          | 50.772 | 51.601 | 53.26  | 53.294 | 53.327 | 51.794 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 156.369856119
-    Full duration: 199.137834787
-
-
-
-    test scenario NovaServers.boot_and_bounce_server
-    +-------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                       |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                  | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server        | 12.013 | 14.52  | 15.332 | 15.8   | 16.267 | 14.249 | 100.0%  | 10    |
-    | nova.reboot_server      | 5.223  | 6.071  | 6.385  | 6.462  | 6.539  | 5.987  | 100.0%  | 10    |
-    | nova.soft_reboot_server | 5.766  | 8.423  | 8.806  | 9.002  | 9.198  | 8.214  | 100.0%  | 10    |
-    | nova.stop_server        | 3.892  | 6.503  | 7.587  | 10.894 | 14.201 | 6.898  | 100.0%  | 10    |
-    | nova.start_server       | 3.432  | 4.687  | 5.177  | 5.424  | 5.672  | 4.587  | 100.0%  | 10    |
-    | nova.rescue_server      | 7.9    | 8.519  | 9.688  | 10.196 | 10.703 | 8.724  | 100.0%  | 10    |
-    | nova.unrescue_server    | 5.091  | 5.518  | 5.836  | 6.131  | 6.426  | 5.577  | 100.0%  | 10    |
-    | nova.delete_server      | 2.495  | 2.921  | 3.469  | 3.516  | 3.563  | 2.974  | 100.0%  | 10    |
-    | total                   | 53.649 | 57.305 | 59.111 | 60.626 | 62.142 | 57.23  | 100.0%  | 10    |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 174.621170044
-    Full duration: 245.828352928
-
-
-
-    test scenario NovaServers.boot_server
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action           | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server | 13.233 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0%  | 10    |
-    | total            | 13.234 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0%  | 10    |
-    +------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 42.6567699909
-    Full duration: 99.771146059
-
-
-
-    test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-    +-----------------------------------------------------------------------------------------------------------+
-    |                                           Response Times (sec)                                            |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups    | 4.306  | 4.999  | 5.282  | 5.289  | 5.296  | 4.937  | 100.0%  | 10    |
-    | nova.create_100_rules             | 41.795 | 43.955 | 45.983 | 46.201 | 46.418 | 44.135 | 100.0%  | 10    |
-    | nova.boot_server                  | 10.075 | 11.651 | 12.302 | 13.061 | 13.82  | 11.534 | 100.0%  | 10    |
-    | nova.get_attached_security_groups | 0.217  | 0.249  | 0.568  | 0.572  | 0.577  | 0.338  | 100.0%  | 10    |
-    | nova.delete_server                | 2.469  | 2.619  | 2.937  | 3.034  | 3.131  | 2.712  | 100.0%  | 10    |
-    | nova.delete_10_security_groups    | 1.574  | 1.878  | 2.55   | 2.704  | 2.858  | 2.053  | 100.0%  | 10    |
-    | total                             | 63.097 | 65.905 | 66.858 | 67.329 | 67.8   | 65.71  | 100.0%  | 10    |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 195.037164927
-    Full duration: 263.490648985
-
-
-
-    test scenario NovaServers.pause_and_unpause_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 12.325 | 13.238 | 14.398 | 14.542 | 14.687 | 13.373 | 100.0%  | 10    |
-    | nova.pause_server   | 2.412  | 2.986  | 3.177  | 3.205  | 3.233  | 2.946  | 100.0%  | 10    |
-    | nova.unpause_server | 2.824  | 3.169  | 3.325  | 3.392  | 3.459  | 3.13   | 100.0%  | 10    |
-    | nova.delete_server  | 2.501  | 3.244  | 3.557  | 3.634  | 3.71   | 3.233  | 100.0%  | 10    |
-    | total               | 21.499 | 22.307 | 24.0   | 24.022 | 24.043 | 22.682 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 67.2968730927
-    Full duration: 134.783083916
-
-
-
-    test scenario NovaServers.boot_server_from_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.885  | 10.866 | 11.617 | 11.636 | 11.655 | 10.841 | 100.0%  | 10    |
-    | nova.boot_server     | 13.236 | 14.774 | 15.766 | 16.126 | 16.486 | 14.693 | 100.0%  | 10    |
-    | total                | 23.437 | 25.64  | 27.197 | 27.213 | 27.23  | 25.534 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 78.3072631359
-    Full duration: 145.979751825
-
-
-
-    test scenario NovaServers.boot_and_list_server
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server  | 12.745 | 14.15  | 15.755 | 15.872 | 15.99  | 14.143 | 100.0%  | 10    |
-    | nova.list_servers | 0.579  | 0.977  | 1.114  | 1.158  | 1.203  | 0.926  | 100.0%  | 10    |
-    | total             | 13.49  | 14.979 | 16.933 | 16.94  | 16.947 | 15.07  | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 46.7471969128
-    Full duration: 130.989289045
-
-
-
-    run_rally - INFO - Test scenario: "nova" OK.
-
-    run_rally - INFO - Starting test scenario "quotas" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  09c70711-40eb-4c85-8b87-c0c081222b0d: started
-    Task 09c70711-40eb-4c85-8b87-c0c081222b0d: finished
-
-    test scenario Quotas.cinder_update
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-    +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    | quotas.update_quotas | 1.123 | 1.192  | 1.297  | 1.331  | 1.365 | 1.21 | 100.0%  | 10    |
-    | total                | 1.123 | 1.192  | 1.297  | 1.331  | 1.365 | 1.21 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    Load duration: 3.62791609764
-    Full duration: 16.2237439156
-
-
-
-    test scenario Quotas.neutron_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.396 | 0.426  | 0.572  | 0.581  | 0.591 | 0.464 | 100.0%  | 10    |
-    | total                | 0.553 | 0.575  | 0.773  | 0.834  | 0.896 | 0.64  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.80940699577
-    Full duration: 13.0895729065
-
-
-
-    test scenario Quotas.cinder_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.145 | 1.182  | 1.365  | 1.407  | 1.449 | 1.234 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.543 | 0.933  | 1.011  | 1.032  | 1.053 | 0.873 | 100.0%  | 10    |
-    | total                | 1.723 | 2.095  | 2.413  | 2.435  | 2.456 | 2.107 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 6.34634900093
-    Full duration: 18.2702391148
-
-
-
-    test scenario Quotas.nova_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.544 | 0.621  | 0.695  | 0.705  | 0.716 | 0.619 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.017 | 0.023  | 0.028  | 0.028  | 0.029 | 0.024 | 100.0%  | 10    |
-    | total                | 0.569 | 0.642  | 0.713  | 0.726  | 0.739 | 0.643 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.95026016235
-    Full duration: 13.2278659344
-
-
-
-    test scenario Quotas.nova_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.571 | 0.647  | 0.664  | 0.692  | 0.719 | 0.643 | 100.0%  | 10    |
-    | total                | 0.571 | 0.647  | 0.664  | 0.692  | 0.719 | 0.644 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.94177007675
-    Full duration: 13.6731410027
-
-
-
-    run_rally - INFO - Test scenario: "quotas" OK.
-
-    run_rally - INFO - Starting test scenario "requests" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  ee8c572e-1240-4996-a06f-801592da0277: started
-    Task ee8c572e-1240-4996-a06f-801592da0277: finished
-
-    test scenario HttpRequests.check_random_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 0.047 | 0.201  | 0.383  | 0.384  | 0.386 | 0.214 | 100.0%  | 10    |
-    | total                  | 0.047 | 0.201  | 0.383  | 0.384  | 0.386 | 0.214 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.791751146317
-    Full duration: 5.66926693916
-
-
-
-    test scenario HttpRequests.check_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 0.044 | 0.046  | 0.052  | 0.052  | 0.053 | 0.048 | 100.0%  | 10    |
-    | total                  | 0.044 | 0.046  | 0.052  | 0.052  | 0.053 | 0.048 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.181750059128
-    Full duration: 5.16227507591
-
-
-
-    run_rally - INFO - Test scenario: "requests" OK.
-
-    run_rally - INFO -
-
-
-                         Rally Summary Report
-    +===================+============+===============+===========+
-    | Module            | Duration   | nb. Test Run  | Success   |
-    +===================+============+===============+===========+
-    | authenticate      | 00:59      | 10            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | glance            | 03:38      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | cinder            | 22:59      | 50            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | heat              | 11:16      | 35            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | keystone          | 02:37      | 29            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | neutron           | 10:03      | 31            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | nova              | 47:41      | 61            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | quotas            | 01:14      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | requests          | 00:10      | 2             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    +===================+============+===============+===========+
-    | TOTAL:            | 01:40:41   | 232           | 100.00%   |
-    +===================+============+===============+===========+
-
-
-Feature tests
--------------
-
-vIMS
-^^^^
-::
-
-    FUNCTEST.info: Running vIMS test...
-    vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-    vIMS - INFO - Update OpenStack creds informations
-    vIMS - INFO - Upload some OS images if it doesn't exist
-    vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - Update security group quota for this tenant
-    vIMS - INFO - Update cinder quota for this tenant
-    vIMS - INFO - Collect flavor id for cloudify manager server
-    vIMS - INFO - Prepare virtualenv for cloudify-cli
-    vIMS - INFO - Downloading the cloudify manager server blueprint
-    vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the cloudify-manager deployment
-    vIMS - INFO - Cloudify-manager server is UP !
-    vIMS - INFO - Cloudify deployment duration:'1149.9'
-    vIMS - INFO - Collect flavor id for all clearwater vm
-    vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
-    vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the clearwater deployment
-    vIMS - INFO - The deployment of clearwater-opnfv is ended
-    vIMS - INFO - vIMS VNF deployment duration:'1133.8'
-    vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
-    vIMS - INFO - vIMS functional test duration:'2.9'
-    vIMS - INFO - Launching the clearwater-opnfv undeployment
-    vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-    vIMS - INFO - Launching the cloudify-manager undeployment
-    vIMS - INFO - Cloudify-manager server has been successfully removed!
-    vIMS - INFO - Removing vIMS tenant ..
-    vIMS - INFO - Removing vIMS user ..
-
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    Promise- INFO - Creating tenant 'promise'...
-    Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
-    Promise- INFO - Creating user 'promiser'...
-    Promise- INFO - Updating OpenStack credentials...
-    Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    Promise- INFO - Creating flavor 'promise-flavor'...
-    Promise- INFO - Exporting environment variables...
-    Promise- INFO - Running command: npm run -s test -- --reporter json
-    Promise- INFO - The test succeeded.
-    Promise- DEBUG -
-    {
-      "stats": {
-        "suites": 23,
-        "tests": 33,
-        "passes": 33,
-        "pending": 0,
-        "failures": 0,
-        "start": "2016-02-18T13:37:06.661Z",
-        "end": "2016-02-18T13:37:12.962Z",
-        "duration": 5524
-      },
-      "tests": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ],
-      "pending": [],
-      "failures": [],
-      "passes": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ]
-    }
-    Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:    23
-     Tests:     33
-     Passes:    33
-     Pending:   0
-     Failures:  0
-     Start:     2016-02-18T13:37:06.661Z
-     End:       2016-02-18T13:37:12.962Z
-     Duration:  6.301
-    ****************************************
-
-
diff --git a/docs/results/fuel-os-nosdn-ovs-ha.rst b/docs/results/fuel-os-nosdn-ovs-ha.rst
deleted file mode 100644 (file)
index 8bac271..0000000
+++ /dev/null
@@ -1,2285 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-nosdn-ovs-ha
-----------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-SSH test...
-    vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_ssh- INFO - Creating neutron network vping-net...
-    vPing_ssh- INFO - Creating security group  'vPing-sg'...
-    vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-    vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-    vPing_ssh- INFO - Floating IP created: '10.118.101.200'
-    vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
-    vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
-    vPing_ssh- INFO - Waiting for ping...
-    vPing_ssh- INFO - vPing detected!
-    vPing_ssh- INFO - vPing duration:'42.1' s.
-    vPing_ssh- INFO - Cleaning up...
-    vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-userdata test...
-    vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_userdata- INFO - Creating neutron network vping-net...
-    vPing_userdata- INFO - Creating security group  'vPing-sg'...
-    vPing_userdata- INFO - Flavor found 'm1.small'
-    vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-     userdata=
-    #!/bin/sh
-
-    while true; do
-     ping -c 1 192.168.130.4 2>&1 >/dev/null
-     RES=$?
-     if [ "Z$RES" = "Z0" ] ; then
-      echo 'vPing OK'
-     break
-     else
-      echo 'vPing KO'
-     fi
-     sleep 1
-    done
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_userdata- INFO - Waiting for ping...
-    vPing_userdata- INFO - vPing detected!
-    vPing_userdata- INFO - vPing duration:'28.6'
-    vPing_userdata- INFO - vPing OK
-    vPing_userdata- INFO - Cleaning up...
-    vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-    +------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+
-    | name                                                                                                                                     | time     | status  |
-    +------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.42319  | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.10399  | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 21.61136 | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 24.17689 | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 44.97306 | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.61967  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.61148  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.36880  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.97375  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.39432  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.62328  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.37363  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.61586  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.35380  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.67239  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.38634  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 1.05724  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.53191  | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 1.18318  | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 1.22600  | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 1.02248  | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 2.15108  | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 3.32340  | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 5.71240  | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 16.19396 | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.0      | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.0      | fail    |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.08151  | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 5.38225  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.30658  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 1.03364  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.55185  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.60722  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.61518  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.10976  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.10289  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.10607  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.09006  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.39571  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.55219  | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00134  | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.20517  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.08353  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.01952  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.07490  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.11856  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.03290  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.04317  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.04307  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.08060  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.09867  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.31911  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.03124  | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.10668  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 0.0      | fail    |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.11260  | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.20834  | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.75046  | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.37893  | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.36982  | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.68314  | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.57271  | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.64458  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 4.92495  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 22.44224 | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 30.13484 | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 15.86074 | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 12.98275 | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 2.59054  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 3.72221  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 2.78814  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 1.60414  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 3.08274  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.16235  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 2.57737  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 1.46117  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 1.22501  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 1.11043  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 2.71277  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 1.10491  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 1.50933  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.94894  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 1.36216  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.57821  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.85906  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.81229  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 1.26423  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 1.39718  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.00093  | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.29322  | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.02099  | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.64378  | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.06226  | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.83135  | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.08382  | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.30164  | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.04541  | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 0.0      | fail    |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.97480  | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 1.05415  | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.26485  | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.02006  | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.84845  | success |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.0      | fail    |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.0      | fail    |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.10464  | success |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 1.02679  | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.64732  | success |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 2.79302  | success |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.0      | fail    |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.38635  | success |
-    | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.0      | fail    |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.67061  | success |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.34593  | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.09899  | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.08376  | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.07817  | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.10831  | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.09626  | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.09352  | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.57765  | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.66822  | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 3.06984  | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 3.62527  | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 6.08457  | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 2.35650  | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 2.99120  | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 1.72175  | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 3.61046  | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 4.54154  | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 2.24168  | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 3.49353  | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 3.50686  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 3.20151  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.69691  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.39375  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.38459  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.29588  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.51586  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 2.70137  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.60901  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.31436  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.32710  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.05551  | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.45609  | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 3.05677  | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 2.98082  | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.63311  | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.09653  | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.35475  | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 2.90406  | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 3.62630  | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 2.17609  | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.37848  | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.09860  | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 7.70778  | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 4.78033  | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 4.62080  | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 3.61729  | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 7.56892  | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 4.67551  | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 3.90091  | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 2.96428  | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 1.98439  | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 3.83806  | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.29228  | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 2.05162  | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.96419  | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.36613  | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.64793  | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.64806  | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.04923  | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 1.42249  | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.61494  | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.64431  | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.61515  | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.79836  | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.84027  | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.71970  | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.06703  | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 15.64501 | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 3.81335  | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 3.28514  | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 3.08361  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 13.04419 | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 17.72121 | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 15.46298 | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 19.52032 | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.06039  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.07579  | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 56.52179 | success |
-    | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 42.52437 | success |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 81.46846 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 72.34328 | fail    |
-    +------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+
-    run_tempest - INFO - Results: {'timestart': '2016-02-1602:24:40.738841', 'duration': 234, 'tests': 210, 'failures': 26}
-
-
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    run_rally - INFO - Starting test scenario "authenticate" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  3074958f-9ce1-47bc-9d9d-e78bc2233a68: started
-    Task 3074958f-9ce1-47bc-9d9d-e78bc2233a68: finished
-
-    test scenario Authenticate.validate_glance
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_glance     | 0.519 | 0.582  | 0.614  | 0.616  | 0.619 | 0.577 | 100.0%  | 10    |
-    | authenticate.validate_glance (2) | 0.318 | 0.548  | 0.621  | 0.699  | 0.777 | 0.557 | 100.0%  | 10    |
-    | total                            | 1.086 | 1.305  | 1.37   | 1.467  | 1.563 | 1.307 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.99583816528
-    Full duration: 11.4604001045
-
-
-
-    test scenario Authenticate.keystone
-    +-----------------------------------------------------------------------------+
-    |                            Response Times (sec)                             |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | total  | 0.139 | 0.157  | 0.174  | 0.175  | 0.175 | 0.158 | 100.0%  | 10    |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.509595870972
-    Full duration: 8.08681082726
-
-
-
-    test scenario Authenticate.validate_heat
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_heat     | 0.281 | 0.3    | 0.407  | 0.408  | 0.409 | 0.322 | 100.0%  | 10    |
-    | authenticate.validate_heat (2) | 0.049 | 0.288  | 0.309  | 0.343  | 0.377 | 0.254 | 100.0%  | 10    |
-    | total                          | 0.474 | 0.756  | 0.876  | 0.883  | 0.89  | 0.748 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.13345599174
-    Full duration: 9.90360093117
-
-
-
-    test scenario Authenticate.validate_nova
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_nova     | 0.263 | 0.305  | 0.334  | 0.394  | 0.454 | 0.313 | 100.0%  | 10    |
-    | authenticate.validate_nova (2) | 0.031 | 0.045  | 0.061  | 0.07   | 0.079 | 0.048 | 100.0%  | 10    |
-    | total                          | 0.456 | 0.517  | 0.555  | 0.62   | 0.686 | 0.525 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.58427906036
-    Full duration: 9.08766698837
-
-
-
-    test scenario Authenticate.validate_cinder
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_cinder     | 0.279 | 0.31   | 0.336  | 0.384  | 0.433 | 0.316 | 100.0%  | 10    |
-    | authenticate.validate_cinder (2) | 0.023 | 0.284  | 0.356  | 0.475  | 0.594 | 0.244 | 100.0%  | 10    |
-    | total                            | 0.44  | 0.784  | 0.989  | 1.066  | 1.142 | 0.75  | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.06888413429
-    Full duration: 9.67203593254
-
-
-
-    test scenario Authenticate.validate_neutron
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_neutron     | 0.279 | 0.333  | 0.347  | 0.348  | 0.348 | 0.328 | 100.0%  | 10    |
-    | authenticate.validate_neutron (2) | 0.042 | 0.302  | 0.341  | 0.374  | 0.407 | 0.263 | 100.0%  | 10    |
-    | total                             | 0.467 | 0.804  | 0.848  | 0.869  | 0.89  | 0.757 | 100.0%  | 10    |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.20722603798
-    Full duration: 10.0450489521
-
-
-
-    run_rally - INFO - Test scenario: "authenticate" OK.
-
-    run_rally - INFO - Starting test scenario "glance" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  2d256e70-85ea-4394-a6ef-c1bb7f56a349: started
-    Task 2d256e70-85ea-4394-a6ef-c1bb7f56a349: finished
-
-    test scenario GlanceImages.list_images
-    +---------------------------------------------------------------------------------------+
-    |                                 Response Times (sec)                                  |
-    +--------------------+------+--------+--------+--------+------+-------+---------+-------+
-    | action             | min  | median | 90%ile | 95%ile | max  | avg   | success | count |
-    +--------------------+------+--------+--------+--------+------+-------+---------+-------+
-    | glance.list_images | 0.69 | 0.754  | 0.845  | 0.853  | 0.86 | 0.771 | 100.0%  | 10    |
-    | total              | 0.69 | 0.754  | 0.845  | 0.853  | 0.86 | 0.771 | 100.0%  | 10    |
-    +--------------------+------+--------+--------+--------+------+-------+---------+-------+
-    Load duration: 2.37443709373
-    Full duration: 12.192773819
-
-
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | glance.create_image | 7.016  | 7.626  | 8.071  | 8.175  | 8.28   | 7.656  | 100.0%  | 10    |
-    | nova.boot_servers   | 14.247 | 15.398 | 16.507 | 16.622 | 16.737 | 15.457 | 100.0%  | 10    |
-    | total               | 21.583 | 22.978 | 23.909 | 24.335 | 24.761 | 23.114 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 68.0709619522
-    Full duration: 125.822338104
-
-
-
-    test scenario GlanceImages.create_and_list_image
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | glance.create_image | 7.021 | 7.699  | 9.045  | 14.322 | 19.599 | 8.763 | 100.0%  | 10    |
-    | glance.list_images  | 0.334 | 0.602  | 0.657  | 0.684  | 0.71   | 0.593 | 100.0%  | 10    |
-    | total               | 7.61  | 8.326  | 9.638  | 14.906 | 20.173 | 9.356 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 28.350317955
-    Full duration: 54.6049070358
-
-
-
-    test scenario GlanceImages.create_and_delete_image
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | glance.create_image | 7.113 | 7.689  | 7.945  | 7.946  | 7.948  | 7.622  | 100.0%  | 10    |
-    | glance.delete_image | 1.846 | 2.236  | 3.676  | 9.026  | 14.377 | 3.407  | 100.0%  | 10    |
-    | total               | 9.452 | 9.823  | 11.494 | 16.81  | 22.126 | 11.029 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 31.6257281303
-    Full duration: 42.0794751644
-
-
-
-    run_rally - INFO - Test scenario: "glance" OK.
-
-    run_rally - INFO - Starting test scenario "cinder" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  9f092186-5955-4467-948a-16d0404a8c2f: started
-    Task 9f092186-5955-4467-948a-16d0404a8c2f: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server     | 10.268 | 12.476 | 13.344 | 13.444 | 13.544 | 12.273 | 100.0%  | 10    |
-    | cinder.create_volume | 3.181  | 3.689  | 3.924  | 4.051  | 4.178  | 3.675  | 100.0%  | 10    |
-    | nova.attach_volume   | 3.763  | 4.185  | 6.83   | 6.904  | 6.978  | 4.705  | 100.0%  | 10    |
-    | nova.detach_volume   | 3.274  | 3.884  | 4.469  | 4.48   | 4.491  | 3.865  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.598  | 2.89   | 3.108  | 3.229  | 3.351  | 2.513  | 100.0%  | 10    |
-    | nova.delete_server   | 2.824  | 3.112  | 3.135  | 3.142  | 3.15   | 3.06   | 100.0%  | 10    |
-    | total                | 28.505 | 29.774 | 31.521 | 31.648 | 31.774 | 30.091 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 89.9433991909
-    Full duration: 132.382716179
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | cinder.create_volume | 9.263 | 9.593  | 10.234 | 10.313 | 10.391 | 9.735 | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.073 | 0.334  | 0.502  | 0.51   | 0.517  | 0.325 | 100.0%  | 10    |
-    | total                | 9.347 | 9.982  | 10.562 | 10.633 | 10.704 | 10.06 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 30.0611338615
-    Full duration: 53.2253141403
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.693 | 3.995  | 4.393  | 4.446  | 4.498 | 4.011 | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.073 | 0.365  | 0.473  | 0.503  | 0.532 | 0.334 | 100.0%  | 10    |
-    | total                | 3.792 | 4.367  | 4.739  | 4.852  | 4.964 | 4.345 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 13.0783438683
-    Full duration: 34.8268380165
-
-
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 3.034 | 3.324  | 3.749  | 4.714  | 5.679 | 3.488 | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.027 | 0.306  | 0.324  | 0.326  | 0.329 | 0.227 | 100.0%  | 10    |
-    | total                  | 3.132 | 3.417  | 4.072  | 5.033  | 5.994 | 3.715 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 10.4324269295
-    Full duration: 51.1932430267
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.495 | 3.952  | 4.201  | 4.213  | 4.224 | 3.929 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.559 | 2.729  | 3.265  | 3.327  | 3.389 | 2.111 | 100.0%  | 10    |
-    | total                | 4.352 | 6.379  | 7.367  | 7.421  | 7.476 | 6.04  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.7915260792
-    Full duration: 37.4740400314
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.153 | 9.894  | 10.152 | 10.17  | 10.189 | 9.798  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.563 | 0.972  | 3.341  | 3.425  | 3.51   | 1.572  | 100.0%  | 10    |
-    | total                | 9.717 | 10.853 | 13.493 | 13.596 | 13.699 | 11.371 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 31.9503250122
-    Full duration: 51.7525529861
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.461 | 3.688  | 4.442  | 4.444  | 4.447 | 3.838 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.493 | 0.917  | 3.039  | 3.183  | 3.328 | 1.504 | 100.0%  | 10    |
-    | total                | 4.048 | 4.704  | 7.416  | 7.425  | 7.434 | 5.343 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 16.7748939991
-    Full duration: 35.0109767914
-
-
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume          | 3.474  | 3.728  | 4.034  | 4.158  | 4.283  | 3.802  | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 16.739 | 27.612 | 32.627 | 32.648 | 32.669 | 26.268 | 100.0%  | 10    |
-    | cinder.delete_volume          | 0.914  | 2.817  | 3.041  | 3.073  | 3.105  | 2.347  | 100.0%  | 10    |
-    | nova.delete_image             | 2.403  | 2.717  | 2.8    | 2.899  | 2.999  | 2.685  | 100.0%  | 10    |
-    | total                         | 26.184 | 36.276 | 42.076 | 42.091 | 42.105 | 35.103 | 100.0%  | 10    |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 100.882842064
-    Full duration: 122.017296791
-
-
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 2.994 | 3.448  | 3.79   | 4.429  | 5.067 | 3.513 | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.529 | 2.878  | 3.135  | 3.14   | 3.144 | 2.867 | 100.0%  | 10    |
-    | total                  | 5.551 | 6.333  | 6.766  | 7.484  | 8.202 | 6.38  | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 20.3024630547
-    Full duration: 53.5971570015
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.445 | 3.759  | 3.809  | 3.811  | 3.814 | 3.703 | 100.0%  | 10    |
-    | total                | 3.445 | 3.759  | 3.809  | 3.812  | 3.814 | 3.703 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.0321419239
-    Full duration: 28.9824199677
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.698 | 3.935  | 4.094  | 4.163  | 4.233 | 3.919 | 100.0%  | 10    |
-    | total                | 3.699 | 3.935  | 4.094  | 4.163  | 4.233 | 3.919 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.7128379345
-    Full duration: 34.5113909245
-
-
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.list_volumes | 0.491 | 0.525  | 0.554  | 0.555  | 0.556 | 0.529 | 100.0%  | 10    |
-    | total               | 0.491 | 0.525  | 0.554  | 0.555  | 0.556 | 0.529 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.63166594505
-    Full duration: 66.0012481213
-
-
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.397  | 3.887  | 4.192  | 4.206  | 4.22   | 3.861  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.867  | 3.153  | 3.188  | 3.25   | 3.311  | 3.111  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.869  | 5.36   | 10.321 | 11.444 | 12.567 | 6.387  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.309  | 3.955  | 4.207  | 4.268  | 4.33   | 3.843  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.26   | 2.629  | 2.904  | 3.051  | 3.199  | 2.668  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.553  | 2.446  | 2.844  | 2.938  | 3.033  | 1.903  | 100.0%  | 10    |
-    | total                  | 18.664 | 22.016 | 27.546 | 29.149 | 30.752 | 22.899 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 67.0612659454
-    Full duration: 183.666878939
-
-
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.553 | 3.919  | 4.193  | 4.206  | 4.219 | 3.896 | 100.0%  | 10    |
-    | cinder.delete_volume | 2.698 | 3.101  | 3.447  | 3.564  | 3.682 | 3.136 | 100.0%  | 10    |
-    | total                | 6.251 | 7.071  | 7.484  | 7.564  | 7.645 | 7.032 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 21.0021979809
-    Full duration: 55.9390618801
-
-
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.435 | 4.074  | 4.424  | 4.424  | 4.425 | 4.026 | 100.0%  | 10    |
-    | cinder.extend_volume | 0.707 | 1.246  | 3.299  | 3.344  | 3.389 | 1.877 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.692 | 1.948  | 3.07   | 3.114  | 3.157 | 1.937 | 100.0%  | 10    |
-    | total                | 5.944 | 8.052  | 8.803  | 9.273  | 9.743 | 7.84  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 23.8975720406
-    Full duration: 43.0286390781
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.311  | 3.828  | 3.963  | 3.983  | 4.004  | 3.796  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.536  | 2.956  | 3.228  | 3.282  | 3.336  | 2.967  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.854  | 4.422  | 6.403  | 6.702  | 7.002  | 4.856  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.28   | 3.968  | 4.168  | 4.23   | 4.291  | 3.861  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.409  | 2.566  | 2.92   | 2.931  | 2.943  | 2.652  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.616  | 2.517  | 2.894  | 3.087  | 3.279  | 2.098  | 100.0%  | 10    |
-    | total                  | 19.096 | 21.622 | 23.818 | 24.006 | 24.195 | 21.486 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 61.8816320896
-    Full duration: 192.880079985
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +-----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                      |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.008 | 3.875  | 4.246  | 4.262  | 4.278  | 3.77   | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.518 | 3.123  | 3.599  | 3.708  | 3.818  | 3.136  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.945 | 5.453  | 7.683  | 8.854  | 10.024 | 5.87   | 100.0%  | 10    |
-    | nova.detach_volume     | 3.292 | 3.879  | 4.458  | 4.792  | 5.127  | 3.95   | 100.0%  | 10    |
-    | cinder.delete_snapshot | 0.527 | 2.572  | 2.804  | 2.854  | 2.904  | 2.393  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.894 | 2.839  | 3.023  | 3.037  | 3.052  | 2.513  | 100.0%  | 10    |
-    | total                  | 20.01 | 23.245 | 26.325 | 27.177 | 28.028 | 23.414 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 71.9912419319
-    Full duration: 203.27274704
-
-
-
-    run_rally - INFO - Test scenario: "cinder" OK.
-
-    run_rally - INFO - Starting test scenario "heat" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  f964ffc4-416b-4d44-b65d-29baeaea8bec: started
-    Task f964ffc4-416b-4d44-b65d-29baeaea8bec: finished
-
-    test scenario HeatStacks.create_suspend_resume_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack  | 3.969 | 4.357  | 4.55   | 4.551  | 4.551 | 4.324 | 100.0%  | 10    |
-    | heat.suspend_stack | 1.657 | 1.711  | 1.822  | 1.868  | 1.915 | 1.731 | 100.0%  | 10    |
-    | heat.resume_stack  | 1.437 | 1.616  | 1.637  | 1.648  | 1.658 | 1.574 | 100.0%  | 10    |
-    | heat.delete_stack  | 1.403 | 1.555  | 1.702  | 2.211  | 2.721 | 1.658 | 100.0%  | 10    |
-    | total              | 8.875 | 9.374  | 9.503  | 9.735  | 9.967 | 9.288 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 27.5499420166
-    Full duration: 37.6667420864
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 3.985 | 4.305  | 4.343  | 4.374  | 4.405 | 4.237 | 100.0%  | 10    |
-    | heat.delete_stack | 1.379 | 1.455  | 1.484  | 1.487  | 1.489 | 1.447 | 100.0%  | 10    |
-    | total             | 5.451 | 5.729  | 5.798  | 5.812  | 5.826 | 5.683 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 17.0478360653
-    Full duration: 27.8095588684
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 26.314 | 28.232 | 29.851 | 29.855 | 29.859 | 28.255 | 100.0%  | 10    |
-    | heat.delete_stack | 10.7   | 11.864 | 12.929 | 12.939 | 12.949 | 12.051 | 100.0%  | 10    |
-    | total             | 38.29  | 40.481 | 41.719 | 41.722 | 41.725 | 40.306 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 120.330497026
-    Full duration: 130.361554861
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 22.65  | 24.176 | 25.608 | 26.138 | 26.667 | 24.433 | 100.0%  | 10    |
-    | heat.delete_stack | 10.59  | 11.212 | 11.949 | 12.486 | 13.022 | 11.332 | 100.0%  | 10    |
-    | total             | 33.338 | 36.173 | 37.277 | 37.282 | 37.287 | 35.765 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 105.698035955
-    Full duration: 115.92205596
-
-
-
-    test scenario HeatStacks.list_stacks_and_resources
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.list_stacks                | 0.513 | 0.529  | 0.55   | 0.555  | 0.559 | 0.532 | 100.0%  | 10    |
-    | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-    | total                           | 0.513 | 0.529  | 0.55   | 0.555  | 0.56  | 0.532 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.66571998596
-    Full duration: 10.2634401321
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-    | heat.create_stack | 3.891 | 4.318  | 4.491  | 4.525  | 4.559 | 4.283  | 100.0%  | 10    |
-    | heat.update_stack | 3.532 | 3.653  | 3.805  | 3.849  | 3.893 | 3.669  | 100.0%  | 10    |
-    | heat.delete_stack | 1.517 | 2.659  | 2.766  | 2.767  | 2.768 | 2.555  | 100.0%  | 10    |
-    | total             | 9.434 | 10.591 | 10.815 | 10.957 | 11.1  | 10.507 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
-    Load duration: 31.6606299877
-    Full duration: 41.6391699314
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 3.815 | 4.241  | 4.394  | 4.403  | 4.411  | 4.206 | 100.0%  | 10    |
-    | heat.update_stack | 3.536 | 3.637  | 3.758  | 3.809  | 3.86   | 3.655 | 100.0%  | 10    |
-    | heat.delete_stack | 1.359 | 1.407  | 1.693  | 2.128  | 2.563  | 1.55  | 100.0%  | 10    |
-    | total             | 9.067 | 9.301  | 9.655  | 10.15  | 10.645 | 9.412 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 27.7025399208
-    Full duration: 38.6538958549
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 3.845  | 4.648  | 5.545  | 5.549  | 5.552  | 4.702  | 100.0%  | 10    |
-    | heat.update_stack | 5.818  | 5.896  | 6.239  | 6.242  | 6.246  | 5.982  | 100.0%  | 10    |
-    | heat.delete_stack | 2.479  | 2.526  | 2.59   | 2.606  | 2.623  | 2.537  | 100.0%  | 10    |
-    | total             | 12.651 | 13.069 | 13.902 | 13.942 | 13.981 | 13.221 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 39.0307080746
-    Full duration: 49.9186120033
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 5.244  | 5.361  | 5.485  | 5.498  | 5.511  | 5.375 | 100.0%  | 10    |
-    | heat.update_stack | 9.239  | 9.295  | 9.34   | 9.346  | 9.353  | 9.298 | 100.0%  | 10    |
-    | heat.delete_stack | 3.643  | 3.694  | 3.736  | 3.74   | 3.745  | 3.697 | 100.0%  | 10    |
-    | total             | 18.262 | 18.349 | 18.503 | 18.508 | 18.514 | 18.37 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 55.1248130798
-    Full duration: 66.4681949615
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.185  | 4.4    | 4.476  | 4.481  | 4.486  | 4.371  | 100.0%  | 10    |
-    | heat.update_stack | 5.806  | 5.891  | 5.921  | 5.933  | 5.946  | 5.879  | 100.0%  | 10    |
-    | heat.delete_stack | 2.512  | 2.569  | 2.622  | 2.626  | 2.629  | 2.572  | 100.0%  | 10    |
-    | total             | 12.536 | 12.853 | 12.946 | 12.953 | 12.959 | 12.821 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 38.3984200954
-    Full duration: 49.409635067
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 3.99  | 4.405  | 4.621  | 4.622  | 4.623  | 4.393  | 100.0%  | 10    |
-    | heat.update_stack | 3.536 | 3.563  | 3.779  | 3.832  | 3.885  | 3.624  | 100.0%  | 10    |
-    | heat.delete_stack | 1.335 | 2.488  | 2.546  | 2.555  | 2.564  | 2.09   | 100.0%  | 10    |
-    | total             | 9.272 | 10.325 | 10.734 | 10.81  | 10.886 | 10.107 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 30.7103030682
-    Full duration: 41.7412381172
-
-
-
-    test scenario HeatStacks.create_and_list_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.146 | 4.271  | 4.393  | 4.448  | 4.504 | 4.284 | 100.0%  | 10    |
-    | heat.list_stacks  | 0.072 | 0.1    | 0.111  | 0.115  | 0.119 | 0.097 | 100.0%  | 10    |
-    | total             | 4.254 | 4.376  | 4.494  | 4.541  | 4.588 | 4.382 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 13.1074800491
-    Full duration: 29.5266339779
-
-
-
-    test scenario HeatStacks.create_check_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 3.907 | 4.192  | 4.293  | 4.364  | 4.435 | 4.155 | 100.0%  | 10    |
-    | heat.check_stack  | 0.745 | 1.525  | 1.901  | 1.922  | 1.944 | 1.529 | 100.0%  | 10    |
-    | heat.delete_stack | 1.391 | 2.514  | 2.598  | 2.642  | 2.685 | 2.316 | 100.0%  | 10    |
-    | total             | 7.026 | 8.237  | 8.42   | 8.494  | 8.569 | 8.0   | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 23.9746980667
-    Full duration: 35.3819260597
-
-
-
-    run_rally - INFO - Test scenario: "heat" OK.
-
-    run_rally - INFO - Starting test scenario "keystone" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  66a8f673-a0ba-4559-8d8e-34457024edd9: started
-    Task 66a8f673-a0ba-4559-8d8e-34457024edd9: finished
-
-    test scenario KeystoneBasic.create_tenant_with_users
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.269 | 0.303  | 0.372  | 0.379  | 0.386 | 0.315 | 100.0%  | 10    |
-    | keystone.create_users  | 1.601 | 1.647  | 1.771  | 1.776  | 1.78  | 1.67  | 100.0%  | 10    |
-    | total                  | 1.871 | 1.96   | 2.095  | 2.101  | 2.107 | 1.985 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 5.90541005135
-    Full duration: 21.2136161327
-
-
-
-    test scenario KeystoneBasic.create_add_and_list_user_roles
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.274 | 0.295  | 0.314  | 0.347  | 0.379 | 0.299 | 100.0%  | 10    |
-    | keystone.add_role    | 0.254 | 0.271  | 0.354  | 0.378  | 0.401 | 0.289 | 100.0%  | 10    |
-    | keystone.list_roles  | 0.133 | 0.141  | 0.154  | 0.155  | 0.155 | 0.142 | 100.0%  | 10    |
-    | total                | 0.673 | 0.705  | 0.811  | 0.828  | 0.844 | 0.73  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.21612095833
-    Full duration: 15.3072237968
-
-
-
-    test scenario KeystoneBasic.add_and_remove_user_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.278 | 0.365  | 0.443  | 0.457  | 0.472 | 0.359 | 100.0%  | 10    |
-    | keystone.add_role    | 0.262 | 0.275  | 0.348  | 0.352  | 0.356 | 0.291 | 100.0%  | 10    |
-    | keystone.remove_role | 0.153 | 0.168  | 0.178  | 0.18   | 0.182 | 0.167 | 100.0%  | 10    |
-    | total                | 0.723 | 0.83   | 0.906  | 0.91   | 0.915 | 0.817 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.51204109192
-    Full duration: 15.9939908981
-
-
-
-    test scenario KeystoneBasic.create_update_and_delete_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.283 | 0.313  | 0.4    | 0.402  | 0.403 | 0.333 | 100.0%  | 10    |
-    | keystone.update_tenant | 0.128 | 0.156  | 0.251  | 0.251  | 0.251 | 0.178 | 100.0%  | 10    |
-    | keystone.delete_tenant | 0.307 | 0.356  | 0.433  | 0.451  | 0.469 | 0.365 | 100.0%  | 10    |
-    | total                  | 0.775 | 0.886  | 0.937  | 0.975  | 1.013 | 0.876 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.67470407486
-    Full duration: 14.5480179787
-
-
-
-    test scenario KeystoneBasic.create_and_delete_service
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_service | 0.262 | 0.301  | 0.324  | 0.35   | 0.375 | 0.301 | 100.0%  | 10    |
-    | keystone.delete_service | 0.136 | 0.163  | 0.181  | 0.209  | 0.236 | 0.165 | 100.0%  | 10    |
-    | total                   | 0.413 | 0.47   | 0.521  | 0.522  | 0.524 | 0.467 | 100.0%  | 10    |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.38856720924
-    Full duration: 12.6957240105
-
-
-
-    test scenario KeystoneBasic.create_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.275 | 0.301  | 0.313  | 0.324  | 0.335 | 0.299 | 100.0%  | 10    |
-    | total                  | 0.276 | 0.301  | 0.313  | 0.324  | 0.335 | 0.299 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.917107105255
-    Full duration: 8.57450699806
-
-
-
-    test scenario KeystoneBasic.create_user
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.287 | 0.309  | 0.394  | 0.408  | 0.422 | 0.331 | 100.0%  | 10    |
-    | total                | 0.287 | 0.31   | 0.394  | 0.408  | 0.422 | 0.331 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.01195383072
-    Full duration: 9.76411700249
-
-
-
-    test scenario KeystoneBasic.create_and_list_tenants
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.29  | 0.31   | 0.33   | 0.331  | 0.332 | 0.311 | 100.0%  | 10    |
-    | keystone.list_tenants  | 0.122 | 0.138  | 0.16   | 0.194  | 0.229 | 0.146 | 100.0%  | 10    |
-    | total                  | 0.422 | 0.451  | 0.492  | 0.525  | 0.558 | 0.457 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.38993692398
-    Full duration: 15.0407979488
-
-
-
-    test scenario KeystoneBasic.create_and_delete_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.29  | 0.367  | 0.474  | 0.501  | 0.528 | 0.374 | 100.0%  | 10    |
-    | keystone.delete_role | 0.276 | 0.317  | 0.52   | 0.54   | 0.561 | 0.362 | 100.0%  | 10    |
-    | total                | 0.572 | 0.704  | 0.994  | 1.042  | 1.089 | 0.737 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.35643291473
-    Full duration: 13.3514738083
-
-
-
-    test scenario KeystoneBasic.get_entities
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.266 | 0.31   | 0.344  | 0.369  | 0.393 | 0.313 | 100.0%  | 10    |
-    | keystone.create_user   | 0.137 | 0.157  | 0.169  | 0.174  | 0.179 | 0.158 | 100.0%  | 10    |
-    | keystone.create_role   | 0.124 | 0.142  | 0.164  | 0.199  | 0.234 | 0.151 | 100.0%  | 10    |
-    | keystone.get_tenant    | 0.112 | 0.129  | 0.147  | 0.149  | 0.15  | 0.13  | 100.0%  | 10    |
-    | keystone.get_user      | 0.126 | 0.135  | 0.148  | 0.15   | 0.153 | 0.137 | 100.0%  | 10    |
-    | keystone.get_role      | 0.116 | 0.127  | 0.143  | 0.156  | 0.169 | 0.131 | 100.0%  | 10    |
-    | keystone.service_list  | 0.117 | 0.135  | 0.218  | 0.224  | 0.23  | 0.152 | 100.0%  | 10    |
-    | keystone.get_service   | 0.12  | 0.13   | 0.172  | 0.197  | 0.221 | 0.141 | 100.0%  | 10    |
-    | total                  | 1.204 | 1.319  | 1.391  | 1.394  | 1.398 | 1.315 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.94662213326
-    Full duration: 21.1036419868
-
-
-
-    test scenario KeystoneBasic.create_and_list_users
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.28  | 0.313  | 0.343  | 0.364  | 0.385 | 0.32  | 100.0%  | 10    |
-    | keystone.list_users  | 0.123 | 0.141  | 0.158  | 0.197  | 0.235 | 0.148 | 100.0%  | 10    |
-    | total                | 0.43  | 0.461  | 0.516  | 0.53   | 0.545 | 0.468 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.41474604607
-    Full duration: 9.85008382797
-
-
-
-    run_rally - INFO - Test scenario: "keystone" OK.
-
-    run_rally - INFO - Starting test scenario "neutron" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  2ead843e-f4d1-4ee2-a635-0d37175e3c39: started
-    Task 2ead843e-f4d1-4ee2-a635-0d37175e3c39: finished
-
-    test scenario NeutronNetworks.create_and_delete_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.788 | 0.834  | 0.941  | 0.962  | 0.984 | 0.854 | 100.0%  | 10    |
-    | neutron.delete_port | 0.229 | 0.625  | 0.757  | 0.814  | 0.871 | 0.637 | 100.0%  | 10    |
-    | total               | 1.057 | 1.507  | 1.702  | 1.707  | 1.712 | 1.492 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.537129879
-    Full duration: 55.4609839916
-
-
-
-    test scenario NeutronNetworks.create_and_list_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.706 | 0.789  | 0.991  | 0.992  | 0.992 | 0.825 | 100.0%  | 10    |
-    | neutron.create_router        | 0.068 | 0.482  | 0.587  | 0.666  | 0.746 | 0.47  | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.711 | 0.784  | 0.907  | 1.031  | 1.155 | 0.817 | 100.0%  | 10    |
-    | neutron.list_routers         | 0.417 | 0.467  | 0.513  | 0.54   | 0.567 | 0.474 | 100.0%  | 10    |
-    | total                        | 2.404 | 2.525  | 2.859  | 2.897  | 2.934 | 2.587 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.67870306969
-    Full duration: 58.1500780582
-
-
-
-    test scenario NeutronNetworks.create_and_delete_routers
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet           | 0.749 | 0.813  | 0.872  | 0.875  | 0.878 | 0.816 | 100.0%  | 10    |
-    | neutron.create_router           | 0.06  | 0.463  | 0.517  | 0.53   | 0.544 | 0.435 | 100.0%  | 10    |
-    | neutron.add_interface_router    | 0.335 | 0.772  | 0.867  | 0.868  | 0.869 | 0.707 | 100.0%  | 10    |
-    | neutron.remove_interface_router | 0.341 | 0.691  | 0.901  | 0.916  | 0.93  | 0.69  | 100.0%  | 10    |
-    | neutron.delete_router           | 0.553 | 0.682  | 0.838  | 0.854  | 0.87  | 0.686 | 100.0%  | 10    |
-    | total                           | 2.946 | 3.271  | 3.758  | 3.795  | 3.832 | 3.335 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 9.81285190582
-    Full duration: 60.2574419975
-
-
-
-    test scenario NeutronNetworks.create_and_list_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.81  | 0.883  | 0.976  | 0.981  | 0.987 | 0.89  | 100.0%  | 10    |
-    | neutron.list_ports  | 0.563 | 0.626  | 0.776  | 0.827  | 0.877 | 0.652 | 100.0%  | 10    |
-    | total               | 1.398 | 1.535  | 1.661  | 1.723  | 1.785 | 1.542 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.79494190216
-    Full duration: 57.4564638138
-
-
-
-    test scenario NeutronNetworks.create_and_delete_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.782 | 0.868  | 0.944  | 0.944  | 0.945 | 0.867 | 100.0%  | 10    |
-    | neutron.delete_subnet | 0.579 | 0.66   | 0.806  | 0.813  | 0.82  | 0.679 | 100.0%  | 10    |
-    | total                 | 1.374 | 1.515  | 1.721  | 1.735  | 1.75  | 1.546 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.67370796204
-    Full duration: 54.8155629635
-
-
-
-    test scenario NeutronNetworks.create_and_delete_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.617 | 0.701  | 0.786  | 0.79   | 0.794 | 0.702 | 100.0%  | 10    |
-    | neutron.delete_network | 0.516 | 0.595  | 0.635  | 0.66   | 0.685 | 0.592 | 100.0%  | 10    |
-    | total                  | 1.156 | 1.302  | 1.382  | 1.392  | 1.401 | 1.294 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.91053414345
-    Full duration: 34.4190309048
-
-
-
-    test scenario NeutronNetworks.create_and_list_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.605 | 0.698  | 0.893  | 0.897  | 0.901 | 0.723 | 100.0%  | 10    |
-    | neutron.list_networks  | 0.403 | 0.422  | 0.518  | 0.522  | 0.526 | 0.44  | 100.0%  | 10    |
-    | total                  | 1.013 | 1.156  | 1.315  | 1.315  | 1.315 | 1.163 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.48294115067
-    Full duration: 36.022400856
-
-
-
-    test scenario NeutronNetworks.create_and_update_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.749 | 0.82   | 0.85   | 0.884  | 0.919 | 0.816 | 100.0%  | 10    |
-    | neutron.create_router        | 0.077 | 0.47   | 0.6    | 0.73   | 0.861 | 0.482 | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.362 | 0.752  | 0.811  | 0.858  | 0.904 | 0.692 | 100.0%  | 10    |
-    | neutron.update_router        | 0.206 | 0.635  | 0.668  | 0.68   | 0.691 | 0.554 | 100.0%  | 10    |
-    | total                        | 1.848 | 2.659  | 2.876  | 3.008  | 3.14  | 2.544 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.22650980949
-    Full duration: 60.5388588905
-
-
-
-    test scenario NeutronNetworks.create_and_update_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.654 | 0.724  | 0.888  | 0.911  | 0.934 | 0.756 | 100.0%  | 10    |
-    | neutron.update_network | 0.145 | 0.545  | 0.569  | 0.59   | 0.611 | 0.502 | 100.0%  | 10    |
-    | total                  | 1.018 | 1.265  | 1.427  | 1.431  | 1.436 | 1.258 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.75120806694
-    Full duration: 35.950884819
-
-
-
-    test scenario NeutronNetworks.create_and_update_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.814 | 0.896  | 0.995  | 1.01   | 1.024 | 0.896 | 100.0%  | 10    |
-    | neutron.update_port | 0.181 | 0.562  | 0.612  | 0.65   | 0.689 | 0.537 | 100.0%  | 10    |
-    | total               | 0.995 | 1.461  | 1.585  | 1.597  | 1.608 | 1.433 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.42992901802
-    Full duration: 55.774241209
-
-
-
-    test scenario NeutronNetworks.create_and_list_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.726 | 0.805  | 1.041  | 1.045  | 1.049 | 0.845 | 100.0%  | 10    |
-    | neutron.list_subnets  | 0.053 | 0.422  | 0.446  | 0.446  | 0.446 | 0.353 | 100.0%  | 10    |
-    | total                 | 0.861 | 1.221  | 1.458  | 1.458  | 1.458 | 1.199 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.38276219368
-    Full duration: 55.0756671429
-
-
-
-    test scenario NeutronNetworks.create_and_update_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.731 | 0.802  | 0.891  | 0.923  | 0.954 | 0.814 | 100.0%  | 10    |
-    | neutron.update_subnet | 0.186 | 0.573  | 0.629  | 0.662  | 0.694 | 0.455 | 100.0%  | 10    |
-    | total                 | 0.962 | 1.374  | 1.524  | 1.533  | 1.543 | 1.27  | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.90665698051
-    Full duration: 56.0127599239
-
-
-
-    run_rally - INFO - Test scenario: "neutron" OK.
-
-    run_rally - INFO - Starting test scenario "nova" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  63203b68-fb0f-4190-b881-339d49343b7e: started
-    Task 63203b68-fb0f-4190-b881-339d49343b7e: finished
-
-    test scenario NovaKeypair.create_and_delete_keypair
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.701 | 0.818  | 0.937  | 1.171  | 1.406 | 0.867 | 100.0%  | 10    |
-    | nova.delete_keypair | 0.032 | 0.044  | 0.06   | 0.062  | 0.065 | 0.046 | 100.0%  | 10    |
-    | total               | 0.733 | 0.862  | 0.986  | 1.228  | 1.471 | 0.913 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.58676719666
-    Full duration: 44.6176929474
-
-
-
-    test scenario NovaServers.snapshot_server
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server       | 13.231 | 15.082 | 16.288 | 16.485 | 16.681 | 15.005 | 100.0%  | 10    |
-    | nova.create_image      | 11.557 | 12.205 | 14.231 | 14.559 | 14.887 | 12.815 | 100.0%  | 10    |
-    | nova.delete_server     | 2.824  | 3.432  | 3.623  | 3.636  | 3.649  | 3.306  | 100.0%  | 10    |
-    | nova.boot_server (2)   | 11.125 | 13.278 | 14.799 | 15.311 | 15.823 | 13.287 | 100.0%  | 10    |
-    | nova.delete_server (2) | 2.504  | 2.94   | 3.422  | 3.44   | 3.457  | 3.055  | 100.0%  | 10    |
-    | nova.delete_image      | 2.668  | 3.276  | 3.598  | 3.634  | 3.669  | 3.259  | 100.0%  | 10    |
-    | total                  | 47.925 | 50.051 | 54.553 | 54.844 | 55.135 | 50.728 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 149.159065008
-    Full duration: 223.027470827
-
-
-
-    test scenario NovaKeypair.boot_and_delete_server_with_keypair
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_keypair | 0.681  | 0.807  | 0.953  | 1.005  | 1.056  | 0.813  | 100.0%  | 10    |
-    | nova.boot_server    | 12.625 | 13.795 | 14.626 | 14.992 | 15.358 | 13.92  | 100.0%  | 10    |
-    | nova.delete_server  | 2.895  | 3.252  | 3.838  | 4.433  | 5.028  | 3.378  | 100.0%  | 10    |
-    | nova.delete_keypair | 0.041  | 0.049  | 0.084  | 0.2    | 0.316  | 0.076  | 100.0%  | 10    |
-    | total               | 16.437 | 18.013 | 19.364 | 19.978 | 20.591 | 18.187 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 54.020512104
-    Full duration: 122.761439085
-
-
-
-    test scenario NovaKeypair.create_and_list_keypairs
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.633 | 0.811  | 0.88   | 0.945  | 1.01  | 0.797 | 100.0%  | 10    |
-    | nova.list_keypairs  | 0.019 | 0.032  | 0.048  | 0.057  | 0.065 | 0.034 | 100.0%  | 10    |
-    | total               | 0.663 | 0.833  | 0.925  | 0.988  | 1.051 | 0.831 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.51079297066
-    Full duration: 45.2959558964
-
-
-
-    test scenario NovaServers.list_servers
-    +---------------------------------------------------------------------------------------+
-    |                                 Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max  | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+------+-------+---------+-------+
-    | nova.list_servers | 1.153 | 1.561  | 1.667  | 1.699  | 1.73 | 1.534 | 100.0%  | 10    |
-    | total             | 1.153 | 1.562  | 1.667  | 1.699  | 1.73 | 1.534 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+------+-------+---------+-------+
-    Load duration: 4.51852703094
-    Full duration: 136.974627972
-
-
-
-    test scenario NovaServers.resize_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 12.504 | 13.59  | 14.825 | 15.228 | 15.63  | 13.671 | 100.0%  | 10    |
-    | nova.resize         | 41.099 | 42.204 | 47.49  | 47.556 | 47.621 | 44.023 | 100.0%  | 10    |
-    | nova.resize_confirm | 2.651  | 3.698  | 3.805  | 4.059  | 4.314  | 3.556  | 100.0%  | 10    |
-    | nova.delete_server  | 2.631  | 3.022  | 3.411  | 4.443  | 5.475  | 3.21   | 100.0%  | 10    |
-    | total               | 60.59  | 62.713 | 69.597 | 69.873 | 70.149 | 64.46  | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 192.511741161
-    Full duration: 232.632377863
-
-
-
-    test scenario NovaServers.boot_server_from_volume_and_delete
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.605  | 10.39  | 10.671 | 10.678 | 10.685 | 10.283 | 100.0%  | 10    |
-    | nova.boot_server     | 13.194 | 15.101 | 15.844 | 16.008 | 16.171 | 15.084 | 100.0%  | 10    |
-    | nova.delete_server   | 5.067  | 5.835  | 6.025  | 6.147  | 6.269  | 5.704  | 100.0%  | 10    |
-    | total                | 29.712 | 31.089 | 31.863 | 32.17  | 32.477 | 31.072 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 93.8591198921
-    Full duration: 176.781407833
-
-
-
-    test scenario NovaServers.boot_and_migrate_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 12.007 | 12.628 | 15.251 | 15.726 | 16.2   | 13.337 | 100.0%  | 10    |
-    | nova.stop_server    | 5.734  | 6.679  | 7.157  | 7.198  | 7.239  | 6.643  | 100.0%  | 10    |
-    | nova.migrate        | 11.005 | 12.115 | 12.764 | 12.898 | 13.031 | 12.041 | 100.0%  | 10    |
-    | nova.resize_confirm | 2.991  | 3.639  | 4.391  | 5.442  | 6.493  | 3.866  | 100.0%  | 10    |
-    | nova.delete_server  | 2.512  | 2.889  | 3.089  | 3.162  | 3.235  | 2.846  | 100.0%  | 10    |
-    | total               | 36.009 | 38.096 | 41.114 | 42.08  | 43.046 | 38.733 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 117.547358036
-    Full duration: 158.547077894
-
-
-
-    test scenario NovaServers.boot_and_delete_server
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server   | 12.11  | 12.864 | 14.437 | 14.962 | 15.486 | 13.148 | 100.0%  | 10    |
-    | nova.delete_server | 2.855  | 3.146  | 3.605  | 3.624  | 3.644  | 3.198  | 100.0%  | 10    |
-    | total              | 15.189 | 15.944 | 18.012 | 18.222 | 18.433 | 16.346 | 100.0%  | 10    |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 47.4842679501
-    Full duration: 115.855407953
-
-
-
-    test scenario NovaServers.boot_and_rebuild_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 11.096 | 13.966 | 14.767 | 14.775 | 14.783 | 13.664 | 100.0%  | 10    |
-    | nova.rebuild_server | 12.012 | 14.475 | 15.049 | 15.15  | 15.252 | 14.233 | 100.0%  | 10    |
-    | nova.delete_server  | 2.573  | 2.99   | 3.499  | 4.34   | 5.181  | 3.213  | 100.0%  | 10    |
-    | total               | 28.419 | 30.951 | 32.946 | 34.081 | 35.216 | 31.111 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 91.1762368679
-    Full duration: 160.48626709
-
-
-
-    test scenario NovaSecGroup.create_and_list_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.384  | 5.131  | 5.534  | 5.638  | 5.741  | 5.066  | 100.0%  | 10    |
-    | nova.create_100_rules          | 42.262 | 43.319 | 44.707 | 45.482 | 46.258 | 43.582 | 100.0%  | 10    |
-    | nova.list_security_groups      | 0.18   | 0.248  | 0.52   | 0.602  | 0.685  | 0.299  | 100.0%  | 10    |
-    | total                          | 47.342 | 48.922 | 49.657 | 50.789 | 51.921 | 48.948 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 145.205770016
-    Full duration: 212.670469999
-
-
-
-    test scenario NovaSecGroup.create_and_delete_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 3.797  | 4.842  | 5.428  | 5.548  | 5.668  | 4.805  | 100.0%  | 10    |
-    | nova.create_100_rules          | 42.897 | 43.258 | 45.74  | 45.781 | 45.822 | 43.845 | 100.0%  | 10    |
-    | nova.delete_10_security_groups | 1.712  | 2.272  | 2.576  | 2.63   | 2.685  | 2.249  | 100.0%  | 10    |
-    | total                          | 49.862 | 50.866 | 51.896 | 52.159 | 52.422 | 50.9   | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 153.145931959
-    Full duration: 195.681600094
-
-
-
-    test scenario NovaServers.boot_and_bounce_server
-    +-------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                       |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                  | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server        | 12.233 | 14.014 | 14.779 | 15.28  | 15.781 | 13.878 | 100.0%  | 10    |
-    | nova.reboot_server      | 5.429  | 5.857  | 6.286  | 6.298  | 6.31   | 5.906  | 100.0%  | 10    |
-    | nova.soft_reboot_server | 7.965  | 8.388  | 8.771  | 8.786  | 8.801  | 8.365  | 100.0%  | 10    |
-    | nova.stop_server        | 4.492  | 6.237  | 6.84   | 6.896  | 6.952  | 6.14   | 100.0%  | 10    |
-    | nova.start_server       | 3.528  | 4.271  | 5.459  | 5.844  | 6.229  | 4.465  | 100.0%  | 10    |
-    | nova.rescue_server      | 7.297  | 8.174  | 10.803 | 11.337 | 11.872 | 8.852  | 100.0%  | 10    |
-    | nova.unrescue_server    | 5.397  | 5.465  | 5.755  | 5.956  | 6.158  | 5.563  | 100.0%  | 10    |
-    | nova.delete_server      | 2.694  | 2.967  | 3.17   | 3.266  | 3.362  | 2.999  | 100.0%  | 10    |
-    | total                   | 53.124 | 55.752 | 58.931 | 59.472 | 60.013 | 56.189 | 100.0%  | 10    |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 166.732338905
-    Full duration: 235.669921875
-
-
-
-    test scenario NovaServers.boot_server
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +------------------+--------+--------+--------+--------+------+--------+---------+-------+
-    | action           | min    | median | 90%ile | 95%ile | max  | avg    | success | count |
-    +------------------+--------+--------+--------+--------+------+--------+---------+-------+
-    | nova.boot_server | 12.435 | 13.902 | 14.341 | 14.37  | 14.4 | 13.679 | 100.0%  | 10    |
-    | total            | 12.435 | 13.903 | 14.341 | 14.37  | 14.4 | 13.679 | 100.0%  | 10    |
-    +------------------+--------+--------+--------+--------+------+--------+---------+-------+
-    Load duration: 40.4824538231
-    Full duration: 98.6827569008
-
-
-
-    test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-    +-----------------------------------------------------------------------------------------------------------+
-    |                                           Response Times (sec)                                            |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups    | 4.34   | 5.246  | 5.496  | 5.585  | 5.675  | 5.171  | 100.0%  | 10    |
-    | nova.create_100_rules             | 41.95  | 43.077 | 44.37  | 44.812 | 45.253 | 43.236 | 100.0%  | 10    |
-    | nova.boot_server                  | 10.869 | 11.908 | 13.524 | 13.633 | 13.742 | 12.265 | 100.0%  | 10    |
-    | nova.get_attached_security_groups | 0.224  | 0.267  | 0.504  | 0.555  | 0.607  | 0.332  | 100.0%  | 10    |
-    | nova.delete_server                | 2.533  | 2.618  | 3.078  | 3.091  | 3.103  | 2.742  | 100.0%  | 10    |
-    | nova.delete_10_security_groups    | 1.637  | 1.754  | 2.383  | 2.591  | 2.798  | 1.972  | 100.0%  | 10    |
-    | total                             | 64.243 | 65.856 | 66.932 | 67.145 | 67.358 | 65.721 | 100.0%  | 10    |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 197.864094019
-    Full duration: 266.162395
-
-
-
-    test scenario NovaServers.pause_and_unpause_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 12.223 | 14.903 | 15.571 | 15.708 | 15.844 | 14.546 | 100.0%  | 10    |
-    | nova.pause_server   | 2.791  | 3.173  | 3.334  | 3.379  | 3.424  | 3.141  | 100.0%  | 10    |
-    | nova.unpause_server | 2.459  | 2.849  | 3.186  | 3.266  | 3.346  | 2.907  | 100.0%  | 10    |
-    | nova.delete_server  | 2.863  | 3.13   | 3.335  | 3.403  | 3.47   | 3.121  | 100.0%  | 10    |
-    | total               | 20.391 | 24.232 | 24.74  | 24.758 | 24.775 | 23.717 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 72.4143497944
-    Full duration: 139.801489115
-
-
-
-    test scenario NovaServers.boot_server_from_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.672  | 10.675 | 10.972 | 11.222 | 11.472 | 10.543 | 100.0%  | 10    |
-    | nova.boot_server     | 14.233 | 16.466 | 17.095 | 17.399 | 17.704 | 16.109 | 100.0%  | 10    |
-    | total                | 23.906 | 27.176 | 27.879 | 28.21  | 28.54  | 26.653 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 79.5798490047
-    Full duration: 145.711636782
-
-
-
-    test scenario NovaServers.boot_and_list_server
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server  | 12.064 | 14.109 | 15.049 | 15.436 | 15.823 | 13.885 | 100.0%  | 10    |
-    | nova.list_servers | 0.612  | 0.992  | 1.197  | 1.199  | 1.201  | 0.948  | 100.0%  | 10    |
-    | total             | 13.261 | 15.082 | 15.982 | 16.209 | 16.435 | 14.833 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 43.442057848
-    Full duration: 128.433704138
-
-
-
-    run_rally - INFO - Test scenario: "nova" OK.
-
-    run_rally - INFO - Starting test scenario "quotas" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  f60014e7-4880-41c6-afbc-ea7d18ef56e0: started
-    Task f60014e7-4880-41c6-afbc-ea7d18ef56e0: finished
-
-    test scenario Quotas.cinder_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.111 | 1.203  | 1.671  | 1.682  | 1.692 | 1.279 | 100.0%  | 10    |
-    | total                | 1.111 | 1.203  | 1.671  | 1.682  | 1.692 | 1.279 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.63238286972
-    Full duration: 15.5500700474
-
-
-
-    test scenario Quotas.neutron_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.392 | 0.43   | 0.632  | 0.65   | 0.667 | 0.482 | 100.0%  | 10    |
-    | total                | 0.555 | 0.597  | 0.799  | 0.808  | 0.816 | 0.64  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.90143704414
-    Full duration: 12.9954409599
-
-
-
-    test scenario Quotas.cinder_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.086 | 1.207  | 1.358  | 1.436  | 1.513 | 1.228 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.549 | 0.88   | 0.94   | 0.951  | 0.963 | 0.839 | 100.0%  | 10    |
-    | total                | 1.654 | 2.078  | 2.316  | 2.37   | 2.424 | 2.067 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 6.08279585838
-    Full duration: 18.0140779018
-
-
-
-    test scenario Quotas.nova_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.573 | 0.62   | 0.652  | 0.658  | 0.664 | 0.619 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.016 | 0.025  | 0.028  | 0.032  | 0.036 | 0.024 | 100.0%  | 10    |
-    | total                | 0.599 | 0.642  | 0.678  | 0.68   | 0.681 | 0.643 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.95340800285
-    Full duration: 13.6638329029
-
-
-
-    test scenario Quotas.nova_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.575 | 0.616  | 0.669  | 0.681  | 0.692 | 0.622 | 100.0%  | 10    |
-    | total                | 0.575 | 0.616  | 0.669  | 0.681  | 0.692 | 0.622 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.90668487549
-    Full duration: 13.5694701672
-
-
-
-    run_rally - INFO - Test scenario: "quotas" OK.
-
-    run_rally - INFO - Starting test scenario "requests" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  3835bbc7-faf5-4671-9261-aa07c1d6a1e2: started
-    Task 3835bbc7-faf5-4671-9261-aa07c1d6a1e2: finished
-
-    test scenario HttpRequests.check_random_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 5.049 | 5.088  | 5.34   | 5.361  | 5.381 | 5.151 | 100.0%  | 10    |
-    | total                  | 5.049 | 5.088  | 5.34   | 5.361  | 5.381 | 5.151 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 15.4988431931
-    Full duration: 20.5546550751
-
-
-
-    test scenario HttpRequests.check_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 5.048 | 5.052  | 5.057  | 5.058  | 5.058 | 5.053 | 100.0%  | 10    |
-    | total                  | 5.048 | 5.052  | 5.057  | 5.058  | 5.058 | 5.053 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 15.2044279575
-    Full duration: 20.1352801323
-
-
-
-    run_rally - INFO - Test scenario: "requests" OK.
-
-    run_rally - INFO -
-
-
-                         Rally Summary Report
-    +===================+============+===============+===========+
-    | Module            | Duration   | nb. Test Run  | Success   |
-    +===================+============+===============+===========+
-    | authenticate      | 00:58      | 10            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | glance            | 03:54      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | cinder            | 22:59      | 50            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | heat              | 11:14      | 35            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | keystone          | 02:37      | 29            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | neutron           | 10:19      | 31            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | nova              | 47:19      | 61            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | quotas            | 01:13      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | requests          | 00:40      | 2             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    +===================+============+===============+===========+
-    | TOTAL:            | 01:41:19   | 232           | 100.00%   |
-    +===================+============+===============+===========+
-
-
-
-Feature tests
--------------
-
-vIMS
-^^^^
-::
-
-    FUNCTEST.info: Running vIMS test...
-    vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-    vIMS - INFO - Update OpenStack creds informations
-    vIMS - INFO - Upload some OS images if it doesn't exist
-    vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - Update security group quota for this tenant
-    vIMS - INFO - Update cinder quota for this tenant
-    vIMS - INFO - Collect flavor id for cloudify manager server
-    vIMS - INFO - Prepare virtualenv for cloudify-cli
-    vIMS - INFO - Downloading the cloudify manager server blueprint
-    vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the cloudify-manager deployment
-    vIMS - INFO - Cloudify-manager server is UP !
-    vIMS - INFO - Cloudify deployment duration:'1149.9'
-    vIMS - INFO - Collect flavor id for all clearwater vm
-    vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
-    vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the clearwater deployment
-    vIMS - INFO - The deployment of clearwater-opnfv is ended
-    vIMS - INFO - vIMS VNF deployment duration:'1133.8'
-    vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
-    vIMS - INFO - vIMS functional test duration:'2.9'
-    vIMS - INFO - Launching the clearwater-opnfv undeployment
-    vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-    vIMS - INFO - Launching the cloudify-manager undeployment
-    vIMS - INFO - Cloudify-manager server has been successfully removed!
-    vIMS - INFO - Removing vIMS tenant ..
-    vIMS - INFO - Removing vIMS user ..
-
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    Promise- INFO - Creating tenant 'promise'...
-    Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
-    Promise- INFO - Creating user 'promiser'...
-    Promise- INFO - Updating OpenStack credentials...
-    Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    Promise- INFO - Creating flavor 'promise-flavor'...
-    Promise- INFO - Exporting environment variables...
-    Promise- INFO - Running command: npm run -s test -- --reporter json
-    Promise- INFO - The test succeeded.
-    Promise- DEBUG -
-    {
-      "stats": {
-        "suites": 23,
-        "tests": 33,
-        "passes": 33,
-        "pending": 0,
-        "failures": 0,
-        "start": "2016-02-23T02:24:39.314Z",
-        "end": "2016-02-23T02:24:44.838Z",
-        "duration": 5524
-      },
-      "tests": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ],
-      "pending": [],
-      "failures": [],
-      "passes": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ]
-    }
-    Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:    23
-     Tests:     33
-     Passes:    33
-     Pending:   0
-     Failures:  0
-     Start:     2016-02-18T13:37:06.661Z
-     End:       2016-02-18T13:37:12.962Z
-     Duration:  6.301
-    ****************************************
-
-
diff --git a/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst b/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst
deleted file mode 100644 (file)
index 652db33..0000000
+++ /dev/null
@@ -1,1254 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-odl_l2-bgpvpn-ha
------------------------------------------------------
-
-VIM
----
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-userdata test...
-    vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_userdata- INFO - Creating neutron network vping-net...
-    vPing_userdata- INFO - Creating security group  'vPing-sg'...
-    vPing_userdata- INFO - Flavor found 'm1.small'
-    vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-     userdata=
-    #!/bin/sh
-
-    while true; do
-     ping -c 1 192.168.130.4 2>&1 >/dev/null
-     RES=$?
-     if [ "Z$RES" = "Z0" ] ; then
-      echo 'vPing OK'
-     break
-     else
-      echo 'vPing KO'
-     fi
-     sleep 1
-    done
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_userdata- INFO - Waiting for ping...
-    vPing_userdata- INFO - vPing detected!
-    vPing_userdata- INFO - vPing duration:'79.7'
-    vPing_userdata- INFO - vPing OK
-    vPing_userdata- INFO - Cleaning up...
-    vPing_userdata- INFO - Deleting network 'vping-net'...
-
-Tempest
-^^^^^^^
-::
-
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    | name                                                                                                                                     | time    | status  |
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.281   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.114   | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 12.926  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 24.849  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 36.056  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.547   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.768   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.486   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 1.049   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.347   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.299   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.952   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.529   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.260   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.786   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.487   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.624   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.792   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.859   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.417   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.461   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.160   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 2.692   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 4.500   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 9.766   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 300.727 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.330   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.687   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 302.209 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.002   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 300.741 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.455   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.680   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 302.095 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.002   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.084   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 3.891   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.470   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.220   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.530   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.437   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.143   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.103   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.079   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.096   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.721   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.181   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.091   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.018   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.095   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.088   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.030   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.035   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.054   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.069   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.084   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.699   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.022   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.075   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.002   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 5.318   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 10.683  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 306.252 | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.838   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 311.592 | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 15.370  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 25.343  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 9.258   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.091   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.152   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.491   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.366   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.286   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.567   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.727   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.596   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 4.330   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 14.127  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 18.635  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 12.265  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 12.122  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 1.506   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 2.128   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 1.933   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 2.111   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 2.560   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.578   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 1.508   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.998   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.998   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 2.359   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 1.243   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 1.306   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 1.421   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.998   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.635   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.974   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.015   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 1.512   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.886   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.250   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.052   | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 336.810 | fail    |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.740   | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.093   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.535   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.028   | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.750   | success |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.245   | success |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.398   | success |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.097   | success |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.904   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.520   | success |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 2.415   | success |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.403   | success |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.292   | success |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.521   | success |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.183   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.109   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.086   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.080   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.089   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.089   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.077   | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.269   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.917   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 15.399  | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 20.214  | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 5.865   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.207   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 2.604   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 2.662   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.556   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.059   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.041   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.278   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.271   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 2.640   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 2.800   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 2.208   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.293   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.300   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 2.291   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 2.745   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 1.368   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.318   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.065   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 5.069   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 3.298   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 2.237   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 2.321   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 5.779   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 2.980   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 2.462   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 2.617   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 1.811   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 3.256   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.033   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 1.774   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 2.789   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.077   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.565   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.751   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.047   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 1.299   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.592   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.613   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.569   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.805   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.762   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.270   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.048   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 6.732   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 3.526   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 3.356   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.875   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 9.723   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 17.070  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 9.744   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 18.252  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.284   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.048   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 322.942 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 335.472 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 332.744 | fail    |
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    2016-04-26 21:34:37,839 - run_tempest - INFO - Results: {'timestart': '2016-04-2620:21:12.306509', 'duration': 803, 'tests': 188, 'failures': 10}
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    2016-04-26 21:36:15,676 - run_rally - INFO - Starting test scenario "authenticate" ...
-    2016-04-26 21:37:35,906 - run_rally - INFO -
-     Preparing input task
-     Task  a8cb2031-5232-47f0-bc43-9316bd7ceefa: started
-    Task a8cb2031-5232-47f0-bc43-9316bd7ceefa: finished
-
-    test scenario Authenticate.validate_glance
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_glance_2_times | 1.015     | 1.244        | 1.415        | 1.476        | 1.536     | 1.249     | 100.0%  | 10    |
-    | total                                | 1.281     | 1.505        | 1.685        | 1.744        | 1.804     | 1.516     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 4.44646310806
-    Full duration: 12.853926897
-
-    test scenario Authenticate.keystone
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.keystone | 0.214     | 0.249        | 0.267        | 0.269        | 0.272     | 0.248     | 100.0%  | 10    |
-    | total                 | 0.214     | 0.249        | 0.267        | 0.269        | 0.272     | 0.248     | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.754605054855
-    Full duration: 9.11485695839
-
-    test scenario Authenticate.validate_heat
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_heat_2_times | 0.343     | 0.61         | 0.662        | 0.733        | 0.805     | 0.606     | 100.0%  | 10    |
-    | total                              | 0.589     | 0.871        | 0.971        | 1.045        | 1.12      | 0.878     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.61781597137
-    Full duration: 11.0082919598
-
-    test scenario Authenticate.validate_nova
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_nova_2_times | 0.328     | 0.371        | 0.479        | 0.495        | 0.51      | 0.391     | 100.0%  | 10    |
-    | total                              | 0.555     | 0.619        | 0.743        | 0.756        | 0.769     | 0.643     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.93781709671
-    Full duration: 10.4554929733
-
-    test scenario Authenticate.validate_cinder
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_cinder_2_times | 0.31      | 0.64         | 0.927        | 0.962        | 0.998     | 0.67      | 100.0%  | 10    |
-    | total                                | 0.549     | 0.921        | 1.219        | 1.236        | 1.253     | 0.939     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.9773349762
-    Full duration: 11.6194210052
-
-    test scenario Authenticate.validate_neutron
-    +------------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                           Response Times (sec)                                                           |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_neutron_2_times | 0.304     | 0.558        | 0.576        | 0.611        | 0.646     | 0.539     | 100.0%  | 10    |
-    | total                                 | 0.569     | 0.804        | 0.819        | 0.851        | 0.882     | 0.785     | 100.0%  | 10    |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.409938097
-    Full duration: 11.0552449226
-
-    2016-04-26 21:37:37,881 - run_rally - INFO - Test scenario: "authenticate" OK.
-
-    2016-04-26 21:37:37,882 - run_rally - INFO - Starting test scenario "glance" ...
-    2016-04-26 21:41:19,902 - run_rally - INFO -
-     Preparing input task
-     Task  5a858da8-1039-4f20-960f-2d44354c4c60: started
-    Task 5a858da8-1039-4f20-960f-2d44354c4c60: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                  |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.list_images | 0.803     | 0.914        | 1.107        | 1.148        | 1.189     | 0.949     | 100.0%  | 10    |
-    | total              | 0.803     | 0.914        | 1.107        | 1.148        | 1.189     | 0.949     | 100.0%  | 10    |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.9055929184
-    Full duration: 14.7421119213
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 7.493     | 7.807        | 9.069        | 12.596       | 16.122    | 8.653     | 100.0%  | 10    |
-    | nova.boot_servers   | 9.309     | 10.032       | 11.628       | 11.726       | 11.824    | 10.411    | 100.0%  | 10    |
-    | total               | 17.19     | 18.474       | 20.176       | 22.804       | 25.432    | 19.064    | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 54.8601989746
-    Full duration: 113.092097998
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 7.313     | 7.52         | 8.653        | 12.221       | 15.788    | 8.359     | 100.0%  | 10    |
-    | glance.list_images  | 0.356     | 0.537        | 0.57         | 0.599        | 0.627     | 0.519     | 100.0%  | 10    |
-    | total               | 7.817     | 8.058        | 9.194        | 12.748       | 16.302    | 8.878     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 24.3566281796
-    Full duration: 40.1059360504
-
-    test scenario GlanceImages.create_and_delete_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 7.08      | 7.515        | 7.968        | 8.084        | 8.201     | 7.585     | 100.0%  | 10    |
-    | glance.delete_image | 1.893     | 2.224        | 2.429        | 2.431        | 2.434     | 2.198     | 100.0%  | 10    |
-    | total               | 9.374     | 9.68         | 10.313       | 10.449       | 10.585    | 9.783     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 29.927503109
-    Full duration: 40.712335825
-
-    2016-04-26 21:41:21,905 - run_rally - INFO - Test scenario: "glance" OK.
-
-    2016-04-26 21:41:21,905 - run_rally - INFO - Starting test scenario "cinder" ...
-    2016-04-26 22:02:57,566 - run_rally - INFO -
-     Preparing input task
-     Task  8714ce27-ec07-493c-894b-0378b012f768: started
-    Task 8714ce27-ec07-493c-894b-0378b012f768: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server     | 7.315     | 7.849        | 8.808        | 9.275        | 9.743     | 8.131     | 100.0%  | 10    |
-    | cinder.create_volume | 3.204     | 3.91         | 4.165        | 4.209        | 4.253     | 3.777     | 100.0%  | 10    |
-    | nova.attach_volume   | 4.193     | 5.576        | 6.847        | 6.918        | 6.989     | 5.577     | 100.0%  | 10    |
-    | nova.detach_volume   | 3.591     | 4.036        | 4.652        | 4.887        | 5.122     | 4.155     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.805     | 2.91         | 3.015        | 3.158        | 3.301     | 2.362     | 100.0%  | 10    |
-    | nova.delete_server   | 2.813     | 3.044        | 3.223        | 3.232        | 3.24      | 3.033     | 100.0%  | 10    |
-    | total                | 24.205    | 26.801       | 29.041       | 29.115       | 29.188    | 27.034    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 81.0580990314
-    Full duration: 112.19692111
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 10.993    | 11.11        | 11.434       | 11.435       | 11.436    | 11.186    | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.069     | 0.33         | 0.436        | 0.474        | 0.512     | 0.268     | 100.0%  | 10    |
-    | total                | 11.084    | 11.476       | 11.601       | 11.714       | 11.828    | 11.454    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 34.1340601444
-    Full duration: 55.759376049
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.45      | 3.958        | 4.546        | 4.569        | 4.591     | 4.003     | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.062     | 0.325        | 0.344        | 0.345        | 0.345     | 0.275     | 100.0%  | 10    |
-    | total                | 3.513     | 4.292        | 4.865        | 4.9          | 4.935     | 4.279     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 12.6924929619
-    Full duration: 34.0712091923
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 3.235     | 3.344        | 3.856        | 4.736        | 5.617     | 3.629     | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.039     | 0.285        | 0.337        | 0.376        | 0.416     | 0.254     | 100.0%  | 10    |
-    | total                  | 3.333     | 3.676        | 4.127        | 4.892        | 5.657     | 3.884     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 10.8523409367
-    Full duration: 47.7997851372
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.471     | 3.85         | 4.197        | 4.341        | 4.485     | 3.858     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.532     | 2.741        | 3.118        | 3.184        | 3.251     | 2.077     | 100.0%  | 10    |
-    | total                | 4.328     | 6.376        | 7.081        | 7.248        | 7.416     | 5.935     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 17.2594389915
-    Full duration: 34.9955868721
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 8.676     | 10.604       | 11.06        | 11.115       | 11.17     | 10.243    | 100.0%  | 10    |
-    | cinder.delete_volume | 0.894     | 2.767        | 3.153        | 3.195        | 3.237     | 2.369     | 100.0%  | 10    |
-    | total                | 9.774     | 12.84        | 13.865       | 14.089       | 14.313    | 12.612    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 37.8307890892
-    Full duration: 56.2227160931
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.45      | 3.88         | 4.434        | 4.439        | 4.445     | 3.935     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.8       | 0.932        | 3.003        | 3.159        | 3.316     | 1.539     | 100.0%  | 10    |
-    | total                | 4.496     | 4.916        | 6.901        | 7.325        | 7.749     | 5.474     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 16.0426750183
-    Full duration: 32.9341490269
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +----------------------------------------------------------------------------------------------------------------------------------+
-    |                                                       Response Times (sec)                                                       |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume          | 3.49      | 3.782        | 4.253        | 4.255        | 4.256     | 3.847     | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 16.394    | 27.4         | 31.961       | 32.07        | 32.18     | 25.735    | 100.0%  | 10    |
-    | cinder.delete_volume          | 0.68      | 2.971        | 3.15         | 3.173        | 3.195     | 2.523     | 100.0%  | 10    |
-    | nova.delete_image             | 2.479     | 2.591        | 14.325       | 14.525       | 14.725    | 4.969     | 100.0%  | 10    |
-    | total                         | 24.827    | 37.87        | 49.56        | 51.384       | 53.208    | 37.075    | 100.0%  | 10    |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 101.809072971
-    Full duration: 121.969902992
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 3.076     | 3.402        | 3.707        | 4.558        | 5.409     | 3.552     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.541     | 2.81         | 3.096        | 3.171        | 3.246     | 2.854     | 100.0%  | 10    |
-    | total                  | 5.963     | 6.195        | 6.881        | 7.543        | 8.206     | 6.406     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 18.6676621437
-    Full duration: 51.159060955
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.592     | 3.816        | 3.986        | 4.022        | 4.058     | 3.828     | 100.0%  | 10    |
-    | total                | 3.592     | 3.816        | 3.986        | 4.022        | 4.058     | 3.828     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.4555690289
-    Full duration: 28.3837711811
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.49      | 3.885        | 4.203        | 4.22         | 4.238     | 3.914     | 100.0%  | 10    |
-    | total                | 3.49      | 3.885        | 4.203        | 4.22         | 4.238     | 3.914     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.7762680054
-    Full duration: 32.9480211735
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.list_volumes | 0.556     | 0.603        | 0.646        | 0.687        | 0.728     | 0.61      | 100.0%  | 10    |
-    | total               | 0.556     | 0.603        | 0.646        | 0.687        | 0.728     | 0.611     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.8286819458
-    Full duration: 63.6903710365
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 3.584     | 3.868        | 4.043        | 4.092        | 4.141     | 3.882     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.795     | 3.099        | 3.183        | 3.279        | 3.376     | 3.058     | 100.0%  | 10    |
-    | nova.attach_volume     | 3.804     | 4.321        | 9.448        | 9.664        | 9.88      | 5.664     | 100.0%  | 10    |
-    | nova.detach_volume     | 3.584     | 4.108        | 4.341        | 4.345        | 4.349     | 4.073     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.527     | 2.796        | 3.137        | 3.155        | 3.172     | 2.849     | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.516     | 2.694        | 3.048        | 3.146        | 3.244     | 2.193     | 100.0%  | 10    |
-    | total                  | 19.584    | 21.934       | 25.955       | 26.608       | 27.261    | 22.822    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 65.3636519909
-    Full duration: 157.771946192
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.799     | 4.234        | 6.551        | 6.658        | 6.765     | 4.608     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.709     | 3.319        | 3.584        | 3.584        | 3.585     | 3.276     | 100.0%  | 10    |
-    | total                | 7.064     | 7.351        | 9.902        | 9.97         | 10.037    | 7.885     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 24.1967608929
-    Full duration: 56.604929924
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.542     | 3.816        | 3.903        | 3.913        | 3.923     | 3.81      | 100.0%  | 10    |
-    | cinder.extend_volume | 1.122     | 3.325        | 3.477        | 3.479        | 3.482     | 2.916     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.537     | 2.74         | 3.216        | 3.222        | 3.227     | 2.259     | 100.0%  | 10    |
-    | total                | 5.854     | 9.459        | 10.487       | 10.503       | 10.52     | 8.985     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 28.2484090328
-    Full duration: 46.2826929092
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 3.569     | 3.853        | 3.95         | 4.015        | 4.08      | 3.829     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.31      | 2.832        | 3.33         | 3.355        | 3.38      | 2.897     | 100.0%  | 10    |
-    | nova.attach_volume     | 4.043     | 4.744        | 7.838        | 8.729        | 9.621     | 5.643     | 100.0%  | 10    |
-    | nova.detach_volume     | 3.471     | 4.246        | 4.498        | 4.498        | 4.498     | 4.184     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.532     | 2.852        | 2.92         | 2.971        | 3.022     | 2.789     | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.549     | 2.606        | 2.992        | 3.023        | 3.053     | 2.117     | 100.0%  | 10    |
-    | total                  | 18.473    | 22.08        | 25.688       | 26.47        | 27.253    | 22.541    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 66.4576151371
-    Full duration: 166.03899312
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 3.15      | 3.42         | 3.637        | 3.78         | 3.923     | 3.45      | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.546     | 2.911        | 3.114        | 3.207        | 3.301     | 2.929     | 100.0%  | 10    |
-    | nova.attach_volume     | 4.077     | 5.64         | 7.857        | 8.865        | 9.874     | 5.963     | 100.0%  | 10    |
-    | nova.detach_volume     | 3.76      | 4.056        | 4.468        | 4.626        | 4.784     | 4.137     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.242     | 2.665        | 2.932        | 2.947        | 2.961     | 2.633     | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.539     | 2.723        | 3.0          | 3.115        | 3.23      | 2.577     | 100.0%  | 10    |
-    | total                  | 19.142    | 22.899       | 26.465       | 27.264       | 28.063    | 23.373    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 68.2796330452
-    Full duration: 167.136126041
-
-SDN Controller
---------------
-
-ODL
-^^^^
-::
-
-    ==============================================================================
-    Basic
-    ==============================================================================
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-    ==============================================================================
-    Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-    ------------------------------------------------------------------------------
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Basic                                                                 | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/repos/functest/output.xml
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-    [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin
-    ==============================================================================
-    Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-    ==============================================================================
-    Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-    ------------------------------------------------------------------------------
-    Create Network :: Create new network in OpenStack                     | PASS |
-    ------------------------------------------------------------------------------
-    Check Network :: Check Network created in OpenDaylight                | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-    ==============================================================================
-    Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-    ------------------------------------------------------------------------------
-    Create New subnet :: Create new subnet in OpenStack                   | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-    ==============================================================================
-    Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-    ------------------------------------------------------------------------------
-    Create New Port :: Create new port in OpenStack                       | PASS |
-    ------------------------------------------------------------------------------
-    Check New Port :: Check new subnet created in OpenDaylight            | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-    ==============================================================================
-    Delete New Port :: Delete previously created port in OpenStack        | PASS |
-    ------------------------------------------------------------------------------
-    Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-    ==============================================================================
-    Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-    ==============================================================================
-    Delete Network :: Delete network in OpenStack                         | PASS |
-    ------------------------------------------------------------------------------
-    Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin                              | PASS |
-    18 critical tests, 18 passed, 0 failed
-    18 tests total, 18 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/repos/functest/output.xml
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-    [0;32mFinal report is located:[0m
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-
-Feature tests
--------------
-
-vIMS
-^^^^
-::
-
-    FUNCTEST.info: Running vIMS test...
-    vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-    vIMS - INFO - Update OpenStack creds informations
-    vIMS - INFO - Upload some OS images if it doesn't exist
-    vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - Update security group quota for this tenant
-    vIMS - INFO - Update cinder quota for this tenant
-    vIMS - INFO - Collect flavor id for cloudify manager server
-    vIMS - INFO - Prepare virtualenv for cloudify-cli
-    vIMS - INFO - Downloading the cloudify manager server blueprint
-    vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the cloudify-manager deployment
-    vIMS - INFO - Cloudify-manager server is UP !
-    vIMS - INFO - Cloudify deployment duration:'1149.9'
-    vIMS - INFO - Collect flavor id for all clearwater vm
-    vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
-    vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the clearwater deployment
-    vIMS - INFO - The deployment of clearwater-opnfv is ended
-    vIMS - INFO - vIMS VNF deployment duration:'1133.8'
-    vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
-    vIMS - INFO - vIMS functional test duration:'2.9'
-    vIMS - INFO - Launching the clearwater-opnfv undeployment
-    vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-    vIMS - INFO - Launching the cloudify-manager undeployment
-    vIMS - INFO - Cloudify-manager server has been successfully removed!
-    vIMS - INFO - Removing vIMS tenant ..
-    vIMS - INFO - Removing vIMS user ..
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    Promise- INFO - Creating tenant 'promise'...
-    Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
-    Promise- INFO - Creating user 'promiser'...
-    Promise- INFO - Updating OpenStack credentials...
-    Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    Promise- INFO - Creating flavor 'promise-flavor'...
-    Promise- INFO - Exporting environment variables...
-    Promise- INFO - Running command: npm run -s test -- --reporter json
-    Promise- INFO - The test succeeded.
-    Promise- DEBUG -
-    {
-      "stats": {
-        "suites": 23,
-        "tests": 33,
-        "passes": 33,
-        "pending": 0,
-        "failures": 0,
-        "start": "2016-02-19T05:41:25.739Z",
-        "end": "2016-02-19T05:41:31.140Z",
-        "duration": 5524
-      },
-      "tests": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ],
-      "pending": [],
-      "failures": [],
-      "passes": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ]
-    }
-    Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:    23
-     Tests:     33
-     Passes:    33
-     Pending:   0
-     Failures:  0
-     Start:    2016-04-26T21:35:23.780Z
-     End:      2016-04-26T21:35:29.337Z
-     Duration: 5.557
-    ****************************************
-
-bgpvpn
-^^^^^^
-::
-
-    ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover}  --load-list /tmp/tmpB17uh4
-    {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn [0.640872s] ... ok
-    {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail [0.293540s] ... ok
-
-    ======
-    Totals
-    ======
-    Ran: 2 tests in 13.0000 sec.
-     - Passed: 2
-     - Skipped: 0
-     - Expected Fail: 0
-     - Unexpected Success: 0
-     - Failed: 0
-    Sum of execute time for each test: 0.9344 sec.
diff --git a/docs/results/fuel-os-odl_l2-nofeature-ha.rst b/docs/results/fuel-os-odl_l2-nofeature-ha.rst
deleted file mode 100644 (file)
index 6a376ae..0000000
+++ /dev/null
@@ -1,2397 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-odl_l2-nofeature-ha
------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-SSH test...
-    vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_ssh- INFO - Creating neutron network vping-net...
-    vPing_ssh- INFO - Creating security group  'vPing-sg'...
-    vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-    vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-    vPing_ssh- INFO - Floating IP created: '10.118.101.200'
-    vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
-    vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
-    vPing_ssh- INFO - Waiting for ping...
-    vPing_ssh- INFO - vPing detected!
-    vPing_ssh- INFO - vPing duration:'42.1' s.
-    vPing_ssh- INFO - Cleaning up...
-    vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-userdata test...
-    vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_userdata- INFO - Creating neutron network vping-net...
-    vPing_userdata- INFO - Creating security group  'vPing-sg'...
-    vPing_userdata- INFO - Flavor found 'm1.small'
-    vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-     userdata=
-    #!/bin/sh
-
-    while true; do
-     ping -c 1 192.168.130.4 2>&1 >/dev/null
-     RES=$?
-     if [ "Z$RES" = "Z0" ] ; then
-      echo 'vPing OK'
-     break
-     else
-      echo 'vPing KO'
-     fi
-     sleep 1
-    done
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_userdata- INFO - Waiting for ping...
-    vPing_userdata- INFO - vPing detected!
-    vPing_userdata- INFO - vPing duration:'28.6'
-    vPing_userdata- INFO - vPing OK
-    vPing_userdata- INFO - Cleaning up...
-    vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | name                                                                                                                                     | time      | status  |
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.49156   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.10940   | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 15.01623  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 29.41033  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 13.86580  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.60879   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.34531   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.33518   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.96138   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.90751   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.62183   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.62195   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.33497   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.64235   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 1.23145   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.83801   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 1.18842   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.35784   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 1.09813   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.88696   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.84049   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.52238   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 3.63444   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 6.75102   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 14.44295  | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 316.24706 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.34052   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.75888   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 316.38576 | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00196   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.10067   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 4.93829   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.78542   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.64749   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.89411   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.32315   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.91146   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.13496   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.11222   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.11119   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.09119   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.10776   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.57188   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00131   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.20660   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.08830   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.02378   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.33571   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.10769   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.02694   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.02251   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.04963   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.07987   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.08196   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.92759   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.03606   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.09925   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.10704   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.20889   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.78463   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.44852   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.37770   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.72001   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.74485   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.67380   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 4.65947   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 19.27912  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 22.83188  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 13.05190  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 10.22705  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 3.02970   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 4.04190   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 2.67671   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 3.10372   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 3.80641   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.05689   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 1.62404   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 1.47470   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 1.21997   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 2.20741   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 3.12907   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 1.56617   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 1.38405   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 1.74547   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.94955   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.62631   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 1.24089   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.28176   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 1.39299   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 0.59369   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.00537   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.35547   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.02691   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.77671   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.03595   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.67764   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.12390   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.35252   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05395   | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 343.72467 | fail    |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.95003   | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.99399   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.31689   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.02590   | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.0       | fail    |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.09974   | success |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 1.21063   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.77355   | success |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.63115   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.10751   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.08180   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.11419   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.09997   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.15346   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.10901   | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.26936   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.78244   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 2.75904   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 3.58070   | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 6.97865   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 0.0       | fail    |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 0.0       | fail    |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 2.19846   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 3.01338   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 5.65439   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 5.23138   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 4.63026   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 4.20924   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 3.23093   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.72657   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.45440   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.37147   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.35779   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.30639   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 3.21748   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.64248   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.30977   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.03731   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.49862   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.26355   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 3.12061   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 3.35577   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.94748   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.39794   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.33413   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 3.39562   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 5.89837   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 2.99973   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.58956   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.48395   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 10.99445  | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 6.94692   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 4.69234   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 0.56033   | fail    |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 8.28629   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 4.94750   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 4.97154   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 3.42252   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 2.06578   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 3.53065   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.29313   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 2.98492   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.10014   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.39465   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.76994   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 7.29710   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.05370   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 0.0       | fail    |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.0       | fail    |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 20.70674  | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 12.57512  | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.94613   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 3.13954   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 15.28613  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 17.92871  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 15.55119  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 19.10263  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.07108   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.37294   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 25.63959  | fail    |
-    | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 16.24070  | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 343.58312 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 356.71394 | fail    |
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    run_tempest - INFO - Results: {'timestart': '2016-02-1905:28:37.031139', 'duration': 730, 'tests': 210, 'failures': 40}
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    run_rally - INFO - Starting test scenario "authenticate" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  c7f4e0fd-a882-4e14-ba02-553118d0cb77: started
-    Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: finished
-
-    test scenario Authenticate.validate_glance
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_glance     | 0.535 | 0.78   | 0.847  | 0.86   | 0.874 | 0.74  | 100.0%  | 10    |
-    | authenticate.validate_glance (2) | 0.667 | 0.689  | 0.793  | 0.807  | 0.821 | 0.717 | 100.0%  | 10    |
-    | total                            | 1.381 | 1.677  | 1.718  | 1.735  | 1.752 | 1.625 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.80417394638
-    Full duration: 12.8028140068
-
-
-
-    test scenario Authenticate.keystone
-    +-----------------------------------------------------------------------------+
-    |                            Response Times (sec)                             |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | total  | 0.121 | 0.149  | 0.163  | 0.164  | 0.166 | 0.149 | 100.0%  | 10    |
-    +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.489310979843
-    Full duration: 7.96697187424
-
-
-
-    test scenario Authenticate.validate_heat
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_heat     | 0.259 | 0.318  | 0.482  | 0.511  | 0.539 | 0.371 | 100.0%  | 10    |
-    | authenticate.validate_heat (2) | 0.051 | 0.287  | 0.385  | 0.386  | 0.387 | 0.24  | 100.0%  | 10    |
-    | total                          | 0.512 | 0.771  | 0.957  | 0.996  | 1.035 | 0.776 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.53649091721
-    Full duration: 10.2540290356
-
-
-
-    test scenario Authenticate.validate_nova
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_nova     | 0.3   | 0.332  | 0.474  | 0.482  | 0.489 | 0.368 | 100.0%  | 10    |
-    | authenticate.validate_nova (2) | 0.034 | 0.049  | 0.059  | 0.065  | 0.07  | 0.05  | 100.0%  | 10    |
-    | total                          | 0.499 | 0.564  | 0.716  | 0.722  | 0.727 | 0.586 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.84303689003
-    Full duration: 9.65319395065
-
-
-
-    test scenario Authenticate.validate_cinder
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_cinder     | 0.274 | 0.428  | 0.475  | 0.509  | 0.543 | 0.405 | 100.0%  | 10    |
-    | authenticate.validate_cinder (2) | 0.025 | 0.424  | 0.455  | 0.456  | 0.458 | 0.376 | 100.0%  | 10    |
-    | total                            | 0.469 | 1.071  | 1.131  | 1.141  | 1.151 | 0.964 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.72650790215
-    Full duration: 10.753674984
-
-
-
-    test scenario Authenticate.validate_neutron
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_neutron     | 0.28  | 0.302  | 0.32   | 0.326  | 0.333 | 0.303 | 100.0%  | 10    |
-    | authenticate.validate_neutron (2) | 0.046 | 0.31   | 0.334  | 0.34   | 0.346 | 0.262 | 100.0%  | 10    |
-    | total                             | 0.467 | 0.764  | 0.81   | 0.838  | 0.866 | 0.728 | 100.0%  | 10    |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.37260484695
-    Full duration: 9.99744796753
-
-
-
-    run_rally - INFO - Test scenario: "authenticate" OK.
-
-    run_rally - INFO - Starting test scenario "glance" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  d54fa25b-b992-4b4e-bef2-14425b86329c: started
-    Task d54fa25b-b992-4b4e-bef2-14425b86329c: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | glance.list_images | 0.877 | 0.902  | 0.997  | 0.998  | 0.999 | 0.932 | 100.0%  | 10    |
-    | total              | 0.877 | 0.902  | 0.997  | 0.998  | 0.999 | 0.932 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.92263484001
-    Full duration: 13.4585630894
-
-
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max   | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-    | glance.create_image | 7.386  | 7.929  | 8.381  | 8.481  | 8.581 | 7.97   | 100.0%  | 10    |
-    | nova.boot_servers   | 8.641  | 10.384 | 10.714 | 11.007 | 11.3  | 10.241 | 100.0%  | 10    |
-    | total               | 16.702 | 18.427 | 18.943 | 19.047 | 19.15 | 18.211 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-    Load duration: 54.6946680546
-    Full duration: 110.071588039
-
-
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | glance.create_image | 7.081 | 7.618  | 8.085  | 8.19   | 8.296 | 7.689 | 100.0%  | 10    |
-    | glance.list_images  | 0.324 | 0.573  | 0.642  | 0.714  | 0.786 | 0.573 | 100.0%  | 10    |
-    | total               | 7.612 | 8.241  | 8.722  | 8.902  | 9.082 | 8.262 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 24.6801600456
-    Full duration: 39.2870121002
-
-
-
-    test scenario GlanceImages.create_and_delete_image
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | glance.create_image | 7.449 | 7.593  | 7.856  | 8.073  | 8.289  | 7.673 | 100.0%  | 10    |
-    | glance.delete_image | 2.001 | 2.442  | 12.75  | 13.42  | 14.089 | 5.507 | 100.0%  | 10    |
-    | total               | 9.487 | 10.064 | 20.503 | 21.441 | 22.378 | 13.18 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 40.0675120354
-    Full duration: 50.2370131016
-
-
-
-    run_rally - INFO - Test scenario: "glance" OK.
-
-    run_rally - INFO - Starting test scenario "cinder" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  6b2be534-fd42-4a5f-be0e-9a789027d4b3: started
-    Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server     | 7.135  | 7.936  | 8.663  | 8.672  | 8.68   | 7.941  | 100.0%  | 10    |
-    | cinder.create_volume | 3.274  | 3.507  | 4.072  | 4.096  | 4.12   | 3.616  | 100.0%  | 10    |
-    | nova.attach_volume   | 4.012  | 4.845  | 6.553  | 6.624  | 6.694  | 5.31   | 100.0%  | 10    |
-    | nova.detach_volume   | 3.256  | 3.739  | 3.938  | 4.096  | 4.253  | 3.716  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.464  | 2.707  | 2.98   | 3.154  | 3.328  | 1.98   | 100.0%  | 10    |
-    | nova.delete_server   | 2.784  | 3.059  | 3.15   | 3.19   | 3.23   | 3.04   | 100.0%  | 10    |
-    | total                | 22.316 | 26.079 | 27.631 | 28.362 | 29.094 | 25.604 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 73.9451169968
-    Full duration: 116.516190052
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | cinder.create_volume | 9.065 | 9.591  | 9.94   | 9.943  | 9.945  | 9.554 | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.048 | 0.346  | 0.386  | 0.394  | 0.402  | 0.301 | 100.0%  | 10    |
-    | total                | 9.138 | 9.94   | 10.313 | 10.324 | 10.335 | 9.855 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 28.8989629745
-    Full duration: 51.7012848854
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.251 | 3.883  | 4.897  | 4.899  | 4.901 | 4.006 | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.055 | 0.072  | 0.333  | 0.334  | 0.334 | 0.145 | 100.0%  | 10    |
-    | total                | 3.313 | 3.952  | 5.212  | 5.223  | 5.234 | 4.151 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.7280011177
-    Full duration: 34.1200621128
-
-
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 2.973 | 3.289  | 5.554  | 5.57   | 5.585 | 3.702 | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.027 | 0.162  | 0.313  | 0.32   | 0.326 | 0.168 | 100.0%  | 10    |
-    | total                  | 3.001 | 3.593  | 5.586  | 5.601  | 5.616 | 3.871 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 10.6676809788
-    Full duration: 51.8370318413
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.324 | 3.69   | 4.382  | 4.392  | 4.403 | 3.828 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.625 | 2.781  | 3.053  | 3.199  | 3.345 | 2.086 | 100.0%  | 10    |
-    | total                | 4.288 | 6.438  | 7.073  | 7.173  | 7.273 | 5.914 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.0577061176
-    Full duration: 35.664162159
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +----------------------+------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min  | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 7.41 | 9.74   | 10.091 | 10.094 | 10.097 | 9.522  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.54 | 0.965  | 3.092  | 3.097  | 3.103  | 1.691  | 100.0%  | 10    |
-    | total                | 7.95 | 10.903 | 12.9   | 12.964 | 13.029 | 11.214 | 100.0%  | 10    |
-    +----------------------+------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 33.3823940754
-    Full duration: 52.0277431011
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.681 | 3.946  | 4.01   | 4.051  | 4.092 | 3.903 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.506 | 2.848  | 3.217  | 3.222  | 3.228 | 2.122 | 100.0%  | 10    |
-    | total                | 4.188 | 6.787  | 7.161  | 7.175  | 7.189 | 6.026 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.0166649818
-    Full duration: 35.4839038849
-
-
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume          | 3.672  | 4.074  | 4.522  | 4.546  | 4.57   | 4.114  | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 21.673 | 31.257 | 31.931 | 31.979 | 32.027 | 29.253 | 100.0%  | 10    |
-    | cinder.delete_volume          | 0.56   | 2.568  | 3.011  | 3.067  | 3.123  | 2.293  | 100.0%  | 10    |
-    | nova.delete_image             | 2.137  | 2.51   | 2.606  | 2.681  | 2.756  | 2.451  | 100.0%  | 10    |
-    | total                         | 28.587 | 39.952 | 40.849 | 41.35  | 41.852 | 38.112 | 100.0%  | 10    |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 110.444069147
-    Full duration: 131.52224803
-
-
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 3.208 | 3.343  | 5.587  | 5.628  | 5.669 | 3.788 | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.503 | 2.86   | 3.196  | 3.217  | 3.239 | 2.893 | 100.0%  | 10    |
-    | total                  | 5.787 | 6.422  | 8.296  | 8.392  | 8.488 | 6.681 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.7773430347
-    Full duration: 53.0582361221
-
-
-
-    test scenario CinderVolumes.create_volume
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.52 | 3.822  | 4.222  | 4.228  | 4.233 | 3.852 | 100.0%  | 10    |
-    | total                | 3.52 | 3.822  | 4.223  | 4.228  | 4.233 | 3.852 | 100.0%  | 10    |
-    +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.2881109715
-    Full duration: 29.6710369587
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.248 | 3.651  | 3.891  | 3.988  | 4.084 | 3.645 | 100.0%  | 10    |
-    | total                | 3.249 | 3.652  | 3.891  | 3.988  | 4.084 | 3.645 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 10.7785470486
-    Full duration: 32.9540159702
-
-
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.list_volumes | 0.499 | 0.52   | 0.539  | 0.55   | 0.561 | 0.522 | 100.0%  | 10    |
-    | total               | 0.499 | 0.52   | 0.539  | 0.55   | 0.561 | 0.523 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.60948395729
-    Full duration: 65.5444660187
-
-
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.547  | 3.82   | 3.891  | 3.927  | 3.962  | 3.787  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.552  | 2.875  | 3.173  | 3.215  | 3.257  | 2.931  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.633  | 5.774  | 8.279  | 8.853  | 9.427  | 6.038  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.599  | 3.826  | 4.233  | 4.444  | 4.655  | 3.905  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.22   | 2.537  | 2.852  | 2.971  | 3.09   | 2.577  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.648  | 2.735  | 2.845  | 2.892  | 2.939  | 2.321  | 100.0%  | 10    |
-    | total                  | 18.538 | 22.642 | 25.806 | 26.204 | 26.601 | 22.745 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 66.8299760818
-    Full duration: 173.895985842
-
-
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.481 | 3.953  | 4.613  | 5.302  | 5.991 | 4.167 | 100.0%  | 10    |
-    | cinder.delete_volume | 1.163 | 3.065  | 3.469  | 3.474  | 3.479 | 2.919 | 100.0%  | 10    |
-    | total                | 5.012 | 7.114  | 7.89   | 8.462  | 9.034 | 7.087 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 20.8082921505
-    Full duration: 55.4062600136
-
-
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | cinder.create_volume | 3.417 | 3.839  | 3.908  | 3.925  | 3.941  | 3.742 | 100.0%  | 10    |
-    | cinder.extend_volume | 0.938 | 2.978  | 3.574  | 3.713  | 3.853  | 2.396 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.577 | 1.808  | 3.066  | 3.146  | 3.225  | 1.858 | 100.0%  | 10    |
-    | total                | 5.44  | 8.275  | 9.921  | 10.095 | 10.269 | 7.997 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 23.5873560905
-    Full duration: 41.9279878139
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +-----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                      |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.668 | 3.89   | 4.255  | 4.266  | 4.277  | 3.937  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.268 | 2.949  | 3.306  | 3.36   | 3.414  | 2.903  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.471 | 4.393  | 7.358  | 8.251  | 9.145  | 5.113  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.277 | 3.925  | 4.509  | 4.566  | 4.622  | 3.926  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.286 | 2.607  | 2.849  | 2.862  | 2.875  | 2.614  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.591 | 2.677  | 2.96   | 3.019  | 3.078  | 2.352  | 100.0%  | 10    |
-    | total                  | 18.8  | 21.654 | 23.365 | 25.201 | 27.038 | 21.974 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 65.2181398869
-    Full duration: 179.069041967
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.22   | 3.682  | 4.259  | 4.27   | 4.281  | 3.723  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.292  | 3.051  | 3.199  | 3.232  | 3.265  | 2.991  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.891  | 4.365  | 6.53   | 6.577  | 6.625  | 4.971  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.248  | 3.565  | 3.767  | 4.044  | 4.321  | 3.568  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.258  | 2.551  | 2.836  | 2.87   | 2.904  | 2.609  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.883  | 2.687  | 3.02   | 3.224  | 3.427  | 2.286  | 100.0%  | 10    |
-    | total                  | 19.132 | 21.712 | 23.229 | 23.566 | 23.904 | 21.677 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 64.7866289616
-    Full duration: 180.275881052
-
-
-
-    run_rally - INFO - Test scenario: "cinder" OK.
-
-    run_rally - INFO - Starting test scenario "heat" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  51925ef8-a527-44d2-8df3-6164af0ec62a: started
-    Task 51925ef8-a527-44d2-8df3-6164af0ec62a: finished
-
-    test scenario HeatStacks.create_suspend_resume_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack  | 4.245 | 4.317  | 4.434  | 4.474  | 4.514 | 4.348 | 100.0%  | 10    |
-    | heat.suspend_stack | 1.497 | 1.713  | 1.747  | 1.75   | 1.753 | 1.7   | 100.0%  | 10    |
-    | heat.resume_stack  | 1.42  | 1.621  | 1.668  | 1.67   | 1.671 | 1.562 | 100.0%  | 10    |
-    | heat.delete_stack  | 1.377 | 1.573  | 1.716  | 2.249  | 2.782 | 1.675 | 100.0%  | 10    |
-    | total              | 8.851 | 9.198  | 9.402  | 9.981  | 10.56 | 9.285 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 27.3572640419
-    Full duration: 37.0984110832
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 3.911 | 4.181  | 4.323  | 4.325  | 4.327 | 4.149 | 100.0%  | 10    |
-    | heat.delete_stack | 1.392 | 1.426  | 1.744  | 1.776  | 1.808 | 1.491 | 100.0%  | 10    |
-    | total             | 5.311 | 5.631  | 5.774  | 5.775  | 5.776 | 5.64  | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 16.9275529385
-    Full duration: 26.8473479748
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 20.192 | 23.206 | 23.805 | 23.826 | 23.847 | 22.465 | 100.0%  | 10    |
-    | heat.delete_stack | 11.755 | 11.868 | 12.963 | 13.0   | 13.036 | 12.282 | 100.0%  | 10    |
-    | total             | 32.02  | 35.613 | 36.714 | 36.721 | 36.729 | 34.747 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 102.752908945
-    Full duration: 112.369065046
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 16.808 | 18.33  | 20.748 | 20.751 | 20.755 | 18.654 | 100.0%  | 10    |
-    | heat.delete_stack | 9.404  | 10.582 | 10.788 | 10.803 | 10.818 | 10.313 | 100.0%  | 10    |
-    | total             | 26.212 | 28.318 | 31.532 | 31.553 | 31.574 | 28.967 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 85.8598790169
-    Full duration: 95.2520959377
-
-
-
-    test scenario HeatStacks.list_stacks_and_resources
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.list_stacks                | 0.45 | 0.485  | 0.512  | 0.512  | 0.512 | 0.487 | 100.0%  | 10    |
-    | heat.list_resources_of_0_stacks | 0.0  | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-    | total                           | 0.45 | 0.485  | 0.512  | 0.512  | 0.512 | 0.487 | 100.0%  | 10    |
-    +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.48300600052
-    Full duration: 9.57427692413
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 3.727 | 4.075  | 4.288  | 4.337  | 4.386  | 4.085  | 100.0%  | 10    |
-    | heat.update_stack | 3.549 | 3.676  | 3.903  | 3.972  | 4.042  | 3.704  | 100.0%  | 10    |
-    | heat.delete_stack | 1.405 | 2.619  | 2.76   | 2.774  | 2.789  | 2.212  | 100.0%  | 10    |
-    | total             | 9.105 | 10.287 | 10.719 | 10.741 | 10.763 | 10.001 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 29.4346759319
-    Full duration: 39.5471699238
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 3.915 | 4.067  | 4.171  | 4.199  | 4.227 | 4.052 | 100.0%  | 10    |
-    | heat.update_stack | 3.521 | 3.661  | 3.773  | 3.791  | 3.81  | 3.658 | 100.0%  | 10    |
-    | heat.delete_stack | 1.38  | 1.477  | 1.612  | 1.618  | 1.624 | 1.492 | 100.0%  | 10    |
-    | total             | 8.916 | 9.128  | 9.484  | 9.493  | 9.503 | 9.203 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 27.5511319637
-    Full duration: 37.5252559185
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.023  | 4.301  | 4.59   | 5.029  | 5.468  | 4.38   | 100.0%  | 10    |
-    | heat.update_stack | 5.783  | 5.888  | 6.061  | 6.08   | 6.1    | 5.912  | 100.0%  | 10    |
-    | heat.delete_stack | 2.475  | 2.546  | 2.705  | 3.2    | 3.694  | 2.65   | 100.0%  | 10    |
-    | total             | 12.613 | 12.74  | 13.76  | 13.912 | 14.064 | 12.942 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 38.1860618591
-    Full duration: 48.4381308556
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.094  | 5.24   | 5.479  | 5.528  | 5.577  | 5.17   | 100.0%  | 10    |
-    | heat.update_stack | 8.178  | 9.243  | 9.316  | 9.324  | 9.332  | 8.862  | 100.0%  | 10    |
-    | heat.delete_stack | 3.63   | 3.68   | 3.714  | 3.714  | 3.715  | 3.68   | 100.0%  | 10    |
-    | total             | 16.974 | 17.76  | 18.444 | 18.466 | 18.488 | 17.713 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 52.4500279427
-    Full duration: 63.0265882015
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.113 | 4.273  | 4.647  | 4.934  | 5.22   | 4.362  | 100.0%  | 10    |
-    | heat.update_stack | 5.809 | 5.888  | 5.941  | 6.056  | 6.17   | 5.907  | 100.0%  | 10    |
-    | heat.delete_stack | 2.513 | 2.561  | 3.694  | 3.7    | 3.706  | 2.891  | 100.0%  | 10    |
-    | total             | 12.55 | 12.759 | 14.013 | 14.546 | 15.079 | 13.161 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 39.0816349983
-    Full duration: 49.7756490707
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 3.762 | 4.115  | 4.19   | 4.27   | 4.35   | 4.062 | 100.0%  | 10    |
-    | heat.update_stack | 3.543 | 3.63   | 3.844  | 3.977  | 4.11   | 3.69  | 100.0%  | 10    |
-    | heat.delete_stack | 1.383 | 1.499  | 2.506  | 2.528  | 2.549  | 1.677 | 100.0%  | 10    |
-    | total             | 8.868 | 9.275  | 10.208 | 10.225 | 10.242 | 9.429 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 27.9543409348
-    Full duration: 38.8234701157
-
-
-
-    test scenario HeatStacks.create_and_list_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.005 | 4.128  | 4.199  | 4.234  | 4.27  | 4.127 | 100.0%  | 10    |
-    | heat.list_stacks  | 0.075 | 0.094  | 0.108  | 0.112  | 0.117 | 0.094 | 100.0%  | 10    |
-    | total             | 4.112 | 4.226  | 4.281  | 4.313  | 4.345 | 4.221 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 12.6059498787
-    Full duration: 27.8848700523
-
-
-
-    test scenario HeatStacks.create_check_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.084 | 4.153  | 4.178  | 4.217  | 4.256 | 4.153 | 100.0%  | 10    |
-    | heat.check_stack  | 0.706 | 1.53   | 1.571  | 1.586  | 1.6   | 1.459 | 100.0%  | 10    |
-    | heat.delete_stack | 1.375 | 1.432  | 2.542  | 2.546  | 2.55  | 1.763 | 100.0%  | 10    |
-    | total             | 7.01  | 7.159  | 8.25   | 8.279  | 8.309 | 7.375 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 22.5798799992
-    Full duration: 33.7318949699
-
-
-
-    run_rally - INFO - Test scenario: "heat" OK.
-
-    run_rally - INFO - Starting test scenario "keystone" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  98c40f01-0adc-48ce-91ca-105f22e60ec9: started
-    Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: finished
-
-    test scenario KeystoneBasic.create_tenant_with_users
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.263 | 0.291  | 0.401  | 0.408  | 0.415 | 0.322 | 100.0%  | 10    |
-    | keystone.create_users  | 1.508 | 1.599  | 1.672  | 1.733  | 1.793 | 1.601 | 100.0%  | 10    |
-    | total                  | 1.782 | 1.949  | 2.051  | 2.066  | 2.081 | 1.923 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 5.82497000694
-    Full duration: 20.636977911
-
-
-
-    test scenario KeystoneBasic.create_add_and_list_user_roles
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.256 | 0.273  | 0.292  | 0.296  | 0.3   | 0.274 | 100.0%  | 10    |
-    | keystone.add_role    | 0.24  | 0.262  | 0.297  | 0.319  | 0.341 | 0.267 | 100.0%  | 10    |
-    | keystone.list_roles  | 0.131 | 0.146  | 0.226  | 0.237  | 0.248 | 0.16  | 100.0%  | 10    |
-    | total                | 0.636 | 0.682  | 0.774  | 0.78   | 0.786 | 0.702 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.11375284195
-    Full duration: 14.9668319225
-
-
-
-    test scenario KeystoneBasic.add_and_remove_user_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.267 | 0.326  | 0.368  | 0.376  | 0.383 | 0.322 | 100.0%  | 10    |
-    | keystone.add_role    | 0.244 | 0.255  | 0.278  | 0.302  | 0.326 | 0.263 | 100.0%  | 10    |
-    | keystone.remove_role | 0.149 | 0.163  | 0.191  | 0.244  | 0.296 | 0.177 | 100.0%  | 10    |
-    | total                | 0.681 | 0.765  | 0.834  | 0.84   | 0.846 | 0.762 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.33364892006
-    Full duration: 14.8711419106
-
-
-
-    test scenario KeystoneBasic.create_update_and_delete_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.272 | 0.316  | 0.391  | 0.394  | 0.396 | 0.327 | 100.0%  | 10    |
-    | keystone.update_tenant | 0.125 | 0.141  | 0.169  | 0.215  | 0.261 | 0.152 | 100.0%  | 10    |
-    | keystone.delete_tenant | 0.299 | 0.321  | 0.379  | 0.394  | 0.408 | 0.333 | 100.0%  | 10    |
-    | total                  | 0.745 | 0.81   | 0.859  | 0.915  | 0.971 | 0.812 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.46658396721
-    Full duration: 13.4442551136
-
-
-
-    test scenario KeystoneBasic.create_and_delete_service
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_service | 0.258 | 0.271  | 0.303  | 0.308  | 0.314 | 0.278 | 100.0%  | 10    |
-    | keystone.delete_service | 0.146 | 0.158  | 0.181  | 0.203  | 0.226 | 0.164 | 100.0%  | 10    |
-    | total                   | 0.408 | 0.442  | 0.464  | 0.475  | 0.487 | 0.442 | 100.0%  | 10    |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.34449720383
-    Full duration: 12.1886069775
-
-
-
-    test scenario KeystoneBasic.create_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.253 | 0.302  | 0.319  | 0.324  | 0.328 | 0.297 | 100.0%  | 10    |
-    | total                  | 0.253 | 0.302  | 0.319  | 0.324  | 0.329 | 0.298 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.912425994873
-    Full duration: 8.74173903465
-
-
-
-    test scenario KeystoneBasic.create_user
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.262 | 0.303  | 0.319  | 0.319  | 0.319 | 0.296 | 100.0%  | 10    |
-    | total                | 0.262 | 0.303  | 0.319  | 0.319  | 0.32  | 0.296 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.953788042068
-    Full duration: 8.72430300713
-
-
-
-    test scenario KeystoneBasic.create_and_list_tenants
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.247 | 0.28   | 0.302  | 0.304  | 0.307 | 0.281 | 100.0%  | 10    |
-    | keystone.list_tenants  | 0.121 | 0.129  | 0.224  | 0.225  | 0.225 | 0.147 | 100.0%  | 10    |
-    | total                  | 0.392 | 0.42   | 0.476  | 0.493  | 0.511 | 0.428 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.32897400856
-    Full duration: 13.584346056
-
-
-
-    test scenario KeystoneBasic.create_and_delete_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.286 | 0.324  | 0.395  | 0.47   | 0.545 | 0.347 | 100.0%  | 10    |
-    | keystone.delete_role | 0.25  | 0.32   | 0.487  | 0.522  | 0.557 | 0.344 | 100.0%  | 10    |
-    | total                | 0.546 | 0.62   | 0.889  | 0.913  | 0.936 | 0.691 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.18193697929
-    Full duration: 12.766493082
-
-
-
-    test scenario KeystoneBasic.get_entities
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.271 | 0.283  | 0.299  | 0.311  | 0.322 | 0.287 | 100.0%  | 10    |
-    | keystone.create_user   | 0.145 | 0.156  | 0.162  | 0.165  | 0.167 | 0.155 | 100.0%  | 10    |
-    | keystone.create_role   | 0.122 | 0.133  | 0.155  | 0.183  | 0.211 | 0.141 | 100.0%  | 10    |
-    | keystone.get_tenant    | 0.109 | 0.126  | 0.145  | 0.178  | 0.211 | 0.133 | 100.0%  | 10    |
-    | keystone.get_user      | 0.12  | 0.133  | 0.2    | 0.205  | 0.21  | 0.148 | 100.0%  | 10    |
-    | keystone.get_role      | 0.106 | 0.12   | 0.137  | 0.155  | 0.172 | 0.126 | 100.0%  | 10    |
-    | keystone.service_list  | 0.112 | 0.126  | 0.144  | 0.178  | 0.212 | 0.134 | 100.0%  | 10    |
-    | keystone.get_service   | 0.104 | 0.125  | 0.131  | 0.134  | 0.136 | 0.123 | 100.0%  | 10    |
-    | total                  | 1.177 | 1.23   | 1.321  | 1.328  | 1.334 | 1.248 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.83582210541
-    Full duration: 20.6130208969
-
-
-
-    test scenario KeystoneBasic.create_and_list_users
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.295 | 0.312  | 0.374  | 0.386  | 0.399 | 0.326 | 100.0%  | 10    |
-    | keystone.list_users  | 0.114 | 0.129  | 0.148  | 0.148  | 0.149 | 0.133 | 100.0%  | 10    |
-    | total                | 0.419 | 0.442  | 0.521  | 0.535  | 0.549 | 0.458 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.37977695465
-    Full duration: 9.29229903221
-
-
-
-    run_rally - INFO - Test scenario: "keystone" OK.
-
-    run_rally - INFO - Starting test scenario "neutron" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  0a18c72f-b575-481a-8997-6d3d52130ede: started
-    Task 0a18c72f-b575-481a-8997-6d3d52130ede: finished
-
-    test scenario NeutronNetworks.create_and_delete_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.758 | 0.851  | 1.15   | 1.23   | 1.309 | 0.925 | 100.0%  | 10    |
-    | neutron.delete_port | 0.241 | 0.578  | 0.611  | 0.618  | 0.625 | 0.488 | 100.0%  | 10    |
-    | total               | 0.998 | 1.415  | 1.73   | 1.808  | 1.886 | 1.414 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.22447299957
-    Full duration: 51.8464670181
-
-
-
-    test scenario NeutronNetworks.create_and_list_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.768 | 0.804  | 0.942  | 1.007  | 1.073 | 0.852 | 100.0%  | 10    |
-    | neutron.create_router        | 0.08  | 0.425  | 0.456  | 0.469  | 0.482 | 0.394 | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.371 | 0.741  | 1.213  | 1.526  | 1.84  | 0.855 | 100.0%  | 10    |
-    | neutron.list_routers         | 0.048 | 0.405  | 0.478  | 0.502  | 0.527 | 0.286 | 100.0%  | 10    |
-    | total                        | 1.684 | 2.22   | 3.085  | 3.308  | 3.53  | 2.388 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.42530488968
-    Full duration: 57.8292651176
-
-
-
-    test scenario NeutronNetworks.create_and_delete_routers
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet           | 0.689 | 0.768  | 0.931  | 0.941  | 0.95  | 0.811 | 100.0%  | 10    |
-    | neutron.create_router           | 0.408 | 0.421  | 0.457  | 0.547  | 0.636 | 0.441 | 100.0%  | 10    |
-    | neutron.add_interface_router    | 0.363 | 0.702  | 0.802  | 0.807  | 0.813 | 0.653 | 100.0%  | 10    |
-    | neutron.remove_interface_router | 0.273 | 0.662  | 0.823  | 0.847  | 0.872 | 0.65  | 100.0%  | 10    |
-    | neutron.delete_router           | 0.178 | 0.557  | 0.661  | 0.665  | 0.669 | 0.541 | 100.0%  | 10    |
-    | total                           | 2.291 | 3.046  | 3.598  | 3.647  | 3.695 | 3.096 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 9.11136102676
-    Full duration: 56.6760940552
-
-
-
-    test scenario NeutronNetworks.create_and_list_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.746 | 0.824  | 0.923  | 0.946  | 0.968 | 0.846 | 100.0%  | 10    |
-    | neutron.list_ports  | 0.157 | 0.57   | 0.629  | 0.663  | 0.697 | 0.481 | 100.0%  | 10    |
-    | total               | 1.065 | 1.343  | 1.476  | 1.493  | 1.51  | 1.327 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.94901585579
-    Full duration: 52.597589016
-
-
-
-    test scenario NeutronNetworks.create_and_delete_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.701 | 0.757  | 1.049  | 1.144  | 1.238 | 0.835 | 100.0%  | 10    |
-    | neutron.delete_subnet | 0.196 | 0.565  | 0.691  | 0.725  | 0.759 | 0.531 | 100.0%  | 10    |
-    | total                 | 0.939 | 1.384  | 1.496  | 1.595  | 1.694 | 1.366 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.35806703568
-    Full duration: 51.0885548592
-
-
-
-    test scenario NeutronNetworks.create_and_delete_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.614 | 0.675  | 0.811  | 0.817  | 0.823 | 0.692 | 100.0%  | 10    |
-    | neutron.delete_network | 0.491 | 0.545  | 0.62   | 0.624  | 0.628 | 0.554 | 100.0%  | 10    |
-    | total                  | 1.133 | 1.231  | 1.388  | 1.415  | 1.443 | 1.246 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.68652009964
-    Full duration: 30.7036879063
-
-
-
-    test scenario NeutronNetworks.create_and_list_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.556 | 0.652  | 0.754  | 0.757  | 0.759 | 0.665 | 100.0%  | 10    |
-    | neutron.list_networks  | 0.361 | 0.383  | 0.478  | 0.503  | 0.528 | 0.403 | 100.0%  | 10    |
-    | total                  | 0.917 | 1.027  | 1.231  | 1.252  | 1.273 | 1.068 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.11869502068
-    Full duration: 33.6655409336
-
-
-
-    test scenario NeutronNetworks.create_and_update_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.718 | 0.757  | 0.921  | 0.922  | 0.923 | 0.795 | 100.0%  | 10    |
-    | neutron.create_router        | 0.073 | 0.405  | 0.44   | 0.448  | 0.455 | 0.38  | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.65  | 0.699  | 0.805  | 0.827  | 0.849 | 0.717 | 100.0%  | 10    |
-    | neutron.update_router        | 0.228 | 0.537  | 0.661  | 0.677  | 0.693 | 0.53  | 100.0%  | 10    |
-    | total                        | 2.134 | 2.511  | 2.583  | 2.583  | 2.583 | 2.422 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.21204185486
-    Full duration: 58.3329060078
-
-
-
-    test scenario NeutronNetworks.create_and_update_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.59  | 0.678  | 0.77   | 0.785  | 0.8   | 0.684 | 100.0%  | 10    |
-    | neutron.update_network | 0.452 | 0.51   | 0.55   | 0.569  | 0.587 | 0.514 | 100.0%  | 10    |
-    | total                  | 1.054 | 1.188  | 1.314  | 1.319  | 1.323 | 1.198 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.48062801361
-    Full duration: 33.7373108864
-
-
-
-    test scenario NeutronNetworks.create_and_update_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.724 | 0.911  | 1.036  | 1.046  | 1.055 | 0.915 | 100.0%  | 10    |
-    | neutron.update_port | 0.332 | 0.55   | 0.569  | 0.573  | 0.578 | 0.53  | 100.0%  | 10    |
-    | total               | 1.173 | 1.466  | 1.591  | 1.607  | 1.623 | 1.445 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.40219402313
-    Full duration: 52.9743890762
-
-
-
-    test scenario NeutronNetworks.create_and_list_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.768 | 0.823  | 0.981  | 1.001  | 1.02  | 0.857 | 100.0%  | 10    |
-    | neutron.list_subnets  | 0.053 | 0.403  | 0.472  | 0.483  | 0.495 | 0.316 | 100.0%  | 10    |
-    | total                 | 0.821 | 1.249  | 1.342  | 1.384  | 1.426 | 1.173 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.63253998756
-    Full duration: 52.0335438251
-
-
-
-    test scenario NeutronNetworks.create_and_update_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.721 | 0.797  | 0.952  | 0.953  | 0.954 | 0.82  | 100.0%  | 10    |
-    | neutron.update_subnet | 0.233 | 0.605  | 0.745  | 0.753  | 0.761 | 0.589 | 100.0%  | 10    |
-    | total                 | 1.002 | 1.432  | 1.561  | 1.638  | 1.715 | 1.409 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.58866596222
-    Full duration: 52.8035202026
-
-
-
-    run_rally - INFO - Test scenario: "neutron" OK.
-
-    run_rally - INFO - Starting test scenario "nova" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  7bc9f24e-75ad-4e01-afd5-3647398a073e: started
-    Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: finished
-
-    test scenario NovaKeypair.create_and_delete_keypair
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.705 | 0.755  | 0.85   | 1.155  | 1.459 | 0.818 | 100.0%  | 10    |
-    | nova.delete_keypair | 0.032 | 0.046  | 0.063  | 0.064  | 0.064 | 0.046 | 100.0%  | 10    |
-    | total               | 0.744 | 0.804  | 0.895  | 1.21   | 1.524 | 0.864 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.08747410774
-    Full duration: 41.9948050976
-
-
-
-    test scenario NovaServers.snapshot_server
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server       | 8.021  | 10.195 | 10.572 | 10.642 | 10.713 | 9.936  | 100.0%  | 10    |
-    | nova.create_image      | 10.782 | 11.261 | 11.548 | 11.631 | 11.715 | 11.242 | 100.0%  | 10    |
-    | nova.delete_server     | 2.821  | 3.28   | 3.4    | 3.426  | 3.452  | 3.222  | 100.0%  | 10    |
-    | nova.boot_server (2)   | 6.39   | 8.069  | 9.073  | 9.382  | 9.691  | 7.984  | 100.0%  | 10    |
-    | nova.delete_server (2) | 2.855  | 2.91   | 3.425  | 3.429  | 3.434  | 3.04   | 100.0%  | 10    |
-    | nova.delete_image      | 2.558  | 2.911  | 3.161  | 3.22   | 3.279  | 2.887  | 100.0%  | 10    |
-    | total                  | 35.039 | 38.279 | 39.897 | 40.21  | 40.523 | 38.314 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 115.44729495
-    Full duration: 188.161262035
-
-
-
-    test scenario NovaKeypair.boot_and_delete_server_with_keypair
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_keypair | 0.64   | 0.869  | 1.365  | 1.399  | 1.433  | 0.948  | 100.0%  | 10    |
-    | nova.boot_server    | 7.047  | 8.139  | 10.062 | 10.11  | 10.159 | 8.606  | 100.0%  | 10    |
-    | nova.delete_server  | 2.522  | 3.1    | 3.242  | 3.267  | 3.292  | 3.041  | 100.0%  | 10    |
-    | nova.delete_keypair | 0.042  | 0.051  | 0.061  | 0.068  | 0.075  | 0.052  | 100.0%  | 10    |
-    | total               | 11.115 | 12.323 | 14.176 | 14.258 | 14.341 | 12.648 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 39.1623878479
-    Full duration: 108.56980896
-
-
-
-    test scenario NovaKeypair.create_and_list_keypairs
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.734 | 0.87   | 0.947  | 0.982  | 1.018 | 0.859 | 100.0%  | 10    |
-    | nova.list_keypairs  | 0.022 | 0.034  | 0.042  | 0.044  | 0.046 | 0.033 | 100.0%  | 10    |
-    | total               | 0.769 | 0.903  | 0.981  | 1.02   | 1.059 | 0.892 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.59114599228
-    Full duration: 44.6869869232
-
-
-
-    test scenario NovaServers.list_servers
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.list_servers | 1.436 | 1.556  | 1.653  | 1.689  | 1.725 | 1.565 | 100.0%  | 10    |
-    | total             | 1.436 | 1.557  | 1.653  | 1.689  | 1.726 | 1.565 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.71795606613
-    Full duration: 123.497851133
-
-
-
-    test scenario NovaServers.resize_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 8.388  | 9.39   | 10.016 | 10.105 | 10.194 | 9.406  | 100.0%  | 10    |
-    | nova.resize         | 40.666 | 42.089 | 46.186 | 46.669 | 47.151 | 42.721 | 100.0%  | 10    |
-    | nova.resize_confirm | 3.322  | 3.648  | 4.206  | 5.097  | 5.989  | 3.842  | 100.0%  | 10    |
-    | nova.delete_server  | 2.499  | 2.977  | 3.32   | 3.383  | 3.446  | 3.012  | 100.0%  | 10    |
-    | total               | 56.246 | 58.698 | 61.838 | 62.514 | 63.19  | 58.982 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 180.054177999
-    Full duration: 221.624077082
-
-
-
-    test scenario NovaServers.boot_server_from_volume_and_delete
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.965  | 10.647 | 11.15  | 11.275 | 11.4   | 10.648 | 100.0%  | 10    |
-    | nova.boot_server     | 8.986  | 10.62  | 12.102 | 12.345 | 12.587 | 10.685 | 100.0%  | 10    |
-    | nova.delete_server   | 3.355  | 5.419  | 5.857  | 5.908  | 5.96   | 5.311  | 100.0%  | 10    |
-    | total                | 23.598 | 26.481 | 28.991 | 29.016 | 29.041 | 26.644 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 79.5105199814
-    Full duration: 161.905633926
-
-
-
-    test scenario NovaServers.boot_and_migrate_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 8.833  | 10.242 | 11.298 | 11.673 | 12.049 | 10.106 | 100.0%  | 10    |
-    | nova.stop_server    | 3.821  | 6.772  | 7.286  | 7.317  | 7.349  | 6.484  | 100.0%  | 10    |
-    | nova.migrate        | 8.569  | 12.084 | 12.564 | 12.67  | 12.776 | 11.309 | 100.0%  | 10    |
-    | nova.resize_confirm | 2.922  | 3.398  | 4.001  | 4.054  | 4.107  | 3.49   | 100.0%  | 10    |
-    | nova.delete_server  | 2.522  | 2.922  | 3.396  | 3.406  | 3.416  | 2.976  | 100.0%  | 10    |
-    | total               | 29.694 | 34.582 | 36.24  | 36.517 | 36.795 | 34.367 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 100.483532906
-    Full duration: 141.506958961
-
-
-
-    test scenario NovaServers.boot_and_delete_server
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server   | 8.586 | 9.397  | 10.198 | 10.288 | 10.378 | 9.508  | 100.0%  | 10    |
-    | nova.delete_server | 2.497 | 3.108  | 3.472  | 3.478  | 3.485  | 3.09   | 100.0%  | 10    |
-    | total              | 11.39 | 12.555 | 13.374 | 13.612 | 13.849 | 12.598 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 38.4852130413
-    Full duration: 106.844094992
-
-
-
-    test scenario NovaServers.boot_and_rebuild_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 8.193  | 9.878  | 10.329 | 10.703 | 11.078 | 9.597  | 100.0%  | 10    |
-    | nova.rebuild_server | 8.434  | 9.946  | 10.942 | 11.066 | 11.191 | 9.967  | 100.0%  | 10    |
-    | nova.delete_server  | 2.887  | 3.097  | 3.934  | 4.794  | 5.654  | 3.399  | 100.0%  | 10    |
-    | total               | 20.573 | 22.393 | 25.427 | 25.892 | 26.357 | 22.963 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 68.7611658573
-    Full duration: 138.198104143
-
-
-
-    test scenario NovaSecGroup.create_and_list_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.914  | 5.073  | 5.815  | 5.965  | 6.116  | 5.288  | 100.0%  | 10    |
-    | nova.create_100_rules          | 41.66  | 44.384 | 45.431 | 45.816 | 46.201 | 44.305 | 100.0%  | 10    |
-    | nova.list_security_groups      | 0.152  | 0.533  | 0.902  | 0.96   | 1.018  | 0.5    | 100.0%  | 10    |
-    | total                          | 47.592 | 50.13  | 51.2   | 51.527 | 51.854 | 50.094 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 149.717460871
-    Full duration: 216.41701889
-
-
-
-    test scenario NovaSecGroup.create_and_delete_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.565  | 5.19   | 5.563  | 5.615  | 5.668  | 5.131  | 100.0%  | 10    |
-    | nova.create_100_rules          | 41.981 | 43.448 | 44.817 | 44.926 | 45.034 | 43.666 | 100.0%  | 10    |
-    | nova.delete_10_security_groups | 2.07   | 2.522  | 2.976  | 3.171  | 3.366  | 2.551  | 100.0%  | 10    |
-    | total                          | 49.35  | 51.576 | 51.781 | 52.087 | 52.394 | 51.349 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 154.714606047
-    Full duration: 196.745972872
-
-
-
-    test scenario NovaServers.boot_and_bounce_server
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action                  | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server        | 8.097 | 9.924  | 11.182 | 11.428 | 11.673 | 10.029 | 100.0%  | 10    |
-    | nova.reboot_server      | 5.363 | 6.246  | 8.84   | 8.907  | 8.973  | 7.049  | 100.0%  | 10    |
-    | nova.soft_reboot_server | 8.452 | 8.823  | 9.184  | 9.291  | 9.398  | 8.83   | 100.0%  | 10    |
-    | nova.stop_server        | 3.808 | 6.394  | 7.284  | 7.3    | 7.316  | 6.358  | 100.0%  | 10    |
-    | nova.start_server       | 3.677 | 5.011  | 5.706  | 5.852  | 5.997  | 4.954  | 100.0%  | 10    |
-    | nova.rescue_server      | 7.752 | 8.674  | 11.07  | 11.07  | 11.071 | 9.269  | 100.0%  | 10    |
-    | nova.unrescue_server    | 5.065 | 5.536  | 5.762  | 5.781  | 5.8    | 5.532  | 100.0%  | 10    |
-    | nova.delete_server      | 2.485 | 2.546  | 3.501  | 4.347  | 5.194  | 2.952  | 100.0%  | 10    |
-    | total                   | 50.79 | 54.629 | 59.2   | 59.748 | 60.297 | 54.995 | 100.0%  | 10    |
-    +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 166.248807907
-    Full duration: 235.770923853
-
-
-
-    test scenario NovaServers.boot_server
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action           | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | nova.boot_server | 6.916 | 9.539  | 12.275 | 12.369 | 12.464 | 9.975 | 100.0%  | 10    |
-    | total            | 6.916 | 9.54   | 12.275 | 12.37  | 12.464 | 9.976 | 100.0%  | 10    |
-    +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 29.8727550507
-    Full duration: 87.0325229168
-
-
-
-    test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-    +-----------------------------------------------------------------------------------------------------------+
-    |                                           Response Times (sec)                                            |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups    | 5.065  | 5.392  | 5.642  | 5.731  | 5.819  | 5.4    | 100.0%  | 10    |
-    | nova.create_100_rules             | 42.116 | 43.904 | 45.452 | 45.794 | 46.137 | 44.057 | 100.0%  | 10    |
-    | nova.boot_server                  | 6.906  | 7.809  | 8.73   | 8.911  | 9.092  | 7.954  | 100.0%  | 10    |
-    | nova.get_attached_security_groups | 0.209  | 0.264  | 0.361  | 0.463  | 0.565  | 0.289  | 100.0%  | 10    |
-    | nova.delete_server                | 2.508  | 2.562  | 2.7    | 2.829  | 2.959  | 2.607  | 100.0%  | 10    |
-    | nova.delete_10_security_groups    | 1.784  | 2.564  | 3.087  | 3.153  | 3.218  | 2.561  | 100.0%  | 10    |
-    | total                             | 60.06  | 63.125 | 63.757 | 63.889 | 64.021 | 62.869 | 100.0%  | 10    |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 188.221204996
-    Full duration: 257.303071976
-
-
-
-    test scenario NovaServers.pause_and_unpause_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 7.896  | 9.252  | 10.006 | 10.25  | 10.494 | 9.303  | 100.0%  | 10    |
-    | nova.pause_server   | 2.784  | 3.19   | 3.465  | 3.487  | 3.509  | 3.226  | 100.0%  | 10    |
-    | nova.unpause_server | 2.782  | 3.172  | 3.226  | 3.258  | 3.29   | 3.105  | 100.0%  | 10    |
-    | nova.delete_server  | 2.553  | 3.301  | 3.545  | 3.619  | 3.693  | 3.248  | 100.0%  | 10    |
-    | total               | 17.692 | 19.035 | 19.794 | 19.85  | 19.905 | 18.883 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 56.6791820526
-    Full duration: 126.811426163
-
-
-
-    test scenario NovaServers.boot_server_from_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.412  | 10.207 | 10.376 | 10.441 | 10.505 | 10.131 | 100.0%  | 10    |
-    | nova.boot_server     | 8.849  | 10.342 | 11.591 | 11.741 | 11.892 | 10.423 | 100.0%  | 10    |
-    | total                | 18.922 | 20.498 | 21.854 | 21.976 | 22.099 | 20.555 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 60.9860489368
-    Full duration: 126.851632118
-
-
-
-    test scenario NovaServers.boot_and_list_server
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server  | 8.227 | 8.931  | 10.864 | 10.959 | 11.054 | 9.41   | 100.0%  | 10    |
-    | nova.list_servers | 0.624 | 1.017  | 1.144  | 1.153  | 1.163  | 0.949  | 100.0%  | 10    |
-    | total             | 8.969 | 9.945  | 11.851 | 11.89  | 11.928 | 10.359 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 30.9555499554
-    Full duration: 111.845392942
-
-
-
-    run_rally - INFO - Test scenario: "nova" OK.
-
-    run_rally - INFO - Starting test scenario "quotas" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  1b950d54-5c1a-4680-9d86-cbebdb0d1b72: started
-    Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: finished
-
-    test scenario Quotas.cinder_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.138 | 1.278  | 1.336  | 1.347  | 1.357 | 1.267 | 100.0%  | 10    |
-    | total                | 1.138 | 1.278  | 1.336  | 1.347  | 1.357 | 1.267 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.75106191635
-    Full duration: 16.480301857
-
-
-
-    test scenario Quotas.neutron_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.406 | 0.441  | 0.5    | 0.501  | 0.502 | 0.454 | 100.0%  | 10    |
-    | total                | 0.546 | 0.618  | 0.666  | 0.67   | 0.674 | 0.616 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.8795170784
-    Full duration: 13.8104491234
-
-
-
-    test scenario Quotas.cinder_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.178 | 1.264  | 1.311  | 1.344  | 1.378 | 1.26  | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.89  | 0.996  | 1.091  | 1.115  | 1.138 | 1.003 | 100.0%  | 10    |
-    | total                | 2.155 | 2.273  | 2.366  | 2.404  | 2.442 | 2.264 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 6.68874502182
-    Full duration: 18.7547061443
-
-
-
-    test scenario Quotas.nova_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.559 | 0.615  | 0.666  | 0.669  | 0.671 | 0.616 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.013 | 0.022  | 0.026  | 0.028  | 0.029 | 0.022 | 100.0%  | 10    |
-    | total                | 0.585 | 0.641  | 0.68   | 0.687  | 0.693 | 0.638 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.9670290947
-    Full duration: 13.6480379105
-
-
-
-    test scenario Quotas.nova_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.587 | 0.621  | 0.738  | 0.758  | 0.777 | 0.646 | 100.0%  | 10    |
-    | total                | 0.587 | 0.621  | 0.738  | 0.758  | 0.777 | 0.647 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.87492918968
-    Full duration: 13.4147770405
-
-
-
-    run_rally - INFO - Test scenario: "quotas" OK.
-
-    run_rally - INFO - Starting test scenario "requests" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  21739b85-984f-45b9-ae85-066dbd1adce3: started
-    Task 21739b85-984f-45b9-ae85-066dbd1adce3: finished
-
-    test scenario HttpRequests.check_random_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 5.047 | 5.181  | 5.389  | 5.395  | 5.401 | 5.204 | 100.0%  | 10    |
-    | total                  | 5.047 | 5.181  | 5.39   | 5.395  | 5.401 | 5.205 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 15.7369980812
-    Full duration: 20.6335179806
-
-
-
-    test scenario HttpRequests.check_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 5.048 | 5.052  | 5.058  | 5.058  | 5.058 | 5.053 | 100.0%  | 10    |
-    | total                  | 5.049 | 5.052  | 5.058  | 5.058  | 5.058 | 5.053 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 15.2042939663
-    Full duration: 20.2779421806
-
-
-
-    run_rally - INFO - Test scenario: "requests" OK.
-
-    run_rally - INFO -
-
-
-                         Rally Summary Report
-    +===================+============+===============+===========+
-    | Module            | Duration   | nb. Test Run  | Success   |
-    +===================+============+===============+===========+
-    | authenticate      | 01:01      | 10            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | glance            | 03:33      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | cinder            | 22:00      | 50            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | heat              | 10:19      | 35            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | keystone          | 02:29      | 29            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | neutron           | 09:44      | 31            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | nova              | 43:55      | 61            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | quotas            | 01:16      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | requests          | 00:40      | 2             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    +===================+============+===============+===========+
-    | TOTAL:            | 01:35:01   | 232           | 100.00%   |
-    +===================+============+===============+===========+
-
-
-
-SDN Controller
---------------
-
-ODL
-^^^^
-::
-
-    ==============================================================================
-    Basic
-    ==============================================================================
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-    ==============================================================================
-    Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-    ------------------------------------------------------------------------------
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Basic                                                                 | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/repos/functest/output.xml
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-    [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin
-    ==============================================================================
-    Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-    ==============================================================================
-    Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-    ------------------------------------------------------------------------------
-    Create Network :: Create new network in OpenStack                     | PASS |
-    ------------------------------------------------------------------------------
-    Check Network :: Check Network created in OpenDaylight                | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-    ==============================================================================
-    Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-    ------------------------------------------------------------------------------
-    Create New subnet :: Create new subnet in OpenStack                   | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-    ==============================================================================
-    Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-    ------------------------------------------------------------------------------
-    Create New Port :: Create new port in OpenStack                       | PASS |
-    ------------------------------------------------------------------------------
-    Check New Port :: Check new subnet created in OpenDaylight            | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-    ==============================================================================
-    Delete New Port :: Delete previously created port in OpenStack        | PASS |
-    ------------------------------------------------------------------------------
-    Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-    ==============================================================================
-    Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-    ==============================================================================
-    Delete Network :: Delete network in OpenStack                         | PASS |
-    ------------------------------------------------------------------------------
-    Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin                              | PASS |
-    18 critical tests, 18 passed, 0 failed
-    18 tests total, 18 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/repos/functest/output.xml
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-    [0;32mFinal report is located:[0m
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-
-
-
-Feature tests
--------------
-
-vIMS
-^^^^
-::
-
-    FUNCTEST.info: Running vIMS test...
-    vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-    vIMS - INFO - Update OpenStack creds informations
-    vIMS - INFO - Upload some OS images if it doesn't exist
-    vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    vIMS - INFO - Update security group quota for this tenant
-    vIMS - INFO - Update cinder quota for this tenant
-    vIMS - INFO - Collect flavor id for cloudify manager server
-    vIMS - INFO - Prepare virtualenv for cloudify-cli
-    vIMS - INFO - Downloading the cloudify manager server blueprint
-    vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the cloudify-manager deployment
-    vIMS - INFO - Cloudify-manager server is UP !
-    vIMS - INFO - Cloudify deployment duration:'1149.9'
-    vIMS - INFO - Collect flavor id for all clearwater vm
-    vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
-    vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-    vIMS - INFO - Writing the inputs file
-    vIMS - INFO - Launching the clearwater deployment
-    vIMS - INFO - The deployment of clearwater-opnfv is ended
-    vIMS - INFO - vIMS VNF deployment duration:'1133.8'
-    vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
-    vIMS - INFO - vIMS functional test duration:'2.9'
-    vIMS - INFO - Launching the clearwater-opnfv undeployment
-    vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
-    vIMS - INFO - Launching the cloudify-manager undeployment
-    vIMS - INFO - Cloudify-manager server has been successfully removed!
-    vIMS - INFO - Removing vIMS tenant ..
-    vIMS - INFO - Removing vIMS user ..
-
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    Promise- INFO - Creating tenant 'promise'...
-    Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
-    Promise- INFO - Creating user 'promiser'...
-    Promise- INFO - Updating OpenStack credentials...
-    Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    Promise- INFO - Creating flavor 'promise-flavor'...
-    Promise- INFO - Exporting environment variables...
-    Promise- INFO - Running command: npm run -s test -- --reporter json
-    Promise- INFO - The test succeeded.
-    Promise- DEBUG -
-    {
-      "stats": {
-        "suites": 23,
-        "tests": 33,
-        "passes": 33,
-        "pending": 0,
-        "failures": 0,
-        "start": "2016-02-19T05:41:25.739Z",
-        "end": "2016-02-19T05:41:31.140Z",
-        "duration": 5524
-      },
-      "tests": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ],
-      "pending": [],
-      "failures": [],
-      "passes": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ]
-    }
-    Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:    23
-     Tests:     33
-     Passes:    33
-     Pending:   0
-     Failures:  0
-     Start:     2016-02-19T05:41:25.739Z
-     End:       2016-02-19T05:41:31.140Z
-     Duration:  6.301
-    ****************************************
-
-
diff --git a/docs/results/fuel-os-odl_l2-sfc-ha.rst b/docs/results/fuel-os-odl_l2-sfc-ha.rst
deleted file mode 100644 (file)
index a827ecf..0000000
+++ /dev/null
@@ -1,1262 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-odl_l2-sfc-ha
------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-SSH test...
-    vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_ssh- INFO - Creating neutron network vping-net...
-    vPing_ssh- INFO - Creating security group  'vPing-sg'...
-    vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-    vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=fff41d5d-579a-4c26-844d-4e86700c44f6
-     network=a5137d46-dea8-4f85-8872-08c4a5927182
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-    vPing_ssh- INFO - Floating IP created: '10.118.101.200'
-    vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
-    vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
-    vPing_ssh- INFO - Waiting for ping...
-    vPing_ssh- INFO - vPing detected!
-    vPing_ssh- INFO - vPing duration:'34.7' s.
-    vPing_ssh- INFO - Cleaning up...
-    vPing_ssh- INFO - vPing OK
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-userdata test...
-    vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_userdata- INFO - Creating neutron network vping-net...
-    vPing_userdata- INFO - Creating security group  'vPing-sg'...
-    vPing_userdata- INFO - Flavor found 'm1.small'
-    vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
-     network=a1efb318-1338-436f-8f26-3a1bacab0538
-     userdata=
-    #!/bin/sh
-
-    while true; do
-     ping -c 1 192.168.130.4 2>&1 >/dev/null
-     RES=$?
-     if [ "Z$RES" = "Z0" ] ; then
-      echo 'vPing OK'
-     break
-     else
-      echo 'vPing KO'
-     fi
-     sleep 1
-    done
-
-    vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_userdata- INFO - Waiting for ping...
-    vPing_userdata- INFO - vPing detected!
-    vPing_userdata- INFO - vPing duration:'20.2'
-    vPing_userdata- INFO - vPing OK
-    vPing_userdata- INFO - Cleaning up...
-    vPing_userdata- INFO - Deleting network 'vping-net'...
-
-Tempest
-^^^^^^^
-::
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    | name                                                                                                                                     | time    | status  |
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.254   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.125   | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 12.388  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 24.859  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 11.610  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.780   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.301   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.308   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 1.031   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.525   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.310   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.327   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.451   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.657   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.624   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.325   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.614   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.537   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.637   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.480   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.480   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.447   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 2.524   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 5.127   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 9.604   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 3.288   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.114   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.489   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.209   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.001   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 15.311  | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.090   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.467   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.207   | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.001   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.085   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 3.900   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.712   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.713   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.622   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.433   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.110   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.094   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.076   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.093   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.528   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.001   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.173   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.093   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.025   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.093   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.080   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.020   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.025   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.043   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.581   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.066   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.288   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.030   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.096   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.001   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 5.780   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 10.302  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 11.027  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 1.138   | skip    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 11.793  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 14.743  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 24.954  | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 8.319   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.102   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.170   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.536   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.507   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.449   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.688   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.515   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.556   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 3.590   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 12.764  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 21.680  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 9.787   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 11.049  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 2.045   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 2.190   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 2.549   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 2.194   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 2.236   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.806   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 1.026   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 1.050   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.552   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 1.557   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 1.266   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.803   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.824   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.778   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.357   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 1.212   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.691   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.931   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.165   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.248   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.078   | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 47.118  | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.111   | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.097   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.262   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.016   | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.809   | success |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.233   | success |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.397   | success |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.077   | success |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.966   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.513   | success |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 2.311   | success |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.401   | success |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.332   | success |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.555   | success |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.059   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.086   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.091   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.078   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.087   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.083   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.076   | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.579   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 2.026   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 2.947   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 15.745  | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 4.489   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.373   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 3.080   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 2.565   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.671   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.317   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.042   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.282   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.045   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 2.800   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 2.487   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.722   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.272   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.282   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 2.391   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 2.499   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 1.658   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.062   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.087   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 5.549   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 3.796   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 3.120   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 2.261   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 6.149   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 3.659   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 2.738   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 2.213   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 1.612   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 2.371   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.043   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 1.383   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.275   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.237   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.531   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 5.699   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.045   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 1.426   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.579   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.680   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.622   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.799   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.770   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.216   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.051   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 18.428  | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 3.313   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.580   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 3.176   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 10.232  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 17.327  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 11.862  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 17.953  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.304   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.680   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 45.140  | success |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 115.284 | success |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 88.143  | success |
-    +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
-    run_tempest - INFO - Results: {'timestart': '2016-04-2701:33:43.774958', 'duration': 1541, 'tests': 188, 'failures': 0}
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    2016-04-27 02:14:20,172 - run_rally - INFO - Starting test scenario "authenticate" ...
-    2016-04-27 02:15:40,641 - run_rally - INFO -
-     Preparing input task
-     Task  1491f5fb-1f66-45d3-b04b-31a8cf53eb71: started
-    Task 1491f5fb-1f66-45d3-b04b-31a8cf53eb71: finished
-
-    test scenario Authenticate.validate_glance
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_glance_2_times | 0.966     | 1.042        | 1.146        | 1.191        | 1.236     | 1.063     | 100.0%  | 10    |
-    | total                                | 1.21      | 1.272        | 1.393        | 1.45         | 1.507     | 1.307     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 3.89922785759
-    Full duration: 12.1358039379
-
-    test scenario Authenticate.keystone
-    +--------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                   |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.keystone | 0.216     | 0.247        | 0.379        | 0.382        | 0.385     | 0.267     | 100.0%  | 10    |
-    | total                 | 0.216     | 0.247        | 0.379        | 0.382        | 0.386     | 0.268     | 100.0%  | 10    |
-    +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 0.732311964035
-    Full duration: 8.95613193512
-
-    test scenario Authenticate.validate_heat
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_heat_2_times | 0.346     | 0.575        | 0.619        | 0.625        | 0.63      | 0.505     | 100.0%  | 10    |
-    | total                              | 0.575     | 0.807        | 0.866        | 0.899        | 0.932     | 0.77      | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.38545608521
-    Full duration: 11.1800699234
-
-    test scenario Authenticate.validate_nova
-    +---------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                         Response Times (sec)                                                          |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_nova_2_times | 0.31      | 0.388        | 0.536        | 0.54         | 0.543     | 0.409     | 100.0%  | 10    |
-    | total                              | 0.553     | 0.635        | 0.773        | 0.794        | 0.814     | 0.663     | 100.0%  | 10    |
-    +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.93493509293
-    Full duration: 10.6224660873
-
-    test scenario Authenticate.validate_cinder
-    +-----------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                          Response Times (sec)                                                           |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_cinder_2_times | 0.296     | 0.55         | 0.598        | 0.713        | 0.828     | 0.553     | 100.0%  | 10    |
-    | total                                | 0.525     | 0.815        | 0.942        | 1.052        | 1.162     | 0.829     | 100.0%  | 10    |
-    +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.46085309982
-    Full duration: 10.4235949516
-
-    test scenario Authenticate.validate_neutron
-    +------------------------------------------------------------------------------------------------------------------------------------------+
-    |                                                           Response Times (sec)                                                           |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | authenticate.validate_neutron_2_times | 0.526     | 0.601        | 0.73         | 0.74         | 0.749     | 0.615     | 100.0%  | 10    |
-    | total                                 | 0.797     | 0.826        | 0.973        | 0.981        | 0.989     | 0.86      | 100.0%  | 10    |
-    +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.49738502502
-    Full duration: 11.2271738052
-
-    2016-04-27 02:15:42,749 - run_rally - INFO - Test scenario: "authenticate" OK.
-    2016-04-27 02:15:42,749 - run_rally - INFO - Starting test scenario "glance" ...
-    2016-04-27 02:19:48,692 - run_rally - INFO -
-     Preparing input task
-     Task  661ec9b2-9c4d-4fcd-b522-0cf3f1dbc4ec: started
-    Task 661ec9b2-9c4d-4fcd-b522-0cf3f1dbc4ec: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------------------------------------+
-    |                                                 Response Times (sec)                                                  |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.list_images | 0.763     | 0.847        | 0.96         | 0.961        | 0.962     | 0.858     | 100.0%  | 10    |
-    | total              | 0.763     | 0.847        | 0.96         | 0.961        | 0.962     | 0.859     | 100.0%  | 10    |
-    +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 2.59311103821
-    Full duration: 13.8837060928
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 7.004     | 7.656        | 20.755       | 26.239       | 31.723    | 11.873    | 100.0%  | 10    |
-    | nova.boot_servers   | 8.947     | 10.367       | 10.531       | 10.637       | 10.744    | 10.109    | 100.0%  | 10    |
-    | total               | 15.951    | 18.072       | 31.179       | 36.629       | 42.078    | 21.982    | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 66.442127943
-    Full duration: 112.407797098
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 7.244     | 7.582        | 7.891        | 7.95         | 8.009     | 7.634     | 100.0%  | 10    |
-    | glance.list_images  | 0.306     | 0.566        | 0.613        | 0.638        | 0.663     | 0.546     | 100.0%  | 10    |
-    | total               | 7.774     | 8.159        | 8.369        | 8.413        | 8.457     | 8.181     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 24.4534111023
-    Full duration: 55.2102069855
-
-    test scenario GlanceImages.create_and_delete_image
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | glance.create_image | 7.177     | 7.831        | 16.251       | 17.887       | 19.523    | 9.669     | 100.0%  | 10    |
-    | glance.delete_image | 1.407     | 2.22         | 2.375        | 2.45         | 2.525     | 2.125     | 100.0%  | 10    |
-    | total               | 9.332     | 9.768        | 18.192       | 20.001       | 21.809    | 11.794    | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 40.9665431976
-    Full duration: 52.3726029396
-
-    22016-04-27 02:19:50,772 - run_rally - INFO - Test scenario: "glance" OK.
-    2016-04-27 02:19:50,773 - run_rally - INFO - Starting test scenario "cinder" ...
-    2016-04-27 02:41:55,538 - run_rally - INFO -
-     Preparing input task
-     Task  a74fb68a-1212-4fff-afdd-a8ad044039fd: started
-    Task a74fb68a-1212-4fff-afdd-a8ad044039fd: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | nova.boot_server     | 7.389     | 8.334        | 9.206        | 9.56         | 9.914     | 8.417     | 100.0%  | 10    |
-    | cinder.create_volume | 3.216     | 3.747        | 4.031        | 4.195        | 4.359     | 3.726     | 100.0%  | 10    |
-    | nova.attach_volume   | 3.856     | 4.202        | 7.174        | 7.341        | 7.508     | 4.8       | 100.0%  | 10    |
-    | nova.detach_volume   | 4.017     | 4.272        | 4.467        | 4.641        | 4.815     | 4.302     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.631     | 2.93         | 3.151        | 3.193        | 3.235     | 2.346     | 100.0%  | 10    |
-    | nova.delete_server   | 2.937     | 3.051        | 3.119        | 3.273        | 3.426     | 3.078     | 100.0%  | 10    |
-    | total                | 23.718    | 25.911       | 29.125       | 29.723       | 30.322    | 26.67     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 78.0439009666
-    Full duration: 110.455639839
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 9.979     | 10.793       | 11.421       | 11.46        | 11.499    | 10.766    | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.074     | 0.299        | 0.372        | 0.384        | 0.397     | 0.235     | 100.0%  | 10    |
-    | total                | 10.062    | 11.109       | 11.668       | 11.734       | 11.8      | 11.002    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 32.7168459892
-    Full duration: 54.91467309
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.417     | 3.882        | 4.164        | 4.19         | 4.217     | 3.871     | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.077     | 0.338        | 0.473        | 0.485        | 0.497     | 0.335     | 100.0%  | 10    |
-    | total                | 3.881     | 4.176        | 4.51         | 4.539        | 4.568     | 4.206     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 12.7357430458
-    Full duration: 32.5659849644
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 3.051     | 3.454        | 5.626        | 5.696        | 5.765     | 3.827     | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.035     | 0.296        | 0.325        | 0.325        | 0.325     | 0.227     | 100.0%  | 10    |
-    | total                  | 3.355     | 3.657        | 5.947        | 6.0          | 6.052     | 4.054     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 13.0978519917
-    Full duration: 50.9691619873
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.632     | 3.83         | 4.025        | 4.124        | 4.223     | 3.857     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.55      | 0.83         | 2.782        | 2.965        | 3.147     | 1.365     | 100.0%  | 10    |
-    | total                | 4.281     | 4.87         | 6.615        | 6.841        | 7.066     | 5.222     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 15.9277088642
-    Full duration: 34.237901926
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 10.252    | 10.977       | 11.943       | 11.948       | 11.953    | 11.097    | 100.0%  | 10    |
-    | cinder.delete_volume | 0.82      | 1.996        | 2.99         | 3.013        | 3.036     | 1.938     | 100.0%  | 10    |
-    | total                | 11.877    | 12.968       | 14.015       | 14.471       | 14.927    | 13.036    | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 37.8433139324
-    Full duration: 56.9522650242
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.852     | 4.061        | 4.498        | 4.604        | 4.711     | 4.133     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.835     | 0.977        | 2.77         | 2.939        | 3.108     | 1.5       | 100.0%  | 10    |
-    | total                | 4.799     | 5.266        | 6.888        | 6.964        | 7.039     | 5.634     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 17.0594739914
-    Full duration: 34.639097929
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +----------------------------------------------------------------------------------------------------------------------------------+
-    |                                                       Response Times (sec)                                                       |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume          | 3.582     | 3.801        | 4.194        | 4.213        | 4.231     | 3.878     | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 19.387    | 31.495       | 32.341       | 32.354       | 32.367    | 29.335    | 100.0%  | 10    |
-    | cinder.delete_volume          | 0.844     | 2.45         | 2.784        | 2.825        | 2.866     | 1.905     | 100.0%  | 10    |
-    | nova.delete_image             | 2.332     | 2.682        | 2.872        | 2.969        | 3.065     | 2.677     | 100.0%  | 10    |
-    | total                         | 26.258    | 39.786       | 40.849       | 41.006       | 41.163    | 37.796    | 100.0%  | 10    |
-    +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 111.222266197
-    Full duration: 129.783249855
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_snapshot | 3.34      | 3.423        | 5.731        | 5.746        | 5.76      | 3.87      | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.556     | 3.104        | 3.272        | 3.285        | 3.299     | 3.068     | 100.0%  | 10    |
-    | total                  | 6.365     | 6.599        | 8.332        | 8.543        | 8.755     | 6.938     | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 19.7357230186
-    Full duration: 50.7531559467
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.497     | 3.901        | 4.226        | 4.246        | 4.266     | 3.883     | 100.0%  | 10    |
-    | total                | 3.497     | 3.901        | 4.226        | 4.246        | 4.266     | 3.883     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.6317541599
-    Full duration: 29.422949791
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.649     | 3.933        | 4.176        | 4.178        | 4.179     | 3.939     | 100.0%  | 10    |
-    | total                | 3.649     | 3.933        | 4.176        | 4.178        | 4.179     | 3.939     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 11.7954070568
-    Full duration: 33.4074928761
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                  |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.list_volumes | 0.559     | 0.596        | 0.645        | 0.658        | 0.671     | 0.603     | 100.0%  | 10    |
-    | total               | 0.559     | 0.596        | 0.645        | 0.658        | 0.671     | 0.603     | 100.0%  | 10    |
-    +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 1.80386185646
-    Full duration: 65.103438139
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 3.223     | 4.031        | 4.142        | 4.196        | 4.25      | 3.949     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.821     | 3.096        | 3.318        | 3.349        | 3.38      | 3.082     | 100.0%  | 10    |
-    | nova.attach_volume     | 4.011     | 4.73         | 9.508        | 10.629       | 11.75     | 5.874     | 100.0%  | 10    |
-    | nova.detach_volume     | 3.603     | 4.136        | 4.42         | 4.481        | 4.542     | 4.112     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.532     | 2.593        | 2.862        | 2.973        | 3.084     | 2.691     | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.626     | 2.709        | 3.035        | 3.087        | 3.139     | 2.413     | 100.0%  | 10    |
-    | total                  | 20.294    | 22.503       | 27.052       | 28.211       | 29.37     | 23.272    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 67.9758191109
-    Full duration: 167.151215076
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.396     | 4.269        | 4.654        | 5.616        | 6.578     | 4.385     | 100.0%  | 10    |
-    | cinder.delete_volume | 2.712     | 3.275        | 3.476        | 3.485        | 3.493     | 3.193     | 100.0%  | 10    |
-    | total                | 6.117     | 7.6          | 8.118        | 8.975        | 9.831     | 7.578     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 24.3931138515
-    Full duration: 56.1436901093
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +-------------------------------------------------------------------------------------------------------------------------+
-    |                                                  Response Times (sec)                                                   |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume | 3.562     | 4.002        | 4.303        | 4.334        | 4.364     | 4.012     | 100.0%  | 10    |
-    | cinder.extend_volume | 0.691     | 1.1          | 3.236        | 3.411        | 3.587     | 1.713     | 100.0%  | 10    |
-    | cinder.delete_volume | 0.583     | 0.974        | 3.176        | 3.253        | 3.33      | 1.51      | 100.0%  | 10    |
-    | total                | 5.58      | 6.337        | 10.123       | 10.341       | 10.559    | 7.236     | 100.0%  | 10    |
-    +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 20.3285830021
-    Full duration: 37.9043469429
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 3.524     | 4.049        | 4.167        | 4.196        | 4.225     | 3.94      | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.743     | 3.026        | 3.356        | 3.408        | 3.46      | 3.053     | 100.0%  | 10    |
-    | nova.attach_volume     | 4.113     | 4.635        | 6.974        | 7.136        | 7.298     | 5.464     | 100.0%  | 10    |
-    | nova.detach_volume     | 3.695     | 4.078        | 4.306        | 4.692        | 5.078     | 4.146     | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.489     | 2.864        | 3.117        | 3.127        | 3.136     | 2.861     | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.577     | 2.556        | 2.985        | 3.013        | 3.041     | 2.272     | 100.0%  | 10    |
-    | total                  | 19.553    | 22.646       | 25.102       | 25.135       | 25.168    | 22.862    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 67.4835031033
-    Full duration: 178.220266819
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +---------------------------------------------------------------------------------------------------------------------------+
-    |                                                   Response Times (sec)                                                    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    | cinder.create_volume   | 3.143     | 3.843        | 3.997        | 4.099        | 4.2       | 3.793     | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.558     | 2.892        | 3.176        | 3.328        | 3.48      | 2.92      | 100.0%  | 10    |
-    | nova.attach_volume     | 4.209     | 5.877        | 7.368        | 8.681        | 9.994     | 6.076     | 100.0%  | 10    |
-    | nova.detach_volume     | 3.533     | 3.91         | 4.349        | 4.363        | 4.378     | 3.99      | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.531     | 2.847        | 3.044        | 3.101        | 3.158     | 2.802     | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.626     | 2.561        | 2.989        | 3.03         | 3.071     | 2.206     | 100.0%  | 10    |
-    | total                  | 20.143    | 23.986       | 25.362       | 26.711       | 28.06     | 23.469    | 100.0%  | 10    |
-    +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
-    Load duration: 67.7886071205
-    Full duration: 169.118987083
-
-    2016-04-27 02:41:57,893 - run_rally - INFO - Test scenario: "cinder" OK.
-
-SDN Controller
---------------
-
-ODL
-^^^^
-::
-
-    ==============================================================================
-    Basic
-    ==============================================================================
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-    ==============================================================================
-    Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-    ------------------------------------------------------------------------------
-    Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Basic                                                                 | PASS |
-    1 critical test, 1 passed, 0 failed
-    1 test total, 1 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/repos/functest/output.xml
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-    [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin
-    ==============================================================================
-    Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-    ==============================================================================
-    Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-    ------------------------------------------------------------------------------
-    Create Network :: Create new network in OpenStack                     | PASS |
-    ------------------------------------------------------------------------------
-    Check Network :: Check Network created in OpenDaylight                | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-    ==============================================================================
-    Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-    ------------------------------------------------------------------------------
-    Create New subnet :: Create new subnet in OpenStack                   | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-    ==============================================================================
-    Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-    ------------------------------------------------------------------------------
-    Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-    ------------------------------------------------------------------------------
-    Create New Port :: Create new port in OpenStack                       | PASS |
-    ------------------------------------------------------------------------------
-    Check New Port :: Check new subnet created in OpenDaylight            | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
-    4 critical tests, 4 passed, 0 failed
-    4 tests total, 4 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-    ==============================================================================
-    Delete New Port :: Delete previously created port in OpenStack        | PASS |
-    ------------------------------------------------------------------------------
-    Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-    ==============================================================================
-    Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-    ------------------------------------------------------------------------------
-    Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-    ==============================================================================
-    Delete Network :: Delete network in OpenStack                         | PASS |
-    ------------------------------------------------------------------------------
-    Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-    ------------------------------------------------------------------------------
-    Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-    2 critical tests, 2 passed, 0 failed
-    2 tests total, 2 passed, 0 failed
-    ==============================================================================
-    Neutron :: Test suite for Neutron Plugin                              | PASS |
-    18 critical tests, 18 passed, 0 failed
-    18 tests total, 18 passed, 0 failed
-    ==============================================================================
-    Output:  /home/opnfv/repos/functest/output.xml
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-    [0;32mFinal report is located:[0m
-    Log:     /home/opnfv/repos/functest/log.html
-    Report:  /home/opnfv/repos/functest/report.html
-
-Feature tests
--------------
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    Promise- INFO - Creating tenant 'promise'...
-    Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
-    Promise- INFO - Creating user 'promiser'...
-    Promise- INFO - Updating OpenStack credentials...
-    Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    Promise- INFO - Creating flavor 'promise-flavor'...
-    Promise- INFO - Exporting environment variables...
-    Promise- INFO - Running command: npm run -s test -- --reporter json
-    Promise- INFO - The test succeeded.
-    Promise- DEBUG -
-    {
-      "stats": {
-        "suites": 23,
-        "tests": 33,
-        "passes": 33,
-        "pending": 0,
-        "failures": 0,
-        "start": "2016-04-27T02:00:03.021Z",
-        "end": "2016-04-27T02:00:08.968Z",
-        "duration": 5947
-      },
-      "tests": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ],
-      "pending": [],
-      "failures": [],
-      "passes": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ]
-    }
-    Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:    23
-     Tests:     33
-     Passes:    33
-     Pending:   0
-     Failures:  0
-     Start:    2016-04-27T02:00:03.021Z
-     End:      2016-04-27T02:00:08.968Z
-     Duration: 5.947
-    ****************************************
-
-vIMS
-^^^^^^^
-::
-
-    FUNCTEST.info: Running vIMS test...
-    2016-04-27 02:00:26,953 - vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
-    2016-04-27 02:00:27,734 - vIMS - INFO - Update OpenStack creds informations
-    2016-04-27 02:00:27,734 - vIMS - INFO - Upload some OS images if it doesn't exist
-    2016-04-27 02:00:28,202 - vIMS - INFO - centos_7 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    2016-04-27 02:01:55,022 - vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
-                                Try downloading this image and upload on glance !
-    2016-04-27 02:03:39,709 - vIMS - INFO - Update security group quota for this tenant
-    2016-04-27 02:03:40,572 - vIMS - INFO - Update cinder quota for this tenant
-    2016-04-27 02:03:41,548 - vIMS - INFO - Collect flavor id for cloudify manager server
-    2016-04-27 02:03:43,403 - vIMS - INFO - Prepare virtualenv for cloudify-cli
-    2016-04-27 02:04:20,255 - vIMS - INFO - Downloading the cloudify manager server blueprint
-    2016-04-27 02:04:21,701 - vIMS - INFO - Cloudify deployment Start Time:'2016-04-27 02:04:21'
-    2016-04-27 02:04:21,701 - vIMS - INFO - Writing the inputs file
-    2016-04-27 02:04:21,706 - vIMS - INFO - Launching the cloudify-manager deployment
-    2016-04-27 02:11:57,797 - vIMS - INFO - Cloudify-manager server is UP !
-    2016-04-27 02:11:57,797 - vIMS - INFO - Cloudify deployment duration:'456.1'
-    2016-04-27 02:11:57,798 - vIMS - INFO - Collect flavor id for all clearwater vm
-    2016-04-27 02:12:00,174 - vIMS - INFO - vIMS VNF deployment Start Time:'2016-04-27 02:12:00'
-    2016-04-27 02:12:00,174 - vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
-    2016-04-27 02:12:01,517 - vIMS - INFO - Writing the inputs file
-    2016-04-27 02:12:01,520 - vIMS - INFO - Launching the clearwater deployment
-    2016-04-27 02:13:46,397 - vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/opnfv-cloudify-clearwater; cfy blueprints upload -b clearwater -p openstack-blueprint.yaml; cfy deployments create -b clearwater -d clearwater-opnfv --inputs inputs.yaml; cfy executions start -w install -d clearwater-opnfv --timeout 1800; '
-    2016-04-27 02:13:46,398 - vIMS - ERROR - RuntimeError: Workflow failed: Task failed 'nova_plugin.server.start' -> NonRecoverableError('Unexpected server state ERROR:None',)
diff --git a/docs/results/fuel-os-onos-nofeature-ha.rst b/docs/results/fuel-os-onos-nofeature-ha.rst
deleted file mode 100644 (file)
index 0e276a6..0000000
+++ /dev/null
@@ -1,2618 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for fuel-os-onos-nofeature-ha
----------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-    FUNCTEST.info: Running vPing-SSH test...
-    vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    vPing_ssh- INFO - Creating neutron network vping-net...
-    vPing_ssh- INFO - Creating security group  'vPing-sg'...
-    vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-    vPing_ssh- INFO - vPing Start Time:'2016-02-21 09:42:15'
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-     name=opnfv-vping-1
-     flavor=<Flavor: m1.small>
-     image=c921bde1-b564-4670-9801-7607bb7dd5f9
-     network=ddbf909c-8936-4d5a-b499-ae5bc6e4981f
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-     name=opnfv-vping-2
-     flavor=<Flavor: m1.small>
-     image=c921bde1-b564-4670-9801-7607bb7dd5f9
-     network=ddbf909c-8936-4d5a-b499-ae5bc6e4981f
-
-    vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-    vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-    vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-    vPing_ssh- INFO - Floating IP created: '10.118.101.200'
-    vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
-    vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
-    vPing_ssh- INFO - Waiting for ping...
-    vPing_ssh- INFO - vPing detected!
-    vPing_ssh- INFO - vPing duration:'267.2' s.
-    vPing_ssh- INFO - Cleaning up...
-    vPing_ssh- INFO - vPing OK
-
-
-
-
-Tempest
-^^^^^^^
-::
-
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | name                                                                                                                                     | time      | status  |
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.33888   | success |
-    | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.10971   | success |
-    | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 15.11040  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 30.42278  | success |
-    | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 13.85713  | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.32690   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.34397   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.37412   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 1.53125   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.34050   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.55659   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.33680   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.57251   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.33960   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.69068   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.33768   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.67793   | success |
-    | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.33491   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 1.60438   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 1.39355   | success |
-    | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 1.24188   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.85431   | success |
-    | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 2.83096   | success |
-    | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 6.66403   | success |
-    | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 13.11276  | success |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.0       | fail    |
-    | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.11312   | success |
-    | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 4.98764   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.62118   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 1.01188   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.73001   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 1.04071   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.53598   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.12633   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.13548   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.08098   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.08810   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.10130   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.63997   | success |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00129   | skip    |
-    | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.20987   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.10442   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.02285   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.10168   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08641   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.03051   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.02042   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.08087   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.06620   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.07583   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 1.02614   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.03649   | success |
-    | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.10806   | success |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 0.0       | fail    |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.09498   | success |
-    | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.15150   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.76964   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.40090   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.38359   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.65971   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.66699   | success |
-    | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.63491   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 5.25088   | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 16.25121  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 22.90196  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 11.28175  | success |
-    | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 12.26759  | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 2.49600   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 2.57009   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 3.21321   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 3.04861   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 3.93770   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.76115   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 1.71809   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 1.21977   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.91452   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.95440   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 3.16889   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 1.57679   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 1.42447   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 1.46180   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 1.15287   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.87581   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.99209   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 0.58096   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 1.07971   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 1.73518   | success |
-    | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.51942   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.32883   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.01961   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 1.56142   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.03891   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.62077   | success |
-    | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.07524   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.29801   | success |
-    | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.07714   | success |
-    | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 0.0       | fail    |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 1.06122   | success |
-    | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 1.10604   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.41781   | success |
-    | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.03176   | success |
-    | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.0       | fail    |
-    | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.34417   | success |
-    | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 1.00125   | success |
-    | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.64367   | success |
-    | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.38885   | success |
-    | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.0       | fail    |
-    | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.52793   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.11210   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.08846   | success |
-    | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.10244   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.10511   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.10566   | success |
-    | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.14063   | success |
-    | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.57457   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.72677   | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 15.66304  | success |
-    | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 3.84418   | success |
-    | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 5.53626   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 2.54078   | success |
-    | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 4.09094   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 1.98866   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 2.87451   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 5.20792   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 2.28358   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 4.49162   | success |
-    | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 3.79765   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 2.99403   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.66099   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.29854   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.32442   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.04955   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.33630   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 2.80651   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.65929   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.36943   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.38991   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.31486   | success |
-    | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.30617   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 2.96002   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 3.15725   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.88622   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.32563   | success |
-    | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.37153   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 3.19676   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 2.65017   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 2.26448   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.38004   | success |
-    | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.32783   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 8.61053   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 5.36523   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 3.30263   | success |
-    | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 2.90758   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 7.98249   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 4.15672   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 4.09748   | success |
-    | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 3.08662   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 1.74965   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 3.81896   | success |
-    | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.31019   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 2.07790   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.59873   | success |
-    | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.33280   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.62361   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.93849   | success |
-    | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.07141   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 1.31814   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.61532   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.61600   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.59934   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.81253   | success |
-    | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.84469   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.72972   | success |
-    | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.06791   | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 19.60479  | success |
-    | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 3.74694   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 3.11182   | success |
-    | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 3.04832   | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 10.66890  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 18.01898  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 16.52370  | success |
-    | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 17.05563  | success |
-    | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.08365   | success |
-    | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.05607   | success |
-    | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 374.04656 | fail    |
-    | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 340.58084 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 349.05347 | fail    |
-    | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 338.91569 | fail    |
-    +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-    run_tempest - INFO - Results: {'timestart': '2016-02-2109:47:08.529077', 'duration': 512, 'tests': 210, 'failures': 31}
-
-Rally
-^^^^^
-::
-
-    FUNCTEST.info: Running Rally benchmark suite...
-    run_rally - INFO - Starting test scenario "authenticate" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  938ee7f4-76f5-42f3-a908-9eb3557dac60: started
-    Task 938ee7f4-76f5-42f3-a908-9eb3557dac60: finished
-
-    test scenario Authenticate.validate_glance
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_glance     | 0.528 | 0.563  | 0.576  | 0.577  | 0.578 | 0.558 | 100.0%  | 10    |
-    | authenticate.validate_glance (2) | 0.524 | 0.536  | 0.584  | 0.646  | 0.707 | 0.556 | 100.0%  | 10    |
-    | total                            | 1.209 | 1.274  | 1.348  | 1.391  | 1.434 | 1.285 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.82395505905
-    Full duration: 11.5060088634
-
-
-
-    test scenario Authenticate.keystone
-    +----------------------------------------------------------------------------+
-    |                            Response Times (sec)                            |
-    +--------+-------+--------+--------+--------+------+-------+---------+-------+
-    | action | min   | median | 90%ile | 95%ile | max  | avg   | success | count |
-    +--------+-------+--------+--------+--------+------+-------+---------+-------+
-    | total  | 0.145 | 0.166  | 0.262  | 0.271  | 0.28 | 0.193 | 100.0%  | 10    |
-    +--------+-------+--------+--------+--------+------+-------+---------+-------+
-    Load duration: 0.597311973572
-    Full duration: 8.39117598534
-
-
-
-    test scenario Authenticate.validate_heat
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_heat     | 0.289 | 0.308  | 0.338  | 0.34   | 0.342 | 0.312 | 100.0%  | 10    |
-    | authenticate.validate_heat (2) | 0.054 | 0.289  | 0.31   | 0.318  | 0.327 | 0.27  | 100.0%  | 10    |
-    | total                          | 0.575 | 0.782  | 0.858  | 0.862  | 0.865 | 0.773 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.38020992279
-    Full duration: 10.2995789051
-
-
-
-    test scenario Authenticate.validate_nova
-    +-----------------------------------------------------------------------------------------------------+
-    |                                        Response Times (sec)                                         |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_nova     | 0.279 | 0.311  | 0.459  | 0.464  | 0.468 | 0.352 | 100.0%  | 10    |
-    | authenticate.validate_nova (2) | 0.033 | 0.056  | 0.061  | 0.063  | 0.065 | 0.053 | 100.0%  | 10    |
-    | total                          | 0.477 | 0.53   | 0.699  | 0.711  | 0.723 | 0.569 | 100.0%  | 10    |
-    +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.69243693352
-    Full duration: 9.33592200279
-
-
-
-    test scenario Authenticate.validate_cinder
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_cinder     | 0.276 | 0.29   | 0.335  | 0.335  | 0.335 | 0.302 | 100.0%  | 10    |
-    | authenticate.validate_cinder (2) | 0.257 | 0.29   | 0.318  | 0.346  | 0.374 | 0.297 | 100.0%  | 10    |
-    | total                            | 0.719 | 0.773  | 0.853  | 0.863  | 0.873 | 0.781 | 100.0%  | 10    |
-    +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.3241250515
-    Full duration: 9.87282705307
-
-
-
-    test scenario Authenticate.validate_neutron
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | authenticate.validate_neutron     | 0.289 | 0.309  | 0.329  | 0.334  | 0.34  | 0.31  | 100.0%  | 10    |
-    | authenticate.validate_neutron (2) | 0.044 | 0.294  | 0.324  | 0.365  | 0.406 | 0.265 | 100.0%  | 10    |
-    | total                             | 0.533 | 0.752  | 0.809  | 0.831  | 0.854 | 0.734 | 100.0%  | 10    |
-    +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.165102005
-    Full duration: 9.4830288887
-
-
-
-    run_rally - INFO - Test scenario: "authenticate" OK.
-
-    run_rally - INFO - Starting test scenario "glance" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  158cf9e7-5336-4cfc-be40-3e75d061e99a: started
-    Task 158cf9e7-5336-4cfc-be40-3e75d061e99a: finished
-
-    test scenario GlanceImages.list_images
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | glance.list_images | 0.726 | 0.781  | 0.882  | 0.891  | 0.899 | 0.807 | 100.0%  | 10    |
-    | total              | 0.726 | 0.783  | 0.882  | 0.891  | 0.899 | 0.807 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.53244495392
-    Full duration: 12.5428349972
-
-
-
-    test scenario GlanceImages.create_image_and_boot_instances
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | glance.create_image | 6.979  | 7.618  | 7.794  | 7.829  | 7.863  | 7.563  | 100.0%  | 10    |
-    | nova.boot_servers   | 8.651  | 10.765 | 11.756 | 11.781 | 11.807 | 10.556 | 100.0%  | 10    |
-    | total               | 15.879 | 18.421 | 19.261 | 19.311 | 19.36  | 18.119 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 53.8314111233
-    Full duration: 120.073235035
-
-
-
-    test scenario GlanceImages.create_and_list_image
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | glance.create_image | 7.329 | 7.6    | 7.99   | 8.113  | 8.236 | 7.653 | 100.0%  | 10    |
-    | glance.list_images  | 0.333 | 0.582  | 0.613  | 0.646  | 0.679 | 0.566 | 100.0%  | 10    |
-    | total               | 7.902 | 8.164  | 8.547  | 8.674  | 8.802 | 8.219 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 24.6576690674
-    Full duration: 38.7420179844
-
-
-
-    test scenario GlanceImages.create_and_delete_image
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | glance.create_image | 7.217 | 7.695  | 7.985  | 8.039  | 8.092  | 7.694 | 100.0%  | 10    |
-    | glance.delete_image | 1.995 | 2.137  | 2.493  | 2.608  | 2.722  | 2.22  | 100.0%  | 10    |
-    | total               | 9.374 | 10.024 | 10.211 | 10.289 | 10.367 | 9.914 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 29.6123759747
-    Full duration: 39.9493000507
-
-
-
-    run_rally - INFO - Test scenario: "glance" OK.
-
-    run_rally - INFO - Starting test scenario "cinder" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  b1aa2d13-0f7a-4bff-8331-81336fed8893: started
-    Task b1aa2d13-0f7a-4bff-8331-81336fed8893: finished
-
-    test scenario CinderVolumes.create_and_attach_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server     | 6.503  | 8.078  | 8.609  | 8.703  | 8.796  | 7.961  | 100.0%  | 10    |
-    | cinder.create_volume | 3.188  | 3.68   | 3.956  | 3.978  | 4.0    | 3.679  | 100.0%  | 10    |
-    | nova.attach_volume   | 3.64   | 4.357  | 6.302  | 6.474  | 6.646  | 4.857  | 100.0%  | 10    |
-    | nova.detach_volume   | 3.578  | 3.916  | 4.783  | 4.818  | 4.854  | 4.034  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.561  | 1.816  | 3.1    | 3.132  | 3.165  | 1.823  | 100.0%  | 10    |
-    | nova.delete_server   | 2.774  | 2.91   | 3.153  | 3.263  | 3.373  | 2.961  | 100.0%  | 10    |
-    | total                | 22.849 | 25.428 | 26.942 | 27.99  | 29.037 | 25.315 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 75.149212122
-    Full duration: 118.157259941
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 7.83  | 9.929  | 10.531 | 10.536 | 10.541 | 9.772  | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.08  | 0.374  | 0.44   | 0.453  | 0.465  | 0.361  | 100.0%  | 10    |
-    | total                | 8.172 | 10.346 | 10.952 | 10.96  | 10.967 | 10.134 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 29.4478600025
-    Full duration: 52.5886940956
-
-
-
-    test scenario CinderVolumes.create_and_list_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.301 | 3.843  | 4.226  | 4.357  | 4.488 | 3.882 | 100.0%  | 10    |
-    | cinder.list_volumes  | 0.053 | 0.331  | 0.398  | 0.398  | 0.398 | 0.273 | 100.0%  | 10    |
-    | total                | 3.637 | 4.144  | 4.619  | 4.733  | 4.847 | 4.156 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 12.4273290634
-    Full duration: 34.9144048691
-
-
-
-    test scenario CinderVolumes.create_and_list_snapshots
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 2.946 | 3.307  | 3.538  | 3.549  | 3.56  | 3.273 | 100.0%  | 10    |
-    | cinder.list_snapshots  | 0.028 | 0.295  | 0.328  | 0.338  | 0.348 | 0.201 | 100.0%  | 10    |
-    | total                  | 3.176 | 3.555  | 3.638  | 3.662  | 3.686 | 3.474 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 10.5382380486
-    Full duration: 51.362334013
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.624 | 3.895  | 4.231  | 4.281  | 4.331 | 3.947 | 100.0%  | 10    |
-    | cinder.delete_volume | 0.812 | 1.949  | 3.114  | 3.122  | 3.131 | 1.972 | 100.0%  | 10    |
-    | total                | 4.618 | 5.84   | 7.204  | 7.278  | 7.351 | 5.92  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 16.7822580338
-    Full duration: 34.5782420635
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.294  | 9.687  | 9.755  | 9.776  | 9.798  | 9.602  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.832  | 2.037  | 2.912  | 3.099  | 3.287  | 1.974  | 100.0%  | 10    |
-    | total                | 10.153 | 11.549 | 12.579 | 12.706 | 12.832 | 11.576 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 33.8279159069
-    Full duration: 52.5032699108
-
-
-
-    test scenario CinderVolumes.create_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.531 | 3.917  | 4.114  | 4.116  | 4.119 | 3.89  | 100.0%  | 10    |
-    | cinder.delete_volume | 0.795 | 0.992  | 3.094  | 3.232  | 3.371 | 1.405 | 100.0%  | 10    |
-    | total                | 4.55  | 4.893  | 6.895  | 7.065  | 7.235 | 5.295 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 14.6577680111
-    Full duration: 32.7706868649
-
-
-
-    test scenario CinderVolumes.create_and_upload_volume_to_image
-    +-------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                          |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume          | 3.529  | 3.821  | 4.216  | 4.22   | 4.223  | 3.861  | 100.0%  | 10    |
-    | cinder.upload_volume_to_image | 19.02  | 29.858 | 31.714 | 31.91  | 32.105 | 28.579 | 100.0%  | 10    |
-    | cinder.delete_volume          | 0.778  | 2.823  | 3.199  | 3.243  | 3.288  | 2.495  | 100.0%  | 10    |
-    | nova.delete_image             | 2.394  | 2.794  | 4.071  | 9.486  | 14.9   | 3.949  | 100.0%  | 10    |
-    | total                         | 28.359 | 39.027 | 42.376 | 45.938 | 49.5   | 38.885 | 100.0%  | 10    |
-    +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 119.134256124
-    Full duration: 139.814013958
-
-
-
-    test scenario CinderVolumes.create_and_delete_snapshot
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_snapshot | 3.047 | 3.312  | 3.751  | 4.588  | 5.426 | 3.504 | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.515 | 2.959  | 3.129  | 3.134  | 3.139 | 2.904 | 100.0%  | 10    |
-    | total                  | 5.93  | 6.273  | 6.77   | 7.355  | 7.941 | 6.408 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 18.6710958481
-    Full duration: 52.810079813
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.645 | 3.983  | 4.278  | 4.284  | 4.291 | 4.015 | 100.0%  | 10    |
-    | total                | 3.645 | 3.983  | 4.278  | 4.284  | 4.291 | 4.015 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.9593629837
-    Full duration: 30.0458798409
-
-
-
-    test scenario CinderVolumes.create_volume
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.5 | 4.11   | 4.423  | 4.479  | 4.535 | 4.045 | 100.0%  | 10    |
-    | total                | 3.5 | 4.11   | 4.423  | 4.479  | 4.535 | 4.045 | 100.0%  | 10    |
-    +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 11.9883899689
-    Full duration: 34.5793349743
-
-
-
-    test scenario CinderVolumes.list_volumes
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.list_volumes | 0.527 | 0.566  | 0.622  | 0.634  | 0.647 | 0.579 | 100.0%  | 10    |
-    | total               | 0.527 | 0.566  | 0.622  | 0.635  | 0.647 | 0.579 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.71377515793
-    Full duration: 66.8403449059
-
-
-
-    test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.423  | 3.79   | 4.204  | 4.228  | 4.253  | 3.832  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.595  | 2.914  | 3.105  | 3.107  | 3.109  | 2.93   | 100.0%  | 10    |
-    | nova.attach_volume     | 3.943  | 6.629  | 7.921  | 8.552  | 9.183  | 6.368  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.275  | 3.933  | 4.098  | 4.151  | 4.204  | 3.813  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.26   | 2.576  | 3.109  | 3.173  | 3.237  | 2.627  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.572  | 2.766  | 2.935  | 3.011  | 3.086  | 2.543  | 100.0%  | 10    |
-    | total                  | 20.778 | 22.953 | 25.368 | 26.28  | 27.193 | 23.194 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 69.8529119492
-    Full duration: 173.89911294
-
-
-
-    test scenario CinderVolumes.create_from_volume_and_delete_volume
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | cinder.create_volume | 3.664 | 3.994  | 4.4    | 4.405  | 4.411 | 4.043 | 100.0%  | 10    |
-    | cinder.delete_volume | 2.706 | 3.262  | 3.503  | 3.525  | 3.547 | 3.211 | 100.0%  | 10    |
-    | total                | 6.956 | 7.239  | 7.437  | 7.513  | 7.589 | 7.254 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 21.7929730415
-    Full duration: 56.4282138348
-
-
-
-    test scenario CinderVolumes.create_and_extend_volume
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 3.519 | 3.91   | 4.25   | 4.293  | 4.336  | 3.898  | 100.0%  | 10    |
-    | cinder.extend_volume | 0.954 | 3.479  | 3.822  | 3.974  | 4.126  | 3.266  | 100.0%  | 10    |
-    | cinder.delete_volume | 2.743 | 3.002  | 3.324  | 3.34   | 3.356  | 3.018  | 100.0%  | 10    |
-    | total                | 8.353 | 10.523 | 10.792 | 10.838 | 10.885 | 10.182 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 30.6360728741
-    Full duration: 49.9283909798
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.39   | 3.97   | 4.263  | 4.45   | 4.638  | 3.957  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.608  | 3.069  | 3.308  | 3.31   | 3.312  | 3.012  | 100.0%  | 10    |
-    | nova.attach_volume     | 4.043  | 5.478  | 7.465  | 8.181  | 8.896  | 5.734  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.111  | 3.712  | 4.231  | 4.297  | 4.362  | 3.748  | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.272  | 2.63   | 2.889  | 3.032  | 3.174  | 2.679  | 100.0%  | 10    |
-    | cinder.delete_volume   | 0.594  | 2.64   | 3.158  | 3.173  | 3.187  | 2.251  | 100.0%  | 10    |
-    | total                  | 18.408 | 23.294 | 24.568 | 24.632 | 24.697 | 22.576 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 68.1245191097
-    Full duration: 178.916586161
-
-
-
-    test scenario CinderVolumes.create_snapshot_and_attach_volume
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume   | 3.136  | 3.923  | 4.27   | 4.334  | 4.398  | 3.903  | 100.0%  | 10    |
-    | cinder.create_snapshot | 2.708  | 2.894  | 3.269  | 3.309  | 3.348  | 2.997  | 100.0%  | 10    |
-    | nova.attach_volume     | 3.853  | 5.659  | 9.176  | 9.424  | 9.673  | 6.046  | 100.0%  | 10    |
-    | nova.detach_volume     | 3.349  | 3.857  | 4.334  | 4.582  | 4.829  | 3.88   | 100.0%  | 10    |
-    | cinder.delete_snapshot | 2.261  | 2.578  | 3.148  | 3.183  | 3.219  | 2.687  | 100.0%  | 10    |
-    | cinder.delete_volume   | 2.584  | 2.856  | 3.08   | 3.208  | 3.335  | 2.877  | 100.0%  | 10    |
-    | total                  | 21.769 | 23.113 | 27.189 | 27.9   | 28.611 | 24.037 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 69.8956279755
-    Full duration: 185.589872122
-
-
-
-    run_rally - INFO - Test scenario: "cinder" OK.
-
-    run_rally - INFO - Starting test scenario "heat" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  6323c0be-a020-4b31-99f0-846288593cf5: started
-    Task 6323c0be-a020-4b31-99f0-846288593cf5: finished
-
-    test scenario HeatStacks.create_suspend_resume_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action             | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack  | 3.897 | 4.064  | 4.38   | 4.573  | 4.766  | 4.148 | 100.0%  | 10    |
-    | heat.suspend_stack | 0.856 | 1.754  | 2.035  | 2.047  | 2.058  | 1.584 | 100.0%  | 10    |
-    | heat.resume_stack  | 1.455 | 1.659  | 1.714  | 1.716  | 1.718  | 1.62  | 100.0%  | 10    |
-    | heat.delete_stack  | 1.394 | 1.581  | 2.739  | 2.752  | 2.765  | 1.784 | 100.0%  | 10    |
-    | total              | 8.071 | 9.183  | 10.285 | 10.314 | 10.344 | 9.135 | 100.0%  | 10    |
-    +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 27.614921093
-    Full duration: 38.014703989
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.032 | 4.108  | 4.322  | 4.37   | 4.419 | 4.169 | 100.0%  | 10    |
-    | heat.delete_stack | 1.408 | 1.463  | 1.821  | 2.204  | 2.588 | 1.599 | 100.0%  | 10    |
-    | total             | 5.497 | 5.706  | 5.963  | 6.33   | 6.698 | 5.768 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 17.1844079494
-    Full duration: 27.193780899
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 22.283 | 23.81  | 24.26  | 24.642 | 25.023 | 23.576 | 100.0%  | 10    |
-    | heat.delete_stack | 10.675 | 11.83  | 13.071 | 13.072 | 13.073 | 12.167 | 100.0%  | 10    |
-    | total             | 33.542 | 35.738 | 36.805 | 36.843 | 36.881 | 35.743 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 107.773921967
-    Full duration: 118.200341225
-
-
-
-    test scenario HeatStacks.create_and_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 18.184 | 20.407 | 21.635 | 21.85  | 22.065 | 20.2  | 100.0%  | 10    |
-    | heat.delete_stack | 10.601 | 10.722 | 11.882 | 11.945 | 12.008 | 11.03 | 100.0%  | 10    |
-    | total             | 28.903 | 31.02  | 33.025 | 33.24  | 33.455 | 31.23 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 92.4247808456
-    Full duration: 102.624263048
-
-
-
-    test scenario HeatStacks.list_stacks_and_resources
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.list_stacks                | 0.493 | 0.534  | 0.591  | 0.604  | 0.617 | 0.542 | 100.0%  | 10    |
-    | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-    | total                           | 0.493 | 0.534  | 0.592  | 0.604  | 0.617 | 0.542 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.70831894875
-    Full duration: 10.6722428799
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.142 | 4.331  | 4.481  | 4.527  | 4.573  | 4.327  | 100.0%  | 10    |
-    | heat.update_stack | 3.575 | 3.673  | 3.746  | 3.752  | 3.758  | 3.674  | 100.0%  | 10    |
-    | heat.delete_stack | 1.9   | 2.609  | 2.795  | 2.836  | 2.877  | 2.6    | 100.0%  | 10    |
-    | total             | 9.714 | 10.635 | 10.858 | 10.879 | 10.899 | 10.601 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 32.1056320667
-    Full duration: 42.6386361122
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 4.12  | 4.273  | 4.323  | 4.33   | 4.336  | 4.247 | 100.0%  | 10    |
-    | heat.update_stack | 3.504 | 3.594  | 3.722  | 3.741  | 3.76   | 3.615 | 100.0%  | 10    |
-    | heat.delete_stack | 1.391 | 1.433  | 1.71   | 2.139  | 2.568  | 1.584 | 100.0%  | 10    |
-    | total             | 9.04  | 9.38   | 9.599  | 10.09  | 10.581 | 9.447 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 29.2272830009
-    Full duration: 40.1677620411
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 3.97   | 4.292  | 4.415  | 4.448  | 4.481  | 4.271  | 100.0%  | 10    |
-    | heat.update_stack | 5.842  | 5.898  | 5.997  | 6.123  | 6.248  | 5.932  | 100.0%  | 10    |
-    | heat.delete_stack | 2.495  | 2.556  | 3.706  | 3.713  | 3.721  | 2.769  | 100.0%  | 10    |
-    | total             | 12.606 | 12.776 | 13.842 | 13.936 | 14.029 | 12.972 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 39.4572560787
-    Full duration: 50.1925730705
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max   | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-    | heat.create_stack | 4.629  | 5.407  | 5.516  | 5.7    | 5.884 | 5.364  | 100.0%  | 10    |
-    | heat.update_stack | 8.444  | 9.309  | 9.353  | 9.359  | 9.365 | 9.16   | 100.0%  | 10    |
-    | heat.delete_stack | 3.645  | 3.715  | 3.749  | 3.76   | 3.771 | 3.715  | 100.0%  | 10    |
-    | total             | 17.585 | 18.448 | 18.542 | 18.731 | 18.92 | 18.239 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+-------+--------+---------+-------+
-    Load duration: 54.5839819908
-    Full duration: 66.1476221085
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | heat.create_stack | 4.153  | 4.42   | 4.537  | 4.626  | 4.716  | 4.414  | 100.0%  | 10    |
-    | heat.update_stack | 5.756  | 5.867  | 5.968  | 5.986  | 6.003  | 5.879  | 100.0%  | 10    |
-    | heat.delete_stack | 2.537  | 2.569  | 3.682  | 3.771  | 3.859  | 2.812  | 100.0%  | 10    |
-    | total             | 12.735 | 12.934 | 13.781 | 13.841 | 13.901 | 13.105 | 100.0%  | 10    |
-    +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 39.6327600479
-    Full duration: 51.5351819992
-
-
-
-    test scenario HeatStacks.create_update_delete_stack
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | heat.create_stack | 4.216 | 4.41   | 4.524  | 4.563  | 4.602  | 4.398 | 100.0%  | 10    |
-    | heat.update_stack | 3.532 | 3.608  | 3.773  | 3.784  | 3.795  | 3.634 | 100.0%  | 10    |
-    | heat.delete_stack | 1.377 | 1.48   | 2.549  | 2.553  | 2.557  | 1.868 | 100.0%  | 10    |
-    | total             | 9.266 | 9.676  | 10.603 | 10.665 | 10.728 | 9.9   | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 29.3563029766
-    Full duration: 41.178768158
-
-
-
-    test scenario HeatStacks.create_and_list_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.154 | 4.25   | 4.32   | 4.358  | 4.396 | 4.255 | 100.0%  | 10    |
-    | heat.list_stacks  | 0.074 | 0.097  | 0.126  | 0.128  | 0.13  | 0.104 | 100.0%  | 10    |
-    | total             | 4.279 | 4.357  | 4.412  | 4.448  | 4.484 | 4.359 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 13.1276688576
-    Full duration: 29.3930869102
-
-
-
-    test scenario HeatStacks.create_check_delete_stack
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | heat.create_stack | 4.092 | 4.317  | 4.556  | 4.566  | 4.577 | 4.328 | 100.0%  | 10    |
-    | heat.check_stack  | 1.476 | 1.524  | 1.598  | 1.722  | 1.845 | 1.56  | 100.0%  | 10    |
-    | heat.delete_stack | 1.38  | 2.515  | 2.587  | 2.689  | 2.791 | 2.103 | 100.0%  | 10    |
-    | total             | 7.059 | 8.243  | 8.619  | 8.666  | 8.713 | 7.99  | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 24.3825399876
-    Full duration: 35.8954949379
-
-
-
-    run_rally - INFO - Test scenario: "heat" OK.
-
-    run_rally - INFO - Starting test scenario "keystone" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  01416586-e6ad-4e3a-a1a2-6fc6305bbaea: started
-    Task 01416586-e6ad-4e3a-a1a2-6fc6305bbaea: finished
-
-    test scenario KeystoneBasic.create_tenant_with_users
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.27  | 0.298  | 0.409  | 0.435  | 0.46  | 0.321 | 100.0%  | 10    |
-    | keystone.create_users  | 1.62  | 1.702  | 1.784  | 1.8    | 1.816 | 1.71  | 100.0%  | 10    |
-    | total                  | 1.925 | 2.027  | 2.126  | 2.152  | 2.178 | 2.031 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 6.16570997238
-    Full duration: 22.7167549133
-
-
-
-    test scenario KeystoneBasic.create_add_and_list_user_roles
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.266 | 0.303  | 0.411  | 0.414  | 0.418 | 0.326 | 100.0%  | 10    |
-    | keystone.add_role    | 0.268 | 0.295  | 0.314  | 0.344  | 0.373 | 0.3   | 100.0%  | 10    |
-    | keystone.list_roles  | 0.148 | 0.159  | 0.168  | 0.169  | 0.17  | 0.158 | 100.0%  | 10    |
-    | total                | 0.695 | 0.767  | 0.865  | 0.868  | 0.872 | 0.784 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.35486006737
-    Full duration: 15.306978941
-
-
-
-    test scenario KeystoneBasic.add_and_remove_user_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.29  | 0.387  | 0.421  | 0.453  | 0.485 | 0.366 | 100.0%  | 10    |
-    | keystone.add_role    | 0.258 | 0.281  | 0.337  | 0.355  | 0.373 | 0.294 | 100.0%  | 10    |
-    | keystone.remove_role | 0.164 | 0.171  | 0.231  | 0.302  | 0.373 | 0.197 | 100.0%  | 10    |
-    | total                | 0.747 | 0.827  | 0.964  | 1.078  | 1.191 | 0.857 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.82508516312
-    Full duration: 16.1954729557
-
-
-
-    test scenario KeystoneBasic.create_update_and_delete_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.258 | 0.319  | 0.527  | 0.533  | 0.538 | 0.37  | 100.0%  | 10    |
-    | keystone.update_tenant | 0.138 | 0.159  | 0.258  | 0.263  | 0.269 | 0.18  | 100.0%  | 10    |
-    | keystone.delete_tenant | 0.319 | 0.34   | 0.454  | 0.455  | 0.455 | 0.371 | 100.0%  | 10    |
-    | total                  | 0.776 | 0.89   | 1.119  | 1.121  | 1.124 | 0.922 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.63998699188
-    Full duration: 14.1927289963
-
-
-
-    test scenario KeystoneBasic.create_and_delete_service
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_service | 0.278 | 0.299  | 0.315  | 0.315  | 0.316 | 0.3   | 100.0%  | 10    |
-    | keystone.delete_service | 0.15  | 0.17   | 0.241  | 0.247  | 0.253 | 0.182 | 100.0%  | 10    |
-    | total                   | 0.434 | 0.481  | 0.533  | 0.538  | 0.544 | 0.482 | 100.0%  | 10    |
-    +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.47481298447
-    Full duration: 13.4397730827
-
-
-
-    test scenario KeystoneBasic.create_tenant
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.301 | 0.315  | 0.339  | 0.384  | 0.429 | 0.325 | 100.0%  | 10    |
-    | total                  | 0.301 | 0.316  | 0.339  | 0.384  | 0.429 | 0.325 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.985784053802
-    Full duration: 9.20213198662
-
-
-
-    test scenario KeystoneBasic.create_user
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +----------------------+------+--------+--------+--------+-------+------+---------+-------+
-    | action               | min  | median | 90%ile | 95%ile | max   | avg  | success | count |
-    +----------------------+------+--------+--------+--------+-------+------+---------+-------+
-    | keystone.create_user | 0.31 | 0.315  | 0.333  | 0.333  | 0.333 | 0.32 | 100.0%  | 10    |
-    | total                | 0.31 | 0.315  | 0.333  | 0.333  | 0.333 | 0.32 | 100.0%  | 10    |
-    +----------------------+------+--------+--------+--------+-------+------+---------+-------+
-    Load duration: 1.00818705559
-    Full duration: 9.22635006905
-
-
-
-    test scenario KeystoneBasic.create_and_list_tenants
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.287 | 0.304  | 0.325  | 0.327  | 0.329 | 0.306 | 100.0%  | 10    |
-    | keystone.list_tenants  | 0.127 | 0.136  | 0.153  | 0.157  | 0.16  | 0.139 | 100.0%  | 10    |
-    | total                  | 0.42  | 0.445  | 0.462  | 0.466  | 0.469 | 0.445 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.36337804794
-    Full duration: 14.8872029781
-
-
-
-    test scenario KeystoneBasic.create_and_delete_role
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_role | 0.282 | 0.386  | 0.408  | 0.422  | 0.436 | 0.365 | 100.0%  | 10    |
-    | keystone.delete_role | 0.268 | 0.3    | 0.401  | 0.491  | 0.581 | 0.334 | 100.0%  | 10    |
-    | total                | 0.575 | 0.677  | 0.804  | 0.911  | 1.018 | 0.699 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.04137206078
-    Full duration: 14.1024041176
-
-
-
-    test scenario KeystoneBasic.get_entities
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_tenant | 0.286 | 0.308  | 0.319  | 0.328  | 0.336 | 0.307 | 100.0%  | 10    |
-    | keystone.create_user   | 0.143 | 0.156  | 0.164  | 0.167  | 0.17  | 0.157 | 100.0%  | 10    |
-    | keystone.create_role   | 0.135 | 0.143  | 0.175  | 0.19   | 0.204 | 0.151 | 100.0%  | 10    |
-    | keystone.get_tenant    | 0.117 | 0.13   | 0.135  | 0.136  | 0.138 | 0.129 | 100.0%  | 10    |
-    | keystone.get_user      | 0.127 | 0.15   | 0.222  | 0.227  | 0.232 | 0.162 | 100.0%  | 10    |
-    | keystone.get_role      | 0.12  | 0.132  | 0.144  | 0.154  | 0.164 | 0.134 | 100.0%  | 10    |
-    | keystone.service_list  | 0.125 | 0.138  | 0.243  | 0.244  | 0.245 | 0.164 | 100.0%  | 10    |
-    | keystone.get_service   | 0.124 | 0.133  | 0.153  | 0.194  | 0.235 | 0.143 | 100.0%  | 10    |
-    | total                  | 1.279 | 1.333  | 1.411  | 1.47   | 1.528 | 1.345 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.00930905342
-    Full duration: 20.4269800186
-
-
-
-    test scenario KeystoneBasic.create_and_list_users
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | keystone.create_user | 0.295 | 0.304  | 0.332  | 0.342  | 0.351 | 0.311 | 100.0%  | 10    |
-    | keystone.list_users  | 0.127 | 0.146  | 0.162  | 0.201  | 0.24  | 0.151 | 100.0%  | 10    |
-    | total                | 0.422 | 0.458  | 0.506  | 0.523  | 0.539 | 0.462 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.42111587524
-    Full duration: 9.87036585808
-
-
-
-    run_rally - INFO - Test scenario: "keystone" OK.
-
-    run_rally - INFO - Starting test scenario "neutron" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  31a75089-836c-4dd2-bea5-146049608ff3: started
-    Task 31a75089-836c-4dd2-bea5-146049608ff3: finished
-
-    test scenario NeutronNetworks.create_and_delete_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.763 | 0.911  | 1.019  | 1.048  | 1.078 | 0.909 | 100.0%  | 10    |
-    | neutron.delete_port | 0.237 | 0.633  | 0.682  | 0.717  | 0.752 | 0.534 | 100.0%  | 10    |
-    | total               | 1.07  | 1.489  | 1.683  | 1.704  | 1.726 | 1.443 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.20432686806
-    Full duration: 54.8132340908
-
-
-
-    test scenario NeutronNetworks.create_and_list_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.762 | 0.836  | 0.949  | 0.98   | 1.011 | 0.863 | 100.0%  | 10    |
-    | neutron.create_router        | 0.066 | 0.493  | 0.686  | 0.691  | 0.695 | 0.459 | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.262 | 0.695  | 0.795  | 0.844  | 0.892 | 0.637 | 100.0%  | 10    |
-    | neutron.list_routers         | 0.039 | 0.407  | 0.441  | 0.452  | 0.462 | 0.308 | 100.0%  | 10    |
-    | total                        | 1.54  | 2.352  | 2.744  | 2.824  | 2.904 | 2.268 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.36094808578
-    Full duration: 61.3011310101
-
-
-
-    test scenario NeutronNetworks.create_and_delete_routers
-    +------------------------------------------------------------------------------------------------------+
-    |                                         Response Times (sec)                                         |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet           | 0.79  | 0.836  | 0.945  | 1.009  | 1.072 | 0.868 | 100.0%  | 10    |
-    | neutron.create_router           | 0.074 | 0.436  | 0.479  | 0.499  | 0.518 | 0.377 | 100.0%  | 10    |
-    | neutron.add_interface_router    | 0.284 | 0.545  | 0.739  | 0.812  | 0.886 | 0.527 | 100.0%  | 10    |
-    | neutron.remove_interface_router | 0.221 | 0.615  | 0.709  | 0.724  | 0.739 | 0.518 | 100.0%  | 10    |
-    | neutron.delete_router           | 0.187 | 0.566  | 0.709  | 0.751  | 0.793 | 0.508 | 100.0%  | 10    |
-    | total                           | 2.124 | 2.811  | 3.347  | 3.379  | 3.412 | 2.799 | 100.0%  | 10    |
-    +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 8.68784189224
-    Full duration: 59.8806409836
-
-
-
-    test scenario NeutronNetworks.create_and_list_ports
-    +-----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
-    +---------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    | neutron.create_port | 0.777 | 0.895  | 0.981  | 1.01   | 1.039 | 0.89 | 100.0%  | 10    |
-    | neutron.list_ports  | 0.525 | 0.678  | 0.726  | 0.735  | 0.743 | 0.65 | 100.0%  | 10    |
-    | total               | 1.351 | 1.564  | 1.694  | 1.729  | 1.764 | 1.54 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+------+---------+-------+
-    Load duration: 4.66481399536
-    Full duration: 56.677120924
-
-
-
-    test scenario NeutronNetworks.create_and_delete_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.785 | 0.926  | 1.065  | 1.065  | 1.065 | 0.914 | 100.0%  | 10    |
-    | neutron.delete_subnet | 0.193 | 0.762  | 0.952  | 1.035  | 1.117 | 0.745 | 100.0%  | 10    |
-    | total                 | 1.258 | 1.702  | 1.876  | 1.903  | 1.929 | 1.659 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 5.09031915665
-    Full duration: 56.7336909771
-
-
-
-    test scenario NeutronNetworks.create_and_delete_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.614 | 0.708  | 0.774  | 0.81   | 0.847 | 0.712 | 100.0%  | 10    |
-    | neutron.delete_network | 0.144 | 0.554  | 0.592  | 0.645  | 0.698 | 0.489 | 100.0%  | 10    |
-    | total                  | 0.809 | 1.248  | 1.41   | 1.418  | 1.427 | 1.202 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.66986989975
-    Full duration: 34.80159688
-
-
-
-    test scenario NeutronNetworks.create_and_list_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.627 | 0.707  | 0.85   | 0.851  | 0.853 | 0.719 | 100.0%  | 10    |
-    | neutron.list_networks  | 0.059 | 0.439  | 0.513  | 0.515  | 0.518 | 0.413 | 100.0%  | 10    |
-    | total                  | 0.909 | 1.126  | 1.242  | 1.306  | 1.371 | 1.132 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.38921308517
-    Full duration: 36.8345379829
-
-
-
-    test scenario NeutronNetworks.create_and_update_routers
-    +---------------------------------------------------------------------------------------------------+
-    |                                       Response Times (sec)                                        |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet        | 0.751 | 0.824  | 0.876  | 0.921  | 0.967 | 0.832 | 100.0%  | 10    |
-    | neutron.create_router        | 0.431 | 0.473  | 0.541  | 0.577  | 0.613 | 0.489 | 100.0%  | 10    |
-    | neutron.add_interface_router | 0.301 | 0.711  | 0.928  | 1.08   | 1.231 | 0.684 | 100.0%  | 10    |
-    | neutron.update_router        | 0.48  | 0.514  | 0.703  | 0.74   | 0.778 | 0.579 | 100.0%  | 10    |
-    | total                        | 2.062 | 2.629  | 2.871  | 3.084  | 3.298 | 2.584 | 100.0%  | 10    |
-    +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 7.65487504005
-    Full duration: 63.1229610443
-
-
-
-    test scenario NeutronNetworks.create_and_update_networks
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_network | 0.656 | 0.719  | 1.152  | 1.152  | 1.153 | 0.796 | 100.0%  | 10    |
-    | neutron.update_network | 0.136 | 0.33   | 0.656  | 0.684  | 0.711 | 0.37  | 100.0%  | 10    |
-    | total                  | 0.793 | 1.067  | 1.71   | 1.757  | 1.803 | 1.166 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.25723409653
-    Full duration: 35.7245519161
-
-
-
-    test scenario NeutronNetworks.create_and_update_ports
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_port | 0.757 | 0.871  | 0.937  | 0.949  | 0.961 | 0.872 | 100.0%  | 10    |
-    | neutron.update_port | 0.152 | 0.553  | 0.69   | 0.695  | 0.7   | 0.449 | 100.0%  | 10    |
-    | total               | 1.013 | 1.374  | 1.562  | 1.591  | 1.621 | 1.322 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.26963686943
-    Full duration: 56.3142960072
-
-
-
-    test scenario NeutronNetworks.create_and_list_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.759 | 0.838  | 0.884  | 0.921  | 0.959 | 0.833 | 100.0%  | 10    |
-    | neutron.list_subnets  | 0.419 | 0.437  | 0.474  | 0.504  | 0.535 | 0.447 | 100.0%  | 10    |
-    | total                 | 1.205 | 1.29   | 1.325  | 1.352  | 1.379 | 1.281 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.90167307854
-    Full duration: 56.5125339031
-
-
-
-    test scenario NeutronNetworks.create_and_update_subnets
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | neutron.create_subnet | 0.739 | 0.86   | 0.894  | 0.899  | 0.904 | 0.847 | 100.0%  | 10    |
-    | neutron.update_subnet | 0.215 | 0.626  | 0.747  | 0.751  | 0.754 | 0.619 | 100.0%  | 10    |
-    | total                 | 0.992 | 1.503  | 1.597  | 1.604  | 1.611 | 1.466 | 100.0%  | 10    |
-    +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 4.40182685852
-    Full duration: 57.6830070019
-
-
-
-    run_rally - INFO - Test scenario: "neutron" OK.
-
-    run_rally - INFO - Starting test scenario "nova" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  584052d3-7a9b-44cb-b72b-0fa69c80ff0f: started
-    Task 584052d3-7a9b-44cb-b72b-0fa69c80ff0f: finished
-
-    test scenario NovaKeypair.create_and_delete_keypair
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.784 | 0.836  | 1.474  | 1.484  | 1.495 | 0.974 | 100.0%  | 10    |
-    | nova.delete_keypair | 0.034 | 0.05   | 0.055  | 0.057  | 0.058 | 0.047 | 100.0%  | 10    |
-    | total               | 0.832 | 0.883  | 1.529  | 1.541  | 1.553 | 1.022 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.34695100784
-    Full duration: 45.7756779194
-
-
-
-    test scenario NovaServers.snapshot_server
-    +------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                      |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server       | 7.554  | 10.346 | 11.835 | 11.965 | 12.095 | 10.244 | 100.0%  | 10    |
-    | nova.create_image      | 11.631 | 12.185 | 12.844 | 13.707 | 14.57  | 12.355 | 100.0%  | 10    |
-    | nova.delete_server     | 2.863  | 3.258  | 3.364  | 3.387  | 3.409  | 3.184  | 100.0%  | 10    |
-    | nova.boot_server (2)   | 7.672  | 8.531  | 9.58   | 9.806  | 10.032 | 8.647  | 100.0%  | 10    |
-    | nova.delete_server (2) | 2.536  | 2.983  | 3.338  | 3.367  | 3.396  | 3.003  | 100.0%  | 10    |
-    | nova.delete_image      | 2.294  | 3.138  | 3.917  | 3.949  | 3.981  | 3.199  | 100.0%  | 10    |
-    | total                  | 37.226 | 39.77  | 43.868 | 44.502 | 45.136 | 40.632 | 100.0%  | 10    |
-    +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 120.862003088
-    Full duration: 196.742653131
-
-
-
-    test scenario NovaKeypair.boot_and_delete_server_with_keypair
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_keypair | 0.722  | 0.911  | 1.196  | 1.303  | 1.41   | 0.932  | 100.0%  | 10    |
-    | nova.boot_server    | 8.584  | 9.058  | 10.234 | 10.397 | 10.559 | 9.363  | 100.0%  | 10    |
-    | nova.delete_server  | 2.535  | 3.3    | 3.362  | 3.407  | 3.453  | 3.174  | 100.0%  | 10    |
-    | nova.delete_keypair | 0.037  | 0.048  | 0.055  | 0.057  | 0.059  | 0.049  | 100.0%  | 10    |
-    | total               | 12.316 | 13.426 | 14.867 | 14.936 | 15.006 | 13.518 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 39.9865550995
-    Full duration: 111.508669853
-
-
-
-    test scenario NovaKeypair.create_and_list_keypairs
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.create_keypair | 0.648 | 0.815  | 1.082  | 1.098  | 1.113 | 0.837 | 100.0%  | 10    |
-    | nova.list_keypairs  | 0.019 | 0.028  | 0.042  | 0.042  | 0.042 | 0.03  | 100.0%  | 10    |
-    | total               | 0.674 | 0.84   | 1.113  | 1.126  | 1.139 | 0.868 | 100.0%  | 10    |
-    +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.55701994896
-    Full duration: 46.8838369846
-
-
-
-    test scenario NovaServers.list_servers
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | nova.list_servers | 1.225 | 1.717  | 2.028  | 2.148  | 2.269 | 1.703 | 100.0%  | 10    |
-    | total             | 1.225 | 1.717  | 2.028  | 2.149  | 2.269 | 1.703 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 5.18592405319
-    Full duration: 131.096873999
-
-
-
-    test scenario NovaServers.resize_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 7.681  | 9.106  | 9.667  | 9.855  | 10.043 | 8.967  | 100.0%  | 10    |
-    | nova.resize         | 41.039 | 42.444 | 47.666 | 47.89  | 48.113 | 43.647 | 100.0%  | 10    |
-    | nova.resize_confirm | 3.05   | 3.839  | 5.756  | 5.796  | 5.836  | 4.129  | 100.0%  | 10    |
-    | nova.delete_server  | 2.538  | 2.977  | 3.37   | 3.436  | 3.502  | 2.99   | 100.0%  | 10    |
-    | total               | 56.14  | 58.909 | 63.601 | 64.059 | 64.517 | 59.734 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 175.1216681
-    Full duration: 218.552350998
-
-
-
-    test scenario NovaServers.boot_server_from_volume_and_delete
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 10.051 | 10.651 | 11.762 | 11.824 | 11.885 | 10.8   | 100.0%  | 10    |
-    | nova.boot_server     | 9.377  | 9.86   | 11.429 | 11.996 | 12.563 | 10.33  | 100.0%  | 10    |
-    | nova.delete_server   | 3.706  | 5.644  | 6.192  | 6.201  | 6.209  | 5.374  | 100.0%  | 10    |
-    | total                | 23.576 | 26.289 | 28.117 | 28.514 | 28.911 | 26.505 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 78.3103020191
-    Full duration: 163.452836037
-
-
-
-    test scenario NovaServers.boot_and_migrate_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 8.257  | 9.346  | 10.61  | 10.662 | 10.713 | 9.544  | 100.0%  | 10    |
-    | nova.stop_server    | 4.295  | 6.497  | 7.089  | 7.118  | 7.147  | 6.056  | 100.0%  | 10    |
-    | nova.migrate        | 9.675  | 12.304 | 13.12  | 13.229 | 13.338 | 12.161 | 100.0%  | 10    |
-    | nova.resize_confirm | 3.122  | 3.507  | 4.272  | 4.364  | 4.457  | 3.653  | 100.0%  | 10    |
-    | nova.delete_server  | 2.554  | 3.188  | 3.429  | 3.496  | 3.562  | 3.139  | 100.0%  | 10    |
-    | total               | 32.033 | 35.063 | 36.096 | 36.58  | 37.064 | 34.553 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 105.193811893
-    Full duration: 148.141517878
-
-
-
-    test scenario NovaServers.boot_and_delete_server
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server   | 8.014  | 9.185  | 9.831  | 10.523 | 11.215 | 9.243  | 100.0%  | 10    |
-    | nova.delete_server | 2.908  | 3.295  | 3.466  | 3.472  | 3.478  | 3.254  | 100.0%  | 10    |
-    | total              | 11.295 | 12.557 | 13.028 | 13.839 | 14.649 | 12.498 | 100.0%  | 10    |
-    +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 36.6073288918
-    Full duration: 109.97128582
-
-
-
-    test scenario NovaServers.boot_and_rebuild_server
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server    | 7.698  | 9.483  | 10.427 | 10.794 | 11.162 | 9.37   | 100.0%  | 10    |
-    | nova.rebuild_server | 8.598  | 9.448  | 10.319 | 10.378 | 10.438 | 9.551  | 100.0%  | 10    |
-    | nova.delete_server  | 2.858  | 3.099  | 3.428  | 3.623  | 3.817  | 3.161  | 100.0%  | 10    |
-    | total               | 20.044 | 22.42  | 23.365 | 23.559 | 23.752 | 22.083 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 64.9432969093
-    Full duration: 139.465661049
-
-
-
-    test scenario NovaSecGroup.create_and_list_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.683  | 5.344  | 5.852  | 5.859  | 5.866  | 5.356  | 100.0%  | 10    |
-    | nova.create_100_rules          | 42.414 | 45.678 | 47.163 | 47.368 | 47.574 | 45.254 | 100.0%  | 10    |
-    | nova.list_security_groups      | 0.175  | 0.212  | 0.354  | 0.608  | 0.863  | 0.283  | 100.0%  | 10    |
-    | total                          | 47.348 | 51.421 | 52.56  | 52.638 | 52.716 | 50.893 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 151.312942028
-    Full duration: 221.151799202
-
-
-
-    test scenario NovaSecGroup.create_and_delete_secgroups
-    +--------------------------------------------------------------------------------------------------------+
-    |                                          Response Times (sec)                                          |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups | 4.207  | 5.153  | 5.865  | 6.016  | 6.167  | 5.223  | 100.0%  | 10    |
-    | nova.create_100_rules          | 44.426 | 45.496 | 46.391 | 46.57  | 46.749 | 45.514 | 100.0%  | 10    |
-    | nova.delete_10_security_groups | 1.719  | 2.314  | 3.033  | 3.409  | 3.786  | 2.461  | 100.0%  | 10    |
-    | total                          | 51.911 | 53.27  | 54.098 | 54.11  | 54.121 | 53.199 | 100.0%  | 10    |
-    +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 158.767210007
-    Full duration: 204.404190063
-
-
-
-    test scenario NovaServers.boot_and_bounce_server
-    +-------------------------------------------------------------------------------------------------+
-    |                                      Response Times (sec)                                       |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                  | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server        | 8.232  | 10.238 | 11.257 | 11.387 | 11.516 | 9.989  | 100.0%  | 10    |
-    | nova.reboot_server      | 5.292  | 6.196  | 8.351  | 8.675  | 8.999  | 6.856  | 100.0%  | 10    |
-    | nova.soft_reboot_server | 7.958  | 8.738  | 8.914  | 8.918  | 8.923  | 8.624  | 100.0%  | 10    |
-    | nova.stop_server        | 3.374  | 6.332  | 7.13   | 7.453  | 7.776  | 5.867  | 100.0%  | 10    |
-    | nova.start_server       | 2.904  | 4.376  | 4.992  | 5.042  | 5.093  | 4.338  | 100.0%  | 10    |
-    | nova.rescue_server      | 7.695  | 9.49   | 10.886 | 11.148 | 11.409 | 9.448  | 100.0%  | 10    |
-    | nova.unrescue_server    | 5.081  | 5.557  | 7.819  | 8.065  | 8.31   | 5.985  | 100.0%  | 10    |
-    | nova.delete_server      | 2.544  | 3.077  | 3.429  | 3.523  | 3.617  | 3.093  | 100.0%  | 10    |
-    | total                   | 49.625 | 55.207 | 55.707 | 56.454 | 57.202 | 54.222 | 100.0%  | 10    |
-    +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 163.818984032
-    Full duration: 233.215523958
-
-
-
-    test scenario NovaServers.boot_server
-    +----------------------------------------------------------------------------------------+
-    |                                  Response Times (sec)                                  |
-    +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | action           | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    | nova.boot_server | 8.48  | 8.958  | 10.243 | 10.531 | 10.819 | 9.243 | 100.0%  | 10    |
-    | total            | 8.481 | 8.958  | 10.244 | 10.531 | 10.819 | 9.244 | 100.0%  | 10    |
-    +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 27.3609120846
-    Full duration: 84.3593919277
-
-
-
-    test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-    +-----------------------------------------------------------------------------------------------------------+
-    |                                           Response Times (sec)                                            |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.create_10_security_groups    | 4.247  | 5.184  | 5.369  | 5.396  | 5.424  | 5.095  | 100.0%  | 10    |
-    | nova.create_100_rules             | 40.661 | 43.059 | 43.938 | 44.458 | 44.978 | 42.794 | 100.0%  | 10    |
-    | nova.boot_server                  | 6.947  | 8.26   | 9.169  | 9.358  | 9.548  | 8.098  | 100.0%  | 10    |
-    | nova.get_attached_security_groups | 0.225  | 0.263  | 0.273  | 0.293  | 0.313  | 0.26   | 100.0%  | 10    |
-    | nova.delete_server                | 2.528  | 2.586  | 2.843  | 2.904  | 2.965  | 2.638  | 100.0%  | 10    |
-    | nova.delete_10_security_groups    | 1.791  | 2.426  | 2.99   | 3.057  | 3.123  | 2.475  | 100.0%  | 10    |
-    | total                             | 59.505 | 61.408 | 62.425 | 63.244 | 64.063 | 61.363 | 100.0%  | 10    |
-    +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 184.570534945
-    Full duration: 253.34465313
-
-
-
-    test scenario NovaServers.pause_and_unpause_server
-    +--------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                    |
-    +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | action              | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
-    +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    | nova.boot_server    | 7.448  | 9.26   | 10.374 | 10.502 | 10.629 | 9.397 | 100.0%  | 10    |
-    | nova.pause_server   | 2.424  | 3.161  | 3.286  | 3.379  | 3.472  | 3.026 | 100.0%  | 10    |
-    | nova.unpause_server | 2.773  | 3.096  | 3.242  | 3.272  | 3.303  | 3.035 | 100.0%  | 10    |
-    | nova.delete_server  | 2.878  | 3.224  | 3.526  | 3.553  | 3.58   | 3.191 | 100.0%  | 10    |
-    | total               | 15.943 | 18.76  | 19.747 | 19.77  | 19.793 | 18.65 | 100.0%  | 10    |
-    +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
-    Load duration: 56.3870060444
-    Full duration: 124.540560007
-
-
-
-    test scenario NovaServers.boot_server_from_volume
-    +----------------------------------------------------------------------------------------------+
-    |                                     Response Times (sec)                                     |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    | cinder.create_volume | 9.453  | 10.083 | 10.563 | 10.801 | 11.039 | 10.104 | 100.0%  | 10    |
-    | nova.boot_server     | 9.213  | 10.415 | 10.885 | 11.116 | 11.346 | 10.301 | 100.0%  | 10    |
-    | total                | 18.667 | 20.779 | 21.44  | 21.628 | 21.816 | 20.405 | 100.0%  | 10    |
-    +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 60.3854188919
-    Full duration: 124.319462061
-
-
-
-    test scenario NovaServers.boot_and_list_server
-    +------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                   |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    | nova.boot_server  | 8.037 | 9.396  | 10.043 | 10.516 | 10.989 | 9.351  | 100.0%  | 10    |
-    | nova.list_servers | 0.654 | 1.026  | 1.113  | 1.156  | 1.198  | 0.988  | 100.0%  | 10    |
-    | total             | 8.984 | 10.311 | 11.119 | 11.575 | 12.032 | 10.339 | 100.0%  | 10    |
-    +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-    Load duration: 31.5458390713
-    Full duration: 114.252287149
-
-
-
-    run_rally - INFO - Test scenario: "nova" OK.
-
-    run_rally - INFO - Starting test scenario "quotas" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  5d3885f2-1759-48e8-9284-c14f3492c4f3: started
-    Task 5d3885f2-1759-48e8-9284-c14f3492c4f3: finished
-
-    test scenario Quotas.cinder_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.126 | 1.235  | 1.607  | 1.612  | 1.618 | 1.297 | 100.0%  | 10    |
-    | total                | 1.126 | 1.235  | 1.607  | 1.613  | 1.618 | 1.297 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 3.74135613441
-    Full duration: 16.1623110771
-
-
-
-    test scenario Quotas.neutron_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.407 | 0.429  | 0.526  | 0.528  | 0.531 | 0.447 | 100.0%  | 10    |
-    | total                | 0.552 | 0.586  | 0.666  | 0.671  | 0.676 | 0.599 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 1.82448792458
-    Full duration: 13.357311964
-
-
-
-    test scenario Quotas.cinder_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 1.093 | 1.146  | 1.27   | 1.276  | 1.282 | 1.177 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.536 | 0.907  | 0.975  | 1.01   | 1.046 | 0.862 | 100.0%  | 10    |
-    | total                | 1.67  | 2.089  | 2.177  | 2.184  | 2.192 | 2.039 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 6.09977889061
-    Full duration: 18.3411080837
-
-
-
-    test scenario Quotas.nova_update_and_delete
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.58  | 0.636  | 0.718  | 0.764  | 0.81  | 0.652 | 100.0%  | 10    |
-    | quotas.delete_quotas | 0.018 | 0.026  | 0.035  | 0.039  | 0.043 | 0.028 | 100.0%  | 10    |
-    | total                | 0.616 | 0.657  | 0.741  | 0.793  | 0.844 | 0.68  | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.00378704071
-    Full duration: 13.8784749508
-
-
-
-    test scenario Quotas.nova_update
-    +-------------------------------------------------------------------------------------------+
-    |                                   Response Times (sec)                                    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | quotas.update_quotas | 0.583 | 0.637  | 0.914  | 1.049  | 1.185 | 0.713 | 100.0%  | 10    |
-    | total                | 0.583 | 0.637  | 0.914  | 1.05   | 1.186 | 0.713 | 100.0%  | 10    |
-    +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 2.00103402138
-    Full duration: 13.8432979584
-
-
-
-    run_rally - INFO - Test scenario: "quotas" OK.
-
-    run_rally - INFO - Starting test scenario "requests" ...
-    run_rally - INFO -
-     Preparing input task
-     Task  6e9ed029-0497-4707-a4d4-c83a848e12e4: started
-    Task 6e9ed029-0497-4707-a4d4-c83a848e12e4: finished
-
-    test scenario HttpRequests.check_random_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 0.044 | 0.183  | 0.349  | 0.376  | 0.402 | 0.201 | 100.0%  | 10    |
-    | total                  | 0.045 | 0.183  | 0.349  | 0.376  | 0.403 | 0.201 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.716305971146
-    Full duration: 5.89718389511
-
-
-
-    test scenario HttpRequests.check_request
-    +---------------------------------------------------------------------------------------------+
-    |                                    Response Times (sec)                                     |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    | requests.check_request | 0.044 | 0.046  | 0.052  | 0.053  | 0.054 | 0.048 | 100.0%  | 10    |
-    | total                  | 0.044 | 0.046  | 0.052  | 0.053  | 0.054 | 0.048 | 100.0%  | 10    |
-    +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-    Load duration: 0.182355165482
-    Full duration: 5.23191189766
-
-
-
-    run_rally - INFO - Test scenario: "requests" OK.
-
-    run_rally - INFO -
-
-
-                         Rally Summary Report
-    +===================+============+===============+===========+
-    | Module            | Duration   | nb. Test Run  | Success   |
-    +===================+============+===============+===========+
-    | authenticate      | 00:58      | 10            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | glance            | 03:31      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | cinder            | 22:25      | 50            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | heat              | 10:53      | 35            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | keystone          | 02:39      | 29            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | neutron           | 10:30      | 31            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | nova              | 44:31      | 61            | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | quotas            | 01:15      | 7             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    | requests          | 00:11      | 2             | 100.00%   |
-    +-------------------+------------+---------------+-----------+
-    +===================+============+===============+===========+
-    | TOTAL:            | 01:36:57   | 232           | 100.00%   |
-    +===================+============+===============+===========+
-
-
-
-SDN Controller
---------------
-
-ONOS
-^^^^
-::
-
-    FUNCTEST.info: Running ONOS test case...
-    FUNCvirNetNB - INFO - Creating component Handle: ONOSrest
-    ******************************
-     CASE INIT
-    ******************************
-
-    ['ONOSrest']
-
-    ******************************
-     Result summary for Testcase2
-    ******************************
-
-    [2016-02-21 09:55:56.965174] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Network Post
-    [2016-02-21 09:55:56.965727] [FUNCvirNetNB] [STEP]  2.1: Generate Post Data
-    [2016-02-21 09:55:56.966454] [FUNCvirNetNB] [STEP]  2.2: Post Data via HTTP
-    [2016-02-21 09:55:57.006264] [FUNCvirNetNB] [STEP]  2.3: Get Data via HTTP
-    [2016-02-21 09:55:57.037745] [FUNCvirNetNB] [STEP]  2.4: Compare Send Id and Get Id
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase3
-    ******************************
-
-    [2016-02-21 09:55:57.048240] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Network Update
-    [2016-02-21 09:55:57.048783] [FUNCvirNetNB] [STEP]  3.1: Generate Post Data
-    [2016-02-21 09:55:57.049571] [FUNCvirNetNB] [STEP]  3.2: Post Data via HTTP
-    [2016-02-21 09:55:57.056744] [FUNCvirNetNB] [STEP]  3.3: Update Data via HTTP
-    [2016-02-21 09:55:57.064248] [FUNCvirNetNB] [STEP]  3.4: Get Data via HTTP
-    [2016-02-21 09:55:57.072845] [FUNCvirNetNB] [STEP]  3.5: Compare Update data.
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase4
-    ******************************
-
-    [2016-02-21 09:55:57.084363] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Network Delete
-    [2016-02-21 09:55:57.084882] [FUNCvirNetNB] [STEP]  4.1: Generate Post Data
-    [2016-02-21 09:55:57.085617] [FUNCvirNetNB] [STEP]  4.2: Post Data via HTTP
-    [2016-02-21 09:55:57.093018] [FUNCvirNetNB] [STEP]  4.3: Delete Data via HTTP
-    [2016-02-21 09:55:57.099770] [FUNCvirNetNB] [STEP]  4.4: Get Data is NULL
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase5
-    ******************************
-
-    [2016-02-21 09:56:02.115745] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Subnet Post
-    [2016-02-21 09:56:02.116339] [FUNCvirNetNB] [STEP]  5.1: Generate Post Data
-    [2016-02-21 09:56:02.117459] [FUNCvirNetNB] [STEP]  5.2: Post Network Data via HTTP(Post Subnet need post network)
-    [2016-02-21 09:56:02.126052] [FUNCvirNetNB] [STEP]  5.3: Post Subnet Data via HTTP
-    [2016-02-21 09:56:02.159577] [FUNCvirNetNB] [STEP]  5.4: Get Subnet Data via HTTP
-    [2016-02-21 09:56:02.172655] [FUNCvirNetNB] [STEP]  5.5: Compare Post Subnet Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase6
-    ******************************
-
-    [2016-02-21 09:56:02.183187] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Subnet Update
-    [2016-02-21 09:56:02.183876] [FUNCvirNetNB] [STEP]  6.1: Generate Post Data
-    [2016-02-21 09:56:02.184887] [FUNCvirNetNB] [STEP]  6.2: Post Network Data via HTTP(Post Subnet need post network)
-    [2016-02-21 09:56:02.192777] [FUNCvirNetNB] [STEP]  6.3: Post Subnet Data via HTTP
-    [2016-02-21 09:56:02.201349] [FUNCvirNetNB] [STEP]  6.4: Update Subnet Data via HTTP
-    [2016-02-21 09:56:02.209629] [FUNCvirNetNB] [STEP]  6.5: Get Subnet Data via HTTP
-    [2016-02-21 09:56:02.216700] [FUNCvirNetNB] [STEP]  6.6: Compare Subnet Data
-    [2016-02-21 09:56:02.217492] [FUNCvirNetNB] [STEP]  6.7: Delete Subnet via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase7
-    ******************************
-
-    [2016-02-21 09:56:02.227738] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Subnet Delete
-    [2016-02-21 09:56:02.228309] [FUNCvirNetNB] [STEP]  7.1: Generate Post Data
-    [2016-02-21 09:56:02.229188] [FUNCvirNetNB] [STEP]  7.2: Post Network Data via HTTP(Post Subnet need post network)
-    [2016-02-21 09:56:02.237036] [FUNCvirNetNB] [STEP]  7.3: Post Subnet Data via HTTP
-    [2016-02-21 09:56:02.245482] [FUNCvirNetNB] [STEP]  7.4: Delete Subnet Data via HTTP
-    [2016-02-21 09:56:02.253076] [FUNCvirNetNB] [STEP]  7.5: Get Subnet Data is NULL
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase8
-    ******************************
-
-    [2016-02-21 09:56:07.269037] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Port Post
-    [2016-02-21 09:56:07.269689] [FUNCvirNetNB] [STEP]  8.1: Generate Post Data
-    [2016-02-21 09:56:07.270772] [FUNCvirNetNB] [STEP]  8.2: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:07.279440] [FUNCvirNetNB] [STEP]  8.3: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:07.287800] [FUNCvirNetNB] [STEP]  8.4: Post Port Data via HTTP
-    [2016-02-21 09:56:07.296863] [FUNCvirNetNB] [STEP]  8.5: Get Port Data via HTTP
-    [2016-02-21 09:56:07.306388] [FUNCvirNetNB] [STEP]  8.6: Compare Post Port Data
-    [2016-02-21 09:56:07.307677] [FUNCvirNetNB] [STEP]  8.7: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase9
-    ******************************
-
-    [2016-02-21 09:56:07.318023] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Port Update
-    [2016-02-21 09:56:07.318708] [FUNCvirNetNB] [STEP]  9.1: Generate Post Data
-    [2016-02-21 09:56:07.320149] [FUNCvirNetNB] [STEP]  9.2: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:07.327326] [FUNCvirNetNB] [STEP]  9.3: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:07.336517] [FUNCvirNetNB] [STEP]  9.4: Post Port Data via HTTP
-    [2016-02-21 09:56:07.345702] [FUNCvirNetNB] [STEP]  9.5: Update Port Data via HTTP
-    [2016-02-21 09:56:07.354021] [FUNCvirNetNB] [STEP]  9.6: Get Port Data via HTTP
-    [2016-02-21 09:56:07.360429] [FUNCvirNetNB] [STEP]  9.7: Compare Update Port Data
-    [2016-02-21 09:56:07.361666] [FUNCvirNetNB] [STEP]  9.8: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase10
-    ******************************
-
-    [2016-02-21 09:56:07.372086] [FUNCvirNetNB] [CASE]  Virtual Network NBI Test - Port Delete
-    [2016-02-21 09:56:07.372739] [FUNCvirNetNB] [STEP]  10.1: Generate Post Data
-    [2016-02-21 09:56:07.373778] [FUNCvirNetNB] [STEP]  10.2: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:07.380739] [FUNCvirNetNB] [STEP]  10.3: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:07.388862] [FUNCvirNetNB] [STEP]  10.4: Post Port Data via HTTP
-    [2016-02-21 09:56:07.396014] [FUNCvirNetNB] [STEP]  10.5: Delete Port Data via HTTP
-    [2016-02-21 09:56:07.417621] [FUNCvirNetNB] [STEP]  10.6: Get Port Data is NULL
-    [2016-02-21 09:56:12.430407] [FUNCvirNetNB] [STEP]  10.7: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-
-    *************************************
-        Test Execution Summary
-
-    *************************************
-
-     Test Start           : 21 Feb 2016 09:55:56
-     Test End             : 21 Feb 2016 09:56:12
-     Execution Time       : 0:00:15.628718
-     Total tests planned  : 9
-     Total tests RUN      : 9
-     Total Pass           : 9
-     Total Fail           : 0
-     Total No Result      : 0
-     Success Percentage   : 100%
-     Execution Result     : 100%
-
-
-
-    ******************************
-     CASE INIT
-    ******************************
-
-    ['ONOSrest']
-
-    ******************************
-     Result summary for Testcase2
-    ******************************
-
-    [2016-02-21 09:56:12.836955] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - Router Post
-    [2016-02-21 09:56:12.838221] [FUNCvirNetNBL3] [STEP]  2.1: Post Network Data via HTTP(Post Router need post network)
-    [2016-02-21 09:56:12.873649] [FUNCvirNetNBL3] [STEP]  2.2: Post Router Data via HTTP
-    [2016-02-21 09:56:12.881751] [FUNCvirNetNBL3] [STEP]  2.3: Get Router Data via HTTP
-    [2016-02-21 09:56:12.914578] [FUNCvirNetNBL3] [STEP]  2.4: Compare Post Router Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase3
-    ******************************
-
-    [2016-02-21 09:56:12.930658] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - Router Update
-    [2016-02-21 09:56:12.931841] [FUNCvirNetNBL3] [STEP]  3.1: Post Network Data via HTTP(Post Router need post network)
-    [2016-02-21 09:56:12.939584] [FUNCvirNetNBL3] [STEP]  3.2: Post Router Data via HTTP
-    [2016-02-21 09:56:12.946895] [FUNCvirNetNBL3] [STEP]  3.3: Update Router Data via HTTP
-    [2016-02-21 09:56:12.953601] [FUNCvirNetNBL3] [STEP]  3.4: Get Router Data via HTTP
-    [2016-02-21 09:56:12.959887] [FUNCvirNetNBL3] [STEP]  3.5: Compare Router Data
-    [2016-02-21 09:56:12.961048] [FUNCvirNetNBL3] [STEP]  3.6: Delete Router via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase4
-    ******************************
-
-    [2016-02-21 09:56:12.970433] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - Router Delete
-    [2016-02-21 09:56:12.971622] [FUNCvirNetNBL3] [STEP]  4.1: Post Network Data via HTTP(Post Router need post network)
-    [2016-02-21 09:56:12.979473] [FUNCvirNetNBL3] [STEP]  4.2: Post Router Data via HTTP
-    [2016-02-21 09:56:12.986263] [FUNCvirNetNBL3] [STEP]  4.3: Delete Router Data via HTTP
-    [2016-02-21 09:56:12.992190] [FUNCvirNetNBL3] [STEP]  4.4: Get Router Data is NULL
-    Verify the Router status
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase5
-    ******************************
-
-    [2016-02-21 09:56:18.008957] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - RouterInterface Post
-    [2016-02-21 09:56:18.010175] [FUNCvirNetNBL3] [STEP]  5.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:18.018296] [FUNCvirNetNBL3] [STEP]  5.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:18.026382] [FUNCvirNetNBL3] [STEP]  5.3: Post Port Data via HTTP
-    [2016-02-21 09:56:18.034099] [FUNCvirNetNBL3] [STEP]  5.4: Post Router Data via HTTP
-    [2016-02-21 09:56:18.040193] [FUNCvirNetNBL3] [STEP]  5.5: Put RouterInterface Data via HTTP
-    [2016-02-21 09:56:18.047317] [FUNCvirNetNBL3] [STEP]  5.6: Get RouterInterface Data via HTTP
-    [2016-02-21 09:56:18.053592] [FUNCvirNetNBL3] [STEP]  5.7: Compare Post Port Data
-    [2016-02-21 09:56:18.055253] [FUNCvirNetNBL3] [STEP]  5.8: Del RouterInterface Data via HTTP
-    [2016-02-21 09:56:18.062038] [FUNCvirNetNBL3] [STEP]  5.9: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase6
-    ******************************
-
-    [2016-02-21 09:56:18.078391] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - RouterInterface Delete
-    [2016-02-21 09:56:18.079883] [FUNCvirNetNBL3] [STEP]  6.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:18.087420] [FUNCvirNetNBL3] [STEP]  6.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:18.095337] [FUNCvirNetNBL3] [STEP]  6.3: Post Port Data via HTTP
-    [2016-02-21 09:56:18.103345] [FUNCvirNetNBL3] [STEP]  6.4: Post Router Data via HTTP
-    [2016-02-21 09:56:18.109767] [FUNCvirNetNBL3] [STEP]  6.5: Post RouterInterface Data via HTTP
-    [2016-02-21 09:56:18.116024] [FUNCvirNetNBL3] [STEP]  6.6: Del RouterInterface Data via HTTP
-    [2016-02-21 09:56:18.122686] [FUNCvirNetNBL3] [STEP]  6.7: Delete Port Data via HTTP
-    [2016-02-21 09:56:18.129655] [FUNCvirNetNBL3] [STEP]  6.8: Get Port Data is NULL
-    [2016-02-21 09:56:23.145559] [FUNCvirNetNBL3] [STEP]  6.9: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase7
-    ******************************
-
-    [2016-02-21 09:56:23.164294] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - FloatingIp Post
-    [2016-02-21 09:56:23.165631] [FUNCvirNetNBL3] [STEP]  7.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:23.173909] [FUNCvirNetNBL3] [STEP]  7.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:23.182105] [FUNCvirNetNBL3] [STEP]  7.3: Post Port Data via HTTP
-    [2016-02-21 09:56:23.189623] [FUNCvirNetNBL3] [STEP]  7.4: Post Router Data via HTTP
-    [2016-02-21 09:56:23.196108] [FUNCvirNetNBL3] [STEP]  7.5: Get Port Data via HTTP
-    [2016-02-21 09:56:23.204332] [FUNCvirNetNBL3] [STEP]  7.6: Post FloatingIp Data via HTTP
-    [2016-02-21 09:56:23.211580] [FUNCvirNetNBL3] [STEP]  7.7: Get Port Data via HTTP
-    [2016-02-21 09:56:23.218993] [FUNCvirNetNBL3] [STEP]  7.8: Get FloatingIp Data via HTTP
-    [2016-02-21 09:56:23.251318] [FUNCvirNetNBL3] [STEP]  7.9: Get FloatingIp Data via HTTP
-    [2016-02-21 09:56:23.259068] [FUNCvirNetNBL3] [STEP]  7.10: Compare Post FloatingIp Data
-    [2016-02-21 09:56:23.260001] [FUNCvirNetNBL3] [STEP]  7.11: Post FloatingIp Clean Data via HTTP
-    [2016-02-21 09:56:23.266784] [FUNCvirNetNBL3] [STEP]  7.12: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase8
-    ******************************
-
-    [2016-02-21 09:56:23.289110] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - FloatingIp Update
-    [2016-02-21 09:56:23.291300] [FUNCvirNetNBL3] [STEP]  8.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:23.299318] [FUNCvirNetNBL3] [STEP]  8.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:23.307738] [FUNCvirNetNBL3] [STEP]  8.3: Post Port Data via HTTP
-    [2016-02-21 09:56:23.315822] [FUNCvirNetNBL3] [STEP]  8.4: Post Router Data via HTTP
-    [2016-02-21 09:56:23.322853] [FUNCvirNetNBL3] [STEP]  8.5: Post FloatingIp Data via HTTP
-    [2016-02-21 09:56:23.329316] [FUNCvirNetNBL3] [STEP]  8.6: Post Delete Data via HTTP
-    [2016-02-21 09:56:23.337183] [FUNCvirNetNBL3] [STEP]  8.7: Post NewPort Data via HTTP
-    [2016-02-21 09:56:23.345756] [FUNCvirNetNBL3] [STEP]  8.8: Post NewFloatingIp Data via HTTP
-    [2016-02-21 09:56:23.353311] [FUNCvirNetNBL3] [STEP]  8.9: Get NewFloatingIp Data via HTTP
-    [2016-02-21 09:56:23.384949] [FUNCvirNetNBL3] [STEP]  8.10: Compare Post FloatingIp Data
-    [2016-02-21 09:56:23.385934] [FUNCvirNetNBL3] [STEP]  8.11: Post FloatingIp Clean Data via HTTP
-    [2016-02-21 09:56:23.392515] [FUNCvirNetNBL3] [STEP]  8.12: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase9
-    ******************************
-
-    [2016-02-21 09:56:23.416898] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - FloatingIp Delete
-    [2016-02-21 09:56:23.418399] [FUNCvirNetNBL3] [STEP]  9.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:23.425551] [FUNCvirNetNBL3] [STEP]  9.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:23.433217] [FUNCvirNetNBL3] [STEP]  9.3: Post Port Data via HTTP
-    [2016-02-21 09:56:23.440717] [FUNCvirNetNBL3] [STEP]  9.4: Post Router Data via HTTP
-    [2016-02-21 09:56:23.447116] [FUNCvirNetNBL3] [STEP]  9.5: Post FloatingIp Data via HTTP
-    [2016-02-21 09:56:23.454356] [FUNCvirNetNBL3] [STEP]  9.6: Post FloatingIp Clean Data via HTTP
-    [2016-02-21 09:56:23.465800] [FUNCvirNetNBL3] [STEP]  9.7: Get FloatingIp Data is NULL
-    [2016-02-21 09:56:28.479269] [FUNCvirNetNBL3] [STEP]  9.8: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase10
-    ******************************
-
-    [2016-02-21 09:56:28.496538] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - Gateway Post
-    [2016-02-21 09:56:28.498465] [FUNCvirNetNBL3] [STEP]  10.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:28.507466] [FUNCvirNetNBL3] [STEP]  10.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:28.515564] [FUNCvirNetNBL3] [STEP]  10.3: Post Port Data via HTTP
-    [2016-02-21 09:56:28.522598] [FUNCvirNetNBL3] [STEP]  10.4: Post Router Data via HTTP
-    [2016-02-21 09:56:28.528755] [FUNCvirNetNBL3] [STEP]  10.5: Get Gateway Data via HTTP
-    [2016-02-21 09:56:28.536142] [FUNCvirNetNBL3] [STEP]  10.6: Compare Post Gateway Data
-    [2016-02-21 09:56:28.537198] [FUNCvirNetNBL3] [STEP]  10.7: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase11
-    ******************************
-
-    [2016-02-21 09:56:28.553805] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - Gateway Update
-    [2016-02-21 09:56:28.555461] [FUNCvirNetNBL3] [STEP]  11.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:28.562664] [FUNCvirNetNBL3] [STEP]  11.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:28.570094] [FUNCvirNetNBL3] [STEP]  11.3: Post Port Data via HTTP
-    [2016-02-21 09:56:28.577203] [FUNCvirNetNBL3] [STEP]  11.4: Post Router Data via HTTP
-    [2016-02-21 09:56:28.583265] [FUNCvirNetNBL3] [STEP]  11.5: Post New Router Data via HTTP
-    [2016-02-21 09:56:28.589203] [FUNCvirNetNBL3] [STEP]  11.6: Get Gateway Data via HTTP
-    [2016-02-21 09:56:28.594700] [FUNCvirNetNBL3] [STEP]  11.7: Compare Post Gateway Data
-    [2016-02-21 09:56:28.595799] [FUNCvirNetNBL3] [STEP]  11.8: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-    ******************************
-     Result summary for Testcase12
-    ******************************
-
-    [2016-02-21 09:56:28.611322] [FUNCvirNetNBL3] [CASE]  Virtual Network NBI Test - Gateway Delete
-    [2016-02-21 09:56:28.612734] [FUNCvirNetNBL3] [STEP]  12.1: Post Network Data via HTTP(Post port need post network)
-    [2016-02-21 09:56:28.620160] [FUNCvirNetNBL3] [STEP]  12.2: Post Subnet Data via HTTP(Post port need post subnet)
-    [2016-02-21 09:56:28.628079] [FUNCvirNetNBL3] [STEP]  12.3: Post Port Data via HTTP
-    [2016-02-21 09:56:28.635761] [FUNCvirNetNBL3] [STEP]  12.4: Post Router Data via HTTP
-    [2016-02-21 09:56:28.642664] [FUNCvirNetNBL3] [STEP]  12.5: Post Del Gateway Data via HTTP
-    [2016-02-21 09:56:28.648775] [FUNCvirNetNBL3] [STEP]  12.6: Get Gateway Data via HTTP
-    [2016-02-21 09:56:28.654590] [FUNCvirNetNBL3] [STEP]  12.7: If Gateway Data is NULL
-    [2016-02-21 09:56:33.660980] [FUNCvirNetNBL3] [STEP]  12.8: Clean Data via HTTP
-
-    *****************************
-     Result: Pass
-    *****************************
-
-
-
-    *************************************
-        Test Execution Summary
-
-    *************************************
-
-     Test Start           : 21 Feb 2016 09:56:12
-     Test End             : 21 Feb 2016 09:56:33
-     Execution Time       : 0:00:20.999784
-     Total tests planned  : 11
-     Total tests RUN      : 11
-     Total Pass           : 11
-     Total Fail           : 0
-     Total No Result      : 0
-     Success Percentage   : 100%
-     Execution Result     : 100%
-
-
-Feature tests
--------------
-
-Promise
-^^^^^^^
-::
-
-    FUNCTEST.info: Running PROMISE test case...
-    Promise- INFO - Creating tenant 'promise'...
-    Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
-    Promise- INFO - Creating user 'promiser'...
-    Promise- INFO - Updating OpenStack credentials...
-    Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-    Promise- INFO - Creating flavor 'promise-flavor'...
-    Promise- INFO - Exporting environment variables...
-    Promise- INFO - Running command: npm run -s test -- --reporter json
-    Promise- INFO - The test succeeded.
-    Promise- DEBUG -
-    {
-      "stats": {
-        "suites": 23,
-        "tests": 33,
-        "passes": 33,
-        "pending": 0,
-        "failures": 0,
-        "start": "2016-02-21T09:56:46.846Z",
-        "end": "2016-02-21T09:56:51.847Z",
-        "duration": 5524
-      },
-      "tests": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ],
-      "pending": [],
-      "failures": [],
-      "passes": [
-        {
-          "title": "should add a new OpenStack provider without error",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-          "duration": 1217,
-          "err": {}
-        },
-        {
-          "title": "should update promise.providers with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-          "duration": 10,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceProvider record in the store",
-          "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should add more capacity to the reservation service without error",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-          "duration": 25,
-          "err": {}
-        },
-        {
-          "title": "should update promise.pools with a new entry",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should contain a ResourcePool record in the store",
-          "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should report total collections and utilizations",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-          "duration": 18,
-          "err": {}
-        },
-        {
-          "title": "should contain newly added capacity pool",
-          "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-          "duration": 8,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider without error",
-          "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-          "duration": 1768,
-          "err": {}
-        },
-        {
-          "title": "should update promise.allocations with a new entry",
-          "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-          "duration": 2,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should reference the created server ID from the provider",
-          "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should have low priority state",
-          "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (no start/end) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-          "duration": 41,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create a new server in target provider (with reservation) without error",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-          "duration": 1617,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceAllocation record in the store",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-          "duration": 1,
-          "err": {}
-        },
-        {
-          "title": "should be referenced in the reservation record",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-          "duration": 7,
-          "err": {}
-        },
-        {
-          "title": "should have high priority state",
-          "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should create reservation record (for future) without error",
-          "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-          "duration": 75,
-          "err": {}
-        },
-        {
-          "title": "should update promise.reservations with a new entry",
-          "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should contain a new ResourceReservation record in the store",
-          "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should contain newly created future reservation",
-          "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-          "duration": 61,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-          "duration": 65,
-          "err": {}
-        },
-        {
-          "title": "should modify existing reservation without error",
-          "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-          "duration": 17,
-          "err": {}
-        },
-        {
-          "title": "should no longer contain record of the deleted reservation",
-          "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-          "duration": 0,
-          "err": {}
-        },
-        {
-          "title": "should decrease available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-          "duration": 15,
-          "err": {}
-        },
-        {
-          "title": "should increase available capacity from a provider in the future",
-          "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-          "duration": 11,
-          "err": {}
-        },
-        {
-          "title": "should report available collections and utilizations",
-          "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-          "duration": 56,
-          "err": {}
-        },
-        {
-          "title": "should fail to create immediate reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-          "duration": 60,
-          "err": {}
-        },
-        {
-          "title": "should fail to create future reservation record with proper error",
-          "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-          "duration": 38,
-          "err": {}
-        },
-        {
-          "title": "should successfully destroy all allocations",
-          "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-          "duration": 361,
-          "err": {}
-        }
-      ]
-    }
-    Promise- INFO -
-    ****************************************
-              Promise test report
-
-    ****************************************
-     Suites:    23
-     Tests:     33
-     Passes:    33
-     Pending:   0
-     Failures:  0
-     Start:     2016-02-21T09:56:46.846Z
-     End:       2016-02-21T09:56:51.847Z
-     Duration:  6.301
-    ****************************************
-
-
diff --git a/docs/results/index.rst b/docs/results/index.rst
deleted file mode 100644 (file)
index 75aac71..0000000
+++ /dev/null
@@ -1,12 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-=====================
-FuncTest test results
-=====================
-
-.. toctree::
-   :maxdepth: 4
-
-.. include:: ./overview.rst
-.. include:: ./results.rst
diff --git a/docs/results/joid-os-odl_l2-nofeature-ha.rst b/docs/results/joid-os-odl_l2-nofeature-ha.rst
deleted file mode 100644 (file)
index 29f4b37..0000000
+++ /dev/null
@@ -1,2189 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Detailed test results for joid-os-odl_l2-nofeature-ha
------------------------------------------------------
-
-VIM
----
-
-vping_ssh
-^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-SSH test...
-  vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_ssh- INFO - Creating neutron network vping-net...
-  vPing_ssh- INFO - Creating security group  'vPing-sg'...
-  vPing_ssh- INFO - Using existing Flavor 'm1.small'...
-  vPing_ssh- INFO - vPing Start Time:'2016-02-23 10:26:42'
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=13cc508d-303d-46a8-bd03-3edae4434dfb
-   network=b183c17a-bac5-4e45-afba-f5bc61edcf9e
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=13cc508d-303d-46a8-bd03-3edae4434dfb
-   network=b183c17a-bac5-4e45-afba-f5bc61edcf9e
-
-  vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
-  vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
-  vPing_ssh- INFO - Floating IP created: '161.105.231.3'
-  vPing_ssh- INFO - Associating floating ip: '161.105.231.3' to VM 'opnfv-vping-2'
-  vPing_ssh- INFO - Trying to establish SSH connection to 161.105.231.3...
-  vPing_ssh- INFO - Waiting for ping...
-  vPing_ssh- INFO - vPing detected!
-  vPing_ssh- INFO - vPing duration:'33.5' s.
-  vPing_ssh- INFO - Cleaning up...
-  vPing_ssh- INFO - vPing OK
-
-
-vping_userdata
-^^^^^^^^^^^^^^
-::
-
-  FUNCTEST.info: Running vPing-userdata test...
-  vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  vPing_userdata- INFO - Creating neutron network vping-net...
-  vPing_userdata- INFO - Creating security group  'vPing-sg'...
-  vPing_userdata- INFO - Flavor found 'm1.small'
-  vPing_userdata- INFO - vPing Start Time:'2016-02-23 10:27:41'
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
-   name=opnfv-vping-1
-   flavor=<Flavor: m1.small>
-   image=a9b0741e-0d2d-4503-b267-af151870739e
-   network=9d9b24f9-7bea-48b1-a4eb-771bf3784900
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
-  vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
-   name=opnfv-vping-2
-   flavor=<Flavor: m1.small>
-   image=a9b0741e-0d2d-4503-b267-af151870739e
-   network=9d9b24f9-7bea-48b1-a4eb-771bf3784900
-   userdata=
-  #!/bin/sh
-
-  while true; do
-   ping -c 1 192.168.130.3 2>&1 >/dev/null
-   RES=$?
-   if [ "Z$RES" = "Z0" ] ; then
-    echo 'vPing OK'
-   break
-   else
-    echo 'vPing KO'
-   fi
-   sleep 1
-  done
-
-  vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
-  vPing_userdata- INFO - Waiting for ping...
-  vPing_userdata- INFO - vPing detected!
-  vPing_userdata- INFO - vPing duration:'17.9'
-  vPing_userdata- INFO - vPing OK
-  vPing_userdata- INFO - Cleaning up...
-  vPing_userdata- INFO - Deleting network 'vping-net'...
-
-
-Tempest
-^^^^^^^
-::
-
-  FUNCTEST.info: Running Tempest tests...
-  run_tempest - INFO - Creating tenant and user for Tempest suite
-  2016-02-23 10:28:17.615 23826 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
-  2016-02-23 10:28:23.990 23826 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
-
-  run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
-  Total results of verification:
-
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-  | 473116be-ef51-45b4-a46d-dcc17b02d920 | 7fa447a8-f40c-475e-bae8-d4f62027b80b |          | 210   | 5        | 2016-02-23 10:28:27.307831 | finished |
-  +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
-
-  Tests:
-
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | name                                                                                                                                     | time      | status  |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.88396   | success |
-  | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.17728   | success |
-  | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 9.72530   | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 9.15814   | success |
-  | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 7.24988   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.23094   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 1.23775   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.92287   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.79109   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.20110   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.48230   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.46126   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.50215   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.21126   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.24888   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.19557   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.53114   | success |
-  | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.88118   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.52117   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 1.01633   | success |
-  | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.40909   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.80631   | success |
-  | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 1.57659   | success |
-  | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 2.75110   | success |
-  | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 9.21019   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 62.75436  | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.17342   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.30973   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.33235   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00133   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 62.74257  | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.19542   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.35564   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.36918   | success |
-  | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.00129   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.18644   | success |
-  | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 3.81844   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.52933   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.50494   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.33257   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.38382   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.47799   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.24448   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.22883   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.21227   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.27651   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.06020   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.40370   | success |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00142   | skip    |
-  | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.30281   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.25500   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.21292   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.19699   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.07649   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.14378   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01122   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.03176   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.06131   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.04448   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.21242   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.18448   | success |
-  | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.06615   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00170   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 5.05891   | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 12.21875  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 10.99696  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 1.04170   | skip    |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 24.60148  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 15.56771  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 21.94185  | success |
-  | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 7.25441   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.17943   | success |
-  | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 1.00217   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.76858   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 1.16728   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.46748   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.60523   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.70657   | success |
-  | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.91519   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 2.30147   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 7.86437   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 15.09430  | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 9.89837   | success |
-  | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 10.11169  | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 1.55906   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 1.98352   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 1.47851   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 1.88043   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 1.53679   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 1.27055   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 1.08039   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.73357   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.86542   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.99209   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 1.08220   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.83730   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.99153   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.54860   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.37611   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.44613   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.55699   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 0.56507   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.48514   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 0.86713   | success |
-  | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.61486   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.12864   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.67877   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.61740   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.13677   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 1.40358   | success |
-  | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.16372   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.18319   | success |
-  | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.33858   | success |
-  | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 45.56777  | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.72770   | success |
-  | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.30390   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.20202   | success |
-  | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.17999   | success |
-  | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.34894   | success |
-  | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.13656   | success |
-  | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.0       | fail    |
-  | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.05100   | success |
-  | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.50255   | success |
-  | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.27108   | success |
-  | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 1.16016   | success |
-  | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.21180   | success |
-  | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.14141   | success |
-  | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.25298   | success |
-  | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.20613   | success |
-  | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 1.42131   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.04287   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.05581   | success |
-  | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.05518   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.04135   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.03642   | success |
-  | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.04205   | success |
-  | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.32191   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.18189   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 1.74422   | success |
-  | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 2.30171   | success |
-  | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 3.45772   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.03994   | success |
-  | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 1.42863   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 1.14505   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 1.60767   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 7.84206   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 1.21731   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 2.11434   | success |
-  | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 2.79624   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 1.61530   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.38291   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.20594   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.19821   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.20089   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.19206   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 1.49044   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.23415   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.21291   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.07398   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.17873   | success |
-  | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.20287   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 1.38012   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 1.87547   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.20872   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.05621   | success |
-  | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.20890   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.70139   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 1.75502   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 1.16521   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.22620   | success |
-  | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.28640   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 4.12301   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 2.49067   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 2.25252   | success |
-  | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 1.48564   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 4.58651   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 2.38901   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 2.54963   | success |
-  | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 1.37000   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 1.31226   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 2.04438   | success |
-  | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.19052   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 1.32708   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 2.12672   | success |
-  | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.20945   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.55381   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 7.80051   | success |
-  | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.03030   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 1.61156   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.86944   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.57507   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.36337   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.66632   | success |
-  | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.47493   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.52216   | success |
-  | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.18647   | success |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 303.03506 | fail    |
-  | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 301.96207 | fail    |
-  | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 3.14842   | success |
-  | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.66111   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 9.31807   | success |
-  | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 15.30017  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 10.64441  | success |
-  | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 13.02957  | success |
-  | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.56814   | success |
-  | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.23431   | success |
-  | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 42.47353  | success |
-  | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 82.90131  | success |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 499.21662 | fail    |
-  | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 501.43822 | fail    |
-  +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
-  run_tempest - INFO - Results: {'timestart': '2016-02-2310:28:27.307831', 'duration': 931, 'tests': 210, 'failures': 5}
-  run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
-  run_tempest - INFO - Deleting tenant and user for Tempest suite)
-
-
-Rally
-^^^^^
-::
-
-  FUNCTEST.info: Running Rally benchmark suite...
-  run_rally - INFO - Starting test scenario "authenticate" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  1e91fffe-1834-4d97-b18c-95b1c3a11763: started
-  Task 1e91fffe-1834-4d97-b18c-95b1c3a11763: finished
-
-  test scenario Authenticate.validate_glance
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_glance     | 0.393 | 0.462  | 0.625  | 0.642  | 0.659 | 0.499 | 100.0%  | 10    |
-  | authenticate.validate_glance (2) | 0.042 | 0.05   | 0.222  | 0.235  | 0.247 | 0.101 | 100.0%  | 10    |
-  | total                            | 0.56  | 0.722  | 0.84   | 0.907  | 0.975 | 0.716 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.11308193207
-  Full duration: 6.43925094604
-
-  test scenario Authenticate.keystone
-  +-----------------------------------------------------------------------------+
-  |                            Response Times (sec)                             |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | total  | 0.096 | 0.108  | 0.117  | 0.118  | 0.118 | 0.108 | 100.0%  | 10    |
-  +--------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.360912799835
-  Full duration: 4.84613108635
-
-  test scenario Authenticate.validate_heat
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_heat     | 0.198 | 0.223  | 0.243  | 0.246  | 0.25  | 0.222 | 100.0%  | 10    |
-  | authenticate.validate_heat (2) | 0.035 | 0.229  | 0.268  | 0.272  | 0.275 | 0.195 | 100.0%  | 10    |
-  | total                          | 0.349 | 0.56   | 0.636  | 0.648  | 0.66  | 0.537 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.73545908928
-  Full duration: 5.89906620979
-
-  test scenario Authenticate.validate_nova
-  +-----------------------------------------------------------------------------------------------------+
-  |                                        Response Times (sec)                                         |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_nova     | 0.191 | 0.225  | 0.273  | 0.326  | 0.379 | 0.239 | 100.0%  | 10    |
-  | authenticate.validate_nova (2) | 0.193 | 0.215  | 0.268  | 0.324  | 0.379 | 0.233 | 100.0%  | 10    |
-  | total                          | 0.512 | 0.561  | 0.696  | 0.708  | 0.719 | 0.589 | 100.0%  | 10    |
-  +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.73631811142
-  Full duration: 6.18624401093
-
-  test scenario Authenticate.validate_cinder
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_cinder     | 0.187 | 0.219  | 0.269  | 0.451  | 0.632 | 0.256 | 100.0%  | 10    |
-  | authenticate.validate_cinder (2) | 0.019 | 0.202  | 0.228  | 0.232  | 0.235 | 0.19  | 100.0%  | 10    |
-  | total                            | 0.318 | 0.572  | 0.652  | 0.81   | 0.967 | 0.582 | 100.0%  | 10    |
-  +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.90990018845
-  Full duration: 6.19068098068
-
-  test scenario Authenticate.validate_neutron
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | authenticate.validate_neutron     | 0.22  | 0.241  | 0.324  | 0.326  | 0.328 | 0.255 | 100.0%  | 10    |
-  | authenticate.validate_neutron (2) | 0.21  | 0.234  | 0.327  | 0.349  | 0.37  | 0.254 | 100.0%  | 10    |
-  | total                             | 0.529 | 0.595  | 0.67   | 0.689  | 0.708 | 0.613 | 100.0%  | 10    |
-  +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.81688117981
-  Full duration: 5.97459483147
-
-  run_rally - INFO - Test scenario: "authenticate" OK.
-
-  run_rally - INFO - Starting test scenario "glance" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  c991643e-676b-49d8-af8c-cf9655ae236b: started
-  Task c991643e-676b-49d8-af8c-cf9655ae236b: finished
-
-  test scenario GlanceImages.list_images
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.list_images | 0.47  | 0.551  | 0.604  | 0.621  | 0.638 | 0.559 | 100.0%  | 10    |
-  | total              | 0.471 | 0.551  | 0.604  | 0.621  | 0.638 | 0.559 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.7134771347
-  Full duration: 7.86669206619
-
-  test scenario GlanceImages.create_image_and_boot_instances
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | glance.create_image | 3.881  | 4.628  | 5.228  | 5.273  | 5.317  | 4.643  | 100.0%  | 10    |
-  | nova.boot_servers   | 7.198  | 8.691  | 9.617  | 9.773  | 9.929  | 8.609  | 100.0%  | 10    |
-  | total               | 11.395 | 13.062 | 14.63  | 14.674 | 14.718 | 13.252 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 40.5051100254
-  Full duration: 80.9348599911
-
-  test scenario GlanceImages.create_and_list_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 4.473 | 4.791  | 5.258  | 5.513  | 5.767 | 4.935 | 100.0%  | 10    |
-  | glance.list_images  | 0.046 | 0.143  | 0.285  | 0.293  | 0.302 | 0.159 | 100.0%  | 10    |
-  | total               | 4.67  | 5.043  | 5.524  | 5.679  | 5.834 | 5.095 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 15.4974470139
-  Full duration: 26.4936869144
-
-  test scenario GlanceImages.create_and_delete_image
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | glance.create_image | 4.297 | 4.864  | 5.167  | 5.345  | 5.523 | 4.859 | 100.0%  | 10    |
-  | glance.delete_image | 0.842 | 1.496  | 1.603  | 1.702  | 1.801 | 1.371 | 100.0%  | 10    |
-  | total               | 5.14  | 6.405  | 6.623  | 6.626  | 6.63  | 6.23  | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 18.5310051441
-  Full duration: 24.86997509
-
-  run_rally - INFO - Test scenario: "glance" OK.
-
-  run_rally - INFO - Starting test scenario "cinder" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  388cb584-9c00-4d54-8f76-53ed3182a475: started
-  Task 388cb584-9c00-4d54-8f76-53ed3182a475: finished
-
-  test scenario CinderVolumes.create_and_attach_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server     | 4.792  | 5.804  | 8.436  | 8.476  | 8.516  | 6.313  | 100.0%  | 10    |
-  | cinder.create_volume | 3.049  | 3.381  | 3.469  | 3.471  | 3.473  | 3.317  | 100.0%  | 10    |
-  | nova.attach_volume   | 3.722  | 3.987  | 4.207  | 4.245  | 4.283  | 4.012  | 100.0%  | 10    |
-  | nova.detach_volume   | 3.492  | 3.685  | 3.892  | 3.925  | 3.958  | 3.702  | 100.0%  | 10    |
-  | cinder.delete_volume | 0.502  | 0.765  | 2.927  | 2.998  | 3.068  | 1.357  | 100.0%  | 10    |
-  | nova.delete_server   | 2.66   | 3.128  | 3.235  | 3.243  | 3.251  | 3.056  | 100.0%  | 10    |
-  | total                | 19.466 | 20.925 | 25.056 | 25.456 | 25.856 | 21.758 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 64.0748999119
-  Full duration: 88.3469510078
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 6.151 | 6.548  | 8.972  | 9.007  | 9.043 | 7.201 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.044 | 0.249  | 0.299  | 0.32   | 0.34  | 0.227 | 100.0%  | 10    |
-  | total                | 6.424 | 6.801  | 9.229  | 9.255  | 9.28  | 7.429 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 22.3146419525
-  Full duration: 39.1755928993
-
-  test scenario CinderVolumes.create_and_list_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.269 | 3.372  | 3.545  | 3.556  | 3.566 | 3.406 | 100.0%  | 10    |
-  | cinder.list_volumes  | 0.051 | 0.27   | 0.296  | 0.304  | 0.313 | 0.249 | 100.0%  | 10    |
-  | total                | 3.321 | 3.662  | 3.786  | 3.819  | 3.852 | 3.656 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 11.0692770481
-  Full duration: 26.8993549347
-
-  test scenario CinderVolumes.create_and_list_snapshots
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.807 | 3.0    | 3.236  | 4.094  | 4.951 | 3.175 | 100.0%  | 10    |
-  | cinder.list_snapshots  | 0.023 | 0.263  | 0.29   | 0.295  | 0.299 | 0.238 | 100.0%  | 10    |
-  | total                  | 3.039 | 3.247  | 3.493  | 4.372  | 5.251 | 3.413 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 11.5568339825
-  Full duration: 45.8590891361
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.35  | 3.413  | 3.511  | 3.567  | 3.622 | 3.434 | 100.0%  | 10    |
-  | cinder.delete_volume | 0.666 | 2.775  | 3.101  | 3.101  | 3.101 | 2.07  | 100.0%  | 10    |
-  | total                | 4.016 | 6.163  | 6.511  | 6.555  | 6.6   | 5.505 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 16.3949551582
-  Full duration: 29.3589651585
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | cinder.create_volume | 6.12  | 6.499  | 8.727  | 8.888  | 9.049  | 6.934 | 100.0%  | 10    |
-  | cinder.delete_volume | 0.689 | 2.95   | 3.117  | 3.132  | 3.147  | 2.519 | 100.0%  | 10    |
-  | total                | 6.97  | 9.45   | 11.391 | 11.777 | 12.163 | 9.454 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 27.9512338638
-  Full duration: 42.110273838
-
-  test scenario CinderVolumes.create_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.153 | 3.382  | 3.523  | 3.546  | 3.569 | 3.401 | 100.0%  | 10    |
-  | cinder.delete_volume | 0.459 | 1.756  | 3.107  | 3.143  | 3.179 | 1.823 | 100.0%  | 10    |
-  | total                | 3.976 | 5.273  | 6.386  | 6.427  | 6.468 | 5.225 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.3155708313
-  Full duration: 27.9943380356
-
-  test scenario CinderVolumes.create_and_upload_volume_to_image
-  +-------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                          |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume          | 3.216  | 3.504  | 3.612  | 3.614  | 3.616  | 3.473  | 100.0%  | 10    |
-  | cinder.upload_volume_to_image | 48.706 | 66.291 | 69.416 | 69.518 | 69.621 | 64.031 | 100.0%  | 10    |
-  | cinder.delete_volume          | 0.681  | 1.721  | 3.226  | 3.286  | 3.347  | 1.88   | 100.0%  | 10    |
-  | nova.delete_image             | 1.064  | 1.392  | 1.76   | 1.884  | 2.007  | 1.407  | 100.0%  | 10    |
-  | total                         | 57.671 | 73.06  | 75.032 | 75.707 | 76.382 | 70.791 | 100.0%  | 10    |
-  +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 206.246454954
-  Full duration: 221.344403028
-
-  test scenario CinderVolumes.create_and_delete_snapshot
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_snapshot | 2.886 | 3.18   | 5.409  | 5.479  | 5.548 | 3.789 | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.442 | 2.892  | 3.051  | 3.111  | 3.172 | 2.875 | 100.0%  | 10    |
-  | total                  | 5.432 | 6.063  | 8.28   | 8.355  | 8.429 | 6.664 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 20.3915560246
-  Full duration: 49.2419481277
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.151 | 3.492  | 3.579  | 3.641  | 3.703 | 3.459 | 100.0%  | 10    |
-  | total                | 3.151 | 3.492  | 3.579  | 3.641  | 3.703 | 3.459 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 10.2652549744
-  Full duration: 23.4044110775
-
-  test scenario CinderVolumes.create_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.221 | 3.489  | 3.632  | 3.639  | 3.647 | 3.448 | 100.0%  | 10    |
-  | total                | 3.222 | 3.489  | 3.632  | 3.64   | 3.647 | 3.448 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 10.2576260567
-  Full duration: 27.1289498806
-
-  test scenario CinderVolumes.list_volumes
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.list_volumes | 0.347 | 0.409  | 0.467  | 0.49   | 0.514 | 0.416 | 100.0%  | 10    |
-  | total               | 0.347 | 0.409  | 0.467  | 0.49   | 0.514 | 0.416 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.25233316422
-  Full duration: 60.8991248608
-
-  test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 3.37   | 3.431  | 3.543  | 3.585  | 3.627  | 3.454  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.744  | 2.922  | 2.98   | 2.993  | 3.006  | 2.901  | 100.0%  | 10    |
-  | nova.attach_volume     | 4.052  | 4.214  | 6.878  | 6.969  | 7.06   | 4.803  | 100.0%  | 10    |
-  | nova.detach_volume     | 3.392  | 3.988  | 4.066  | 4.11   | 4.154  | 3.906  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 0.753  | 2.605  | 2.986  | 3.013  | 3.04   | 2.343  | 100.0%  | 10    |
-  | cinder.delete_volume   | 0.492  | 2.767  | 2.955  | 3.011  | 3.067  | 1.989  | 100.0%  | 10    |
-  | total                  | 16.494 | 20.022 | 23.368 | 23.417 | 23.465 | 20.126 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 59.1712889671
-  Full duration: 133.726794958
-
-  test scenario CinderVolumes.create_from_volume_and_delete_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.434 | 3.618  | 4.006  | 4.825  | 5.645 | 3.835 | 100.0%  | 10    |
-  | cinder.delete_volume | 2.853 | 2.996  | 3.194  | 3.231  | 3.269 | 3.035 | 100.0%  | 10    |
-  | total                | 6.323 | 6.672  | 7.143  | 7.89   | 8.637 | 6.87  | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 20.0482749939
-  Full duration: 48.4943790436
-
-  test scenario CinderVolumes.create_and_extend_volume
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | cinder.create_volume | 3.242 | 3.547  | 3.574  | 3.574  | 3.575 | 3.477 | 100.0%  | 10    |
-  | cinder.extend_volume | 0.67  | 0.904  | 3.113  | 3.227  | 3.341 | 1.343 | 100.0%  | 10    |
-  | cinder.delete_volume | 0.756 | 2.645  | 3.074  | 3.111  | 3.147 | 2.224 | 100.0%  | 10    |
-  | total                | 5.261 | 7.245  | 7.684  | 8.512  | 9.341 | 7.045 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 21.6863160133
-  Full duration: 35.5403769016
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +-----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                      |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 3.427 | 3.543  | 3.82   | 3.829  | 3.838  | 3.59   | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.673 | 2.992  | 3.109  | 3.111  | 3.112  | 2.928  | 100.0%  | 10    |
-  | nova.attach_volume     | 3.759 | 4.112  | 4.508  | 5.345  | 6.182  | 4.292  | 100.0%  | 10    |
-  | nova.detach_volume     | 3.458 | 4.067  | 4.174  | 4.261  | 4.348  | 4.006  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.665 | 2.794  | 2.946  | 2.986  | 3.026  | 2.823  | 100.0%  | 10    |
-  | cinder.delete_volume   | 0.707 | 2.907  | 3.246  | 3.257  | 3.268  | 2.558  | 100.0%  | 10    |
-  | total                  | 18.87 | 21.068 | 21.909 | 22.497 | 23.086 | 20.904 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 61.3498468399
-  Full duration: 141.86026597
-
-  test scenario CinderVolumes.create_snapshot_and_attach_volume
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume   | 2.885  | 3.335  | 3.519  | 3.55   | 3.581  | 3.305  | 100.0%  | 10    |
-  | cinder.create_snapshot | 2.609  | 2.889  | 3.002  | 3.021  | 3.041  | 2.853  | 100.0%  | 10    |
-  | nova.attach_volume     | 3.794  | 4.368  | 6.443  | 6.495  | 6.548  | 4.951  | 100.0%  | 10    |
-  | nova.detach_volume     | 3.341  | 3.93   | 4.07   | 4.11   | 4.15   | 3.862  | 100.0%  | 10    |
-  | cinder.delete_snapshot | 2.73   | 2.943  | 3.009  | 3.029  | 3.049  | 2.912  | 100.0%  | 10    |
-  | cinder.delete_volume   | 0.667  | 2.901  | 3.015  | 3.027  | 3.039  | 2.437  | 100.0%  | 10    |
-  | total                  | 18.717 | 21.217 | 22.919 | 23.013 | 23.108 | 21.377 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 62.8349030018
-  Full duration: 143.571810007
-
-  run_rally - INFO - Test scenario: "cinder" OK.
-
-  run_rally - INFO - Starting test scenario "heat" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  1055c160-be9e-4209-9219-2eda388f64ca: started
-  Task 1055c160-be9e-4209-9219-2eda388f64ca: finished
-
-  test scenario HeatStacks.create_suspend_resume_delete_stack
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack  | 3.658 | 4.153  | 4.633  | 4.957  | 5.28  | 4.179 | 100.0%  | 10    |
-  | heat.suspend_stack | 0.603 | 0.984  | 1.772  | 1.876  | 1.98  | 1.163 | 100.0%  | 10    |
-  | heat.resume_stack  | 0.553 | 1.347  | 2.26   | 2.264  | 2.268 | 1.425 | 100.0%  | 10    |
-  | heat.delete_stack  | 1.527 | 1.61   | 1.95   | 1.96   | 1.97  | 1.701 | 100.0%  | 10    |
-  | total              | 7.456 | 8.457  | 9.273  | 9.324  | 9.376 | 8.469 | 100.0%  | 10    |
-  +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 25.1924760342
-  Full duration: 31.4871768951
-
-  test scenario HeatStacks.create_and_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 3.724 | 4.253  | 4.355  | 4.361  | 4.366 | 4.141 | 100.0%  | 10    |
-  | heat.delete_stack | 1.538 | 1.86   | 2.427  | 2.427  | 2.428 | 1.933 | 100.0%  | 10    |
-  | total             | 5.609 | 6.117  | 6.381  | 6.402  | 6.422 | 6.073 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 18.3157711029
-  Full duration: 24.7532258034
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 19.874 | 21.385 | 22.341 | 22.535 | 22.729 | 21.343 | 100.0%  | 10    |
-  | heat.delete_stack | 10.707 | 11.672 | 12.205 | 12.275 | 12.345 | 11.562 | 100.0%  | 10    |
-  | total             | 30.923 | 33.359 | 33.959 | 34.235 | 34.512 | 32.905 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 99.1549890041
-  Full duration: 105.660290003
-
-  test scenario HeatStacks.create_and_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 15.572 | 18.262 | 19.048 | 19.088 | 19.127 | 18.071 | 100.0%  | 10    |
-  | heat.delete_stack | 10.145 | 10.711 | 11.519 | 11.545 | 11.571 | 10.78  | 100.0%  | 10    |
-  | total             | 25.725 | 29.14  | 29.903 | 30.143 | 30.382 | 28.851 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 85.5803580284
-  Full duration: 92.0883340836
-
-  test scenario HeatStacks.list_stacks_and_resources
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.list_stacks                | 0.391 | 0.425  | 0.461  | 0.477  | 0.492 | 0.432 | 100.0%  | 10    |
-  | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
-  | total                           | 0.391 | 0.425  | 0.461  | 0.477  | 0.492 | 0.432 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.32646512985
-  Full duration: 6.55452680588
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 3.818 | 4.127  | 4.55   | 4.634  | 4.719 | 4.191 | 100.0%  | 10    |
-  | heat.update_stack | 2.555 | 3.026  | 3.487  | 3.49   | 3.493 | 2.994 | 100.0%  | 10    |
-  | heat.delete_stack | 1.278 | 1.905  | 2.468  | 2.484  | 2.501 | 1.938 | 100.0%  | 10    |
-  | total             | 8.59  | 8.987  | 9.575  | 9.58   | 9.585 | 9.123 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 27.2428030968
-  Full duration: 34.0842261314
-
-  test scenario HeatStacks.create_update_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 3.817 | 4.322  | 4.498  | 4.571  | 4.643 | 4.268 | 100.0%  | 10    |
-  | heat.update_stack | 2.571 | 3.085  | 3.495  | 3.651  | 3.807 | 3.093 | 100.0%  | 10    |
-  | heat.delete_stack | 1.261 | 1.933  | 2.188  | 2.23   | 2.271 | 1.85  | 100.0%  | 10    |
-  | total             | 8.823 | 9.193  | 9.529  | 9.645  | 9.76  | 9.211 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 27.712323904
-  Full duration: 34.6925389767
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 3.534  | 4.559  | 4.878  | 4.986  | 5.094  | 4.397  | 100.0%  | 10    |
-  | heat.update_stack | 4.274  | 4.722  | 5.38   | 5.427  | 5.474  | 4.782  | 100.0%  | 10    |
-  | heat.delete_stack | 2.324  | 2.687  | 3.01   | 3.031  | 3.051  | 2.761  | 100.0%  | 10    |
-  | total             | 10.398 | 11.879 | 12.749 | 13.064 | 13.379 | 11.941 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 36.5785570145
-  Full duration: 43.5735290051
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 4.244  | 4.341  | 4.695  | 4.992  | 5.29   | 4.489  | 100.0%  | 10    |
-  | heat.update_stack | 7.174  | 8.094  | 8.59   | 8.598  | 8.605  | 8.081  | 100.0%  | 10    |
-  | heat.delete_stack | 2.663  | 2.892  | 3.804  | 3.808  | 3.813  | 3.088  | 100.0%  | 10    |
-  | total             | 15.231 | 15.561 | 16.269 | 16.292 | 16.315 | 15.659 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 46.8214969635
-  Full duration: 54.2644329071
-
-  test scenario HeatStacks.create_update_delete_stack
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 4.041  | 4.381  | 4.699  | 4.835  | 4.971  | 4.435  | 100.0%  | 10    |
-  | heat.update_stack | 4.032  | 4.694  | 5.611  | 5.758  | 5.906  | 4.82   | 100.0%  | 10    |
-  | heat.delete_stack | 2.715  | 3.034  | 3.306  | 3.315  | 3.324  | 3.036  | 100.0%  | 10    |
-  | total             | 11.427 | 12.204 | 13.196 | 13.241 | 13.286 | 12.292 | 100.0%  | 10    |
-  +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 37.1505100727
-  Full duration: 44.6821551323
-
-  test scenario HeatStacks.create_update_delete_stack
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  | heat.create_stack | 3.692 | 4.397  | 4.751  | 4.908  | 5.065  | 4.428  | 100.0%  | 10    |
-  | heat.update_stack | 3.631 | 4.037  | 4.866  | 4.875  | 4.885  | 4.167  | 100.0%  | 10    |
-  | heat.delete_stack | 1.267 | 1.966  | 2.279  | 2.33   | 2.382  | 1.871  | 100.0%  | 10    |
-  | total             | 9.823 | 10.45  | 11.136 | 11.248 | 11.361 | 10.466 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 31.3539619446
-  Full duration: 39.0203011036
-
-  test scenario HeatStacks.create_and_list_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 4.039 | 4.653  | 4.788  | 4.792  | 4.796 | 4.563 | 100.0%  | 10    |
-  | heat.list_stacks  | 0.052 | 0.39   | 0.447  | 0.461  | 0.474 | 0.339 | 100.0%  | 10    |
-  | total             | 4.106 | 4.992  | 5.218  | 5.244  | 5.27  | 4.902 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 14.8402919769
-  Full duration: 27.3945071697
-
-  test scenario HeatStacks.create_check_delete_stack
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | heat.create_stack | 3.744 | 4.489  | 4.836  | 4.864  | 4.891 | 4.475 | 100.0%  | 10    |
-  | heat.check_stack  | 0.612 | 1.265  | 1.684  | 1.853  | 2.022 | 1.261 | 100.0%  | 10    |
-  | heat.delete_stack | 1.272 | 1.804  | 2.077  | 2.209  | 2.342 | 1.813 | 100.0%  | 10    |
-  | total             | 6.355 | 7.754  | 8.128  | 8.148  | 8.168 | 7.55  | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 23.1206851006
-  Full duration: 31.1694560051
-
-  run_rally - INFO - Test scenario: "heat" OK.
-
-  run_rally - INFO - Starting test scenario "keystone" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  897d895f-d779-44a7-bb9b-0e66854f43da: started
-  Task 897d895f-d779-44a7-bb9b-0e66854f43da: finished
-
-  test scenario KeystoneBasic.create_tenant_with_users
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.199 | 0.225  | 0.245  | 0.26   | 0.274 | 0.227 | 100.0%  | 10    |
-  | keystone.create_users  | 1.448 | 1.551  | 1.618  | 1.62   | 1.621 | 1.544 | 100.0%  | 10    |
-  | total                  | 1.702 | 1.78   | 1.819  | 1.83   | 1.842 | 1.772 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 5.34110379219
-  Full duration: 17.6792171001
-
-  test scenario KeystoneBasic.create_add_and_list_user_roles
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.206 | 0.231  | 0.279  | 0.28   | 0.281 | 0.238 | 100.0%  | 10    |
-  | keystone.add_role    | 0.248 | 0.256  | 0.3    | 0.314  | 0.328 | 0.269 | 100.0%  | 10    |
-  | keystone.list_roles  | 0.133 | 0.143  | 0.175  | 0.182  | 0.189 | 0.149 | 100.0%  | 10    |
-  | total                | 0.596 | 0.655  | 0.689  | 0.719  | 0.75  | 0.657 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.96121311188
-  Full duration: 11.1928119659
-
-  test scenario KeystoneBasic.add_and_remove_user_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.201 | 0.224  | 0.231  | 0.232  | 0.233 | 0.22  | 100.0%  | 10    |
-  | keystone.add_role    | 0.245 | 0.259  | 0.287  | 0.295  | 0.304 | 0.265 | 100.0%  | 10    |
-  | keystone.remove_role | 0.137 | 0.148  | 0.164  | 0.172  | 0.18  | 0.15  | 100.0%  | 10    |
-  | total                | 0.605 | 0.631  | 0.668  | 0.673  | 0.679 | 0.635 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.9179649353
-  Full duration: 11.3398149014
-
-  test scenario KeystoneBasic.create_update_and_delete_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.204 | 0.23   | 0.249  | 0.262  | 0.276 | 0.234 | 100.0%  | 10    |
-  | keystone.update_tenant | 0.134 | 0.136  | 0.178  | 0.179  | 0.18  | 0.148 | 100.0%  | 10    |
-  | keystone.delete_tenant | 0.288 | 0.308  | 0.353  | 0.36   | 0.367 | 0.316 | 100.0%  | 10    |
-  | total                  | 0.653 | 0.684  | 0.749  | 0.761  | 0.774 | 0.698 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.11506795883
-  Full duration: 10.1015338898
-
-  test scenario KeystoneBasic.create_and_delete_service
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_service | 0.223 | 0.237  | 0.288  | 0.289  | 0.29  | 0.245 | 100.0%  | 10    |
-  | keystone.delete_service | 0.14  | 0.152  | 0.165  | 0.175  | 0.185 | 0.154 | 100.0%  | 10    |
-  | total                   | 0.373 | 0.389  | 0.43   | 0.442  | 0.453 | 0.399 | 100.0%  | 10    |
-  +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.24712610245
-  Full duration: 9.40017700195
-
-  test scenario KeystoneBasic.create_tenant
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.219 | 0.235  | 0.25   | 0.263  | 0.277 | 0.238 | 100.0%  | 10    |
-  | total                  | 0.219 | 0.236  | 0.25   | 0.263  | 0.277 | 0.238 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.738801002502
-  Full duration: 6.97619819641
-
-  test scenario KeystoneBasic.create_user
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.242 | 0.253  | 0.272  | 0.28   | 0.288 | 0.257 | 100.0%  | 10    |
-  | total                | 0.242 | 0.253  | 0.272  | 0.28   | 0.288 | 0.258 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.813333034515
-  Full duration: 7.2009499073
-
-  test scenario KeystoneBasic.create_and_list_tenants
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.215 | 0.241  | 0.264  | 0.277  | 0.289 | 0.245 | 100.0%  | 10    |
-  | keystone.list_tenants  | 0.128 | 0.136  | 0.183  | 0.202  | 0.22  | 0.151 | 100.0%  | 10    |
-  | total                  | 0.366 | 0.388  | 0.425  | 0.44   | 0.455 | 0.396 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.19499707222
-  Full duration: 10.8357591629
-
-  test scenario KeystoneBasic.create_and_delete_role
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_role | 0.231 | 0.252  | 0.281  | 0.294  | 0.307 | 0.258 | 100.0%  | 10    |
-  | keystone.delete_role | 0.28  | 0.293  | 0.399  | 0.418  | 0.437 | 0.329 | 100.0%  | 10    |
-  | total                | 0.511 | 0.579  | 0.676  | 0.69   | 0.704 | 0.587 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.80924010277
-  Full duration: 10.1753411293
-
-  test scenario KeystoneBasic.get_entities
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_tenant | 0.24  | 0.257  | 0.281  | 0.283  | 0.284 | 0.258 | 100.0%  | 10    |
-  | keystone.create_user   | 0.15  | 0.164  | 0.206  | 0.206  | 0.206 | 0.171 | 100.0%  | 10    |
-  | keystone.create_role   | 0.13  | 0.136  | 0.143  | 0.159  | 0.176 | 0.139 | 100.0%  | 10    |
-  | keystone.get_tenant    | 0.13  | 0.138  | 0.141  | 0.143  | 0.146 | 0.137 | 100.0%  | 10    |
-  | keystone.get_user      | 0.112 | 0.132  | 0.137  | 0.137  | 0.137 | 0.131 | 100.0%  | 10    |
-  | keystone.get_role      | 0.129 | 0.133  | 0.139  | 0.156  | 0.174 | 0.137 | 100.0%  | 10    |
-  | keystone.service_list  | 0.129 | 0.132  | 0.135  | 0.137  | 0.138 | 0.133 | 100.0%  | 10    |
-  | keystone.get_service   | 0.132 | 0.135  | 0.178  | 0.178  | 0.178 | 0.147 | 100.0%  | 10    |
-  | total                  | 1.204 | 1.22   | 1.323  | 1.328  | 1.332 | 1.252 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.79558706284
-  Full duration: 16.6252310276
-
-  test scenario KeystoneBasic.create_and_list_users
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | keystone.create_user | 0.239 | 0.266  | 0.295  | 0.298  | 0.301 | 0.27  | 100.0%  | 10    |
-  | keystone.list_users  | 0.137 | 0.143  | 0.186  | 0.211  | 0.235 | 0.157 | 100.0%  | 10    |
-  | total                | 0.397 | 0.419  | 0.448  | 0.474  | 0.5   | 0.427 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.30778193474
-  Full duration: 8.03108906746
-
-  run_rally - INFO - Test scenario: "keystone" OK.
-
-  run_rally - INFO - Starting test scenario "neutron" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  6e4f3aaf-b5ee-4eeb-8ac3-057f7b4d6309: started
-  Task 6e4f3aaf-b5ee-4eeb-8ac3-057f7b4d6309: finished
-
-  test scenario NeutronNetworks.create_and_delete_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.806 | 0.859  | 0.937  | 0.938  | 0.939 | 0.873 | 100.0%  | 10    |
-  | neutron.delete_port | 0.202 | 0.689  | 0.761  | 0.777  | 0.794 | 0.529 | 100.0%  | 10    |
-  | total               | 1.023 | 1.572  | 1.686  | 1.703  | 1.72  | 1.401 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.3307390213
-  Full duration: 57.6386358738
-
-  test scenario NeutronNetworks.create_and_list_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.739 | 0.817  | 0.85   | 0.861  | 0.871 | 0.812 | 100.0%  | 10    |
-  | neutron.create_router        | 0.079 | 0.545  | 0.57   | 0.584  | 0.598 | 0.499 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.348 | 0.89   | 0.978  | 0.986  | 0.994 | 0.793 | 100.0%  | 10    |
-  | neutron.list_routers         | 0.047 | 0.566  | 0.607  | 0.612  | 0.617 | 0.515 | 100.0%  | 10    |
-  | total                        | 2.172 | 2.707  | 2.868  | 2.88   | 2.891 | 2.618 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 7.91338610649
-  Full duration: 64.1935119629
-
-  test scenario NeutronNetworks.create_and_delete_routers
-  +------------------------------------------------------------------------------------------------------+
-  |                                         Response Times (sec)                                         |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet           | 0.769 | 0.8    | 0.846  | 0.881  | 0.915 | 0.809 | 100.0%  | 10    |
-  | neutron.create_router           | 0.488 | 0.528  | 0.576  | 0.615  | 0.653 | 0.539 | 100.0%  | 10    |
-  | neutron.add_interface_router    | 0.839 | 0.882  | 0.983  | 0.985  | 0.987 | 0.901 | 100.0%  | 10    |
-  | neutron.remove_interface_router | 0.343 | 0.809  | 0.898  | 0.906  | 0.913 | 0.763 | 100.0%  | 10    |
-  | neutron.delete_router           | 0.614 | 0.686  | 0.787  | 0.849  | 0.912 | 0.708 | 100.0%  | 10    |
-  | total                           | 3.419 | 3.666  | 3.994  | 3.997  | 3.999 | 3.719 | 100.0%  | 10    |
-  +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 11.0299580097
-  Full duration: 65.4096131325
-
-  test scenario NeutronNetworks.create_and_list_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.83  | 0.888  | 0.995  | 1.184  | 1.372 | 0.935 | 100.0%  | 10    |
-  | neutron.list_ports  | 0.554 | 0.625  | 0.697  | 0.704  | 0.712 | 0.626 | 100.0%  | 10    |
-  | total               | 1.405 | 1.487  | 1.692  | 1.888  | 2.084 | 1.562 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 5.07633280754
-  Full duration: 59.1840729713
-
-  test scenario NeutronNetworks.create_and_delete_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.731 | 0.806  | 0.857  | 0.933  | 1.01  | 0.812 | 100.0%  | 10    |
-  | neutron.delete_subnet | 0.183 | 0.688  | 0.872  | 0.918  | 0.965 | 0.691 | 100.0%  | 10    |
-  | total                 | 0.948 | 1.544  | 1.665  | 1.681  | 1.696 | 1.503 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.69728302956
-  Full duration: 58.486093998
-
-  test scenario NeutronNetworks.create_and_delete_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.641 | 0.686  | 0.757  | 0.82   | 0.883 | 0.707 | 100.0%  | 10    |
-  | neutron.delete_network | 0.158 | 0.632  | 0.656  | 0.665  | 0.674 | 0.585 | 100.0%  | 10    |
-  | total                  | 0.901 | 1.305  | 1.424  | 1.469  | 1.514 | 1.292 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.96865105629
-  Full duration: 36.4033529758
-
-  test scenario NeutronNetworks.create_and_list_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.634 | 0.679  | 0.751  | 0.797  | 0.844 | 0.695 | 100.0%  | 10    |
-  | neutron.list_networks  | 0.472 | 0.522  | 0.552  | 0.555  | 0.557 | 0.521 | 100.0%  | 10    |
-  | total                  | 1.154 | 1.192  | 1.284  | 1.327  | 1.369 | 1.216 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.68979907036
-  Full duration: 38.8585669994
-
-  test scenario NeutronNetworks.create_and_update_routers
-  +---------------------------------------------------------------------------------------------------+
-  |                                       Response Times (sec)                                        |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet        | 0.759 | 0.82   | 0.863  | 0.871  | 0.879 | 0.819 | 100.0%  | 10    |
-  | neutron.create_router        | 0.518 | 0.558  | 0.62   | 0.627  | 0.634 | 0.566 | 100.0%  | 10    |
-  | neutron.add_interface_router | 0.465 | 0.878  | 1.032  | 1.081  | 1.13  | 0.879 | 100.0%  | 10    |
-  | neutron.update_router        | 0.158 | 0.636  | 0.722  | 0.73   | 0.737 | 0.564 | 100.0%  | 10    |
-  | total                        | 2.298 | 2.877  | 3.13   | 3.178  | 3.226 | 2.827 | 100.0%  | 10    |
-  +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 8.47763490677
-  Full duration: 62.3842899799
-
-  test scenario NeutronNetworks.create_and_update_networks
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_network | 0.627 | 0.673  | 0.974  | 1.044  | 1.114 | 0.744 | 100.0%  | 10    |
-  | neutron.update_network | 0.153 | 0.605  | 0.623  | 0.626  | 0.629 | 0.564 | 100.0%  | 10    |
-  | total                  | 0.809 | 1.285  | 1.576  | 1.65   | 1.723 | 1.308 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.00336408615
-  Full duration: 38.2563900948
-
-  test scenario NeutronNetworks.create_and_update_ports
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_port | 0.796 | 0.874  | 1.084  | 1.1    | 1.116 | 0.908 | 100.0%  | 10    |
-  | neutron.update_port | 0.595 | 0.622  | 0.697  | 0.76   | 0.823 | 0.646 | 100.0%  | 10    |
-  | total               | 1.44  | 1.497  | 1.737  | 1.82   | 1.904 | 1.554 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.89373588562
-  Full duration: 57.0287640095
-
-  test scenario NeutronNetworks.create_and_list_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.706 | 0.775  | 0.866  | 0.893  | 0.92  | 0.789 | 100.0%  | 10    |
-  | neutron.list_subnets  | 0.487 | 0.519  | 0.53   | 0.54   | 0.55  | 0.517 | 100.0%  | 10    |
-  | total                 | 1.233 | 1.291  | 1.393  | 1.414  | 1.435 | 1.307 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.97321105003
-  Full duration: 55.8097410202
-
-  test scenario NeutronNetworks.create_and_update_subnets
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | neutron.create_subnet | 0.72  | 0.834  | 0.873  | 0.905  | 0.936 | 0.819 | 100.0%  | 10    |
-  | neutron.update_subnet | 0.24  | 0.66   | 0.83   | 0.838  | 0.847 | 0.61  | 100.0%  | 10    |
-  | total                 | 1.098 | 1.433  | 1.66   | 1.686  | 1.713 | 1.429 | 100.0%  | 10    |
-  +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.11318302155
-  Full duration: 55.0307190418
-
-  run_rally - INFO - Test scenario: "neutron" OK.
-
-  run_rally - INFO - Starting test scenario "nova" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  52be10f0-6365-4abd-8a9b-5f626b8c2e7a: started
-  Task 52be10f0-6365-4abd-8a9b-5f626b8c2e7a: finished
-
-  test scenario NovaKeypair.create_and_delete_keypair
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.695 | 0.769  | 0.948  | 0.991  | 1.035 | 0.816 | 100.0%  | 10    |
-  | nova.delete_keypair | 0.017 | 0.453  | 0.499  | 0.551  | 0.604 | 0.423 | 100.0%  | 10    |
-  | total               | 0.944 | 1.187  | 1.524  | 1.533  | 1.542 | 1.239 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.69359993935
-  Full duration: 34.1216721535
-
-  test scenario NovaServers.snapshot_server
-  +------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                      |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server       | 6.466  | 7.619  | 9.603  | 9.617  | 9.63   | 7.898  | 100.0%  | 10    |
-  | nova.create_image      | 7.251  | 8.663  | 10.95  | 11.033 | 11.116 | 8.905  | 100.0%  | 10    |
-  | nova.delete_server     | 2.865  | 4.177  | 4.352  | 4.362  | 4.373  | 3.878  | 100.0%  | 10    |
-  | nova.boot_server (2)   | 7.263  | 7.636  | 9.053  | 9.177  | 9.301  | 7.965  | 100.0%  | 10    |
-  | nova.delete_server (2) | 2.41   | 3.487  | 3.939  | 4.129  | 4.318  | 3.406  | 100.0%  | 10    |
-  | nova.delete_image      | 2.217  | 3.339  | 3.856  | 3.864  | 3.873  | 3.205  | 100.0%  | 10    |
-  | total                  | 32.246 | 34.577 | 37.931 | 38.819 | 39.707 | 35.259 | 100.0%  | 10    |
-  +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 104.138304949
-  Full duration: 162.17621994
-
-  test scenario NovaKeypair.boot_and_delete_server_with_keypair
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_keypair | 0.717  | 0.776  | 0.905  | 0.916  | 0.927  | 0.799  | 100.0%  | 10    |
-  | nova.boot_server    | 5.96   | 7.356  | 9.573  | 9.701  | 9.829  | 7.641  | 100.0%  | 10    |
-  | nova.delete_server  | 3.226  | 3.979  | 4.24   | 4.272  | 4.305  | 3.929  | 100.0%  | 10    |
-  | nova.delete_keypair | 0.018  | 0.446  | 0.498  | 0.498  | 0.498  | 0.375  | 100.0%  | 10    |
-  | total               | 11.513 | 12.362 | 14.5   | 14.767 | 15.033 | 12.746 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 37.7138030529
-  Full duration: 95.0321340561
-
-  test scenario NovaKeypair.create_and_list_keypairs
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.create_keypair | 0.706 | 0.754  | 0.859  | 0.881  | 0.904 | 0.766 | 100.0%  | 10    |
-  | nova.list_keypairs  | 0.021 | 0.458  | 0.489  | 0.492  | 0.495 | 0.412 | 100.0%  | 10    |
-  | total               | 0.767 | 1.195  | 1.282  | 1.326  | 1.371 | 1.178 | 100.0%  | 10    |
-  +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.66450190544
-  Full duration: 35.3121151924
-
-  test scenario NovaServers.list_servers
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | nova.list_servers | 1.158 | 1.197  | 1.257  | 1.26   | 1.263 | 1.207 | 100.0%  | 10    |
-  | total             | 1.158 | 1.197  | 1.257  | 1.26   | 1.263 | 1.207 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.67958188057
-  Full duration: 102.272238016
-
-  test scenario NovaServers.resize_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 6.482  | 7.414  | 8.638  | 9.129  | 9.619  | 7.594  | 100.0%  | 10    |
-  | nova.resize         | 12.87  | 13.632 | 13.841 | 14.061 | 14.281 | 13.519 | 100.0%  | 10    |
-  | nova.resize_confirm | 3.854  | 4.236  | 4.429  | 4.579  | 4.729  | 4.184  | 100.0%  | 10    |
-  | nova.delete_server  | 2.853  | 3.971  | 4.187  | 4.209  | 4.231  | 3.798  | 100.0%  | 10    |
-  | total               | 27.866 | 29.013 | 29.93  | 30.646 | 31.361 | 29.095 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 86.1472420692
-  Full duration: 116.147330999
-
-  test scenario NovaServers.boot_server_from_volume_and_delete
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 7.809  | 9.646  | 10.21  | 10.4   | 10.59  | 9.268  | 100.0%  | 10    |
-  | nova.boot_server     | 7.938  | 9.663  | 10.373 | 10.451 | 10.528 | 9.379  | 100.0%  | 10    |
-  | nova.delete_server   | 3.263  | 4.164  | 4.323  | 4.341  | 4.359  | 3.965  | 100.0%  | 10    |
-  | total                | 21.009 | 22.166 | 24.464 | 24.608 | 24.752 | 22.612 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 65.8047540188
-  Full duration: 133.871994019
-
-  test scenario NovaServers.boot_and_migrate_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 6.526  | 7.611  | 9.253  | 9.328  | 9.404  | 7.939  | 100.0%  | 10    |
-  | nova.stop_server    | 3.956  | 4.801  | 7.753  | 7.839  | 7.924  | 5.676  | 100.0%  | 10    |
-  | nova.migrate        | 9.278  | 9.686  | 10.387 | 10.401 | 10.415 | 9.75   | 100.0%  | 10    |
-  | nova.resize_confirm | 3.763  | 4.624  | 4.769  | 4.775  | 4.781  | 4.457  | 100.0%  | 10    |
-  | nova.delete_server  | 3.333  | 3.772  | 4.263  | 4.388  | 4.514  | 3.895  | 100.0%  | 10    |
-  | total               | 28.369 | 30.746 | 35.217 | 35.664 | 36.111 | 31.718 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 95.1431679726
-  Full duration: 124.915132999
-
-  test scenario NovaServers.boot_and_delete_server
-  +--------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                    |
-  +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server   | 7.051  | 7.863  | 9.774  | 9.886  | 9.999  | 8.295  | 100.0%  | 10    |
-  | nova.delete_server | 2.506  | 4.173  | 4.427  | 5.12   | 5.813  | 4.06   | 100.0%  | 10    |
-  | total              | 10.355 | 11.708 | 14.201 | 15.006 | 15.812 | 12.355 | 100.0%  | 10    |
-  +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 36.3530268669
-  Full duration: 92.853083849
-
-  test scenario NovaServers.boot_and_rebuild_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 6.552  | 7.699  | 10.036 | 10.113 | 10.19  | 8.371  | 100.0%  | 10    |
-  | nova.rebuild_server | 9.522  | 11.78  | 13.651 | 13.906 | 14.162 | 11.746 | 100.0%  | 10    |
-  | nova.delete_server  | 3.327  | 4.064  | 4.61   | 4.82   | 5.03   | 4.065  | 100.0%  | 10    |
-  | total               | 19.511 | 25.224 | 26.458 | 26.522 | 26.586 | 24.182 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 73.8343379498
-  Full duration: 129.419740915
-
-  test scenario NovaSecGroup.create_and_list_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 6.563  | 9.397  | 10.161 | 10.173 | 10.185 | 8.839  | 100.0%  | 10    |
-  | nova.create_100_rules          | 45.018 | 49.294 | 56.133 | 56.18  | 56.227 | 50.472 | 100.0%  | 10    |
-  | nova.list_security_groups      | 0.111  | 0.217  | 0.579  | 0.601  | 0.623  | 0.264  | 100.0%  | 10    |
-  | total                          | 52.204 | 58.754 | 65.138 | 65.785 | 66.433 | 59.576 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 179.173851967
-  Full duration: 240.213445902
-
-  test scenario NovaSecGroup.create_and_delete_secgroups
-  +--------------------------------------------------------------------------------------------------------+
-  |                                          Response Times (sec)                                          |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups | 7.358  | 9.711  | 10.153 | 10.476 | 10.798 | 9.428  | 100.0%  | 10    |
-  | nova.create_100_rules          | 47.694 | 51.106 | 54.599 | 55.137 | 55.674 | 51.004 | 100.0%  | 10    |
-  | nova.delete_10_security_groups | 1.777  | 3.576  | 4.456  | 4.736  | 5.016  | 3.515  | 100.0%  | 10    |
-  | total                          | 59.615 | 63.877 | 66.262 | 66.848 | 67.435 | 63.947 | 100.0%  | 10    |
-  +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 191.541640997
-  Full duration: 222.269508839
-
-  test scenario NovaServers.boot_and_bounce_server
-  +-------------------------------------------------------------------------------------------------+
-  |                                      Response Times (sec)                                       |
-  +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                  | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server        | 7.313  | 7.988  | 8.758  | 9.045  | 9.331  | 8.15   | 100.0%  | 10    |
-  | nova.reboot_server      | 5.889  | 6.906  | 7.056  | 7.078  | 7.101  | 6.624  | 100.0%  | 10    |
-  | nova.soft_reboot_server | 6.349  | 6.773  | 8.096  | 8.126  | 8.156  | 6.947  | 100.0%  | 10    |
-  | nova.stop_server        | 4.4    | 5.425  | 6.714  | 7.318  | 7.922  | 5.67   | 100.0%  | 10    |
-  | nova.start_server       | 2.424  | 4.059  | 5.269  | 5.417  | 5.564  | 4.057  | 100.0%  | 10    |
-  | nova.rescue_server      | 8.473  | 9.131  | 9.695  | 9.957  | 10.219 | 9.177  | 100.0%  | 10    |
-  | nova.unrescue_server    | 2.688  | 5.82   | 6.893  | 6.92   | 6.948  | 5.504  | 100.0%  | 10    |
-  | nova.delete_server      | 3.393  | 3.812  | 4.417  | 4.473  | 4.53   | 3.858  | 100.0%  | 10    |
-  | total                   | 47.129 | 50.214 | 51.652 | 52.087 | 52.523 | 50.006 | 100.0%  | 10    |
-  +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 150.170030117
-  Full duration: 206.320158958
-
-  test scenario NovaServers.boot_server
-  +----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                  |
-  +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action           | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.boot_server | 7.775 | 8.214  | 9.964  | 10.061 | 10.157 | 8.648 | 100.0%  | 10    |
-  | total            | 7.775 | 8.214  | 9.965  | 10.061 | 10.157 | 8.649 | 100.0%  | 10    |
-  +------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 25.5615310669
-  Full duration: 72.0356788635
-
-  test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
-  +-----------------------------------------------------------------------------------------------------------+
-  |                                           Response Times (sec)                                            |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.create_10_security_groups    | 7.852  | 9.225  | 10.298 | 10.398 | 10.498 | 9.327  | 100.0%  | 10    |
-  | nova.create_100_rules             | 45.734 | 50.042 | 52.231 | 53.454 | 54.678 | 49.891 | 100.0%  | 10    |
-  | nova.boot_server                  | 5.843  | 6.686  | 7.412  | 7.548  | 7.683  | 6.632  | 100.0%  | 10    |
-  | nova.get_attached_security_groups | 0.173  | 0.215  | 0.678  | 0.757  | 0.836  | 0.311  | 100.0%  | 10    |
-  | nova.delete_server                | 2.437  | 2.94   | 3.313  | 3.412  | 3.512  | 2.92   | 100.0%  | 10    |
-  | nova.delete_10_security_groups    | 2.172  | 3.217  | 4.733  | 5.576  | 6.419  | 3.474  | 100.0%  | 10    |
-  | total                             | 67.914 | 73.688 | 75.248 | 75.466 | 75.684 | 72.556 | 100.0%  | 10    |
-  +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 217.134851933
-  Full duration: 273.106995821
-
-  test scenario NovaServers.pause_and_unpause_server
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | nova.boot_server    | 7.355  | 8.061  | 9.184  | 9.727  | 10.271 | 8.306  | 100.0%  | 10    |
-  | nova.pause_server   | 2.766  | 3.437  | 3.779  | 3.807  | 3.836  | 3.361  | 100.0%  | 10    |
-  | nova.unpause_server | 2.762  | 3.685  | 3.988  | 4.013  | 4.037  | 3.492  | 100.0%  | 10    |
-  | nova.delete_server  | 2.835  | 3.909  | 4.299  | 4.343  | 4.387  | 3.776  | 100.0%  | 10    |
-  | total               | 16.602 | 18.903 | 20.184 | 20.456 | 20.729 | 18.936 | 100.0%  | 10    |
-  +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 57.0698840618
-  Full duration: 114.94224596
-
-  test scenario NovaServers.boot_server_from_volume
-  +----------------------------------------------------------------------------------------------+
-  |                                     Response Times (sec)                                     |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  | cinder.create_volume | 7.772  | 10.48  | 10.909 | 11.031 | 11.154 | 9.647  | 100.0%  | 10    |
-  | nova.boot_server     | 8.129  | 9.825  | 11.137 | 11.167 | 11.196 | 9.722  | 100.0%  | 10    |
-  | total                | 16.389 | 19.221 | 21.482 | 21.884 | 22.285 | 19.369 | 100.0%  | 10    |
-  +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
-  Load duration: 57.2666420937
-  Full duration: 114.729999065
-
-  test scenario NovaServers.boot_and_list_server
-  +-----------------------------------------------------------------------------------------+
-  |                                  Response Times (sec)                                   |
-  +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
-  +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  | nova.boot_server  | 7.43  | 8.747  | 9.88   | 10.022 | 10.163 | 8.832 | 100.0%  | 10    |
-  | nova.list_servers | 0.267 | 1.207  | 1.259  | 1.275  | 1.29   | 1.04  | 100.0%  | 10    |
-  | total             | 8.602 | 9.378  | 11.07  | 11.227 | 11.384 | 9.873 | 100.0%  | 10    |
-  +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
-  Load duration: 29.5450980663
-  Full duration: 106.656322002
-
-  run_rally - INFO - Test scenario: "nova" OK.
-
-  run_rally - INFO - Starting test scenario "quotas" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  dcebd6f2-6fd1-4d5d-8d66-445030082b6c: started
-  Task dcebd6f2-6fd1-4d5d-8d66-445030082b6c: finished
-
-  test scenario Quotas.cinder_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 1.163 | 1.265  | 1.531  | 1.556  | 1.581 | 1.345 | 100.0%  | 10    |
-  | total                | 1.163 | 1.265  | 1.531  | 1.556  | 1.581 | 1.345 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 4.06574201584
-  Full duration: 14.4119129181
-
-  test scenario Quotas.neutron_update
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.498 | 0.56   | 0.589  | 0.591  | 0.593 | 0.558 | 100.0%  | 10    |
-  | total                | 0.62  | 0.66   | 0.701  | 0.702  | 0.703 | 0.667 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 2.05467915535
-  Full duration: 11.7390589714
-
-  test scenario Quotas.cinder_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 1.19  | 1.288  | 1.399  | 1.415  | 1.432 | 1.303 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.531 | 1.107  | 1.208  | 1.235  | 1.262 | 1.062 | 100.0%  | 10    |
-  | total                | 1.779 | 2.435  | 2.535  | 2.549  | 2.562 | 2.365 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 7.07872509956
-  Full duration: 17.2571020126
-
-  test scenario Quotas.nova_update_and_delete
-  +-------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | quotas.update_quotas | 0.669 | 0.708  | 0.732  | 0.745  | 0.757 | 0.703 | 100.0%  | 10    |
-  | quotas.delete_quotas | 0.02  | 0.508  | 0.557  | 0.558  | 0.559 | 0.466 | 100.0%  | 10    |
-  | total                | 0.727 | 1.212  | 1.275  | 1.28   | 1.285 | 1.169 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 3.64670991898
-  Full duration: 13.1532580853
-
-  test scenario Quotas.nova_update
-  +------------------------------------------------------------------------------------------+
-  |                                   Response Times (sec)                                   |
-  +----------------------+-------+--------+--------+--------+------+-------+---------+-------+
-  | action               | min   | median | 90%ile | 95%ile | max  | avg   | success | count |
-  +----------------------+-------+--------+--------+--------+------+-------+---------+-------+
-  | quotas.update_quotas | 0.652 | 0.726  | 0.761  | 0.766  | 0.77 | 0.722 | 100.0%  | 10    |
-  | total                | 0.652 | 0.727  | 0.762  | 0.766  | 0.77 | 0.722 | 100.0%  | 10    |
-  +----------------------+-------+--------+--------+--------+------+-------+---------+-------+
-  Load duration: 2.22018194199
-  Full duration: 11.9367260933
-
-  run_rally - INFO - Test scenario: "quotas" OK.
-
-  run_rally - INFO - Starting test scenario "requests" ...
-  run_rally - INFO -
-   Preparing input task
-   Task  89de006e-a4fd-4526-9211-477075f8e5fc: started
-  Task 89de006e-a4fd-4526-9211-477075f8e5fc: finished
-
-  test scenario HttpRequests.check_random_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 0.184 | 0.456  | 1.019  | 1.022  | 1.026 | 0.555 | 100.0%  | 10    |
-  | total                  | 0.184 | 0.456  | 1.02   | 1.023  | 1.026 | 0.555 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 1.69973492622
-  Full duration: 5.72609114647
-
-  test scenario HttpRequests.check_request
-  +---------------------------------------------------------------------------------------------+
-  |                                    Response Times (sec)                                     |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  | requests.check_request | 0.185 | 0.189  | 0.191  | 0.194  | 0.197 | 0.189 | 100.0%  | 10    |
-  | total                  | 0.185 | 0.189  | 0.191  | 0.194  | 0.197 | 0.189 | 100.0%  | 10    |
-  +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
-  Load duration: 0.616016864777
-  Full duration: 4.89253997803
-
-  run_rally - INFO - Test scenario: "requests" OK.
-
-  run_rally - INFO -
-
-                       Rally Summary Report
-  +===================+============+===============+===========+
-  | Module            | Duration   | nb. Test Run  | Success   |
-  +===================+============+===============+===========+
-  | authenticate      | 00:35      | 10            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | glance            | 02:20      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | cinder            | 19:44      | 50            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | heat              | 09:29      | 35            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | keystone          | 01:59      | 29            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | neutron           | 10:48      | 31            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | nova              | 39:36      | 61            | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | quotas            | 01:08      | 7             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  | requests          | 00:10      | 2             | 100.00%   |
-  +-------------------+------------+---------------+-----------+
-  +===================+============+===============+===========+
-  | TOTAL:            | 01:25:53   | 232           | 100.00%   |
-  +===================+============+===============+===========+
-
-
-SDN Controller
---------------
-
-ODL
-^^^
-::
-
-  ==============================================================================
-  Basic
-  ==============================================================================
-  Basic.010 Restconf OK :: Test suite to verify Restconf is OK
-  ==============================================================================
-  Get Controller Modules :: Get the controller modules via Restconf     | PASS |
-  ------------------------------------------------------------------------------
-  Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
-  1 critical test, 1 passed, 0 failed
-  1 test total, 1 passed, 0 failed
-  ==============================================================================
-  Basic                                                                 | PASS |
-  1 critical test, 1 passed, 0 failed
-  1 test total, 1 passed, 0 failed
-  ==============================================================================
-  Output:  /home/opnfv/output.xml
-  Log:     /home/opnfv/log.html
-  Report:  /home/opnfv/report.html
-  ==============================================================================
-  Neutron :: Test suite for Neutron Plugin
-  ==============================================================================
-  Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
-  ==============================================================================
-  Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
-  ------------------------------------------------------------------------------
-  Create Network :: Create new network in OpenStack                     | PASS |
-  ------------------------------------------------------------------------------
-  Check Network :: Check Network created in OpenDaylight                | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
-  4 critical tests, 4 passed, 0 failed
-  4 tests total, 4 passed, 0 failed
-  ==============================================================================
-  Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
-  ==============================================================================
-  Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
-  ------------------------------------------------------------------------------
-  Create New subnet :: Create new subnet in OpenStack                   | PASS |
-  ------------------------------------------------------------------------------
-  Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
-  4 critical tests, 4 passed, 0 failed
-  4 tests total, 4 passed, 0 failed
-  ==============================================================================
-  Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
-  ==============================================================================
-  Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
-  ------------------------------------------------------------------------------
-  Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
-  ------------------------------------------------------------------------------
-  Create New Port :: Create new port in OpenStack                       | PASS |
-  ------------------------------------------------------------------------------
-  Check New Port :: Check new subnet created in OpenDaylight            | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
-  4 critical tests, 4 passed, 0 failed
-  4 tests total, 4 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
-  ==============================================================================
-  Delete New Port :: Delete previously created port in OpenStack        | PASS |
-  ------------------------------------------------------------------------------
-  Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
-  ==============================================================================
-  Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
-  ------------------------------------------------------------------------------
-  Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
-  ==============================================================================
-  Delete Network :: Delete network in OpenStack                         | PASS |
-  ------------------------------------------------------------------------------
-  Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
-  ------------------------------------------------------------------------------
-  Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
-  2 critical tests, 2 passed, 0 failed
-  2 tests total, 2 passed, 0 failed
-  ==============================================================================
-  Neutron :: Test suite for Neutron Plugin                              | PASS |
-  18 critical tests, 18 passed, 0 failed
-  18 tests total, 18 passed, 0 failed
-
-
-Feature tests
--------------
-
-Promise
-^^^^^^^
-::
-
-  FUNCTEST.info: Running PROMISE test case...
-  Promise- INFO - Creating tenant 'promise'...
-  Promise- INFO - Adding role 'eed9b04b536646c994679496e7b653cc' to tenant 'promise'...
-  Promise- INFO - Creating user 'promiser'...
-  Promise- INFO - Updating OpenStack credentials...
-  Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
-  Promise- INFO - Creating flavor 'promise-flavor'...
-  Promise- INFO - Exporting environment variables...
-  Promise- INFO - Running command: npm run -s test -- --reporter json
-  Promise- INFO - The test succeeded.
-  {
-    "stats": {
-      "suites": 23,
-      "tests": 33,
-      "passes": 33,
-      "pending": 0,
-      "failures": 0,
-      "start": "2016-02-23T10:44:37.402Z",
-      "end": "2016-02-23T10:44:42.006Z",
-      "duration": 4604
-    },
-    "tests": [
-      {
-        "title": "should add a new OpenStack provider without error",
-        "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-        "duration": 1171,
-        "err": {}
-      },
-      {
-        "title": "should update promise.providers with a new entry",
-        "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-        "duration": 7,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceProvider record in the store",
-        "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-        "duration": 1,
-        "err": {}
-      },
-      {
-        "title": "should add more capacity to the reservation service without error",
-        "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-        "duration": 29,
-        "err": {}
-      },
-      {
-        "title": "should update promise.pools with a new entry",
-        "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-        "duration": 1,
-        "err": {}
-      },
-      {
-        "title": "should contain a ResourcePool record in the store",
-        "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should report total collections and utilizations",
-        "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-        "duration": 23,
-        "err": {}
-      },
-      {
-        "title": "should contain newly added capacity pool",
-        "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-        "duration": 13,
-        "err": {}
-      },
-      {
-        "title": "should create a new server in target provider without error",
-        "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-        "duration": 1144,
-        "err": {}
-      },
-      {
-        "title": "should update promise.allocations with a new entry",
-        "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-        "duration": 3,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceAllocation record in the store",
-        "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should reference the created server ID from the provider",
-        "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should have low priority state",
-        "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should create reservation record (no start/end) without error",
-        "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-        "duration": 71,
-        "err": {}
-      },
-      {
-        "title": "should update promise.reservations with a new entry",
-        "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-        "duration": 9,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceReservation record in the store",
-        "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should create a new server in target provider (with reservation) without error",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-        "duration": 1025,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceAllocation record in the store",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should be referenced in the reservation record",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-        "duration": 5,
-        "err": {}
-      },
-      {
-        "title": "should have high priority state",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should create reservation record (for future) without error",
-        "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-        "duration": 125,
-        "err": {}
-      },
-      {
-        "title": "should update promise.reservations with a new entry",
-        "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-        "duration": 18,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceReservation record in the store",
-        "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should contain newly created future reservation",
-        "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-        "duration": 74,
-        "err": {}
-      },
-      {
-        "title": "should modify existing reservation without error",
-        "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-        "duration": 88,
-        "err": {}
-      },
-      {
-        "title": "should modify existing reservation without error",
-        "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-        "duration": 19,
-        "err": {}
-      },
-      {
-        "title": "should no longer contain record of the deleted reservation",
-        "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-        "duration": 1,
-        "err": {}
-      },
-      {
-        "title": "should decrease available capacity from a provider in the future",
-        "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-        "duration": 18,
-        "err": {}
-      },
-      {
-        "title": "should increase available capacity from a provider in the future",
-        "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-        "duration": 13,
-        "err": {}
-      },
-      {
-        "title": "should report available collections and utilizations",
-        "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-        "duration": 66,
-        "err": {}
-      },
-      {
-        "title": "should fail to create immediate reservation record with proper error",
-        "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-        "duration": 74,
-        "err": {}
-      },
-      {
-        "title": "should fail to create future reservation record with proper error",
-        "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-        "duration": 69,
-        "err": {}
-      },
-      {
-        "title": "should successfully destroy all allocations",
-        "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-        "duration": 507,
-        "err": {}
-      }
-    ],
-    "pending": [],
-    "failures": [],
-    "passes": [
-      {
-        "title": "should add a new OpenStack provider without error",
-        "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
-        "duration": 1171,
-        "err": {}
-      },
-      {
-        "title": "should update promise.providers with a new entry",
-        "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
-        "duration": 7,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceProvider record in the store",
-        "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
-        "duration": 1,
-        "err": {}
-      },
-      {
-        "title": "should add more capacity to the reservation service without error",
-        "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
-        "duration": 29,
-        "err": {}
-      },
-      {
-        "title": "should update promise.pools with a new entry",
-        "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
-        "duration": 1,
-        "err": {}
-      },
-      {
-        "title": "should contain a ResourcePool record in the store",
-        "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should report total collections and utilizations",
-        "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
-        "duration": 23,
-        "err": {}
-      },
-      {
-        "title": "should contain newly added capacity pool",
-        "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
-        "duration": 13,
-        "err": {}
-      },
-      {
-        "title": "should create a new server in target provider without error",
-        "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
-        "duration": 1144,
-        "err": {}
-      },
-      {
-        "title": "should update promise.allocations with a new entry",
-        "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
-        "duration": 3,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceAllocation record in the store",
-        "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should reference the created server ID from the provider",
-        "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should have low priority state",
-        "fullTitle": "promise allocation without reservation create-instance should have low priority state",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should create reservation record (no start/end) without error",
-        "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
-        "duration": 71,
-        "err": {}
-      },
-      {
-        "title": "should update promise.reservations with a new entry",
-        "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
-        "duration": 9,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceReservation record in the store",
-        "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should create a new server in target provider (with reservation) without error",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
-        "duration": 1025,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceAllocation record in the store",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should be referenced in the reservation record",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
-        "duration": 5,
-        "err": {}
-      },
-      {
-        "title": "should have high priority state",
-        "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should create reservation record (for future) without error",
-        "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
-        "duration": 125,
-        "err": {}
-      },
-      {
-        "title": "should update promise.reservations with a new entry",
-        "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
-        "duration": 18,
-        "err": {}
-      },
-      {
-        "title": "should contain a new ResourceReservation record in the store",
-        "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
-        "duration": 0,
-        "err": {}
-      },
-      {
-        "title": "should contain newly created future reservation",
-        "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
-        "duration": 74,
-        "err": {}
-      },
-      {
-        "title": "should modify existing reservation without error",
-        "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
-        "duration": 88,
-        "err": {}
-      },
-      {
-        "title": "should modify existing reservation without error",
-        "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
-        "duration": 19,
-        "err": {}
-      },
-      {
-        "title": "should no longer contain record of the deleted reservation",
-        "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
-        "duration": 1,
-        "err": {}
-      },
-      {
-        "title": "should decrease available capacity from a provider in the future",
-        "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
-        "duration": 18,
-        "err": {}
-      },
-      {
-        "title": "should increase available capacity from a provider in the future",
-        "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
-        "duration": 13,
-        "err": {}
-      },
-      {
-        "title": "should report available collections and utilizations",
-        "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
-        "duration": 66,
-        "err": {}
-      },
-      {
-        "title": "should fail to create immediate reservation record with proper error",
-        "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
-        "duration": 74,
-        "err": {}
-      },
-      {
-        "title": "should fail to create future reservation record with proper error",
-        "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
-        "duration": 69,
-        "err": {}
-      },
-      {
-        "title": "should successfully destroy all allocations",
-        "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
-        "duration": 507,
-        "err": {}
-      }
-    ]
-  }
-  Promise- INFO -
-  ****************************************
-            Promise test report
-
-  ****************************************
-   Suites:     23
-   Tests:      33
-   Passes:     33
-   Pending:    0
-   Failures:   0
-   Start:      2016-02-23T10:44:37.402Z
-   End:        2016-02-23T10:44:42.006Z
-   Duration:   4.604
-  ****************************************
-
-  Promise- INFO - Pushing results to DB...
diff --git a/docs/results/overview.rst b/docs/results/overview.rst
deleted file mode 100644 (file)
index ea71426..0000000
+++ /dev/null
@@ -1,79 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-FuncTest test result document overview
-======================================
-
-Functest project is described in `Functest user guide`_.
-The user guide details the different test cases as well as the possible errors.
-A `developer guide`_ and a `configuration guide`_ are also available.
-
-Functest is run systematically at the end of an OPNFV fresh installation.
-All the runnable tests are run sequentially. The installer and the scenario are
-considered to evaluate whether the test case can be run or not. That is why all
-the number of test cases may vary from 1 installer to another and from 1
-scenario to another.
-
-The list of scenario supported by installer can be described as follows:
-
-+----------------+---------+---------+---------+---------+
-|    Scenario    |  Apex   | Compass |  Fuel   |   Joid  |
-+================+=========+=========+=========+=========+
-|   odl_l2       |    X    |    X    |    X    |    X    |
-+----------------+---------+---------+---------+---------+
-|   onos         |         |    X    |         |         |
-+----------------+---------+---------+---------+---------+
-|   nosdn        |         |    X    |    X    |         |
-+----------------+---------+---------+---------+---------+
-|   ovs (dpdk)   |         |         |    X    |         |
-+----------------+---------+---------+---------+---------+
-
-The matrix below details the Functest runnable tests versus the installer and
-the scenario:
-
-+----------------+-------------+-------------+-------------+-------------+
-|  Test cases    |    Apex     |   Compass   |    Fuel     |     Joid    |
-+================+=============+=============+=============+=============+
-|   vPing SSH    | all         | all         | all         | all         |
-+----------------+-------------+-------------+-------------+-------------+
-| vPing userdata | all except  | all except  | all except  | all except  |
-|                | ONOS        | ONOS        | ONOS        | ONOS        |
-+----------------+-------------+-------------+-------------+-------------+
-| Tempest        | all         | all         | all         | all         |
-+----------------+-------------+-------------+-------------+-------------+
-| Rally          | all         | all         | all         | all         |
-+----------------+-------------+-------------+-------------+-------------+
-| ODL            | all ODL     | all ODL     | all ODL     | all ODL     |
-+----------------+-------------+-------------+-------------+-------------+
-| ONOS           | ONOS        | ONOS        | ONOS        | ONOS        |
-+----------------+-------------+-------------+-------------+-------------+
-| Promise        | no          | no          | all         | all         |
-+----------------+-------------+-------------+-------------+-------------+
-| vIMS           | all except  | all except  | all except  | all except  |
-|                | ONOS        | ONOS        | ONOS        | ONOS        |
-+----------------+-------------+-------------+-------------+-------------+
-| Doctor         | all         | no          | no          | no          |
-+----------------+-------------+-------------+-------------+-------------+
-
-all means that the test case is run on all the scenarios related to the
-installer.
-
-Functest results from continuous integration can be found in:
- * jenkins logs: https://build.opnfv.org/ci/view/functest/
- * artifacts http://artifacts.opnfv.org/, it includes the tempest logs and the
- Rally html pages
-
-Additional test result assests and information
-==============================================
-
-The Functest deals with 2 dashboards:
- * The `Test Dashboard`_ provides an overview of all the projects
- * The  `Functest Dashboard`_ dedicated to Functest real-time test results
-
-    * is used to provide a quick overview of the different testcases according to installer and scenario.
-
-.. _`Test Dashboard`: https://www.opnfv.org/opnfvtestgraphs/per-test-projects/default
-.. _`Functest Dashboard`: https://testresults.opnfv.org/dashboard/
-.. _`Functest user guide`: artifacts.opnfv.org/functest/docs/userguide/index.html
-.. _`developer guide`: artifacts.opnfv.org/functest/docs/devguide/index.html
-.. _`configuration guide`: artifacts.opnfv.org/functest/docs/configguide/index.html
diff --git a/docs/results/results.rst b/docs/results/results.rst
deleted file mode 100644 (file)
index f4f210a..0000000
+++ /dev/null
@@ -1,73 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
-.. http://creativecommons.org/licenses/by/4.0
-
-Results listed by scenario
-==========================
-
-The following sections describe the functest results as evaluated for
-the Brahmaputra release scenario validation runs.  Each section describes
-the determined state of the specific scenario as deployed in the Brahmaputra
-release process.
-
-To qualify for release the scenarios must have deployed and been successfully
-tested in four consecutive installations to establish stability of deployment
-and feature capability
-
-.. toctree::
-
-.. include:: ./compass-os-nosdn-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./compass-os-odl_l2-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./compass-os-onos-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./fuel-os-nosdn-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./fuel-os-nosdn-ovs-ha.rst
-
-.. toctree::
-
-.. include:: ./fuel-os-odl_l2-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./fuel-os-onos-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./apex-os-odl_l2-nofeature-ha.rst
-
-.. toctree::
-
-.. include:: ./joid-os-odl_l2-nofeature-ha.rst
-
-.. Add each of the scenario files as they are set to
-.. release ready and the results are available for publishing.
-
-.. apex-os-ocl-nofeature-ha.rst
-.. apex-os-odl_l2-sfc-ha.rst
-.. apex-os-odl_l3-nofeature-ha.rst
-.. apex-os-onos-nofeature-ha.rst
-.. apex-os-odl_l2-nofeature-ha.rst
-.. compass-os-onos-nofeature-ha.rst
-.. compass-os-ocl-nofeature-ha.rst
-.. compass-os-odl_l2-nofeature-ha.rst
-.. fuel-os-nosdn-kvm-ha.rst
-.. fuel-os-nosdn-nofeature-ha.rst
-.. fuel-os-nosdn-ovs-ha.rst
-.. fuel-os-odl_l2-bgpvpn-ha.rst
-.. fuel-os-odl_l2-nofeature-ha.rst
-.. fuel-os-odl_l3-nofeature-ha.rst
-.. fuel-os-onos-nofeature-ha.rst
-.. joid-os-nosdn-nofeature-ha.rst
-.. joid-os-ocl-nofeature-ha.rst
-.. joid-os-odl_l2-nofeature-ha.rst
-.. joid-os-onos-nofeature-ha.rst