docs/results/fuel-os-nosdn-nofeature-ha.rst

   1 .. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
   2 .. http://creativecommons.org/licenses/by/4.0
   3
   4 Detailed test results for fuel-os-nosdn-nofeature-ha
   5 -------------------------------------------------------
   6
   7 The following section outlines the detailed Functest results for the Brahmaputra scenario
   8 deploying OpenStack in a Pharos environment by the Fuel installer.
   9
  10 vPing_SSH
  11 ^^^^^^^^^
  12 ::
  13     FUNCTEST.info: Running vPing-SSH test...
  14     vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
  15     vPing_ssh- INFO - Creating neutron network vping-net...
  16     vPing_ssh- INFO - Creating security group  'vPing-sg'...
  17     vPing_ssh- INFO - Using existing Flavor 'm1.small'...
  18     vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
  19     vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
  20      name=opnfv-vping-1
  21      flavor=<Flavor: m1.small>
  22      image=fff41d5d-579a-4c26-844d-4e86700c44f6
  23      network=a5137d46-dea8-4f85-8872-08c4a5927182
  24
  25     vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
  26     vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
  27     vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
  28      name=opnfv-vping-2
  29      flavor=<Flavor: m1.small>
  30      image=fff41d5d-579a-4c26-844d-4e86700c44f6
  31      network=a5137d46-dea8-4f85-8872-08c4a5927182
  32
  33     vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
  34     vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
  35     vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
  36     vPing_ssh- INFO - Floating IP created: '10.118.101.200'
  37     vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
  38     vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
  39     vPing_ssh- INFO - Waiting for ping...
  40     vPing_ssh- INFO - vPing detected!
  41     vPing_ssh- INFO - vPing duration:'42.1' s.
  42     vPing_ssh- INFO - Cleaning up...
  43     vPing_ssh- INFO - vPing OK
  44 ::
  45
  46
  47 vPing_userdata
  48 ^^^^^^^^^^^^^^
  49 ::
  50     FUNCTEST.info: Running vPing-userdata test...
  51     vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
  52     vPing_userdata- INFO - Creating neutron network vping-net...
  53     vPing_userdata- INFO - Creating security group  'vPing-sg'...
  54     vPing_userdata- INFO - Flavor found 'm1.small'
  55     vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
  56     vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
  57      name=opnfv-vping-1
  58      flavor=<Flavor: m1.small>
  59      image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
  60      network=a1efb318-1338-436f-8f26-3a1bacab0538
  61
  62     vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
  63     vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
  64      name=opnfv-vping-2
  65      flavor=<Flavor: m1.small>
  66      image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
  67      network=a1efb318-1338-436f-8f26-3a1bacab0538
  68      userdata=
  69     #!/bin/sh
  70
  71     while true; do
  72      ping -c 1 192.168.130.4 2>&1 >/dev/null
  73      RES=$?
  74      if [ "Z$RES" = "Z0" ] ; then
  75       echo 'vPing OK'
  76      break
  77      else
  78       echo 'vPing KO'
  79      fi
  80      sleep 1
  81     done
  82
  83     vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
  84     vPing_userdata- INFO - Waiting for ping...
  85     vPing_userdata- INFO - vPing detected!
  86     vPing_userdata- INFO - vPing duration:'28.6'
  87     vPing_userdata- INFO - vPing OK
  88     vPing_userdata- INFO - Cleaning up...
  89     vPing_userdata- INFO - Deleting network 'vping-net'...
  90 ::
  91
  92
  93 Tempest
  94 ^^^^^^^
  95 ::
  96     +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
  97     | name                                                                                                                                     | time      | status  |
  98     +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
  99     | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.29312   | success |
 100     | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.12976   | success |
 101     | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 23.95577  | success |
 102     | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 32.53650  | success |
 103     | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 22.68958  | success |
 104     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.54691   | success |
 105     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.30066   | success |
 106     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.57103   | success |
 107     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.97553   | success |
 108     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.37256   | success |
 109     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.33110   | success |
 110     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.34175   | success |
 111     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.35964   | success |
 112     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.62128   | success |
 113     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.88552   | success |
 114     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.35258   | success |
 115     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 1.14056   | success |
 116     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.64330   | success |
 117     | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 1.59904   | success |
 118     | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.85262   | success |
 119     | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.89806   | success |
 120     | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.43298   | success |
 121     | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 2.74835   | success |
 122     | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 7.51973   | success |
 123     | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 17.31905  | success |
 124     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 0.0       | fail    |
 125     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.0       | fail    |
 126     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.0       | fail    |
 127     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.0       | fail    |
 128     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.0       | fail    |
 129     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 0.0       | fail    |
 130     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.0       | fail    |
 131     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.0       | fail    |
 132     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.0       | fail    |
 133     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.0       | fail    |
 134     | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.11526   | success |
 135     | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 4.43153   | success |
 136     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.49287   | success |
 137     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.32071   | success |
 138     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.24839   | success |
 139     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.62886   | success |
 140     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.45498   | success |
 141     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.11221   | success |
 142     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.07743   | success |
 143     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.07866   | success |
 144     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.08414   | success |
 145     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.09610   | success |
 146     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.87584   | success |
 147     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00178   | skip    |
 148     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.18671   | success |
 149     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.07254   | success |
 150     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.02355   | success |
 151     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.09336   | success |
 152     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08789   | success |
 153     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.02832   | success |
 154     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01969   | success |
 155     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.05608   | success |
 156     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.09405   | success |
 157     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.07124   | success |
 158     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 1.09862   | success |
 159     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.02806   | success |
 160     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.10085   | success |
 161     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00074   | skip    |
 162     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 7.05293   | success |
 163     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 12.83974  | success |
 164     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 75.96327  | success |
 165     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.89960   | skip    |
 166     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 86.10969  | success |
 167     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 14.36274  | success |
 168     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 25.20801  | success |
 169     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 9.79668   | success |
 170     | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.10422   | success |
 171     | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.45171   | success |
 172     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.71962   | success |
 173     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.37393   | success |
 174     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.39671   | success |
 175     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.67878   | success |
 176     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.96139   | success |
 177     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.70247   | success |
 178     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 5.01425   | success |
 179     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 21.66147  | success |
 180     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 29.15375  | success |
 181     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 17.01011  | success |
 182     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 15.12162  | success |
 183     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 2.32047   | success |
 184     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 2.43351   | success |
 185     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 3.54755   | success |
 186     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 3.49832   | success |
 187     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 1.66971   | success |
 188     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.67563   | success |
 189     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 1.52468   | success |
 190     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 2.11125   | success |
 191     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 1.11519   | success |
 192     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 1.59954   | success |
 193     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 2.71532   | success |
 194     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.67781   | success |
 195     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.80861   | success |
 196     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 1.12394   | success |
 197     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.98070   | success |
 198     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.95038   | success |
 199     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.58962   | success |
 200     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.76753   | success |
 201     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.92874   | success |
 202     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 1.98170   | success |
 203     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.09696   | success |
 204     | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.23813   | success |
 205     | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.02568   | success |
 206     | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.73035   | success |
 207     | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.03287   | success |
 208     | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.61622   | success |
 209     | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.10251   | success |
 210     | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.32244   | success |
 211     | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05310   | success |
 212     | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 46.35639  | success |
 213     | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 1.19554   | success |
 214     | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.13783   | success |
 215     | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.28038   | success |
 216     | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.02405   | success |
 217     | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.0       | fail    |
 218     | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.0       | fail    |
 219     | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.0       | fail    |
 220     | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.0       | fail    |
 221     | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 1.06799   | success |
 222     | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.70652   | success |
 223     | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.0       | fail    |
 224     | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.56777   | success |
 225     | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.34317   | success |
 226     | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.61946   | success |
 227     | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.0       | fail    |
 228     | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.55157   | success |
 229     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.10777   | success |
 230     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.09198   | success |
 231     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.08536   | success |
 232     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.12301   | success |
 233     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.19557   | success |
 234     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.11454   | success |
 235     | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.58158   | success |
 236     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 1.96230   | success |
 237     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 3.11881   | success |
 238     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 31.78599  | success |
 239     | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 6.18197   | success |
 240     | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 0.36573   | fail    |
 241     | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 4.19923   | success |
 242     | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 2.05001   | success |
 243     | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 2.85155   | success |
 244     | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 4.85758   | success |
 245     | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 2.47936   | success |
 246     | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 4.29082   | success |
 247     | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 4.14373   | success |
 248     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 2.85702   | success |
 249     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.63578   | success |
 250     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.44139   | success |
 251     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.31069   | success |
 252     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.31575   | success |
 253     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.34149   | success |
 254     | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 2.96967   | success |
 255     | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.61978   | success |
 256     | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.30406   | success |
 257     | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.29284   | success |
 258     | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.07605   | success |
 259     | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.28866   | success |
 260     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 3.34364   | success |
 261     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 2.65709   | success |
 262     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.51327   | success |
 263     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.34515   | success |
 264     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.34468   | success |
 265     | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 3.78910   | success |
 266     | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 3.78827   | success |
 267     | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 2.58076   | success |
 268     | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.35346   | success |
 269     | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.38372   | success |
 270     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 8.02302   | success |
 271     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 5.55884   | success |
 272     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 4.89503   | success |
 273     | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 3.13616   | success |
 274     | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 7.91220   | success |
 275     | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 4.35397   | success |
 276     | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 4.24212   | success |
 277     | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 3.20634   | success |
 278     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 2.00386   | success |
 279     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 3.26379   | success |
 280     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.29497   | success |
 281     | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 2.34355   | success |
 282     | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.27875   | success |
 283     | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.05434   | success |
 284     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.63001   | success |
 285     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 7.10424   | success |
 286     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.06177   | success |
 287     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.0       | fail    |
 288     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.0       | fail    |
 289     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.0       | fail    |
 290     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.0       | fail    |
 291     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.0       | fail    |
 292     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.0       | fail    |
 293     | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.98140   | success |
 294     | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.05857   | success |
 295     | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 19.61269  | success |
 296     | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 4.21790   | success |
 297     | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.96832   | success |
 298     | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.59962   | success |
 299     | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 14.77900  | success |
 300     | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 19.28760  | success |
 301     | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 14.36310  | success |
 302     | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 24.02107  | success |
 303     | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.05931   | success |
 304     | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.31742   | success |
 305     | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 54.55460  | success |
 306     | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 41.67013  | fail    |
 307     | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 109.37734 | success |
 308     | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 61.05784  | fail    |
 309     +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
 310     run_tempest - INFO - Results: {'timestart': '2016-02-1813:29:52.500975', 'duration': 416, 'tests': 210, 'failures': 25}
 311 ::
 312
 313
 314 vIMS
 315 ^^^^
 316 ::
 317     FUNCTEST.info: Running vIMS test...
 318     vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
 319     vIMS - INFO - Update OpenStack creds informations
 320     vIMS - INFO - Upload some OS images if it doesn't exist
 321     vIMS - INFO - centos_7 image doesn't exist on glance repository.
 322                                 Try downloading this image and upload on glance !
 323     vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
 324                                 Try downloading this image and upload on glance !
 325     vIMS - INFO - Update security group quota for this tenant
 326     vIMS - INFO - Update cinder quota for this tenant
 327     vIMS - INFO - Collect flavor id for cloudify manager server
 328     vIMS - INFO - Prepare virtualenv for cloudify-cli
 329     vIMS - INFO - Downloading the cloudify manager server blueprint
 330     vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
 331     vIMS - INFO - Writing the inputs file
 332     vIMS - INFO - Launching the cloudify-manager deployment
 333     vIMS - INFO - Cloudify-manager server is UP !
 334     vIMS - INFO - Cloudify deployment duration:'1149.9'
 335     vIMS - INFO - Collect flavor id for all clearwater vm
 336     vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
 337     vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
 338     vIMS - INFO - Writing the inputs file
 339     vIMS - INFO - Launching the clearwater deployment
 340     vIMS - INFO - The deployment of clearwater-opnfv is ended
 341     vIMS - INFO - vIMS VNF deployment duration:'1133.8'
 342     vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
 343     vIMS - INFO - vIMS functional test duration:'2.9'
 344     vIMS - INFO - Launching the clearwater-opnfv undeployment
 345     vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
 346     vIMS - INFO - Launching the cloudify-manager undeployment
 347     vIMS - INFO - Cloudify-manager server has been successfully removed!
 348     vIMS - INFO - Removing vIMS tenant ..
 349     vIMS - INFO - Removing vIMS user ..
 350 ::
 351
 352
 353 Promise
 354 ^^^^^^^
 355 ::
 356     FUNCTEST.info: Running PROMISE test case...
 357     Promise- INFO - Creating tenant 'promise'...
 358     Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
 359     Promise- INFO - Creating user 'promiser'...
 360     Promise- INFO - Updating OpenStack credentials...
 361     Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
 362     Promise- INFO - Creating flavor 'promise-flavor'...
 363     Promise- INFO - Exporting environment variables...
 364     Promise- INFO - Running command: npm run -s test -- --reporter json
 365     Promise- INFO - The test succeeded.
 366     Promise- DEBUG -
 367     {
 368       "stats": {
 369         "suites": 23,
 370         "tests": 33,
 371         "passes": 33,
 372         "pending": 0,
 373         "failures": 0,
 374         "start": "2016-02-18T13:37:06.661Z",
 375         "end": "2016-02-18T13:37:12.962Z",
 376         "duration": 5524
 377       },
 378       "tests": [
 379         {
 380           "title": "should add a new OpenStack provider without error",
 381           "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
 382           "duration": 1217,
 383           "err": {}
 384         },
 385         {
 386           "title": "should update promise.providers with a new entry",
 387           "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
 388           "duration": 10,
 389           "err": {}
 390         },
 391         {
 392           "title": "should contain a new ResourceProvider record in the store",
 393           "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
 394           "duration": 0,
 395           "err": {}
 396         },
 397         {
 398           "title": "should add more capacity to the reservation service without error",
 399           "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
 400           "duration": 25,
 401           "err": {}
 402         },
 403         {
 404           "title": "should update promise.pools with a new entry",
 405           "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
 406           "duration": 1,
 407           "err": {}
 408         },
 409         {
 410           "title": "should contain a ResourcePool record in the store",
 411           "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
 412           "duration": 0,
 413           "err": {}
 414         },
 415         {
 416           "title": "should report total collections and utilizations",
 417           "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
 418           "duration": 18,
 419           "err": {}
 420         },
 421         {
 422           "title": "should contain newly added capacity pool",
 423           "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
 424           "duration": 8,
 425           "err": {}
 426         },
 427         {
 428           "title": "should create a new server in target provider without error",
 429           "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
 430           "duration": 1768,
 431           "err": {}
 432         },
 433         {
 434           "title": "should update promise.allocations with a new entry",
 435           "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
 436           "duration": 2,
 437           "err": {}
 438         },
 439         {
 440           "title": "should contain a new ResourceAllocation record in the store",
 441           "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
 442           "duration": 0,
 443           "err": {}
 444         },
 445         {
 446           "title": "should reference the created server ID from the provider",
 447           "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
 448           "duration": 1,
 449           "err": {}
 450         },
 451         {
 452           "title": "should have low priority state",
 453           "fullTitle": "promise allocation without reservation create-instance should have low priority state",
 454           "duration": 0,
 455           "err": {}
 456         },
 457         {
 458           "title": "should create reservation record (no start/end) without error",
 459           "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
 460           "duration": 41,
 461           "err": {}
 462         },
 463         {
 464           "title": "should update promise.reservations with a new entry",
 465           "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
 466           "duration": 7,
 467           "err": {}
 468         },
 469         {
 470           "title": "should contain a new ResourceReservation record in the store",
 471           "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
 472           "duration": 0,
 473           "err": {}
 474         },
 475         {
 476           "title": "should create a new server in target provider (with reservation) without error",
 477           "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
 478           "duration": 1617,
 479           "err": {}
 480         },
 481         {
 482           "title": "should contain a new ResourceAllocation record in the store",
 483           "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
 484           "duration": 1,
 485           "err": {}
 486         },
 487         {
 488           "title": "should be referenced in the reservation record",
 489           "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
 490           "duration": 7,
 491           "err": {}
 492         },
 493         {
 494           "title": "should have high priority state",
 495           "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
 496           "duration": 0,
 497           "err": {}
 498         },
 499         {
 500           "title": "should create reservation record (for future) without error",
 501           "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
 502           "duration": 75,
 503           "err": {}
 504         },
 505         {
 506           "title": "should update promise.reservations with a new entry",
 507           "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
 508           "duration": 17,
 509           "err": {}
 510         },
 511         {
 512           "title": "should contain a new ResourceReservation record in the store",
 513           "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
 514           "duration": 0,
 515           "err": {}
 516         },
 517         {
 518           "title": "should contain newly created future reservation",
 519           "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
 520           "duration": 61,
 521           "err": {}
 522         },
 523         {
 524           "title": "should modify existing reservation without error",
 525           "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
 526           "duration": 65,
 527           "err": {}
 528         },
 529         {
 530           "title": "should modify existing reservation without error",
 531           "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
 532           "duration": 17,
 533           "err": {}
 534         },
 535         {
 536           "title": "should no longer contain record of the deleted reservation",
 537           "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
 538           "duration": 0,
 539           "err": {}
 540         },
 541         {
 542           "title": "should decrease available capacity from a provider in the future",
 543           "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
 544           "duration": 15,
 545           "err": {}
 546         },
 547         {
 548           "title": "should increase available capacity from a provider in the future",
 549           "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
 550           "duration": 11,
 551           "err": {}
 552         },
 553         {
 554           "title": "should report available collections and utilizations",
 555           "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
 556           "duration": 56,
 557           "err": {}
 558         },
 559         {
 560           "title": "should fail to create immediate reservation record with proper error",
 561           "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
 562           "duration": 60,
 563           "err": {}
 564         },
 565         {
 566           "title": "should fail to create future reservation record with proper error",
 567           "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
 568           "duration": 38,
 569           "err": {}
 570         },
 571         {
 572           "title": "should successfully destroy all allocations",
 573           "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
 574           "duration": 361,
 575           "err": {}
 576         }
 577       ],
 578       "pending": [],
 579       "failures": [],
 580       "passes": [
 581         {
 582           "title": "should add a new OpenStack provider without error",
 583           "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
 584           "duration": 1217,
 585           "err": {}
 586         },
 587         {
 588           "title": "should update promise.providers with a new entry",
 589           "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
 590           "duration": 10,
 591           "err": {}
 592         },
 593         {
 594           "title": "should contain a new ResourceProvider record in the store",
 595           "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
 596           "duration": 0,
 597           "err": {}
 598         },
 599         {
 600           "title": "should add more capacity to the reservation service without error",
 601           "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
 602           "duration": 25,
 603           "err": {}
 604         },
 605         {
 606           "title": "should update promise.pools with a new entry",
 607           "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
 608           "duration": 1,
 609           "err": {}
 610         },
 611         {
 612           "title": "should contain a ResourcePool record in the store",
 613           "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
 614           "duration": 0,
 615           "err": {}
 616         },
 617         {
 618           "title": "should report total collections and utilizations",
 619           "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
 620           "duration": 18,
 621           "err": {}
 622         },
 623         {
 624           "title": "should contain newly added capacity pool",
 625           "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
 626           "duration": 8,
 627           "err": {}
 628         },
 629         {
 630           "title": "should create a new server in target provider without error",
 631           "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
 632           "duration": 1768,
 633           "err": {}
 634         },
 635         {
 636           "title": "should update promise.allocations with a new entry",
 637           "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
 638           "duration": 2,
 639           "err": {}
 640         },
 641         {
 642           "title": "should contain a new ResourceAllocation record in the store",
 643           "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
 644           "duration": 0,
 645           "err": {}
 646         },
 647         {
 648           "title": "should reference the created server ID from the provider",
 649           "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
 650           "duration": 1,
 651           "err": {}
 652         },
 653         {
 654           "title": "should have low priority state",
 655           "fullTitle": "promise allocation without reservation create-instance should have low priority state",
 656           "duration": 0,
 657           "err": {}
 658         },
 659         {
 660           "title": "should create reservation record (no start/end) without error",
 661           "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
 662           "duration": 41,
 663           "err": {}
 664         },
 665         {
 666           "title": "should update promise.reservations with a new entry",
 667           "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
 668           "duration": 7,
 669           "err": {}
 670         },
 671         {
 672           "title": "should contain a new ResourceReservation record in the store",
 673           "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
 674           "duration": 0,
 675           "err": {}
 676         },
 677         {
 678           "title": "should create a new server in target provider (with reservation) without error",
 679           "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
 680           "duration": 1617,
 681           "err": {}
 682         },
 683         {
 684           "title": "should contain a new ResourceAllocation record in the store",
 685           "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
 686           "duration": 1,
 687           "err": {}
 688         },
 689         {
 690           "title": "should be referenced in the reservation record",
 691           "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
 692           "duration": 7,
 693           "err": {}
 694         },
 695         {
 696           "title": "should have high priority state",
 697           "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
 698           "duration": 0,
 699           "err": {}
 700         },
 701         {
 702           "title": "should create reservation record (for future) without error",
 703           "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
 704           "duration": 75,
 705           "err": {}
 706         },
 707         {
 708           "title": "should update promise.reservations with a new entry",
 709           "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
 710           "duration": 17,
 711           "err": {}
 712         },
 713         {
 714           "title": "should contain a new ResourceReservation record in the store",
 715           "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
 716           "duration": 0,
 717           "err": {}
 718         },
 719         {
 720           "title": "should contain newly created future reservation",
 721           "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
 722           "duration": 61,
 723           "err": {}
 724         },
 725         {
 726           "title": "should modify existing reservation without error",
 727           "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
 728           "duration": 65,
 729           "err": {}
 730         },
 731         {
 732           "title": "should modify existing reservation without error",
 733           "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
 734           "duration": 17,
 735           "err": {}
 736         },
 737         {
 738           "title": "should no longer contain record of the deleted reservation",
 739           "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
 740           "duration": 0,
 741           "err": {}
 742         },
 743         {
 744           "title": "should decrease available capacity from a provider in the future",
 745           "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
 746           "duration": 15,
 747           "err": {}
 748         },
 749         {
 750           "title": "should increase available capacity from a provider in the future",
 751           "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
 752           "duration": 11,
 753           "err": {}
 754         },
 755         {
 756           "title": "should report available collections and utilizations",
 757           "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
 758           "duration": 56,
 759           "err": {}
 760         },
 761         {
 762           "title": "should fail to create immediate reservation record with proper error",
 763           "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
 764           "duration": 60,
 765           "err": {}
 766         },
 767         {
 768           "title": "should fail to create future reservation record with proper error",
 769           "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
 770           "duration": 38,
 771           "err": {}
 772         },
 773         {
 774           "title": "should successfully destroy all allocations",
 775           "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
 776           "duration": 361,
 777           "err": {}
 778         }
 779       ]
 780     }
 781     Promise- INFO -
 782     ****************************************
 783               Promise test report
 784
 785     ****************************************
 786      Suites:    23
 787      Tests:     33
 788      Passes:    33
 789      Pending:   0
 790      Failures:  0
 791      Start:     2016-02-18T13:37:06.661Z
 792      End:       2016-02-18T13:37:12.962Z
 793      Duration:  6.301
 794     ****************************************
 795 ::
 796
 797
 798
 799 Rally
 800 ^^^^^
 801 ::
 802     FUNCTEST.info: Running Rally benchmark suite...
 803     run_rally - INFO - Starting test scenario "authenticate" ...
 804     run_rally - INFO -
 805      Preparing input task
 806      Task  2ff4981a-75d9-4de4-a111-3194115c4a00: started
 807     Task 2ff4981a-75d9-4de4-a111-3194115c4a00: finished
 808
 809     test scenario Authenticate.validate_glance
 810     +-------------------------------------------------------------------------------------------------------+
 811     |                                         Response Times (sec)                                          |
 812     +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 813     | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 814     +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 815     | authenticate.validate_glance     | 0.534 | 0.569  | 0.722  | 0.818  | 0.914 | 0.618 | 100.0%  | 10    |
 816     | authenticate.validate_glance (2) | 0.512 | 0.609  | 0.713  | 0.766  | 0.818 | 0.631 | 100.0%  | 10    |
 817     | total                            | 1.257 | 1.358  | 1.703  | 1.715  | 1.726 | 1.418 | 100.0%  | 10    |
 818     +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 819     Load duration: 4.01803302765
 820     Full duration: 11.7534348965
 821
 822
 823
 824     test scenario Authenticate.keystone
 825     +-----------------------------------------------------------------------------+
 826     |                            Response Times (sec)                             |
 827     +--------+-------+--------+--------+--------+-------+-------+---------+-------+
 828     | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 829     +--------+-------+--------+--------+--------+-------+-------+---------+-------+
 830     | total  | 0.132 | 0.154  | 0.172  | 0.172  | 0.173 | 0.155 | 100.0%  | 10    |
 831     +--------+-------+--------+--------+--------+-------+-------+---------+-------+
 832     Load duration: 0.491301059723
 833     Full duration: 8.25924301147
 834
 835
 836
 837     test scenario Authenticate.validate_heat
 838     +-----------------------------------------------------------------------------------------------------+
 839     |                                        Response Times (sec)                                         |
 840     +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 841     | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 842     +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 843     | authenticate.validate_heat     | 0.297 | 0.32   | 0.355  | 0.359  | 0.363 | 0.324 | 100.0%  | 10    |
 844     | authenticate.validate_heat (2) | 0.043 | 0.056  | 0.302  | 0.304  | 0.307 | 0.127 | 100.0%  | 10    |
 845     | total                          | 0.499 | 0.607  | 0.769  | 0.82   | 0.87  | 0.629 | 100.0%  | 10    |
 846     +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 847     Load duration: 1.91573691368
 848     Full duration: 10.0396120548
 849
 850
 851
 852     test scenario Authenticate.validate_nova
 853     +-----------------------------------------------------------------------------------------------------+
 854     |                                        Response Times (sec)                                         |
 855     +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 856     | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 857     +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 858     | authenticate.validate_nova     | 0.306 | 0.35   | 0.534  | 0.554  | 0.574 | 0.407 | 100.0%  | 10    |
 859     | authenticate.validate_nova (2) | 0.037 | 0.059  | 0.07   | 0.081  | 0.092 | 0.059 | 100.0%  | 10    |
 860     | total                          | 0.526 | 0.596  | 0.771  | 0.782  | 0.792 | 0.639 | 100.0%  | 10    |
 861     +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 862     Load duration: 1.9150788784
 863     Full duration: 9.77701401711
 864
 865
 866
 867     test scenario Authenticate.validate_cinder
 868     +-------------------------------------------------------------------------------------------------------+
 869     |                                         Response Times (sec)                                          |
 870     +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 871     | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 872     +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 873     | authenticate.validate_cinder     | 0.268 | 0.315  | 0.353  | 0.475  | 0.596 | 0.334 | 100.0%  | 10    |
 874     | authenticate.validate_cinder (2) | 0.025 | 0.282  | 0.314  | 0.323  | 0.331 | 0.264 | 100.0%  | 10    |
 875     | total                            | 0.721 | 0.78   | 0.827  | 0.837  | 0.847 | 0.779 | 100.0%  | 10    |
 876     +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 877     Load duration: 2.34766292572
 878     Full duration: 10.0672118664
 879
 880
 881
 882     test scenario Authenticate.validate_neutron
 883     +--------------------------------------------------------------------------------------------------------+
 884     |                                          Response Times (sec)                                          |
 885     +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 886     | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 887     +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 888     | authenticate.validate_neutron     | 0.266 | 0.305  | 0.386  | 0.399  | 0.411 | 0.319 | 100.0%  | 10    |
 889     | authenticate.validate_neutron (2) | 0.043 | 0.291  | 0.375  | 0.403  | 0.432 | 0.241 | 100.0%  | 10    |
 890     | total                             | 0.483 | 0.76   | 0.908  | 0.914  | 0.92  | 0.729 | 100.0%  | 10    |
 891     +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 892     Load duration: 2.25539779663
 893     Full duration: 9.62706780434
 894
 895
 896
 897     run_rally - INFO - Test scenario: "authenticate" OK.
 898
 899     run_rally - INFO - Starting test scenario "glance" ...
 900     run_rally - INFO -
 901      Preparing input task
 902      Task  9fb726cd-f20e-4f95-b32f-5928c72cf58d: started
 903     Task 9fb726cd-f20e-4f95-b32f-5928c72cf58d: finished
 904
 905     test scenario GlanceImages.list_images
 906     +-----------------------------------------------------------------------------------------+
 907     |                                  Response Times (sec)                                   |
 908     +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 909     | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 910     +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 911     | glance.list_images | 0.72  | 0.85   | 0.942  | 0.947  | 0.951 | 0.833 | 100.0%  | 10    |
 912     | total              | 0.721 | 0.85   | 0.943  | 0.947  | 0.951 | 0.834 | 100.0%  | 10    |
 913     +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 914     Load duration: 2.45959687233
 915     Full duration: 12.9740490913
 916
 917
 918
 919     test scenario GlanceImages.create_image_and_boot_instances
 920     +---------------------------------------------------------------------------------------------+
 921     |                                    Response Times (sec)                                     |
 922     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
 923     | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
 924     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
 925     | glance.create_image | 7.498  | 7.743  | 17.964 | 19.73  | 21.495 | 10.171 | 100.0%  | 10    |
 926     | nova.boot_servers   | 13.174 | 14.424 | 15.318 | 15.539 | 15.76  | 14.34  | 100.0%  | 10    |
 927     | total               | 20.863 | 22.368 | 32.383 | 33.741 | 35.099 | 24.511 | 100.0%  | 10    |
 928     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
 929     Load duration: 68.7006659508
 930     Full duration: 127.436779022
 931
 932
 933
 934     test scenario GlanceImages.create_and_list_image
 935     +------------------------------------------------------------------------------------------+
 936     |                                   Response Times (sec)                                   |
 937     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 938     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
 939     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 940     | glance.create_image | 7.303 | 7.684  | 7.837  | 7.911  | 7.984 | 7.63  | 100.0%  | 10    |
 941     | glance.list_images  | 0.328 | 0.583  | 0.697  | 0.698  | 0.699 | 0.574 | 100.0%  | 10    |
 942     | total               | 7.862 | 8.283  | 8.38   | 8.472  | 8.564 | 8.205 | 100.0%  | 10    |
 943     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
 944     Load duration: 24.5710179806
 945     Full duration: 37.9533209801
 946
 947
 948
 949     test scenario GlanceImages.create_and_delete_image
 950     +-------------------------------------------------------------------------------------------+
 951     |                                   Response Times (sec)                                    |
 952     +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
 953     | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
 954     +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
 955     | glance.create_image | 7.448 | 7.605  | 7.805  | 7.817  | 7.829  | 7.617 | 100.0%  | 10    |
 956     | glance.delete_image | 2.01  | 2.372  | 2.628  | 2.686  | 2.743  | 2.393 | 100.0%  | 10    |
 957     | total               | 9.506 | 9.976  | 10.387 | 10.466 | 10.545 | 10.01 | 100.0%  | 10    |
 958     +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
 959     Load duration: 30.0124220848
 960     Full duration: 40.2773120403
 961
 962
 963
 964     run_rally - INFO - Test scenario: "glance" OK.
 965
 966     run_rally - INFO - Starting test scenario "cinder" ...
 967     run_rally - INFO -
 968      Preparing input task
 969      Task  a724f287-e014-40ef-8e87-173e5eb2b0a2: started
 970     Task a724f287-e014-40ef-8e87-173e5eb2b0a2: finished
 971
 972     test scenario CinderVolumes.create_and_attach_volume
 973     +----------------------------------------------------------------------------------------------+
 974     |                                     Response Times (sec)                                     |
 975     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
 976     | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
 977     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
 978     | nova.boot_server     | 10.889 | 13.965 | 14.695 | 14.724 | 14.752 | 13.234 | 100.0%  | 10    |
 979     | cinder.create_volume | 3.218  | 3.812  | 4.128  | 4.214  | 4.3    | 3.776  | 100.0%  | 10    |
 980     | nova.attach_volume   | 3.737  | 4.69   | 4.963  | 5.092  | 5.222  | 4.612  | 100.0%  | 10    |
 981     | nova.detach_volume   | 3.18   | 3.917  | 4.273  | 4.325  | 4.377  | 3.867  | 100.0%  | 10    |
 982     | cinder.delete_volume | 0.489  | 2.54   | 2.801  | 2.886  | 2.972  | 2.261  | 100.0%  | 10    |
 983     | nova.delete_server   | 2.527  | 2.94   | 3.218  | 3.228  | 3.239  | 2.926  | 100.0%  | 10    |
 984     | total                | 26.351 | 30.9   | 32.731 | 33.273 | 33.815 | 30.677 | 100.0%  | 10    |
 985     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
 986     Load duration: 91.1857719421
 987     Full duration: 133.454293013
 988
 989
 990
 991     test scenario CinderVolumes.create_and_list_volume
 992     +--------------------------------------------------------------------------------------------+
 993     |                                    Response Times (sec)                                    |
 994     +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
 995     | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
 996     +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
 997     | cinder.create_volume | 7.415 | 9.652  | 10.383 | 10.548 | 10.713 | 9.48  | 100.0%  | 10    |
 998     | cinder.list_volumes  | 0.072 | 0.328  | 0.4    | 0.407  | 0.415  | 0.295 | 100.0%  | 10    |
 999     | total                | 7.76  | 10.022 | 10.706 | 10.88  | 11.054 | 9.775 | 100.0%  | 10    |
1000     +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1001     Load duration: 28.0870580673
1002     Full duration: 51.2606179714
1003
1004
1005
1006     test scenario CinderVolumes.create_and_list_volume
1007     +-------------------------------------------------------------------------------------------+
1008     |                                   Response Times (sec)                                    |
1009     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1010     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1011     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1012     | cinder.create_volume | 3.521 | 4.03   | 4.785  | 4.869  | 4.953 | 4.19  | 100.0%  | 10    |
1013     | cinder.list_volumes  | 0.062 | 0.347  | 0.411  | 0.426  | 0.44  | 0.308 | 100.0%  | 10    |
1014     | total                | 3.852 | 4.421  | 5.139  | 5.227  | 5.315 | 4.499 | 100.0%  | 10    |
1015     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1016     Load duration: 13.1967639923
1017     Full duration: 35.2137930393
1018
1019
1020
1021     test scenario CinderVolumes.create_and_list_snapshots
1022     +---------------------------------------------------------------------------------------------+
1023     |                                    Response Times (sec)                                     |
1024     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1025     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1026     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1027     | cinder.create_snapshot | 2.957 | 3.349  | 5.449  | 5.627  | 5.805 | 3.738 | 100.0%  | 10    |
1028     | cinder.list_snapshots  | 0.028 | 0.304  | 0.348  | 0.382  | 0.416 | 0.213 | 100.0%  | 10    |
1029     | total                  | 3.259 | 3.42   | 5.776  | 5.945  | 6.113 | 3.952 | 100.0%  | 10    |
1030     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1031     Load duration: 10.5537779331
1032     Full duration: 49.7043690681
1033
1034
1035
1036     test scenario CinderVolumes.create_and_delete_volume
1037     +-------------------------------------------------------------------------------------------+
1038     |                                   Response Times (sec)                                    |
1039     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1040     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1041     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1042     | cinder.create_volume | 3.281 | 3.907  | 4.106  | 4.128  | 4.15  | 3.806 | 100.0%  | 10    |
1043     | cinder.delete_volume | 0.788 | 2.667  | 3.082  | 3.16   | 3.239 | 2.256 | 100.0%  | 10    |
1044     | total                | 4.617 | 6.29   | 6.997  | 7.066  | 7.135 | 6.063 | 100.0%  | 10    |
1045     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1046     Load duration: 18.3220980167
1047     Full duration: 36.1331720352
1048
1049
1050
1051     test scenario CinderVolumes.create_and_delete_volume
1052     +---------------------------------------------------------------------------------------------+
1053     |                                    Response Times (sec)                                     |
1054     +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1055     | action               | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1056     +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1057     | cinder.create_volume | 8.901 | 9.932  | 10.338 | 10.395 | 10.452 | 9.781  | 100.0%  | 10    |
1058     | cinder.delete_volume | 0.579 | 1.672  | 2.856  | 2.952  | 3.049  | 1.773  | 100.0%  | 10    |
1059     | total                | 9.725 | 11.645 | 12.996 | 13.017 | 13.039 | 11.554 | 100.0%  | 10    |
1060     +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1061     Load duration: 35.517152071
1062     Full duration: 54.0071978569
1063
1064
1065
1066     test scenario CinderVolumes.create_and_delete_volume
1067     +-------------------------------------------------------------------------------------------+
1068     |                                   Response Times (sec)                                    |
1069     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1070     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1071     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1072     | cinder.create_volume | 3.596 | 3.887  | 4.71   | 4.712  | 4.715 | 4.08  | 100.0%  | 10    |
1073     | cinder.delete_volume | 0.512 | 0.923  | 1.297  | 2.319  | 3.341 | 1.114 | 100.0%  | 10    |
1074     | total                | 4.381 | 4.91   | 5.923  | 6.573  | 7.223 | 5.195 | 100.0%  | 10    |
1075     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1076     Load duration: 15.0102190971
1077     Full duration: 33.4934709072
1078
1079
1080
1081     test scenario CinderVolumes.create_and_upload_volume_to_image
1082     +-------------------------------------------------------------------------------------------------------+
1083     |                                         Response Times (sec)                                          |
1084     +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1085     | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1086     +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1087     | cinder.create_volume          | 3.512  | 3.838  | 4.155  | 4.202  | 4.249  | 3.861  | 100.0%  | 10    |
1088     | cinder.upload_volume_to_image | 16.283 | 24.737 | 33.632 | 38.034 | 42.436 | 26.102 | 100.0%  | 10    |
1089     | cinder.delete_volume          | 0.583  | 1.719  | 3.056  | 3.165  | 3.274  | 1.853  | 100.0%  | 10    |
1090     | nova.delete_image             | 2.514  | 2.856  | 13.194 | 14.749 | 16.305 | 5.182  | 100.0%  | 10    |
1091     | total                         | 23.887 | 34.293 | 49.972 | 51.48  | 52.988 | 36.998 | 100.0%  | 10    |
1092     +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1093     Load duration: 107.503821135
1094     Full duration: 129.166619062
1095
1096
1097
1098     test scenario CinderVolumes.create_and_delete_snapshot
1099     +---------------------------------------------------------------------------------------------+
1100     |                                    Response Times (sec)                                     |
1101     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1102     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1103     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1104     | cinder.create_snapshot | 3.064 | 3.257  | 3.408  | 3.415  | 3.422 | 3.261 | 100.0%  | 10    |
1105     | cinder.delete_snapshot | 2.586 | 2.915  | 3.148  | 3.165  | 3.181 | 2.938 | 100.0%  | 10    |
1106     | total                  | 5.837 | 6.18   | 6.465  | 6.534  | 6.603 | 6.199 | 100.0%  | 10    |
1107     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1108     Load duration: 18.601981163
1109     Full duration: 53.3941659927
1110
1111
1112
1113     test scenario CinderVolumes.create_volume
1114     +-------------------------------------------------------------------------------------------+
1115     |                                   Response Times (sec)                                    |
1116     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1117     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1118     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1119     | cinder.create_volume | 3.424 | 3.854  | 4.025  | 4.05   | 4.075 | 3.808 | 100.0%  | 10    |
1120     | total                | 3.424 | 3.854  | 4.025  | 4.05   | 4.075 | 3.808 | 100.0%  | 10    |
1121     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1122     Load duration: 11.3824880123
1123     Full duration: 30.7913680077
1124
1125
1126
1127     test scenario CinderVolumes.create_volume
1128     +-------------------------------------------------------------------------------------------+
1129     |                                   Response Times (sec)                                    |
1130     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1131     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1132     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1133     | cinder.create_volume | 3.391 | 3.979  | 4.585  | 4.6    | 4.616 | 3.999 | 100.0%  | 10    |
1134     | total                | 3.391 | 3.979  | 4.585  | 4.601  | 4.616 | 3.999 | 100.0%  | 10    |
1135     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1136     Load duration: 12.107943058
1137     Full duration: 36.5596921444
1138
1139
1140
1141     test scenario CinderVolumes.list_volumes
1142     +------------------------------------------------------------------------------------------+
1143     |                                   Response Times (sec)                                   |
1144     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1145     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1146     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1147     | cinder.list_volumes | 0.478 | 0.562  | 0.711  | 0.746  | 0.781 | 0.587 | 100.0%  | 10    |
1148     | total               | 0.479 | 0.562  | 0.711  | 0.746  | 0.781 | 0.587 | 100.0%  | 10    |
1149     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1150     Load duration: 1.79518508911
1151     Full duration: 65.9313700199
1152
1153
1154
1155     test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
1156     +-----------------------------------------------------------------------------------------------+
1157     |                                     Response Times (sec)                                      |
1158     +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1159     | action                 | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1160     +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1161     | cinder.create_volume   | 3.557 | 3.914  | 4.206  | 4.213  | 4.22   | 3.884  | 100.0%  | 10    |
1162     | cinder.create_snapshot | 2.701 | 3.063  | 3.248  | 3.251  | 3.254  | 3.06   | 100.0%  | 10    |
1163     | nova.attach_volume     | 3.75  | 4.986  | 6.112  | 6.385  | 6.658  | 5.059  | 100.0%  | 10    |
1164     | nova.detach_volume     | 3.149 | 3.81   | 4.11   | 4.168  | 4.225  | 3.762  | 100.0%  | 10    |
1165     | cinder.delete_snapshot | 2.241 | 2.766  | 3.077  | 3.102  | 3.128  | 2.725  | 100.0%  | 10    |
1166     | cinder.delete_volume   | 0.748 | 2.428  | 2.712  | 2.772  | 2.831  | 1.912  | 100.0%  | 10    |
1167     | total                  | 19.22 | 21.354 | 24.347 | 24.725 | 25.102 | 21.684 | 100.0%  | 10    |
1168     +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1169     Load duration: 64.028840065
1170     Full duration: 186.598311901
1171
1172
1173
1174     test scenario CinderVolumes.create_from_volume_and_delete_volume
1175     +-------------------------------------------------------------------------------------------+
1176     |                                   Response Times (sec)                                    |
1177     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1178     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1179     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1180     | cinder.create_volume | 3.539 | 4.149  | 4.62   | 4.622  | 4.623 | 4.106 | 100.0%  | 10    |
1181     | cinder.delete_volume | 2.844 | 3.223  | 3.604  | 3.609  | 3.614 | 3.235 | 100.0%  | 10    |
1182     | total                | 6.383 | 7.559  | 7.85   | 7.868  | 7.886 | 7.341 | 100.0%  | 10    |
1183     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1184     Load duration: 21.6859838963
1185     Full duration: 55.5635709763
1186
1187
1188
1189     test scenario CinderVolumes.create_and_extend_volume
1190     +--------------------------------------------------------------------------------------------+
1191     |                                    Response Times (sec)                                    |
1192     +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1193     | action               | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
1194     +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1195     | cinder.create_volume | 3.434 | 3.852  | 3.99   | 4.004  | 4.018  | 3.842 | 100.0%  | 10    |
1196     | cinder.extend_volume | 0.955 | 2.236  | 3.552  | 3.564  | 3.576  | 2.281 | 100.0%  | 10    |
1197     | cinder.delete_volume | 0.868 | 3.015  | 3.332  | 3.398  | 3.465  | 2.861 | 100.0%  | 10    |
1198     | total                | 5.962 | 9.186  | 10.497 | 10.52  | 10.544 | 8.984 | 100.0%  | 10    |
1199     +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1200     Load duration: 28.1479110718
1201     Full duration: 47.0005409718
1202
1203
1204
1205     test scenario CinderVolumes.create_snapshot_and_attach_volume
1206     +------------------------------------------------------------------------------------------------+
1207     |                                      Response Times (sec)                                      |
1208     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1209     | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1210     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1211     | cinder.create_volume   | 3.595  | 3.868  | 4.206  | 4.208  | 4.211  | 3.886  | 100.0%  | 10    |
1212     | cinder.create_snapshot | 2.595  | 3.131  | 3.249  | 3.258  | 3.267  | 3.037  | 100.0%  | 10    |
1213     | nova.attach_volume     | 4.101  | 4.563  | 5.363  | 7.225  | 9.087  | 4.928  | 100.0%  | 10    |
1214     | nova.detach_volume     | 3.299  | 3.896  | 4.226  | 4.274  | 4.323  | 3.816  | 100.0%  | 10    |
1215     | cinder.delete_snapshot | 2.27   | 2.573  | 2.884  | 3.105  | 3.325  | 2.635  | 100.0%  | 10    |
1216     | cinder.delete_volume   | 0.611  | 2.479  | 2.742  | 2.863  | 2.983  | 2.239  | 100.0%  | 10    |
1217     | total                  | 19.728 | 21.533 | 22.719 | 24.643 | 26.568 | 21.737 | 100.0%  | 10    |
1218     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1219     Load duration: 62.6771988869
1220     Full duration: 187.817504883
1221
1222
1223
1224     test scenario CinderVolumes.create_snapshot_and_attach_volume
1225     +------------------------------------------------------------------------------------------------+
1226     |                                      Response Times (sec)                                      |
1227     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1228     | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1229     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1230     | cinder.create_volume   | 3.255  | 3.476  | 4.793  | 4.86   | 4.926  | 3.766  | 100.0%  | 10    |
1231     | cinder.create_snapshot | 2.387  | 2.868  | 3.304  | 3.311  | 3.318  | 2.906  | 100.0%  | 10    |
1232     | nova.attach_volume     | 3.864  | 4.167  | 4.94   | 5.864  | 6.787  | 4.392  | 100.0%  | 10    |
1233     | nova.detach_volume     | 3.699  | 4.047  | 4.388  | 4.408  | 4.428  | 4.066  | 100.0%  | 10    |
1234     | cinder.delete_snapshot | 2.492  | 2.621  | 2.825  | 2.828  | 2.831  | 2.651  | 100.0%  | 10    |
1235     | cinder.delete_volume   | 0.65   | 2.735  | 3.048  | 3.123  | 3.198  | 2.567  | 100.0%  | 10    |
1236     | total                  | 18.915 | 21.629 | 24.215 | 25.025 | 25.835 | 22.025 | 100.0%  | 10    |
1237     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1238     Load duration: 64.388502121
1239     Full duration: 192.928286076
1240
1241
1242
1243     run_rally - INFO - Test scenario: "cinder" OK.
1244
1245     run_rally - INFO - Starting test scenario "heat" ...
1246     run_rally - INFO -
1247      Preparing input task
1248      Task  44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: started
1249     Task 44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: finished
1250
1251     test scenario HeatStacks.create_suspend_resume_delete_stack
1252     +------------------------------------------------------------------------------------------+
1253     |                                   Response Times (sec)                                   |
1254     +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1255     | action             | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
1256     +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1257     | heat.create_stack  | 4.131 | 4.448  | 4.579  | 4.616  | 4.652  | 4.417 | 100.0%  | 10    |
1258     | heat.suspend_stack | 1.521 | 1.721  | 1.772  | 1.792  | 1.812  | 1.701 | 100.0%  | 10    |
1259     | heat.resume_stack  | 1.454 | 1.625  | 1.703  | 1.708  | 1.713  | 1.63  | 100.0%  | 10    |
1260     | heat.delete_stack  | 1.387 | 1.57   | 2.717  | 2.724  | 2.731  | 1.88  | 100.0%  | 10    |
1261     | total              | 8.994 | 9.448  | 10.723 | 10.75  | 10.777 | 9.627 | 100.0%  | 10    |
1262     +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1263     Load duration: 28.125330925
1264     Full duration: 37.9011991024
1265
1266
1267
1268     test scenario HeatStacks.create_and_delete_stack
1269     +----------------------------------------------------------------------------------------+
1270     |                                  Response Times (sec)                                  |
1271     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1272     | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1273     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1274     | heat.create_stack | 4.098 | 4.267  | 4.383  | 4.452  | 4.52  | 4.266 | 100.0%  | 10    |
1275     | heat.delete_stack | 1.423 | 1.468  | 1.536  | 1.679  | 1.822 | 1.505 | 100.0%  | 10    |
1276     | total             | 5.574 | 5.769  | 5.922  | 5.933  | 5.944 | 5.77  | 100.0%  | 10    |
1277     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1278     Load duration: 17.2579169273
1279     Full duration: 27.4368560314
1280
1281
1282
1283     test scenario HeatStacks.create_and_delete_stack
1284     +-------------------------------------------------------------------------------------------+
1285     |                                   Response Times (sec)                                    |
1286     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1287     | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1288     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1289     | heat.create_stack | 25.037 | 28.231 | 29.801 | 29.828 | 29.856 | 27.99  | 100.0%  | 10    |
1290     | heat.delete_stack | 10.707 | 11.831 | 13.046 | 13.573 | 14.099 | 12.249 | 100.0%  | 10    |
1291     | total             | 36.902 | 40.321 | 42.736 | 42.79  | 42.844 | 40.24  | 100.0%  | 10    |
1292     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1293     Load duration: 119.344232082
1294     Full duration: 129.710185051
1295
1296
1297
1298     test scenario HeatStacks.create_and_delete_stack
1299     +-------------------------------------------------------------------------------------------+
1300     |                                   Response Times (sec)                                    |
1301     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1302     | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1303     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1304     | heat.create_stack | 21.352 | 24.853 | 26.526 | 26.562 | 26.598 | 24.433 | 100.0%  | 10    |
1305     | heat.delete_stack | 9.51   | 10.67  | 10.95  | 11.42  | 11.889 | 10.684 | 100.0%  | 10    |
1306     | total             | 31.928 | 35.457 | 37.299 | 37.449 | 37.598 | 35.117 | 100.0%  | 10    |
1307     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1308     Load duration: 106.840685844
1309     Full duration: 117.40921998
1310
1311
1312
1313     test scenario HeatStacks.list_stacks_and_resources
1314     +------------------------------------------------------------------------------------------------------+
1315     |                                         Response Times (sec)                                         |
1316     +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1317     | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1318     +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1319     | heat.list_stacks                | 0.488 | 0.522  | 0.539  | 0.54   | 0.54  | 0.522 | 100.0%  | 10    |
1320     | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
1321     | total                           | 0.488 | 0.522  | 0.539  | 0.54   | 0.541 | 0.522 | 100.0%  | 10    |
1322     +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1323     Load duration: 1.59450078011
1324     Full duration: 9.86936807632
1325
1326
1327
1328     test scenario HeatStacks.create_update_delete_stack
1329     +------------------------------------------------------------------------------------------+
1330     |                                   Response Times (sec)                                   |
1331     +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1332     | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1333     +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1334     | heat.create_stack | 3.845 | 4.214  | 4.356  | 4.377  | 4.397  | 4.193  | 100.0%  | 10    |
1335     | heat.update_stack | 3.558 | 3.774  | 3.853  | 3.855  | 3.857  | 3.726  | 100.0%  | 10    |
1336     | heat.delete_stack | 1.56  | 2.57   | 2.756  | 2.776  | 2.797  | 2.512  | 100.0%  | 10    |
1337     | total             | 9.445 | 10.455 | 10.866 | 10.915 | 10.963 | 10.431 | 100.0%  | 10    |
1338     +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1339     Load duration: 31.3620579243
1340     Full duration: 42.2799968719
1341
1342
1343
1344     test scenario HeatStacks.create_update_delete_stack
1345     +-----------------------------------------------------------------------------------------+
1346     |                                  Response Times (sec)                                   |
1347     +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1348     | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
1349     +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1350     | heat.create_stack | 4.133 | 4.157  | 4.354  | 4.413  | 4.472  | 4.209 | 100.0%  | 10    |
1351     | heat.update_stack | 3.534 | 3.713  | 3.821  | 3.958  | 4.096  | 3.717 | 100.0%  | 10    |
1352     | heat.delete_stack | 1.383 | 1.402  | 1.736  | 2.156  | 2.575  | 1.556 | 100.0%  | 10    |
1353     | total             | 9.126 | 9.41   | 9.772  | 10.018 | 10.263 | 9.482 | 100.0%  | 10    |
1354     +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1355     Load duration: 29.0769648552
1356     Full duration: 39.4647920132
1357
1358
1359
1360     test scenario HeatStacks.create_update_delete_stack
1361     +------------------------------------------------------------------------------------------+
1362     |                                   Response Times (sec)                                   |
1363     +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1364     | action            | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
1365     +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1366     | heat.create_stack | 4.275  | 4.465  | 4.666  | 4.855  | 5.044  | 4.509 | 100.0%  | 10    |
1367     | heat.update_stack | 5.801  | 5.876  | 6.0    | 6.166  | 6.332  | 5.928 | 100.0%  | 10    |
1368     | heat.delete_stack | 2.525  | 2.564  | 3.649  | 3.683  | 3.717  | 2.793 | 100.0%  | 10    |
1369     | total             | 12.743 | 13.005 | 13.996 | 14.01  | 14.023 | 13.23 | 100.0%  | 10    |
1370     +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1371     Load duration: 39.5067877769
1372     Full duration: 50.3663468361
1373
1374
1375
1376     test scenario HeatStacks.create_update_delete_stack
1377     +------------------------------------------------------------------------------------------+
1378     |                                   Response Times (sec)                                   |
1379     +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1380     | action            | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
1381     +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1382     | heat.create_stack | 4.517  | 5.462  | 5.602  | 5.608  | 5.614  | 5.389 | 100.0%  | 10    |
1383     | heat.update_stack | 8.345  | 9.324  | 9.403  | 9.411  | 9.42   | 9.245 | 100.0%  | 10    |
1384     | heat.delete_stack | 3.69   | 3.723  | 3.746  | 3.755  | 3.763  | 3.725 | 100.0%  | 10    |
1385     | total             | 17.515 | 18.525 | 18.645 | 18.683 | 18.722 | 18.36 | 100.0%  | 10    |
1386     +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1387     Load duration: 54.7039349079
1388     Full duration: 65.6854679585
1389
1390
1391
1392     test scenario HeatStacks.create_update_delete_stack
1393     +-------------------------------------------------------------------------------------------+
1394     |                                   Response Times (sec)                                    |
1395     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1396     | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1397     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1398     | heat.create_stack | 4.122  | 4.348  | 4.549  | 4.597  | 4.645  | 4.358  | 100.0%  | 10    |
1399     | heat.update_stack | 5.791  | 5.87   | 5.92   | 5.932  | 5.944  | 5.864  | 100.0%  | 10    |
1400     | heat.delete_stack | 2.506  | 2.55   | 3.704  | 3.778  | 3.853  | 2.791  | 100.0%  | 10    |
1401     | total             | 12.485 | 12.814 | 13.98  | 14.075 | 14.169 | 13.013 | 100.0%  | 10    |
1402     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1403     Load duration: 38.5906641483
1404     Full duration: 49.8386061192
1405
1406
1407
1408     test scenario HeatStacks.create_update_delete_stack
1409     +-----------------------------------------------------------------------------------------+
1410     |                                  Response Times (sec)                                   |
1411     +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1412     | action            | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
1413     +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1414     | heat.create_stack | 4.062 | 4.33   | 4.493  | 4.501  | 4.508  | 4.317 | 100.0%  | 10    |
1415     | heat.update_stack | 3.553 | 3.585  | 3.783  | 3.936  | 4.088  | 3.648 | 100.0%  | 10    |
1416     | heat.delete_stack | 1.376 | 1.418  | 2.552  | 2.555  | 2.558  | 1.856 | 100.0%  | 10    |
1417     | total             | 9.179 | 9.535  | 10.607 | 10.678 | 10.749 | 9.822 | 100.0%  | 10    |
1418     +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1419     Load duration: 29.5593960285
1420     Full duration: 40.873290062
1421
1422
1423
1424     test scenario HeatStacks.create_and_list_stack
1425     +----------------------------------------------------------------------------------------+
1426     |                                  Response Times (sec)                                  |
1427     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1428     | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1429     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1430     | heat.create_stack | 4.105 | 4.264  | 4.394  | 4.43   | 4.466 | 4.276 | 100.0%  | 10    |
1431     | heat.list_stacks  | 0.062 | 0.103  | 0.113  | 0.116  | 0.119 | 0.096 | 100.0%  | 10    |
1432     | total             | 4.18  | 4.373  | 4.501  | 4.531  | 4.561 | 4.371 | 100.0%  | 10    |
1433     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1434     Load duration: 13.1703698635
1435     Full duration: 29.690456152
1436
1437
1438
1439     test scenario HeatStacks.create_check_delete_stack
1440     +----------------------------------------------------------------------------------------+
1441     |                                  Response Times (sec)                                  |
1442     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1443     | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1444     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1445     | heat.create_stack | 4.194 | 4.357  | 4.595  | 4.64   | 4.684 | 4.393 | 100.0%  | 10    |
1446     | heat.check_stack  | 1.511 | 1.542  | 1.627  | 1.753  | 1.88  | 1.58  | 100.0%  | 10    |
1447     | heat.delete_stack | 1.402 | 2.55   | 2.707  | 2.749  | 2.791 | 2.257 | 100.0%  | 10    |
1448     | total             | 7.411 | 8.429  | 8.66   | 8.745  | 8.829 | 8.23  | 100.0%  | 10    |
1449     +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1450     Load duration: 24.4679090977
1451     Full duration: 35.6907479763
1452
1453
1454
1455     run_rally - INFO - Test scenario: "heat" OK.
1456
1457     run_rally - INFO - Starting test scenario "keystone" ...
1458     run_rally - INFO -
1459      Preparing input task
1460      Task  416065d0-3811-4bee-9b53-37743e1f179c: started
1461     Task 416065d0-3811-4bee-9b53-37743e1f179c: finished
1462
1463     test scenario KeystoneBasic.create_tenant_with_users
1464     +---------------------------------------------------------------------------------------------+
1465     |                                    Response Times (sec)                                     |
1466     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1467     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1468     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1469     | keystone.create_tenant | 0.285 | 0.297  | 0.328  | 0.336  | 0.343 | 0.305 | 100.0%  | 10    |
1470     | keystone.create_users  | 1.651 | 1.673  | 1.73   | 1.749  | 1.768 | 1.688 | 100.0%  | 10    |
1471     | total                  | 1.952 | 1.986  | 2.027  | 2.061  | 2.095 | 1.993 | 100.0%  | 10    |
1472     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1473     Load duration: 5.98874807358
1474     Full duration: 22.4405510426
1475
1476
1477
1478     test scenario KeystoneBasic.create_add_and_list_user_roles
1479     +-------------------------------------------------------------------------------------------+
1480     |                                   Response Times (sec)                                    |
1481     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1482     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1483     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1484     | keystone.create_role | 0.287 | 0.308  | 0.404  | 0.428  | 0.452 | 0.331 | 100.0%  | 10    |
1485     | keystone.add_role    | 0.276 | 0.31   | 0.371  | 0.379  | 0.388 | 0.319 | 100.0%  | 10    |
1486     | keystone.list_roles  | 0.137 | 0.151  | 0.175  | 0.207  | 0.239 | 0.16  | 100.0%  | 10    |
1487     | total                | 0.732 | 0.775  | 0.951  | 0.962  | 0.972 | 0.809 | 100.0%  | 10    |
1488     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1489     Load duration: 2.38230800629
1490     Full duration: 15.068157196
1491
1492
1493
1494     test scenario KeystoneBasic.add_and_remove_user_role
1495     +-------------------------------------------------------------------------------------------+
1496     |                                   Response Times (sec)                                    |
1497     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1498     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1499     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1500     | keystone.create_role | 0.263 | 0.3    | 0.41   | 0.455  | 0.499 | 0.336 | 100.0%  | 10    |
1501     | keystone.add_role    | 0.265 | 0.28   | 0.342  | 0.405  | 0.468 | 0.302 | 100.0%  | 10    |
1502     | keystone.remove_role | 0.151 | 0.182  | 0.347  | 0.35   | 0.354 | 0.226 | 100.0%  | 10    |
1503     | total                | 0.713 | 0.844  | 1.002  | 1.019  | 1.036 | 0.864 | 100.0%  | 10    |
1504     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1505     Load duration: 2.52822303772
1506     Full duration: 15.38514781
1507
1508
1509
1510     test scenario KeystoneBasic.create_update_and_delete_tenant
1511     +---------------------------------------------------------------------------------------------+
1512     |                                    Response Times (sec)                                     |
1513     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1514     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1515     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1516     | keystone.create_tenant | 0.267 | 0.354  | 0.411  | 0.421  | 0.432 | 0.346 | 100.0%  | 10    |
1517     | keystone.update_tenant | 0.139 | 0.15   | 0.185  | 0.223  | 0.262 | 0.164 | 100.0%  | 10    |
1518     | keystone.delete_tenant | 0.302 | 0.333  | 0.418  | 0.448  | 0.477 | 0.35  | 100.0%  | 10    |
1519     | total                  | 0.738 | 0.879  | 0.917  | 0.961  | 1.006 | 0.86  | 100.0%  | 10    |
1520     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1521     Load duration: 2.55070900917
1522     Full duration: 14.2816069126
1523
1524
1525
1526     test scenario KeystoneBasic.create_and_delete_service
1527     +----------------------------------------------------------------------------------------------+
1528     |                                     Response Times (sec)                                     |
1529     +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1530     | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1531     +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1532     | keystone.create_service | 0.279 | 0.303  | 0.408  | 0.41   | 0.412 | 0.322 | 100.0%  | 10    |
1533     | keystone.delete_service | 0.15  | 0.168  | 0.188  | 0.192  | 0.196 | 0.169 | 100.0%  | 10    |
1534     | total                   | 0.443 | 0.471  | 0.584  | 0.594  | 0.604 | 0.491 | 100.0%  | 10    |
1535     +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1536     Load duration: 1.47291088104
1537     Full duration: 12.6235470772
1538
1539
1540
1541     test scenario KeystoneBasic.create_tenant
1542     +---------------------------------------------------------------------------------------------+
1543     |                                    Response Times (sec)                                     |
1544     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1545     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1546     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1547     | keystone.create_tenant | 0.274 | 0.302  | 0.315  | 0.324  | 0.334 | 0.301 | 100.0%  | 10    |
1548     | total                  | 0.274 | 0.302  | 0.315  | 0.325  | 0.334 | 0.301 | 100.0%  | 10    |
1549     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1550     Load duration: 0.926929950714
1551     Full duration: 9.11541318893
1552
1553
1554
1555     test scenario KeystoneBasic.create_user
1556     +-------------------------------------------------------------------------------------------+
1557     |                                   Response Times (sec)                                    |
1558     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1559     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1560     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1561     | keystone.create_user | 0.285 | 0.312  | 0.353  | 0.392  | 0.431 | 0.323 | 100.0%  | 10    |
1562     | total                | 0.285 | 0.313  | 0.353  | 0.392  | 0.431 | 0.323 | 100.0%  | 10    |
1563     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1564     Load duration: 1.09427213669
1565     Full duration: 9.44248485565
1566
1567
1568
1569     test scenario KeystoneBasic.create_and_list_tenants
1570     +---------------------------------------------------------------------------------------------+
1571     |                                    Response Times (sec)                                     |
1572     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1573     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1574     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1575     | keystone.create_tenant | 0.276 | 0.302  | 0.312  | 0.315  | 0.318 | 0.299 | 100.0%  | 10    |
1576     | keystone.list_tenants  | 0.133 | 0.141  | 0.147  | 0.149  | 0.15  | 0.141 | 100.0%  | 10    |
1577     | total                  | 0.416 | 0.441  | 0.462  | 0.463  | 0.463 | 0.44  | 100.0%  | 10    |
1578     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1579     Load duration: 1.356580019
1580     Full duration: 14.5843369961
1581
1582
1583
1584     test scenario KeystoneBasic.create_and_delete_role
1585     +-------------------------------------------------------------------------------------------+
1586     |                                   Response Times (sec)                                    |
1587     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1588     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1589     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1590     | keystone.create_role | 0.271 | 0.306  | 0.517  | 0.532  | 0.547 | 0.37  | 100.0%  | 10    |
1591     | keystone.delete_role | 0.295 | 0.305  | 0.621  | 0.655  | 0.689 | 0.401 | 100.0%  | 10    |
1592     | total                | 0.572 | 0.743  | 0.991  | 1.076  | 1.16  | 0.771 | 100.0%  | 10    |
1593     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1594     Load duration: 2.24743795395
1595     Full duration: 14.336769104
1596
1597
1598
1599     test scenario KeystoneBasic.get_entities
1600     +---------------------------------------------------------------------------------------------+
1601     |                                    Response Times (sec)                                     |
1602     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1603     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1604     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1605     | keystone.create_tenant | 0.284 | 0.313  | 0.395  | 0.4    | 0.405 | 0.328 | 100.0%  | 10    |
1606     | keystone.create_user   | 0.141 | 0.155  | 0.176  | 0.176  | 0.177 | 0.159 | 100.0%  | 10    |
1607     | keystone.create_role   | 0.136 | 0.155  | 0.173  | 0.209  | 0.245 | 0.16  | 100.0%  | 10    |
1608     | keystone.get_tenant    | 0.124 | 0.132  | 0.143  | 0.144  | 0.144 | 0.133 | 100.0%  | 10    |
1609     | keystone.get_user      | 0.124 | 0.141  | 0.232  | 0.234  | 0.237 | 0.158 | 100.0%  | 10    |
1610     | keystone.get_role      | 0.122 | 0.125  | 0.142  | 0.144  | 0.147 | 0.129 | 100.0%  | 10    |
1611     | keystone.service_list  | 0.121 | 0.13   | 0.138  | 0.139  | 0.139 | 0.13  | 100.0%  | 10    |
1612     | keystone.get_service   | 0.118 | 0.132  | 0.158  | 0.16   | 0.161 | 0.136 | 100.0%  | 10    |
1613     | total                  | 1.253 | 1.315  | 1.403  | 1.449  | 1.495 | 1.334 | 100.0%  | 10    |
1614     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1615     Load duration: 4.18330001831
1616     Full duration: 21.2465929985
1617
1618
1619
1620     test scenario KeystoneBasic.create_and_list_users
1621     +-------------------------------------------------------------------------------------------+
1622     |                                   Response Times (sec)                                    |
1623     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1624     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1625     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1626     | keystone.create_user | 0.27  | 0.324  | 0.381  | 0.409  | 0.436 | 0.33  | 100.0%  | 10    |
1627     | keystone.list_users  | 0.125 | 0.142  | 0.183  | 0.233  | 0.283 | 0.157 | 100.0%  | 10    |
1628     | total                | 0.409 | 0.47   | 0.53   | 0.625  | 0.719 | 0.487 | 100.0%  | 10    |
1629     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1630     Load duration: 1.41358304024
1631     Full duration: 9.46058607101
1632
1633
1634
1635     run_rally - INFO - Test scenario: "keystone" OK.
1636
1637     run_rally - INFO - Starting test scenario "neutron" ...
1638     run_rally - INFO -
1639      Preparing input task
1640      Task  66bee4c3-3b3f-4215-9910-63425b400d9a: started
1641     Task 66bee4c3-3b3f-4215-9910-63425b400d9a: finished
1642
1643     test scenario NeutronNetworks.create_and_delete_ports
1644     +------------------------------------------------------------------------------------------+
1645     |                                   Response Times (sec)                                   |
1646     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1647     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1648     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1649     | neutron.create_port | 0.762 | 0.83   | 0.953  | 0.983  | 1.014 | 0.858 | 100.0%  | 10    |
1650     | neutron.delete_port | 0.224 | 0.62   | 0.763  | 0.78   | 0.797 | 0.582 | 100.0%  | 10    |
1651     | total               | 1.011 | 1.549  | 1.599  | 1.603  | 1.607 | 1.441 | 100.0%  | 10    |
1652     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1653     Load duration: 4.14246201515
1654     Full duration: 53.9938690662
1655
1656
1657
1658     test scenario NeutronNetworks.create_and_list_routers
1659     +---------------------------------------------------------------------------------------------------+
1660     |                                       Response Times (sec)                                        |
1661     +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1662     | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1663     +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1664     | neutron.create_subnet        | 0.718 | 0.792  | 0.884  | 0.89   | 0.895 | 0.801 | 100.0%  | 10    |
1665     | neutron.create_router        | 0.435 | 0.451  | 0.555  | 0.56   | 0.565 | 0.474 | 100.0%  | 10    |
1666     | neutron.add_interface_router | 0.341 | 0.776  | 1.004  | 1.11   | 1.215 | 0.789 | 100.0%  | 10    |
1667     | neutron.list_routers         | 0.066 | 0.42   | 0.477  | 0.491  | 0.505 | 0.367 | 100.0%  | 10    |
1668     | total                        | 1.661 | 2.48   | 2.738  | 2.797  | 2.855 | 2.431 | 100.0%  | 10    |
1669     +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1670     Load duration: 7.12932991982
1671     Full duration: 59.6318800449
1672
1673
1674
1675     test scenario NeutronNetworks.create_and_delete_routers
1676     +------------------------------------------------------------------------------------------------------+
1677     |                                         Response Times (sec)                                         |
1678     +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1679     | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1680     +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1681     | neutron.create_subnet           | 0.739 | 0.812  | 0.936  | 0.949  | 0.963 | 0.833 | 100.0%  | 10    |
1682     | neutron.create_router           | 0.073 | 0.467  | 0.548  | 0.564  | 0.58  | 0.447 | 100.0%  | 10    |
1683     | neutron.add_interface_router    | 0.32  | 0.758  | 0.881  | 0.901  | 0.92  | 0.737 | 100.0%  | 10    |
1684     | neutron.remove_interface_router | 0.632 | 0.723  | 0.767  | 0.788  | 0.808 | 0.719 | 100.0%  | 10    |
1685     | neutron.delete_router           | 0.575 | 0.622  | 0.72   | 0.74   | 0.759 | 0.639 | 100.0%  | 10    |
1686     | total                           | 2.939 | 3.398  | 3.635  | 3.725  | 3.814 | 3.375 | 100.0%  | 10    |
1687     +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1688     Load duration: 10.4781250954
1689     Full duration: 61.2645328045
1690
1691
1692
1693     test scenario NeutronNetworks.create_and_list_ports
1694     +------------------------------------------------------------------------------------------+
1695     |                                   Response Times (sec)                                   |
1696     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1697     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1698     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1699     | neutron.create_port | 0.728 | 0.859  | 0.909  | 0.944  | 0.978 | 0.857 | 100.0%  | 10    |
1700     | neutron.list_ports  | 0.52  | 0.599  | 0.71   | 0.735  | 0.76  | 0.618 | 100.0%  | 10    |
1701     | total               | 1.37  | 1.459  | 1.597  | 1.611  | 1.624 | 1.475 | 100.0%  | 10    |
1702     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1703     Load duration: 4.50073218346
1704     Full duration: 55.2021510601
1705
1706
1707
1708     test scenario NeutronNetworks.create_and_delete_subnets
1709     +--------------------------------------------------------------------------------------------+
1710     |                                    Response Times (sec)                                    |
1711     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1712     | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1713     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1714     | neutron.create_subnet | 0.749 | 0.788  | 0.939  | 0.956  | 0.972 | 0.824 | 100.0%  | 10    |
1715     | neutron.delete_subnet | 0.556 | 0.673  | 0.778  | 0.819  | 0.859 | 0.687 | 100.0%  | 10    |
1716     | total                 | 1.361 | 1.521  | 1.693  | 1.697  | 1.702 | 1.511 | 100.0%  | 10    |
1717     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1718     Load duration: 4.66956591606
1719     Full duration: 54.1284301281
1720
1721
1722
1723     test scenario NeutronNetworks.create_and_delete_networks
1724     +---------------------------------------------------------------------------------------------+
1725     |                                    Response Times (sec)                                     |
1726     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1727     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1728     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1729     | neutron.create_network | 0.62  | 0.643  | 0.756  | 0.784  | 0.812 | 0.672 | 100.0%  | 10    |
1730     | neutron.delete_network | 0.481 | 0.54   | 0.616  | 0.686  | 0.756 | 0.558 | 100.0%  | 10    |
1731     | total                  | 1.101 | 1.206  | 1.363  | 1.377  | 1.391 | 1.23  | 100.0%  | 10    |
1732     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1733     Load duration: 3.73822879791
1734     Full duration: 33.2811751366
1735
1736
1737
1738     test scenario NeutronNetworks.create_and_list_networks
1739     +---------------------------------------------------------------------------------------------+
1740     |                                    Response Times (sec)                                     |
1741     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1742     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1743     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1744     | neutron.create_network | 0.583 | 0.675  | 0.782  | 0.782  | 0.783 | 0.691 | 100.0%  | 10    |
1745     | neutron.list_networks  | 0.058 | 0.395  | 0.517  | 0.522  | 0.528 | 0.364 | 100.0%  | 10    |
1746     | total                  | 0.834 | 1.066  | 1.187  | 1.242  | 1.298 | 1.055 | 100.0%  | 10    |
1747     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1748     Load duration: 3.09279990196
1749     Full duration: 33.633177042
1750
1751
1752
1753     test scenario NeutronNetworks.create_and_update_routers
1754     +---------------------------------------------------------------------------------------------------+
1755     |                                       Response Times (sec)                                        |
1756     +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1757     | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1758     +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1759     | neutron.create_subnet        | 0.713 | 0.8    | 0.903  | 0.913  | 0.922 | 0.811 | 100.0%  | 10    |
1760     | neutron.create_router        | 0.434 | 0.449  | 0.476  | 0.497  | 0.519 | 0.458 | 100.0%  | 10    |
1761     | neutron.add_interface_router | 0.666 | 0.749  | 0.912  | 0.954  | 0.996 | 0.791 | 100.0%  | 10    |
1762     | neutron.update_router        | 0.222 | 0.579  | 0.659  | 0.678  | 0.697 | 0.556 | 100.0%  | 10    |
1763     | total                        | 2.156 | 2.643  | 2.768  | 2.799  | 2.83  | 2.617 | 100.0%  | 10    |
1764     +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1765     Load duration: 7.76268601418
1766     Full duration: 57.6214001179
1767
1768
1769
1770     test scenario NeutronNetworks.create_and_update_networks
1771     +---------------------------------------------------------------------------------------------+
1772     |                                    Response Times (sec)                                     |
1773     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1774     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1775     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1776     | neutron.create_network | 0.606 | 0.672  | 0.761  | 0.785  | 0.81  | 0.681 | 100.0%  | 10    |
1777     | neutron.update_network | 0.137 | 0.518  | 0.538  | 0.542  | 0.547 | 0.482 | 100.0%  | 10    |
1778     | total                  | 0.893 | 1.183  | 1.261  | 1.288  | 1.315 | 1.164 | 100.0%  | 10    |
1779     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1780     Load duration: 3.59189605713
1781     Full duration: 34.8437690735
1782
1783
1784
1785     test scenario NeutronNetworks.create_and_update_ports
1786     +------------------------------------------------------------------------------------------+
1787     |                                   Response Times (sec)                                   |
1788     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1789     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1790     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1791     | neutron.create_port | 0.738 | 0.792  | 0.889  | 0.921  | 0.952 | 0.815 | 100.0%  | 10    |
1792     | neutron.update_port | 0.161 | 0.551  | 0.596  | 0.6    | 0.605 | 0.516 | 100.0%  | 10    |
1793     | total               | 1.044 | 1.339  | 1.429  | 1.482  | 1.536 | 1.331 | 100.0%  | 10    |
1794     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1795     Load duration: 4.11195087433
1796     Full duration: 53.0145220757
1797
1798
1799
1800     test scenario NeutronNetworks.create_and_list_subnets
1801     +--------------------------------------------------------------------------------------------+
1802     |                                    Response Times (sec)                                    |
1803     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1804     | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1805     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1806     | neutron.create_subnet | 0.703 | 0.748  | 0.832  | 0.861  | 0.89  | 0.764 | 100.0%  | 10    |
1807     | neutron.list_subnets  | 0.054 | 0.396  | 0.445  | 0.479  | 0.513 | 0.374 | 100.0%  | 10    |
1808     | total                 | 0.757 | 1.159  | 1.256  | 1.272  | 1.287 | 1.138 | 100.0%  | 10    |
1809     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1810     Load duration: 3.5137629509
1811     Full duration: 52.7622568607
1812
1813
1814
1815     test scenario NeutronNetworks.create_and_update_subnets
1816     +--------------------------------------------------------------------------------------------+
1817     |                                    Response Times (sec)                                    |
1818     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1819     | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1820     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1821     | neutron.create_subnet | 0.742 | 0.813  | 0.947  | 0.948  | 0.949 | 0.838 | 100.0%  | 10    |
1822     | neutron.update_subnet | 0.234 | 0.583  | 0.695  | 0.696  | 0.696 | 0.58  | 100.0%  | 10    |
1823     | total                 | 1.043 | 1.427  | 1.587  | 1.596  | 1.604 | 1.418 | 100.0%  | 10    |
1824     +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1825     Load duration: 4.36762094498
1826     Full duration: 54.1341950893
1827
1828
1829
1830     run_rally - INFO - Test scenario: "neutron" OK.
1831
1832     run_rally - INFO - Starting test scenario "nova" ...
1833     run_rally - INFO -
1834      Preparing input task
1835      Task  c631be68-64eb-462f-af72-0946f649719e: started
1836     Task c631be68-64eb-462f-af72-0946f649719e: finished
1837
1838     test scenario NovaKeypair.create_and_delete_keypair
1839     +------------------------------------------------------------------------------------------+
1840     |                                   Response Times (sec)                                   |
1841     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1842     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1843     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1844     | nova.create_keypair | 0.689 | 0.825  | 1.389  | 1.414  | 1.439 | 0.956 | 100.0%  | 10    |
1845     | nova.delete_keypair | 0.034 | 0.045  | 0.058  | 0.058  | 0.059 | 0.046 | 100.0%  | 10    |
1846     | total               | 0.734 | 0.868  | 1.43   | 1.458  | 1.487 | 1.002 | 100.0%  | 10    |
1847     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1848     Load duration: 2.95623397827
1849     Full duration: 43.0288610458
1850
1851
1852
1853     test scenario NovaServers.snapshot_server
1854     +------------------------------------------------------------------------------------------------+
1855     |                                      Response Times (sec)                                      |
1856     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1857     | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1858     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1859     | nova.boot_server       | 13.069 | 14.075 | 14.775 | 15.063 | 15.35  | 14.118 | 100.0%  | 10    |
1860     | nova.create_image      | 10.992 | 11.363 | 11.948 | 12.03  | 12.112 | 11.402 | 100.0%  | 10    |
1861     | nova.delete_server     | 2.878  | 3.026  | 3.413  | 3.454  | 3.495  | 3.121  | 100.0%  | 10    |
1862     | nova.boot_server (2)   | 10.807 | 12.891 | 14.009 | 14.098 | 14.188 | 12.932 | 100.0%  | 10    |
1863     | nova.delete_server (2) | 2.914  | 3.356  | 4.738  | 4.974  | 5.21   | 3.557  | 100.0%  | 10    |
1864     | nova.delete_image      | 2.769  | 3.227  | 3.659  | 3.685  | 3.711  | 3.238  | 100.0%  | 10    |
1865     | total                  | 44.842 | 48.482 | 49.94  | 50.257 | 50.573 | 48.369 | 100.0%  | 10    |
1866     +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1867     Load duration: 145.116047144
1868     Full duration: 218.130707026
1869
1870
1871
1872     test scenario NovaKeypair.boot_and_delete_server_with_keypair
1873     +---------------------------------------------------------------------------------------------+
1874     |                                    Response Times (sec)                                     |
1875     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1876     | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1877     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1878     | nova.create_keypair | 0.67   | 0.815  | 1.452  | 1.483  | 1.515  | 0.945  | 100.0%  | 10    |
1879     | nova.boot_server    | 11.229 | 12.914 | 14.714 | 15.148 | 15.581 | 13.075 | 100.0%  | 10    |
1880     | nova.delete_server  | 2.87   | 3.313  | 3.4    | 3.451  | 3.502  | 3.214  | 100.0%  | 10    |
1881     | nova.delete_keypair | 0.034  | 0.048  | 0.056  | 0.056  | 0.057  | 0.046  | 100.0%  | 10    |
1882     | total               | 15.3   | 17.062 | 18.916 | 19.109 | 19.302 | 17.281 | 100.0%  | 10    |
1883     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1884     Load duration: 51.5624389648
1885     Full duration: 121.866284132
1886
1887
1888
1889     test scenario NovaKeypair.create_and_list_keypairs
1890     +------------------------------------------------------------------------------------------+
1891     |                                   Response Times (sec)                                   |
1892     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1893     | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1894     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1895     | nova.create_keypair | 0.681 | 0.825  | 1.368  | 1.468  | 1.568 | 0.975 | 100.0%  | 10    |
1896     | nova.list_keypairs  | 0.021 | 0.027  | 0.038  | 0.038  | 0.039 | 0.03  | 100.0%  | 10    |
1897     | total               | 0.715 | 0.855  | 1.394  | 1.494  | 1.593 | 1.005 | 100.0%  | 10    |
1898     +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1899     Load duration: 3.00225996971
1900     Full duration: 44.8396139145
1901
1902
1903
1904     test scenario NovaServers.list_servers
1905     +---------------------------------------------------------------------------------------+
1906     |                                 Response Times (sec)                                  |
1907     +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
1908     | action            | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
1909     +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
1910     | nova.list_servers | 1.385 | 1.648  | 1.794  | 1.8    | 1.806 | 1.64 | 100.0%  | 10    |
1911     | total             | 1.386 | 1.648  | 1.794  | 1.8    | 1.807 | 1.64 | 100.0%  | 10    |
1912     +-------------------+-------+--------+--------+--------+-------+------+---------+-------+
1913     Load duration: 4.86725592613
1914     Full duration: 144.563478947
1915
1916
1917
1918     test scenario NovaServers.resize_server
1919     +---------------------------------------------------------------------------------------------+
1920     |                                    Response Times (sec)                                     |
1921     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1922     | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1923     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1924     | nova.boot_server    | 11.794 | 13.235 | 14.683 | 15.23  | 15.778 | 13.569 | 100.0%  | 10    |
1925     | nova.resize         | 40.775 | 43.909 | 47.803 | 47.888 | 47.973 | 44.294 | 100.0%  | 10    |
1926     | nova.resize_confirm | 2.664  | 3.406  | 5.701  | 5.894  | 6.087  | 3.777  | 100.0%  | 10    |
1927     | nova.delete_server  | 2.831  | 2.964  | 3.671  | 4.355  | 5.038  | 3.264  | 100.0%  | 10    |
1928     | total               | 59.51  | 64.72  | 68.963 | 69.477 | 69.991 | 64.905 | 100.0%  | 10    |
1929     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1930     Load duration: 193.15106678
1931     Full duration: 234.439800978
1932
1933
1934
1935     test scenario NovaServers.boot_server_from_volume_and_delete
1936     +----------------------------------------------------------------------------------------------+
1937     |                                     Response Times (sec)                                     |
1938     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1939     | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1940     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1941     | cinder.create_volume | 9.703  | 10.351 | 11.374 | 12.306 | 13.237 | 10.631 | 100.0%  | 10    |
1942     | nova.boot_server     | 13.02  | 14.474 | 15.965 | 16.121 | 16.276 | 14.667 | 100.0%  | 10    |
1943     | nova.delete_server   | 3.826  | 5.813  | 5.967  | 6.081  | 6.196  | 5.561  | 100.0%  | 10    |
1944     | total                | 27.612 | 30.787 | 32.582 | 32.736 | 32.891 | 30.859 | 100.0%  | 10    |
1945     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1946     Load duration: 92.1244728565
1947     Full duration: 176.439888954
1948
1949
1950
1951     test scenario NovaServers.boot_and_migrate_server
1952     +---------------------------------------------------------------------------------------------+
1953     |                                    Response Times (sec)                                     |
1954     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1955     | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1956     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1957     | nova.boot_server    | 12.068 | 13.808 | 14.866 | 14.966 | 15.067 | 13.788 | 100.0%  | 10    |
1958     | nova.stop_server    | 4.417  | 6.774  | 7.032  | 7.224  | 7.416  | 6.512  | 100.0%  | 10    |
1959     | nova.migrate        | 10.786 | 11.454 | 11.957 | 11.999 | 12.04  | 11.487 | 100.0%  | 10    |
1960     | nova.resize_confirm | 3.328  | 3.614  | 3.822  | 3.905  | 3.988  | 3.621  | 100.0%  | 10    |
1961     | nova.delete_server  | 2.862  | 3.057  | 3.364  | 3.454  | 3.544  | 3.116  | 100.0%  | 10    |
1962     | total               | 34.85  | 38.711 | 40.179 | 40.344 | 40.508 | 38.525 | 100.0%  | 10    |
1963     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1964     Load duration: 115.221567869
1965     Full duration: 156.790792227
1966
1967
1968
1969     test scenario NovaServers.boot_and_delete_server
1970     +--------------------------------------------------------------------------------------------+
1971     |                                    Response Times (sec)                                    |
1972     +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1973     | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1974     +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1975     | nova.boot_server   | 12.492 | 13.618 | 14.995 | 15.0   | 15.004 | 13.701 | 100.0%  | 10    |
1976     | nova.delete_server | 2.88   | 3.033  | 3.371  | 3.49   | 3.61   | 3.125  | 100.0%  | 10    |
1977     | total              | 15.773 | 16.838 | 17.914 | 18.089 | 18.264 | 16.827 | 100.0%  | 10    |
1978     +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1979     Load duration: 50.1218390465
1980     Full duration: 119.306482077
1981
1982
1983
1984     test scenario NovaServers.boot_and_rebuild_server
1985     +---------------------------------------------------------------------------------------------+
1986     |                                    Response Times (sec)                                     |
1987     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1988     | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1989     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1990     | nova.boot_server    | 12.196 | 13.798 | 15.074 | 15.293 | 15.511 | 13.812 | 100.0%  | 10    |
1991     | nova.rebuild_server | 12.036 | 13.891 | 15.523 | 15.599 | 15.676 | 13.972 | 100.0%  | 10    |
1992     | nova.delete_server  | 2.645  | 3.268  | 3.55   | 3.589  | 3.628  | 3.208  | 100.0%  | 10    |
1993     | total               | 28.349 | 31.175 | 32.771 | 33.141 | 33.511 | 30.993 | 100.0%  | 10    |
1994     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1995     Load duration: 92.8703818321
1996     Full duration: 164.587569952
1997
1998
1999
2000     test scenario NovaSecGroup.create_and_list_secgroups
2001     +--------------------------------------------------------------------------------------------------------+
2002     |                                          Response Times (sec)                                          |
2003     +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2004     | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2005     +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2006     | nova.create_10_security_groups | 4.388  | 5.032  | 5.224  | 5.25   | 5.277  | 4.975  | 100.0%  | 10    |
2007     | nova.create_100_rules          | 42.993 | 44.613 | 45.762 | 45.785 | 45.808 | 44.39  | 100.0%  | 10    |
2008     | nova.list_security_groups      | 0.153  | 0.195  | 0.36   | 0.486  | 0.613  | 0.251  | 100.0%  | 10    |
2009     | total                          | 48.225 | 50.01  | 50.441 | 50.635 | 50.83  | 49.616 | 100.0%  | 10    |
2010     +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2011     Load duration: 149.417917013
2012     Full duration: 217.353839159
2013
2014
2015
2016     test scenario NovaSecGroup.create_and_delete_secgroups
2017     +--------------------------------------------------------------------------------------------------------+
2018     |                                          Response Times (sec)                                          |
2019     +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2020     | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2021     +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2022     | nova.create_10_security_groups | 4.382  | 5.191  | 5.496  | 5.608  | 5.72   | 5.12   | 100.0%  | 10    |
2023     | nova.create_100_rules          | 43.059 | 44.368 | 45.778 | 46.029 | 46.28  | 44.458 | 100.0%  | 10    |
2024     | nova.delete_10_security_groups | 1.662  | 2.265  | 2.495  | 2.664  | 2.832  | 2.215  | 100.0%  | 10    |
2025     | total                          | 50.772 | 51.601 | 53.26  | 53.294 | 53.327 | 51.794 | 100.0%  | 10    |
2026     +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2027     Load duration: 156.369856119
2028     Full duration: 199.137834787
2029
2030
2031
2032     test scenario NovaServers.boot_and_bounce_server
2033     +-------------------------------------------------------------------------------------------------+
2034     |                                      Response Times (sec)                                       |
2035     +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2036     | action                  | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2037     +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2038     | nova.boot_server        | 12.013 | 14.52  | 15.332 | 15.8   | 16.267 | 14.249 | 100.0%  | 10    |
2039     | nova.reboot_server      | 5.223  | 6.071  | 6.385  | 6.462  | 6.539  | 5.987  | 100.0%  | 10    |
2040     | nova.soft_reboot_server | 5.766  | 8.423  | 8.806  | 9.002  | 9.198  | 8.214  | 100.0%  | 10    |
2041     | nova.stop_server        | 3.892  | 6.503  | 7.587  | 10.894 | 14.201 | 6.898  | 100.0%  | 10    |
2042     | nova.start_server       | 3.432  | 4.687  | 5.177  | 5.424  | 5.672  | 4.587  | 100.0%  | 10    |
2043     | nova.rescue_server      | 7.9    | 8.519  | 9.688  | 10.196 | 10.703 | 8.724  | 100.0%  | 10    |
2044     | nova.unrescue_server    | 5.091  | 5.518  | 5.836  | 6.131  | 6.426  | 5.577  | 100.0%  | 10    |
2045     | nova.delete_server      | 2.495  | 2.921  | 3.469  | 3.516  | 3.563  | 2.974  | 100.0%  | 10    |
2046     | total                   | 53.649 | 57.305 | 59.111 | 60.626 | 62.142 | 57.23  | 100.0%  | 10    |
2047     +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2048     Load duration: 174.621170044
2049     Full duration: 245.828352928
2050
2051
2052
2053     test scenario NovaServers.boot_server
2054     +------------------------------------------------------------------------------------------+
2055     |                                   Response Times (sec)                                   |
2056     +------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2057     | action           | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2058     +------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2059     | nova.boot_server | 13.233 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0%  | 10    |
2060     | total            | 13.234 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0%  | 10    |
2061     +------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2062     Load duration: 42.6567699909
2063     Full duration: 99.771146059
2064
2065
2066
2067     test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
2068     +-----------------------------------------------------------------------------------------------------------+
2069     |                                           Response Times (sec)                                            |
2070     +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2071     | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2072     +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2073     | nova.create_10_security_groups    | 4.306  | 4.999  | 5.282  | 5.289  | 5.296  | 4.937  | 100.0%  | 10    |
2074     | nova.create_100_rules             | 41.795 | 43.955 | 45.983 | 46.201 | 46.418 | 44.135 | 100.0%  | 10    |
2075     | nova.boot_server                  | 10.075 | 11.651 | 12.302 | 13.061 | 13.82  | 11.534 | 100.0%  | 10    |
2076     | nova.get_attached_security_groups | 0.217  | 0.249  | 0.568  | 0.572  | 0.577  | 0.338  | 100.0%  | 10    |
2077     | nova.delete_server                | 2.469  | 2.619  | 2.937  | 3.034  | 3.131  | 2.712  | 100.0%  | 10    |
2078     | nova.delete_10_security_groups    | 1.574  | 1.878  | 2.55   | 2.704  | 2.858  | 2.053  | 100.0%  | 10    |
2079     | total                             | 63.097 | 65.905 | 66.858 | 67.329 | 67.8   | 65.71  | 100.0%  | 10    |
2080     +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2081     Load duration: 195.037164927
2082     Full duration: 263.490648985
2083
2084
2085
2086     test scenario NovaServers.pause_and_unpause_server
2087     +---------------------------------------------------------------------------------------------+
2088     |                                    Response Times (sec)                                     |
2089     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2090     | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2091     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2092     | nova.boot_server    | 12.325 | 13.238 | 14.398 | 14.542 | 14.687 | 13.373 | 100.0%  | 10    |
2093     | nova.pause_server   | 2.412  | 2.986  | 3.177  | 3.205  | 3.233  | 2.946  | 100.0%  | 10    |
2094     | nova.unpause_server | 2.824  | 3.169  | 3.325  | 3.392  | 3.459  | 3.13   | 100.0%  | 10    |
2095     | nova.delete_server  | 2.501  | 3.244  | 3.557  | 3.634  | 3.71   | 3.233  | 100.0%  | 10    |
2096     | total               | 21.499 | 22.307 | 24.0   | 24.022 | 24.043 | 22.682 | 100.0%  | 10    |
2097     +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2098     Load duration: 67.2968730927
2099     Full duration: 134.783083916
2100
2101
2102
2103     test scenario NovaServers.boot_server_from_volume
2104     +----------------------------------------------------------------------------------------------+
2105     |                                     Response Times (sec)                                     |
2106     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2107     | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2108     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2109     | cinder.create_volume | 9.885  | 10.866 | 11.617 | 11.636 | 11.655 | 10.841 | 100.0%  | 10    |
2110     | nova.boot_server     | 13.236 | 14.774 | 15.766 | 16.126 | 16.486 | 14.693 | 100.0%  | 10    |
2111     | total                | 23.437 | 25.64  | 27.197 | 27.213 | 27.23  | 25.534 | 100.0%  | 10    |
2112     +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2113     Load duration: 78.3072631359
2114     Full duration: 145.979751825
2115
2116
2117
2118     test scenario NovaServers.boot_and_list_server
2119     +-------------------------------------------------------------------------------------------+
2120     |                                   Response Times (sec)                                    |
2121     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2122     | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
2123     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2124     | nova.boot_server  | 12.745 | 14.15  | 15.755 | 15.872 | 15.99  | 14.143 | 100.0%  | 10    |
2125     | nova.list_servers | 0.579  | 0.977  | 1.114  | 1.158  | 1.203  | 0.926  | 100.0%  | 10    |
2126     | total             | 13.49  | 14.979 | 16.933 | 16.94  | 16.947 | 15.07  | 100.0%  | 10    |
2127     +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
2128     Load duration: 46.7471969128
2129     Full duration: 130.989289045
2130
2131
2132
2133     run_rally - INFO - Test scenario: "nova" OK.
2134
2135     run_rally - INFO - Starting test scenario "quotas" ...
2136     run_rally - INFO -
2137      Preparing input task
2138      Task  09c70711-40eb-4c85-8b87-c0c081222b0d: started
2139     Task 09c70711-40eb-4c85-8b87-c0c081222b0d: finished
2140
2141     test scenario Quotas.cinder_update
2142     +------------------------------------------------------------------------------------------+
2143     |                                   Response Times (sec)                                   |
2144     +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
2145     | action               | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
2146     +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
2147     | quotas.update_quotas | 1.123 | 1.192  | 1.297  | 1.331  | 1.365 | 1.21 | 100.0%  | 10    |
2148     | total                | 1.123 | 1.192  | 1.297  | 1.331  | 1.365 | 1.21 | 100.0%  | 10    |
2149     +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
2150     Load duration: 3.62791609764
2151     Full duration: 16.2237439156
2152
2153
2154
2155     test scenario Quotas.neutron_update
2156     +-------------------------------------------------------------------------------------------+
2157     |                                   Response Times (sec)                                    |
2158     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2159     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
2160     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2161     | quotas.update_quotas | 0.396 | 0.426  | 0.572  | 0.581  | 0.591 | 0.464 | 100.0%  | 10    |
2162     | total                | 0.553 | 0.575  | 0.773  | 0.834  | 0.896 | 0.64  | 100.0%  | 10    |
2163     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2164     Load duration: 1.80940699577
2165     Full duration: 13.0895729065
2166
2167
2168
2169     test scenario Quotas.cinder_update_and_delete
2170     +-------------------------------------------------------------------------------------------+
2171     |                                   Response Times (sec)                                    |
2172     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2173     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
2174     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2175     | quotas.update_quotas | 1.145 | 1.182  | 1.365  | 1.407  | 1.449 | 1.234 | 100.0%  | 10    |
2176     | quotas.delete_quotas | 0.543 | 0.933  | 1.011  | 1.032  | 1.053 | 0.873 | 100.0%  | 10    |
2177     | total                | 1.723 | 2.095  | 2.413  | 2.435  | 2.456 | 2.107 | 100.0%  | 10    |
2178     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2179     Load duration: 6.34634900093
2180     Full duration: 18.2702391148
2181
2182
2183
2184     test scenario Quotas.nova_update_and_delete
2185     +-------------------------------------------------------------------------------------------+
2186     |                                   Response Times (sec)                                    |
2187     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2188     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
2189     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2190     | quotas.update_quotas | 0.544 | 0.621  | 0.695  | 0.705  | 0.716 | 0.619 | 100.0%  | 10    |
2191     | quotas.delete_quotas | 0.017 | 0.023  | 0.028  | 0.028  | 0.029 | 0.024 | 100.0%  | 10    |
2192     | total                | 0.569 | 0.642  | 0.713  | 0.726  | 0.739 | 0.643 | 100.0%  | 10    |
2193     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2194     Load duration: 1.95026016235
2195     Full duration: 13.2278659344
2196
2197
2198
2199     test scenario Quotas.nova_update
2200     +-------------------------------------------------------------------------------------------+
2201     |                                   Response Times (sec)                                    |
2202     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2203     | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
2204     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2205     | quotas.update_quotas | 0.571 | 0.647  | 0.664  | 0.692  | 0.719 | 0.643 | 100.0%  | 10    |
2206     | total                | 0.571 | 0.647  | 0.664  | 0.692  | 0.719 | 0.644 | 100.0%  | 10    |
2207     +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2208     Load duration: 1.94177007675
2209     Full duration: 13.6731410027
2210
2211
2212
2213     run_rally - INFO - Test scenario: "quotas" OK.
2214
2215     run_rally - INFO - Starting test scenario "requests" ...
2216     run_rally - INFO -
2217      Preparing input task
2218      Task  ee8c572e-1240-4996-a06f-801592da0277: started
2219     Task ee8c572e-1240-4996-a06f-801592da0277: finished
2220
2221     test scenario HttpRequests.check_random_request
2222     +---------------------------------------------------------------------------------------------+
2223     |                                    Response Times (sec)                                     |
2224     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2225     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
2226     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2227     | requests.check_request | 0.047 | 0.201  | 0.383  | 0.384  | 0.386 | 0.214 | 100.0%  | 10    |
2228     | total                  | 0.047 | 0.201  | 0.383  | 0.384  | 0.386 | 0.214 | 100.0%  | 10    |
2229     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2230     Load duration: 0.791751146317
2231     Full duration: 5.66926693916
2232
2233
2234
2235     test scenario HttpRequests.check_request
2236     +---------------------------------------------------------------------------------------------+
2237     |                                    Response Times (sec)                                     |
2238     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2239     | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
2240     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2241     | requests.check_request | 0.044 | 0.046  | 0.052  | 0.052  | 0.053 | 0.048 | 100.0%  | 10    |
2242     | total                  | 0.044 | 0.046  | 0.052  | 0.052  | 0.053 | 0.048 | 100.0%  | 10    |
2243     +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
2244     Load duration: 0.181750059128
2245     Full duration: 5.16227507591
2246
2247
2248
2249     run_rally - INFO - Test scenario: "requests" OK.
2250
2251     run_rally - INFO -
2252
2253
2254                          Rally Summary Report
2255     +===================+============+===============+===========+
2256     | Module            | Duration   | nb. Test Run  | Success   |
2257     +===================+============+===============+===========+
2258     | authenticate      | 00:59      | 10            | 100.00%   |
2259     +-------------------+------------+---------------+-----------+
2260     | glance            | 03:38      | 7             | 100.00%   |
2261     +-------------------+------------+---------------+-----------+
2262     | cinder            | 22:59      | 50            | 100.00%   |
2263     +-------------------+------------+---------------+-----------+
2264     | heat              | 11:16      | 35            | 100.00%   |
2265     +-------------------+------------+---------------+-----------+
2266     | keystone          | 02:37      | 29            | 100.00%   |
2267     +-------------------+------------+---------------+-----------+
2268     | neutron           | 10:03      | 31            | 100.00%   |
2269     +-------------------+------------+---------------+-----------+
2270     | nova              | 47:41      | 61            | 100.00%   |
2271     +-------------------+------------+---------------+-----------+
2272     | quotas            | 01:14      | 7             | 100.00%   |
2273     +-------------------+------------+---------------+-----------+
2274     | requests          | 00:10      | 2             | 100.00%   |
2275     +-------------------+------------+---------------+-----------+
2276     +===================+============+===============+===========+
2277     | TOTAL:            | 01:40:41   | 232           | 100.00%   |
2278     +===================+============+===============+===========+
2279 ::