Merge "Extract util functions from tempest.py to conf_utils"
[functest.git] / docs / results / fuel-os-nosdn-kvm-ha.rst
1 .. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
2 .. http://creativecommons.org/licenses/by/4.0
3
4 Detailed test results for fuel-os-nosdn-kvm-ha
5 ----------------------------------------------
6
7 VIM
8 ---
9
10 Tempest
11 ^^^^^^^
12 ::
13
14     +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
15     | name                                                                                                                      | time      | status  |
16     +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
17     | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                | 0.37487   | success |
18     | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                              | 0.09209   | success |
19     | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.94115   | success |
20     | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list   | 1.59631   | success |
21     | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete   | 3.03178   | success |
22     | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                      | 11.13795  | success |
23     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                          | 0.07863   | success |
24     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                 | 0.00116   | success |
25     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                    | 0.08504   | success |
26     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                           | 0.00099   | success |
27     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                             | 7.63607   | success |
28     | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                      | 0.06693   | success |
29     | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network           | 0.13367   | success |
30     | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_create                       | 0.0       | skip    |
31     | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_delete                       | 0.0       | skip    |
32     | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_get                          | 0.0       | skip    |
33     | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_list                         | 0.0       | skip    |
34     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_create                        | 0.0       | skip    |
35     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_delete                        | 0.0       | skip    |
36     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_get                           | 0.0       | skip    |
37     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_list                          | 0.0       | skip    |
38     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_create                           | 0.0       | skip    |
39     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_delete                           | 0.0       | skip    |
40     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_get                              | 0.0       | skip    |
41     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_list                             | 0.0       | skip    |
42     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_create                                | 0.0       | skip    |
43     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_delete                                | 0.0       | skip    |
44     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_get                                   | 0.0       | skip    |
45     | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_list                                  | 0.0       | skip    |
46     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_create                            | 0.0       | skip    |
47     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_delete                            | 0.0       | skip    |
48     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_get                               | 0.0       | skip    |
49     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_list                              | 0.0       | skip    |
50     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_job_binary_get_data                                      | 0.0       | skip    |
51     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_create                                  | 0.0       | skip    |
52     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_delete                                  | 0.0       | skip    |
53     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_get                                     | 0.0       | skip    |
54     | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_list                                    | 0.0       | skip    |
55     | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_create               | 0.0       | skip    |
56     | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_delete               | 0.0       | skip    |
57     | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_get                  | 0.0       | skip    |
58     | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_get_data             | 0.0       | skip    |
59     | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_list                 | 0.0       | skip    |
60     | tempest.api.data_processing.test_jobs.JobTest.test_job_create                                                             | 0.0       | skip    |
61     | tempest.api.data_processing.test_jobs.JobTest.test_job_delete                                                             | 0.0       | skip    |
62     | tempest.api.data_processing.test_jobs.JobTest.test_job_get                                                                | 0.0       | skip    |
63     | tempest.api.data_processing.test_jobs.JobTest.test_job_list                                                               | 0.0       | skip    |
64     | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_create               | 0.0       | skip    |
65     | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_delete               | 0.0       | skip    |
66     | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_get                  | 0.0       | skip    |
67     | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_list                 | 0.0       | skip    |
68     | tempest.api.data_processing.test_plugins.PluginsTest.test_plugin_get                                                      | 0.0       | skip    |
69     | tempest.api.data_processing.test_plugins.PluginsTest.test_plugin_list                                                     | 0.0       | skip    |
70     | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_compare_db_flavors_with_os                             | 0.0       | skip    |
71     | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_get_db_flavor                                          | 0.0       | skip    |
72     | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_list_db_flavors                                        | 0.0       | skip    |
73     | tempest.api.database.limits.test_limits.DatabaseLimitsTest.test_absolute_limits                                           | 0.0       | skip    |
74     | tempest.api.database.versions.test_versions.DatabaseVersionsTest.test_list_db_versions                                    | 0.0       | skip    |
75     | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                           | 0.57347   | success |
76     | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                   | 0.17627   | success |
77     | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete              | 0.33315   | success |
78     | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                               | 0.08263   | success |
79     | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                               | 0.82181   | success |
80     | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                       | 0.42812   | success |
81     | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                               | 1.89984   | success |
82     | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                             | 0.33804   | success |
83     | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                            | 0.26122   | success |
84     | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list                                | 0.43116   | success |
85     | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                               | 0.40022   | success |
86     | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                            | 1.70626   | success |
87     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                          | 0.07075   | success |
88     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                    | 0.06209   | success |
89     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                     | 0.06225   | success |
90     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                          | 0.08494   | success |
91     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                    | 0.04772   | success |
92     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                     | 0.05578   | success |
93     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                              | 1.27065   | success |
94     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                            | 2.38206   | success |
95     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                              | 2.46710   | success |
96     | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                          | 2.88813   | success |
97     | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address            | 0.91435   | success |
98     | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                  | 1.63719   | success |
99     | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network                                  | 1.30351   | success |
100     | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port                                     | 1.98554   | success |
101     | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet                                   | 3.09141   | success |
102     | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network                                      | 1.40844   | success |
103     | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port                                         | 1.67281   | success |
104     | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet                                       | 2.34230   | success |
105     | tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet                               | 1.77383   | success |
106     | tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility                                       | 0.27369   | success |
107     | tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks                                                     | 0.21206   | success |
108     | tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets                                                      | 0.05304   | success |
109     | tempest.api.network.test_networks.NetworksIpV6Test.test_show_network                                                      | 0.03923   | success |
110     | tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet                                                       | 0.21345   | success |
111     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                          | 1.96905   | success |
112     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                  | 0.41775   | success |
113     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                | 0.04545   | success |
114     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                 | 0.03878   | success |
115     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                 | 0.03483   | success |
116     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                  | 0.19582   | success |
117     | tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet                                   | 1.74789   | success |
118     | tempest.api.network.test_networks.NetworksTest.test_external_network_visibility                                           | 0.23307   | success |
119     | tempest.api.network.test_networks.NetworksTest.test_list_networks                                                         | 0.05593   | success |
120     | tempest.api.network.test_networks.NetworksTest.test_list_subnets                                                          | 0.03420   | success |
121     | tempest.api.network.test_networks.NetworksTest.test_show_network                                                          | 0.22495   | success |
122     | tempest.api.network.test_networks.NetworksTest.test_show_subnet                                                           | 0.04874   | success |
123     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                             | 1.87449   | success |
124     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                  | 1.73660   | success |
125     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                           | 1.47535   | success |
126     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                          | 0.07632   | success |
127     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                           | 0.22105   | success |
128     | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                 | 1.88100   | success |
129     | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                      | 2.43974   | success |
130     | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                               | 0.73850   | success |
131     | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                              | 0.23058   | success |
132     | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                               | 0.22952   | success |
133     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                      | 4.10475   | success |
134     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                            | 2.05694   | success |
135     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                          | 1.35753   | success |
136     | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                               | 1.43959   | success |
137     | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                          | 3.83507   | success |
138     | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                | 2.17349   | success |
139     | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                              | 1.93067   | success |
140     | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                   | 1.12709   | success |
141     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group              | 1.29264   | success |
142     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                     | 1.59275   | success |
143     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                       | 0.03756   | success |
144     | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                  | 1.57130   | success |
145     | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                         | 1.52547   | success |
146     | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                           | 0.05488   | success |
147     | tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools       | 1.47037   | success |
148     | tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota                                  | 0.0       | fail    |
149     | tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object                                 | 0.0       | fail    |
150     | tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata                                   | 0.0       | fail    |
151     | tempest.api.object_storage.test_account_services.AccountTest.test_list_containers                                         | 0.0       | fail    |
152     | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object                             | 0.32095   | fail    |
153     | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects                         | 0.02198   | fail    |
154     | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object                             | 0.01216   | fail    |
155     | tempest.api.object_storage.test_container_services.ContainerTest.test_create_container                                    | 0.36258   | fail    |
156     | tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents                             | 0.01330   | fail    |
157     | tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata                             | 0.01521   | fail    |
158     | tempest.api.object_storage.test_object_services.ObjectTest.test_create_object                                             | 0.0       | fail    |
159     | tempest.api.object_storage.test_object_services.ObjectTest.test_get_object                                                | 0.0       | fail    |
160     | tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata                                      | 0.0       | fail    |
161     | tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata                                    | 0.0       | fail    |
162     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                            | 0.40358   | success |
163     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                            | 4.40282   | success |
164     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                        | 0.04414   | success |
165     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                               | 1.05533   | success |
166     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                           | 0.48932   | success |
167     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                               | 0.49844   | success |
168     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate               | 0.49092   | success |
169     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change     | 0.60408   | success |
170     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change   | 0.63262   | success |
171     | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                  | 2.74910   | success |
172     | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                      | 0.04588   | success |
173     | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 5.96533   | success |
174     | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 2.93564   | success |
175     | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                        | 2.06137   | success |
176     | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                        | 2.08282   | success |
177     | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                 | 7.85484   | success |
178     | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                      | 13.98156  | success |
179     | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                 | 7.31661   | success |
180     | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                      | 14.01416  | success |
181     | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                               | 0.06604   | success |
182     | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                               | 0.25951   | success |
183     | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                        | 49.36369  | success |
184     | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops                                           | 25.33085  | success |
185     | tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes                                     | 0.0       | skip    |
186     | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                  | 103.45858 | success |
187     | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                | 76.91454  | success |
188     +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
189     2016-04-26 01:22:55,788 - run_tempest - INFO - Results: {'timestart': '2016-04-2601:09:10.555191', 'duration': 824, 'tests': 171, 'failures': 14}
190
191 Rally
192 ^^^^^
193 ::
194
195     FUNCTEST.info: Running Rally benchmark suite...
196     2016-04-26 01:24:50,982 - run_rally - INFO - Starting test scenario "authenticate" ...
197     2016-04-26 01:25:56,731 - run_rally - INFO -
198      Preparing input task
199      Task  8204ef26-e392-473b-b607-fe79c30f3c6c: started
200     Task 8204ef26-e392-473b-b607-fe79c30f3c6c: finished
201
202     test scenario Authenticate.validate_glance
203     +-----------------------------------------------------------------------------------------------------------------------------------------+
204     |                                                          Response Times (sec)                                                           |
205     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
206     | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
207     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
208     | authenticate.validate_glance_2_times | 0.823     | 0.883        | 0.951        | 0.954        | 0.957     | 0.885     | 100.0%  | 10    |
209     | total                                | 1.01      | 1.089        | 1.144        | 1.158        | 1.172     | 1.085     | 100.0%  | 10    |
210     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
211     Load duration: 3.33679389954
212     Full duration: 10.0142049789
213
214     test scenario Authenticate.keystone
215     +--------------------------------------------------------------------------------------------------------------------------+
216     |                                                   Response Times (sec)                                                   |
217     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
218     | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
219     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
220     | authenticate.keystone | 0.173     | 0.191        | 0.195        | 0.201        | 0.206     | 0.189     | 100.0%  | 10    |
221     | total                 | 0.173     | 0.191        | 0.195        | 0.201        | 0.206     | 0.189     | 100.0%  | 10    |
222     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
223     Load duration: 0.59915304184
224     Full duration: 6.89671802521
225
226     test scenario Authenticate.validate_heat
227     +---------------------------------------------------------------------------------------------------------------------------------------+
228     |                                                         Response Times (sec)                                                          |
229     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
230     | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
231     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
232     | authenticate.validate_heat_2_times | 0.436     | 0.468        | 0.496        | 0.499        | 0.502     | 0.47      | 100.0%  | 10    |
233     | total                              | 0.637     | 0.668        | 0.704        | 0.705        | 0.707     | 0.671     | 100.0%  | 10    |
234     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
235     Load duration: 2.02648496628
236     Full duration: 8.63242101669
237
238     test scenario Authenticate.validate_nova
239     +---------------------------------------------------------------------------------------------------------------------------------------+
240     |                                                         Response Times (sec)                                                          |
241     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
242     | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
243     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
244     | authenticate.validate_nova_2_times | 0.245     | 0.281        | 0.405        | 0.41         | 0.416     | 0.301     | 100.0%  | 10    |
245     | total                              | 0.423     | 0.459        | 0.585        | 0.607        | 0.628     | 0.488     | 100.0%  | 10    |
246     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
247     Load duration: 1.44381713867
248     Full duration: 8.15497398376
249
250     test scenario Authenticate.validate_cinder
251     +-----------------------------------------------------------------------------------------------------------------------------------------+
252     |                                                          Response Times (sec)                                                           |
253     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
254     | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
255     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
256     | authenticate.validate_cinder_2_times | 0.245     | 0.435        | 0.501        | 0.598        | 0.695     | 0.446     | 100.0%  | 10    |
257     | total                                | 0.416     | 0.662        | 0.692        | 0.777        | 0.862     | 0.642     | 100.0%  | 10    |
258     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
259     Load duration: 1.90059304237
260     Full duration: 8.63323712349
261
262     test scenario Authenticate.validate_neutron
263     +------------------------------------------------------------------------------------------------------------------------------------------+
264     |                                                           Response Times (sec)                                                           |
265     +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
266     | Action                                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
267     +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
268     | authenticate.validate_neutron_2_times | 0.312     | 0.491        | 0.599        | 0.608        | 0.617     | 0.493     | 100.0%  | 10    |
269     | total                                 | 0.512     | 0.69         | 0.788        | 0.798        | 0.808     | 0.69      | 100.0%  | 10    |
270     +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
271     Load duration: 2.07425689697
272     Full duration: 8.5414249897
273
274     2016-04-26 01:25:58,048 - run_rally - INFO - Test scenario: "authenticate" OK.
275
276     2016-04-26 01:25:58,314 - run_rally - INFO - Starting test scenario "glance" ...
277     2016-04-26 01:29:06,596 - run_rally - INFO -
278      Preparing input task
279      Task  4929df57-a129-42f5-bf1e-e1acf761f7dd: started
280     Task 4929df57-a129-42f5-bf1e-e1acf761f7dd: finished
281
282     test scenario GlanceImages.list_images
283     +-----------------------------------------------------------------------------------------------------------------------+
284     |                                                 Response Times (sec)                                                  |
285     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
286     | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
287     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
288     | glance.list_images | 0.629     | 0.677        | 0.844        | 0.862        | 0.879     | 0.706     | 100.0%  | 10    |
289     | total              | 0.629     | 0.677        | 0.844        | 0.862        | 0.879     | 0.706     | 100.0%  | 10    |
290     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
291     Load duration: 2.06210279465
292     Full duration: 11.1119971275
293
294     test scenario GlanceImages.create_image_and_boot_instances
295     +------------------------------------------------------------------------------------------------------------------------+
296     |                                                  Response Times (sec)                                                  |
297     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
298     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
299     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
300     | glance.create_image | 6.132     | 6.43         | 6.695        | 6.801        | 6.907     | 6.444     | 100.0%  | 10    |
301     | nova.boot_servers   | 12.665    | 13.469       | 14.176       | 14.374       | 14.573    | 13.486    | 100.0%  | 10    |
302     | total               | 19.057    | 19.947       | 20.84        | 20.94        | 21.039    | 19.931    | 100.0%  | 10    |
303     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
304     Load duration: 58.8742520809
305     Full duration: 95.2440040112
306
307     test scenario GlanceImages.create_and_list_image
308     +------------------------------------------------------------------------------------------------------------------------+
309     |                                                  Response Times (sec)                                                  |
310     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
311     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
312     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
313     | glance.create_image | 6.278     | 6.53         | 7.761        | 11.222       | 14.683    | 7.394     | 100.0%  | 10    |
314     | glance.list_images  | 0.299     | 0.472        | 0.515        | 0.522        | 0.529     | 0.462     | 100.0%  | 10    |
315     | total               | 6.752     | 7.034        | 8.227        | 11.691       | 15.154    | 7.856     | 100.0%  | 10    |
316     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
317     Load duration: 22.2857620716
318     Full duration: 34.3181619644
319
320     test scenario GlanceImages.create_and_delete_image
321     +------------------------------------------------------------------------------------------------------------------------+
322     |                                                  Response Times (sec)                                                  |
323     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
324     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
325     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
326     | glance.create_image | 6.137     | 6.554        | 6.898        | 6.924        | 6.95      | 6.58      | 100.0%  | 10    |
327     | glance.delete_image | 1.285     | 1.713        | 1.917        | 1.962        | 2.006     | 1.713     | 100.0%  | 10    |
328     | total               | 7.602     | 8.362        | 8.696        | 8.748        | 8.799     | 8.292     | 100.0%  | 10    |
329     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
330     Load duration: 25.0005450249
331     Full duration: 34.4151468277
332
333     2016-04-26 01:29:07,930 - run_rally - INFO - Test scenario: "glance" OK.
334
335     2016-04-26 01:29:08,087 - run_rally - INFO - Starting test scenario "cinder" ...
336     2016-04-26 02:24:09,641 - run_rally - INFO - Percentage error: n/a, | total                | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
337
338     2016-04-26 02:24:09,661 - run_rally - INFO - Percentage error: n/a, | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
339
340     2016-04-26 02:24:09,663 - run_rally - INFO - Percentage error: n/a, | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
341
342     2016-04-26 02:24:09,666 - run_rally - INFO - Percentage error: n/a, | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
343
344     2016-04-26 02:24:09,780 - run_rally - INFO -
345      Preparing input task
346      Task  3d8fb27f-5dfb-4a07-ad7d-cec99384404f: started
347     Task 3d8fb27f-5dfb-4a07-ad7d-cec99384404f: finished
348
349     test scenario CinderVolumes.create_and_attach_volume
350     +-------------------------------------------------------------------------------------------------------------------------+
351     |                                                  Response Times (sec)                                                   |
352     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
353     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
354     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
355     | nova.boot_server     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
356     | cinder.create_volume | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
357     | nova.attach_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
358     | nova.detach_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
359     | total                | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
360     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
361     Load duration: 438.78555584
362     Full duration: 476.062150002
363
364     test scenario CinderVolumes.create_and_list_volume
365     +-------------------------------------------------------------------------------------------------------------------------+
366     |                                                  Response Times (sec)                                                   |
367     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
368     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
369     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
370     | cinder.create_volume | 7.312     | 9.44         | 9.821        | 9.964        | 10.107    | 9.128     | 100.0%  | 10    |
371     | cinder.list_volumes  | 0.058     | 0.27         | 0.297        | 0.324        | 0.35      | 0.215     | 100.0%  | 10    |
372     | total                | 7.37      | 9.626        | 10.164       | 10.275       | 10.386    | 9.343     | 100.0%  | 10    |
373     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
374     Load duration: 28.7357289791
375     Full duration: 47.5475459099
376
377     test scenario CinderVolumes.create_and_list_volume
378     +-------------------------------------------------------------------------------------------------------------------------+
379     |                                                  Response Times (sec)                                                   |
380     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
381     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
382     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
383     | cinder.create_volume | 3.202     | 3.516        | 3.662        | 3.711        | 3.761     | 3.5       | 100.0%  | 10    |
384     | cinder.list_volumes  | 0.05      | 0.224        | 0.315        | 0.344        | 0.372     | 0.193     | 100.0%  | 10    |
385     | total                | 3.298     | 3.743        | 3.868        | 3.888        | 3.907     | 3.693     | 100.0%  | 10    |
386     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
387     Load duration: 11.2217340469
388     Full duration: 27.984375
389
390     test scenario CinderVolumes.create_and_list_snapshots
391     +---------------------------------------------------------------------------------------------------------------------------+
392     |                                                   Response Times (sec)                                                    |
393     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
394     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
395     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
396     | cinder.create_snapshot | 2.92      | 3.143        | 4.9          | 4.966        | 5.032     | 3.472     | 100.0%  | 10    |
397     | cinder.list_snapshots  | 0.023     | 0.029        | 0.218        | 0.233        | 0.248     | 0.072     | 100.0%  | 10    |
398     | total                  | 2.955     | 3.197        | 4.927        | 4.993        | 5.06      | 3.545     | 100.0%  | 10    |
399     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
400     Load duration: 9.69527101517
401     Full duration: 42.2511930466
402
403     test scenario CinderVolumes.create_and_delete_volume
404     +-------------------------------------------------------------------------------------------------------------------------+
405     |                                                  Response Times (sec)                                                   |
406     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
407     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
408     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
409     | cinder.create_volume | 3.018     | 3.457        | 3.685        | 3.737        | 3.788     | 3.413     | 100.0%  | 10    |
410     | cinder.delete_volume | 0.914     | 2.612        | 3.053        | 3.069        | 3.085     | 2.563     | 100.0%  | 10    |
411     | total                | 3.932     | 6.16         | 6.58         | 6.669        | 6.759     | 5.977     | 100.0%  | 10    |
412     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
413     Load duration: 17.8796432018
414     Full duration: 31.8870809078
415
416     test scenario CinderVolumes.create_and_delete_volume
417     +-------------------------------------------------------------------------------------------------------------------------+
418     |                                                  Response Times (sec)                                                   |
419     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
420     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
421     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
422     | cinder.create_volume | 8.958     | 9.585        | 9.884        | 10.249       | 10.614    | 9.589     | 100.0%  | 10    |
423     | cinder.delete_volume | 0.775     | 2.647        | 3.059        | 3.255        | 3.451     | 2.387     | 100.0%  | 10    |
424     | total                | 10.49     | 12.128       | 12.864       | 13.066       | 13.269    | 11.977    | 100.0%  | 10    |
425     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
426     Load duration: 35.2168581486
427     Full duration: 50.825067997
428
429     test scenario CinderVolumes.create_and_delete_volume
430     +-------------------------------------------------------------------------------------------------------------------------+
431     |                                                  Response Times (sec)                                                   |
432     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
433     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
434     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
435     | cinder.create_volume | 3.192     | 3.607        | 4.26         | 4.265        | 4.27      | 3.682     | 100.0%  | 10    |
436     | cinder.delete_volume | 2.551     | 2.625        | 3.0          | 3.039        | 3.079     | 2.731     | 100.0%  | 10    |
437     | total                | 5.766     | 6.169        | 7.217        | 7.239        | 7.262     | 6.413     | 100.0%  | 10    |
438     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
439     Load duration: 19.1643960476
440     Full duration: 32.8357338905
441
442     test scenario CinderVolumes.create_and_upload_volume_to_image
443     +----------------------------------------------------------------------------------------------------------------------------------+
444     |                                                       Response Times (sec)                                                       |
445     +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
446     | Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
447     +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
448     | cinder.create_volume          | 3.223     | 3.533        | 3.679        | 3.775        | 3.87      | 3.545     | 100.0%  | 10    |
449     | cinder.upload_volume_to_image | 24.815    | 36.631       | 39.206       | 39.953       | 40.701    | 34.888    | 100.0%  | 10    |
450     | cinder.delete_volume          | 2.335     | 2.578        | 2.734        | 2.742        | 2.75      | 2.535     | 100.0%  | 10    |
451     | nova.delete_image             | 1.988     | 2.228        | 2.551        | 2.734        | 2.917     | 2.296     | 100.0%  | 10    |
452     | total                         | 32.77     | 45.39        | 47.552       | 48.244       | 48.935    | 43.265    | 100.0%  | 10    |
453     +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
454     Load duration: 124.777842999
455     Full duration: 139.828857899
456
457     test scenario CinderVolumes.create_volume
458     +-------------------------------------------------------------------------------------------------------------------------+
459     |                                                  Response Times (sec)                                                   |
460     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
461     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
462     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
463     | cinder.create_volume | 3.281     | 3.509        | 3.788        | 3.8          | 3.812     | 3.517     | 100.0%  | 10    |
464     | total                | 3.281     | 3.509        | 3.788        | 3.8          | 3.813     | 3.517     | 100.0%  | 10    |
465     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
466     Load duration: 10.4726939201
467     Full duration: 25.0890491009
468
469     test scenario CinderVolumes.create_volume
470     +-------------------------------------------------------------------------------------------------------------------------+
471     |                                                  Response Times (sec)                                                   |
472     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
473     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
474     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
475     | cinder.create_volume | 3.219     | 3.547        | 3.845        | 3.858        | 3.872     | 3.556     | 100.0%  | 10    |
476     | total                | 3.22      | 3.548        | 3.845        | 3.858        | 3.872     | 3.556     | 100.0%  | 10    |
477     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
478     Load duration: 10.6221859455
479     Full duration: 28.0074269772
480
481     test scenario CinderVolumes.list_volumes
482     +------------------------------------------------------------------------------------------------------------------------+
483     |                                                  Response Times (sec)                                                  |
484     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
485     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
486     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
487     | cinder.list_volumes | 0.459     | 0.521        | 0.574        | 0.58         | 0.585     | 0.523     | 100.0%  | 10    |
488     | total               | 0.459     | 0.521        | 0.574        | 0.58         | 0.586     | 0.523     | 100.0%  | 10    |
489     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
490     Load duration: 1.56029701233
491     Full duration: 54.4247999191
492
493     test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
494     +---------------------------------------------------------------------------------------------------------------------------+
495     |                                                   Response Times (sec)                                                    |
496     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
497     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
498     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
499     | cinder.create_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
500     | cinder.create_snapshot | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
501     | nova.attach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
502     | nova.detach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
503     | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
504     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
505     Load duration: 428.079464197
506     Full duration: 524.52899909
507
508     test scenario CinderVolumes.create_snapshot_and_attach_volume
509     +---------------------------------------------------------------------------------------------------------------------------+
510     |                                                   Response Times (sec)                                                    |
511     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
512     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
513     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
514     | cinder.create_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
515     | cinder.create_snapshot | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
516     | nova.attach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
517     | nova.detach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
518     | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
519     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
520     Load duration: 423.273214102
521     Full duration: 1129.47603798
522
523     test scenario CinderVolumes.create_snapshot_and_attach_volume
524     +---------------------------------------------------------------------------------------------------------------------------+
525     |                                                   Response Times (sec)                                                    |
526     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
527     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
528     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
529     | cinder.create_volume   | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
530     | cinder.create_snapshot | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
531     | nova.attach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
532     | nova.detach_volume     | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
533     | total                  | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 5     |
534     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
535     Load duration: 426.579771996
536     Full duration: 529.032740116
537
538     test scenario CinderVolumes.create_and_delete_snapshot
539     +---------------------------------------------------------------------------------------------------------------------------+
540     |                                                   Response Times (sec)                                                    |
541     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
542     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
543     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
544     | cinder.create_snapshot | 2.8       | 2.961        | 3.287        | 4.217        | 5.148     | 3.157     | 100.0%  | 10    |
545     | cinder.delete_snapshot | 2.364     | 2.643        | 2.86         | 2.881        | 2.902     | 2.611     | 100.0%  | 10    |
546     | total                  | 5.173     | 5.494        | 6.148        | 7.099        | 8.05      | 5.769     | 100.0%  | 10    |
547     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
548     Load duration: 16.4653530121
549     Full duration: 44.3639709949
550
551     test scenario CinderVolumes.create_and_extend_volume
552     +-------------------------------------------------------------------------------------------------------------------------+
553     |                                                  Response Times (sec)                                                   |
554     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
555     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
556     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
557     | cinder.create_volume | 3.119     | 3.685        | 4.169        | 4.22         | 4.27      | 3.741     | 100.0%  | 10    |
558     | cinder.extend_volume | 2.536     | 3.106        | 3.175        | 3.189        | 3.203     | 3.023     | 100.0%  | 10    |
559     | cinder.delete_volume | 2.42      | 2.895        | 3.05         | 3.068        | 3.087     | 2.822     | 100.0%  | 10    |
560     | total                | 8.68      | 9.571        | 10.355       | 10.358       | 10.362    | 9.586     | 100.0%  | 10    |
561     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
562     Load duration: 28.6492631435
563     Full duration: 42.1216299534
564
565     test scenario CinderVolumes.create_from_volume_and_delete_volume
566     +-------------------------------------------------------------------------------------------------------------------------+
567     |                                                  Response Times (sec)                                                   |
568     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
569     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
570     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
571     | cinder.create_volume | 3.108     | 3.632        | 3.846        | 3.968        | 4.089     | 3.621     | 100.0%  | 10    |
572     | cinder.delete_volume | 2.54      | 2.847        | 3.276        | 3.29         | 3.304     | 2.881     | 100.0%  | 10    |
573     | total                | 6.172     | 6.512        | 6.734        | 6.756        | 6.778     | 6.502     | 100.0%  | 10    |
574     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
575     Load duration: 19.1909890175
576     Full duration: 46.976804018
577
578     2016-04-26 02:24:11,068 - run_rally - INFO - Test scenario: "cinder" Failed.
579
580     2016-04-26 02:24:12,074 - run_rally - INFO - Starting test scenario "heat" ...
581     2016-04-26 04:42:36,239 - run_rally - INFO - Percentage error: n/a, | total             | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
582
583     2016-04-26 04:42:36,363 - run_rally - INFO -
584      Preparing input task
585      Task  e9e698b5-79f5-41a7-be5f-04761a3c0034: started
586     Task e9e698b5-79f5-41a7-be5f-04761a3c0034: finished
587
588     test scenario HeatStacks.create_suspend_resume_delete_stack
589     +-----------------------------------------------------------------------------------------------------------------------+
590     |                                                 Response Times (sec)                                                  |
591     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
592     | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
593     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
594     | heat.create_stack  | 3.62      | 3.722        | 4.104        | 4.115        | 4.126     | 3.846     | 100.0%  | 10    |
595     | heat.suspend_stack | 1.392     | 1.475        | 1.609        | 1.616        | 1.623     | 1.493     | 100.0%  | 10    |
596     | heat.resume_stack  | 1.339     | 1.369        | 1.514        | 1.533        | 1.553     | 1.406     | 100.0%  | 10    |
597     | heat.delete_stack  | 1.283     | 1.429        | 1.447        | 1.461        | 1.474     | 1.382     | 100.0%  | 10    |
598     | total              | 7.77      | 8.014        | 8.597        | 8.614        | 8.631     | 8.127     | 100.0%  | 10    |
599     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
600     Load duration: 24.2256169319
601     Full duration: 33.6042699814
602
603     test scenario HeatStacks.create_and_delete_stack
604     +----------------------------------------------------------------------------------------------------------------------+
605     |                                                 Response Times (sec)                                                 |
606     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
607     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
608     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
609     | heat.create_stack | 3.528     | 3.756        | 3.905        | 3.933        | 3.961     | 3.764     | 100.0%  | 10    |
610     | heat.delete_stack | 1.311     | 1.341        | 1.386        | 1.503        | 1.62      | 1.366     | 100.0%  | 10    |
611     | total             | 5.037     | 5.102        | 5.246        | 5.271        | 5.296     | 5.13      | 100.0%  | 10    |
612     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
613     Load duration: 15.2723751068
614     Full duration: 24.6334218979
615
616     test scenario HeatStacks.create_and_delete_stack
617     +----------------------------------------------------------------------------------------------------------------------+
618     |                                                 Response Times (sec)                                                 |
619     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
620     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
621     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
622     | heat.create_stack | 20.555    | 22.623       | 23.694       | 23.77        | 23.845    | 22.663    | 100.0%  | 10    |
623     | heat.delete_stack | 9.082     | 10.25        | 10.461       | 10.929       | 11.397    | 9.938     | 100.0%  | 10    |
624     | total             | 29.655    | 32.918       | 33.982       | 33.989       | 33.997    | 32.602    | 100.0%  | 10    |
625     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
626     Load duration: 97.7232019901
627     Full duration: 107.206387043
628
629     test scenario HeatStacks.create_and_delete_stack
630     +----------------------------------------------------------------------------------------------------------------------+
631     |                                                 Response Times (sec)                                                 |
632     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
633     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
634     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
635     | heat.create_stack | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
636     | heat.delete_stack | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
637     | total             | n/a       | n/a          | n/a          | n/a          | n/a       | n/a       | n/a     | 6     |
638     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
639     Load duration: 7201.48637915
640     Full duration: 7812.01388121
641
642     test scenario HeatStacks.list_stacks_and_resources
643     +------------------------------------------------------------------------------------------------------------------------------------+
644     |                                                        Response Times (sec)                                                        |
645     +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
646     | Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
647     +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
648     | heat.list_stacks                | 0.371     | 0.401        | 0.42         | 0.421        | 0.423     | 0.4       | 100.0%  | 10    |
649     | heat.list_resources_of_0_stacks | 0.0       | 0.0          | 0.0          | 0.0          | 0.0       | 0.0       | 100.0%  | 10    |
650     | total                           | 0.371     | 0.401        | 0.42         | 0.422        | 0.423     | 0.4       | 100.0%  | 10    |
651     +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
652     Load duration: 1.24707102776
653     Full duration: 7.24165606499
654
655     test scenario HeatStacks.create_update_delete_stack
656     +----------------------------------------------------------------------------------------------------------------------+
657     |                                                 Response Times (sec)                                                 |
658     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
659     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
660     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
661     | heat.create_stack | 3.41      | 3.442        | 3.472        | 3.481        | 3.49      | 3.444     | 100.0%  | 10    |
662     | heat.update_stack | 3.427     | 3.453        | 3.509        | 3.599        | 3.69      | 3.475     | 100.0%  | 10    |
663     | heat.delete_stack | 1.295     | 1.311        | 1.326        | 1.329        | 1.332     | 1.312     | 100.0%  | 10    |
664     | total             | 8.162     | 8.205        | 8.277        | 8.357        | 8.436     | 8.231     | 100.0%  | 10    |
665     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
666     Load duration: 24.6856651306
667     Full duration: 32.1383240223
668
669     test scenario HeatStacks.create_update_delete_stack
670     +----------------------------------------------------------------------------------------------------------------------+
671     |                                                 Response Times (sec)                                                 |
672     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
673     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
674     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
675     | heat.create_stack | 3.326     | 3.417        | 3.624        | 3.676        | 3.728     | 3.459     | 100.0%  | 10    |
676     | heat.update_stack | 3.408     | 3.52         | 3.811        | 3.819        | 3.828     | 3.573     | 100.0%  | 10    |
677     | heat.delete_stack | 1.276     | 1.302        | 1.335        | 1.398        | 1.46      | 1.317     | 100.0%  | 10    |
678     | total             | 8.14      | 8.309        | 8.56         | 8.596        | 8.632     | 8.349     | 100.0%  | 10    |
679     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
680     Load duration: 25.028924942
681     Full duration: 32.9079070091
682
683     test scenario HeatStacks.create_update_delete_stack
684     +----------------------------------------------------------------------------------------------------------------------+
685     |                                                 Response Times (sec)                                                 |
686     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
687     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
688     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
689     | heat.create_stack | 3.527     | 4.137        | 4.746        | 4.747        | 4.748     | 4.133     | 100.0%  | 10    |
690     | heat.update_stack | 5.668     | 5.712        | 5.744        | 5.767        | 5.789     | 5.712     | 100.0%  | 10    |
691     | heat.delete_stack | 2.413     | 2.431        | 2.441        | 2.446        | 2.451     | 2.431     | 100.0%  | 10    |
692     | total             | 11.652    | 12.305       | 12.891       | 12.9         | 12.909    | 12.276    | 100.0%  | 10    |
693     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
694     Load duration: 37.3458311558
695     Full duration: 45.2056248188
696
697     test scenario HeatStacks.create_update_delete_stack
698     +----------------------------------------------------------------------------------------------------------------------+
699     |                                                 Response Times (sec)                                                 |
700     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
701     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
702     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
703     | heat.create_stack | 4.501     | 4.64         | 4.77         | 4.782        | 4.793     | 4.64      | 100.0%  | 10    |
704     | heat.update_stack | 7.947     | 9.065        | 9.146        | 9.207        | 9.269     | 8.97      | 100.0%  | 10    |
705     | heat.delete_stack | 2.4       | 2.442        | 2.645        | 3.133        | 3.62      | 2.563     | 100.0%  | 10    |
706     | total             | 14.999    | 16.132       | 16.488       | 16.984       | 17.479    | 16.174    | 100.0%  | 10    |
707     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
708     Load duration: 49.7609598637
709     Full duration: 58.2143821716
710
711     test scenario HeatStacks.create_update_delete_stack
712     +----------------------------------------------------------------------------------------------------------------------+
713     |                                                 Response Times (sec)                                                 |
714     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
715     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
716     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
717     | heat.create_stack | 3.481     | 3.63         | 4.77         | 4.771        | 4.772     | 4.024     | 100.0%  | 10    |
718     | heat.update_stack | 5.615     | 5.681        | 5.721        | 5.745        | 5.77      | 5.683     | 100.0%  | 10    |
719     | heat.delete_stack | 2.4       | 2.433        | 2.467        | 2.492        | 2.516     | 2.438     | 100.0%  | 10    |
720     | total             | 11.536    | 11.803       | 12.864       | 12.933       | 13.001    | 12.145    | 100.0%  | 10    |
721     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
722     Load duration: 36.3764190674
723     Full duration: 44.1169888973
724
725     test scenario HeatStacks.create_update_delete_stack
726     +----------------------------------------------------------------------------------------------------------------------+
727     |                                                 Response Times (sec)                                                 |
728     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
729     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
730     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
731     | heat.create_stack | 3.513     | 3.601        | 3.641        | 3.658        | 3.674     | 3.59      | 100.0%  | 10    |
732     | heat.update_stack | 3.405     | 3.427        | 3.437        | 3.457        | 3.477     | 3.427     | 100.0%  | 10    |
733     | heat.delete_stack | 1.298     | 1.326        | 1.353        | 1.356        | 1.358     | 1.328     | 100.0%  | 10    |
734     | total             | 8.251     | 8.353        | 8.412        | 8.416        | 8.42      | 8.345     | 100.0%  | 10    |
735     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
736     Load duration: 25.0552000999
737     Full duration: 33.6825659275
738
739     test scenario HeatStacks.create_and_list_stack
740     +----------------------------------------------------------------------------------------------------------------------+
741     |                                                 Response Times (sec)                                                 |
742     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
743     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
744     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
745     | heat.create_stack | 3.53      | 3.568        | 3.594        | 3.61         | 3.626     | 3.57      | 100.0%  | 10    |
746     | heat.list_stacks  | 0.047     | 0.073        | 0.102        | 0.107        | 0.111     | 0.075     | 100.0%  | 10    |
747     | total             | 3.6       | 3.639        | 3.69         | 3.696        | 3.702     | 3.646     | 100.0%  | 10    |
748     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
749     Load duration: 11.0165708065
750     Full duration: 22.4389858246
751
752     test scenario HeatStacks.create_check_delete_stack
753     +----------------------------------------------------------------------------------------------------------------------+
754     |                                                 Response Times (sec)                                                 |
755     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
756     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
757     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
758     | heat.create_stack | 3.561     | 3.575        | 3.625        | 3.627        | 3.63      | 3.585     | 100.0%  | 10    |
759     | heat.check_stack  | 1.396     | 1.41         | 1.433        | 1.439        | 1.445     | 1.413     | 100.0%  | 10    |
760     | heat.delete_stack | 1.266     | 1.309        | 1.32         | 1.323        | 1.327     | 1.302     | 100.0%  | 10    |
761     | total             | 6.234     | 6.289        | 6.339        | 6.347        | 6.355     | 6.3       | 100.0%  | 10    |
762     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
763     Load duration: 18.943114996
764     Full duration: 27.5446438789
765
766     2016-04-26 04:42:37,867 - run_rally - INFO - Test scenario: "heat" Failed.
767
768     2016-04-26 04:42:38,263 - run_rally - INFO - Starting test scenario "keystone" ...
769     2016-04-26 04:44:49,615 - run_rally - INFO -
770      Preparing input task
771      Task  20bc8dfd-1a51-488b-97df-c30ea71319be: started
772     Task 20bc8dfd-1a51-488b-97df-c30ea71319be: finished
773
774     test scenario KeystoneBasic.create_tenant_with_users
775     +---------------------------------------------------------------------------------------------------------------------------+
776     |                                                   Response Times (sec)                                                    |
777     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
778     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
779     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
780     | keystone.create_tenant | 0.27      | 0.29         | 0.299        | 0.303        | 0.308     | 0.289     | 100.0%  | 10    |
781     | keystone.create_users  | 1.059     | 1.132        | 1.206        | 1.212        | 1.218     | 1.138     | 100.0%  | 10    |
782     | total                  | 1.348     | 1.431        | 1.504        | 1.507        | 1.51      | 1.427     | 100.0%  | 10    |
783     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
784     Load duration: 4.29734396935
785     Full duration: 16.6833910942
786
787     test scenario KeystoneBasic.create_add_and_list_user_roles
788     +-------------------------------------------------------------------------------------------------------------------------+
789     |                                                  Response Times (sec)                                                   |
790     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
791     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
792     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
793     | keystone.create_role | 0.241     | 0.277        | 0.302        | 0.303        | 0.303     | 0.275     | 100.0%  | 10    |
794     | keystone.add_role    | 0.16      | 0.176        | 0.19         | 0.193        | 0.196     | 0.177     | 100.0%  | 10    |
795     | keystone.list_roles  | 0.085     | 0.095        | 0.1          | 0.104        | 0.108     | 0.095     | 100.0%  | 10    |
796     | total                | 0.501     | 0.55         | 0.583        | 0.589        | 0.595     | 0.547     | 100.0%  | 10    |
797     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
798     Load duration: 1.68035697937
799     Full duration: 10.5181751251
800
801     test scenario KeystoneBasic.add_and_remove_user_role
802     +-------------------------------------------------------------------------------------------------------------------------+
803     |                                                  Response Times (sec)                                                   |
804     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
805     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
806     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
807     | keystone.create_role | 0.267     | 0.289        | 0.32         | 0.322        | 0.324     | 0.294     | 100.0%  | 10    |
808     | keystone.add_role    | 0.148     | 0.172        | 0.194        | 0.195        | 0.196     | 0.172     | 100.0%  | 10    |
809     | keystone.remove_role | 0.093     | 0.132        | 0.166        | 0.168        | 0.169     | 0.133     | 100.0%  | 10    |
810     | total                | 0.527     | 0.616        | 0.63         | 0.638        | 0.646     | 0.599     | 100.0%  | 10    |
811     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
812     Load duration: 1.79448008537
813     Full duration: 10.6772811413
814
815     test scenario KeystoneBasic.create_update_and_delete_tenant
816     +---------------------------------------------------------------------------------------------------------------------------+
817     |                                                   Response Times (sec)                                                    |
818     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
819     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
820     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
821     | keystone.create_tenant | 0.277     | 0.31         | 0.398        | 0.421        | 0.443     | 0.33      | 100.0%  | 10    |
822     | keystone.update_tenant | 0.083     | 0.097        | 0.116        | 0.117        | 0.118     | 0.1       | 100.0%  | 10    |
823     | keystone.delete_tenant | 0.198     | 0.236        | 0.247        | 0.249        | 0.251     | 0.232     | 100.0%  | 10    |
824     | total                  | 0.598     | 0.643        | 0.731        | 0.761        | 0.791     | 0.662     | 100.0%  | 10    |
825     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
826     Load duration: 2.00753998756
827     Full duration: 9.88667607307
828
829     test scenario KeystoneBasic.create_and_delete_service
830     +----------------------------------------------------------------------------------------------------------------------------+
831     |                                                    Response Times (sec)                                                    |
832     +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
833     | Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
834     +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
835     | keystone.create_service | 0.276     | 0.302        | 0.313        | 0.344        | 0.374     | 0.305     | 100.0%  | 10    |
836     | keystone.delete_service | 0.092     | 0.105        | 0.118        | 0.118        | 0.119     | 0.106     | 100.0%  | 10    |
837     | total                   | 0.369     | 0.41         | 0.421        | 0.444        | 0.467     | 0.411     | 100.0%  | 10    |
838     +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
839     Load duration: 1.31590604782
840     Full duration: 9.7633960247
841
842     test scenario KeystoneBasic.create_tenant
843     +---------------------------------------------------------------------------------------------------------------------------+
844     |                                                   Response Times (sec)                                                    |
845     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
846     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
847     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
848     | keystone.create_tenant | 0.283     | 0.314        | 0.348        | 0.359        | 0.371     | 0.32      | 100.0%  | 10    |
849     | total                  | 0.283     | 0.315        | 0.348        | 0.36         | 0.371     | 0.32      | 100.0%  | 10    |
850     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
851     Load duration: 0.971438169479
852     Full duration: 6.68577694893
853
854     test scenario KeystoneBasic.create_user
855     +-------------------------------------------------------------------------------------------------------------------------+
856     |                                                  Response Times (sec)                                                   |
857     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
858     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
859     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
860     | keystone.create_user | 0.308     | 0.325        | 0.341        | 0.345        | 0.349     | 0.326     | 100.0%  | 10    |
861     | total                | 0.308     | 0.326        | 0.341        | 0.345        | 0.349     | 0.326     | 100.0%  | 10    |
862     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
863     Load duration: 1.01120591164
864     Full duration: 6.84676504135
865
866     test scenario KeystoneBasic.create_and_list_tenants
867     +---------------------------------------------------------------------------------------------------------------------------+
868     |                                                   Response Times (sec)                                                    |
869     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
870     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
871     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
872     | keystone.create_tenant | 0.26      | 0.276        | 0.295        | 0.297        | 0.3       | 0.277     | 100.0%  | 10    |
873     | keystone.list_tenants  | 0.071     | 0.082        | 0.09         | 0.094        | 0.098     | 0.083     | 100.0%  | 10    |
874     | total                  | 0.333     | 0.361        | 0.378        | 0.38         | 0.383     | 0.36      | 100.0%  | 10    |
875     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
876     Load duration: 1.12287592888
877     Full duration: 9.86326503754
878
879     test scenario KeystoneBasic.create_and_delete_role
880     +-------------------------------------------------------------------------------------------------------------------------+
881     |                                                  Response Times (sec)                                                   |
882     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
883     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
884     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
885     | keystone.create_role | 0.285     | 0.323        | 0.381        | 0.382        | 0.382     | 0.33      | 100.0%  | 10    |
886     | keystone.delete_role | 0.167     | 0.191        | 0.225        | 0.226        | 0.228     | 0.194     | 100.0%  | 10    |
887     | total                | 0.47      | 0.513        | 0.582        | 0.595        | 0.609     | 0.524     | 100.0%  | 10    |
888     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
889     Load duration: 1.57796812057
890     Full duration: 9.51138591766
891
892     test scenario KeystoneBasic.get_entities
893     +---------------------------------------------------------------------------------------------------------------------------+
894     |                                                   Response Times (sec)                                                    |
895     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
896     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
897     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
898     | keystone.create_tenant | 0.282     | 0.31         | 0.334        | 0.364        | 0.395     | 0.315     | 100.0%  | 10    |
899     | keystone.create_user   | 0.1       | 0.104        | 0.122        | 0.122        | 0.123     | 0.108     | 100.0%  | 10    |
900     | keystone.create_role   | 0.079     | 0.092        | 0.102        | 0.107        | 0.112     | 0.094     | 100.0%  | 10    |
901     | keystone.get_tenant    | 0.072     | 0.08         | 0.087        | 0.089        | 0.092     | 0.081     | 100.0%  | 10    |
902     | keystone.get_user      | 0.087     | 0.091        | 0.114        | 0.139        | 0.163     | 0.099     | 100.0%  | 10    |
903     | keystone.get_role      | 0.07      | 0.078        | 0.085        | 0.086        | 0.088     | 0.078     | 100.0%  | 10    |
904     | keystone.service_list  | 0.079     | 0.086        | 0.103        | 0.124        | 0.145     | 0.093     | 100.0%  | 10    |
905     | keystone.get_service   | 0.069     | 0.086        | 0.093        | 0.096        | 0.098     | 0.084     | 100.0%  | 10    |
906     | total                  | 0.889     | 0.939        | 1.023        | 1.035        | 1.048     | 0.952     | 100.0%  | 10    |
907     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
908     Load duration: 2.919891119
909     Full duration: 15.3317778111
910
911     test scenario KeystoneBasic.create_and_list_users
912     +-------------------------------------------------------------------------------------------------------------------------+
913     |                                                  Response Times (sec)                                                   |
914     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
915     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
916     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
917     | keystone.create_user | 0.287     | 0.314        | 0.336        | 0.345        | 0.354     | 0.316     | 100.0%  | 10    |
918     | keystone.list_users  | 0.072     | 0.081        | 0.096        | 0.097        | 0.097     | 0.083     | 100.0%  | 10    |
919     | total                | 0.365     | 0.393        | 0.424        | 0.431        | 0.437     | 0.399     | 100.0%  | 10    |
920     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
921     Load duration: 1.23520803452
922     Full duration: 7.35707998276
923
924     2016-04-26 04:44:50,952 - run_rally - INFO - Test scenario: "keystone" OK.
925
926     2016-04-26 04:44:51,319 - run_rally - INFO - Starting test scenario "neutron" ...
927     2016-04-26 04:51:16,265 - run_rally - INFO -
928      Preparing input task
929      Task  256bf66d-8312-4077-869b-394a1574c2e3: started
930     Task 256bf66d-8312-4077-869b-394a1574c2e3: finished
931
932     test scenario NeutronNetworks.create_and_delete_ports
933     +------------------------------------------------------------------------------------------------------------------------+
934     |                                                  Response Times (sec)                                                  |
935     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
936     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
937     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
938     | neutron.create_port | 0.607     | 0.653        | 0.721        | 0.75         | 0.78      | 0.666     | 100.0%  | 10    |
939     | neutron.delete_port | 0.175     | 0.407        | 0.455        | 0.462        | 0.469     | 0.37      | 100.0%  | 10    |
940     | total               | 0.814     | 1.09         | 1.137        | 1.137        | 1.137     | 1.036     | 100.0%  | 10    |
941     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
942     Load duration: 3.12694001198
943     Full duration: 32.3510808945
944
945     test scenario NeutronNetworks.create_and_list_routers
946     +---------------------------------------------------------------------------------------------------------------------------------+
947     |                                                      Response Times (sec)                                                       |
948     +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
949     | Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
950     +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
951     | neutron.create_subnet        | 0.578     | 0.606        | 0.635        | 0.643        | 0.65      | 0.609     | 100.0%  | 10    |
952     | neutron.create_router        | 0.06      | 0.256        | 0.307        | 0.341        | 0.376     | 0.237     | 100.0%  | 10    |
953     | neutron.add_interface_router | 0.244     | 0.508        | 0.566        | 0.589        | 0.612     | 0.476     | 100.0%  | 10    |
954     | neutron.list_routers         | 0.04      | 0.238        | 0.271        | 0.275        | 0.278     | 0.194     | 100.0%  | 10    |
955     | total                        | 1.169     | 1.517        | 1.722        | 1.742        | 1.762     | 1.517     | 100.0%  | 10    |
956     +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
957     Load duration: 4.54089903831
958     Full duration: 35.4128360748
959
960     test scenario NeutronNetworks.create_and_update_networks
961     +---------------------------------------------------------------------------------------------------------------------------+
962     |                                                   Response Times (sec)                                                    |
963     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
964     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
965     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
966     | neutron.create_network | 0.523     | 0.561        | 0.635        | 0.642        | 0.648     | 0.573     | 100.0%  | 10    |
967     | neutron.update_network | 0.106     | 0.337        | 0.376        | 0.391        | 0.406     | 0.303     | 100.0%  | 10    |
968     | total                  | 0.691     | 0.877        | 1.006        | 1.007        | 1.008     | 0.876     | 100.0%  | 10    |
969     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
970     Load duration: 2.54131317139
971     Full duration: 19.3984429836
972
973     test scenario NeutronNetworks.create_and_list_ports
974     +------------------------------------------------------------------------------------------------------------------------+
975     |                                                  Response Times (sec)                                                  |
976     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
977     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
978     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
979     | neutron.create_port | 0.581     | 0.643        | 0.971        | 1.006        | 1.042     | 0.712     | 100.0%  | 10    |
980     | neutron.list_ports  | 0.102     | 0.365        | 0.455        | 0.469        | 0.483     | 0.307     | 100.0%  | 10    |
981     | total               | 0.725     | 1.086        | 1.149        | 1.292        | 1.435     | 1.019     | 100.0%  | 10    |
982     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
983     Load duration: 2.83818507195
984     Full duration: 32.8225178719
985
986     test scenario NeutronNetworks.create_and_delete_subnets
987     +--------------------------------------------------------------------------------------------------------------------------+
988     |                                                   Response Times (sec)                                                   |
989     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
990     | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
991     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
992     | neutron.create_subnet | 0.571     | 0.62         | 0.673        | 0.682        | 0.69      | 0.626     | 100.0%  | 10    |
993     | neutron.delete_subnet | 0.136     | 0.358        | 0.5          | 0.571        | 0.642     | 0.333     | 100.0%  | 10    |
994     | total                 | 0.724     | 0.978        | 1.14         | 1.183        | 1.227     | 0.959     | 100.0%  | 10    |
995     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
996     Load duration: 3.04690408707
997     Full duration: 31.1584250927
998
999     test scenario NeutronNetworks.create_and_update_subnets
1000     +--------------------------------------------------------------------------------------------------------------------------+
1001     |                                                   Response Times (sec)                                                   |
1002     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1003     | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1004     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1005     | neutron.create_subnet | 0.579     | 0.74         | 0.789        | 0.831        | 0.873     | 0.728     | 100.0%  | 10    |
1006     | neutron.update_subnet | 0.166     | 0.4          | 0.491        | 0.516        | 0.541     | 0.378     | 100.0%  | 10    |
1007     | total                 | 0.789     | 1.155        | 1.275        | 1.279        | 1.283     | 1.106     | 100.0%  | 10    |
1008     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1009     Load duration: 3.20878195763
1010     Full duration: 31.9853599072
1011
1012     test scenario NeutronNetworks.create_and_list_networks
1013     +---------------------------------------------------------------------------------------------------------------------------+
1014     |                                                   Response Times (sec)                                                    |
1015     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1016     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1017     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1018     | neutron.create_network | 0.524     | 0.589        | 0.694        | 0.736        | 0.779     | 0.613     | 100.0%  | 10    |
1019     | neutron.list_networks  | 0.046     | 0.171        | 0.409        | 0.461        | 0.513     | 0.211     | 100.0%  | 10    |
1020     | total                  | 0.58      | 0.747        | 1.083        | 1.09         | 1.096     | 0.824     | 100.0%  | 10    |
1021     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1022     Load duration: 2.37781405449
1023     Full duration: 19.9551098347
1024
1025     test scenario NeutronNetworks.create_and_update_routers
1026     +---------------------------------------------------------------------------------------------------------------------------------+
1027     |                                                      Response Times (sec)                                                       |
1028     +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1029     | Action                       | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1030     +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1031     | neutron.create_subnet        | 0.592     | 0.623        | 0.664        | 0.665        | 0.667     | 0.628     | 100.0%  | 10    |
1032     | neutron.create_router        | 0.269     | 0.279        | 0.31         | 0.32         | 0.329     | 0.287     | 100.0%  | 10    |
1033     | neutron.add_interface_router | 0.28      | 0.484        | 0.653        | 0.671        | 0.688     | 0.477     | 100.0%  | 10    |
1034     | neutron.update_router        | 0.156     | 0.389        | 0.45         | 0.456        | 0.462     | 0.361     | 100.0%  | 10    |
1035     | total                        | 1.388     | 1.739        | 1.953        | 1.981        | 2.009     | 1.754     | 100.0%  | 10    |
1036     +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1037     Load duration: 5.26099705696
1038     Full duration: 37.1857252121
1039
1040     test scenario NeutronNetworks.create_and_delete_routers
1041     +------------------------------------------------------------------------------------------------------------------------------------+
1042     |                                                        Response Times (sec)                                                        |
1043     +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1044     | Action                          | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1045     +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1046     | neutron.create_subnet           | 0.558     | 0.624        | 0.707        | 0.736        | 0.765     | 0.637     | 100.0%  | 10    |
1047     | neutron.create_router           | 0.044     | 0.288        | 0.341        | 0.362        | 0.383     | 0.253     | 100.0%  | 10    |
1048     | neutron.add_interface_router    | 0.299     | 0.527        | 0.563        | 0.573        | 0.583     | 0.502     | 100.0%  | 10    |
1049     | neutron.remove_interface_router | 0.241     | 0.46         | 0.559        | 0.56         | 0.561     | 0.444     | 100.0%  | 10    |
1050     | neutron.delete_router           | 0.15      | 0.392        | 0.469        | 0.487        | 0.505     | 0.343     | 100.0%  | 10    |
1051     | total                           | 1.845     | 2.118        | 2.453        | 2.507        | 2.56      | 2.179     | 100.0%  | 10    |
1052     +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1053     Load duration: 6.46906304359
1054     Full duration: 37.6224770546
1055
1056     test scenario NeutronNetworks.create_and_update_ports
1057     +------------------------------------------------------------------------------------------------------------------------+
1058     |                                                  Response Times (sec)                                                  |
1059     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1060     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1061     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1062     | neutron.create_port | 0.605     | 0.665        | 0.825        | 0.85         | 0.876     | 0.691     | 100.0%  | 10    |
1063     | neutron.update_port | 0.126     | 0.359        | 0.409        | 0.423        | 0.437     | 0.325     | 100.0%  | 10    |
1064     | total               | 0.731     | 1.054        | 1.179        | 1.192        | 1.205     | 1.017     | 100.0%  | 10    |
1065     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1066     Load duration: 3.16282176971
1067     Full duration: 34.5440177917
1068
1069     test scenario NeutronNetworks.create_and_list_subnets
1070     +--------------------------------------------------------------------------------------------------------------------------+
1071     |                                                   Response Times (sec)                                                   |
1072     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1073     | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1074     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1075     | neutron.create_subnet | 0.578     | 0.613        | 0.667        | 0.678        | 0.689     | 0.622     | 100.0%  | 10    |
1076     | neutron.list_subnets  | 0.23      | 0.266        | 0.336        | 0.34         | 0.344     | 0.276     | 100.0%  | 10    |
1077     | total                 | 0.835     | 0.9          | 0.963        | 0.966        | 0.969     | 0.898     | 100.0%  | 10    |
1078     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1079     Load duration: 2.74195313454
1080     Full duration: 32.8288888931
1081
1082     test scenario NeutronNetworks.create_and_delete_networks
1083     +---------------------------------------------------------------------------------------------------------------------------+
1084     |                                                   Response Times (sec)                                                    |
1085     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1086     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1087     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1088     | neutron.create_network | 0.525     | 0.612        | 0.729        | 0.735        | 0.74      | 0.626     | 100.0%  | 10    |
1089     | neutron.delete_network | 0.133     | 0.375        | 0.446        | 0.474        | 0.501     | 0.35      | 100.0%  | 10    |
1090     | total                  | 0.739     | 1.004        | 1.113        | 1.177        | 1.242     | 0.976     | 100.0%  | 10    |
1091     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1092     Load duration: 2.94529485703
1093     Full duration: 19.0619311333
1094
1095     2016-04-26 04:51:17,592 - run_rally - INFO - Test scenario: "neutron" OK.
1096
1097     2016-04-26 04:51:18,073 - run_rally - INFO - Starting test scenario "nova" ...
1098     2016-04-26 07:03:18,875 - run_rally - INFO -
1099      Preparing input task
1100      Task  a238f5f4-fd3d-4015-95c9-2b0ba5d314b6: started
1101     Task a238f5f4-fd3d-4015-95c9-2b0ba5d314b6: finished
1102
1103     test scenario NovaKeypair.create_and_delete_keypair
1104     +------------------------------------------------------------------------------------------------------------------------+
1105     |                                                  Response Times (sec)                                                  |
1106     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1107     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1108     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1109     | nova.create_keypair | 0.579     | 0.646        | 0.774        | 0.918        | 1.062     | 0.695     | 100.0%  | 10    |
1110     | nova.delete_keypair | 0.023     | 0.027        | 0.048        | 0.051        | 0.054     | 0.033     | 100.0%  | 10    |
1111     | total               | 0.627     | 0.687        | 0.8          | 0.943        | 1.085     | 0.728     | 100.0%  | 10    |
1112     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1113     Load duration: 2.11327505112
1114     Full duration: 24.7004601955
1115
1116     test scenario NovaServers.snapshot_server
1117     +---------------------------------------------------------------------------------------------------------------------------+
1118     |                                                   Response Times (sec)                                                    |
1119     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1120     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1121     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1122     | nova.boot_server       | 9.939     | 11.728       | 13.031       | 13.319       | 13.606    | 11.722    | 100.0%  | 10    |
1123     | nova.create_image      | 9.473     | 9.734        | 10.003       | 10.052       | 10.1      | 9.728     | 100.0%  | 10    |
1124     | nova.delete_server     | 2.63      | 2.927        | 3.279        | 3.899        | 4.52      | 3.033     | 100.0%  | 10    |
1125     | nova.boot_server (2)   | 9.986     | 10.959       | 11.567       | 11.737       | 11.907    | 10.921    | 100.0%  | 10    |
1126     | nova.delete_server (2) | 2.41      | 2.772        | 2.958        | 2.963        | 2.968     | 2.712     | 100.0%  | 10    |
1127     | nova.delete_image      | 1.467     | 2.001        | 2.188        | 2.332        | 2.477     | 1.95      | 100.0%  | 10    |
1128     | total                  | 37.87     | 39.802       | 41.419       | 42.304       | 43.189    | 40.067    | 100.0%  | 10    |
1129     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1130     Load duration: 120.693696976
1131     Full duration: 164.095020056
1132
1133     test scenario NovaKeypair.boot_and_delete_server_with_keypair
1134     +------------------------------------------------------------------------------------------------------------------------+
1135     |                                                  Response Times (sec)                                                  |
1136     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1137     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1138     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1139     | nova.create_keypair | 0.515     | 0.637        | 0.702        | 0.714        | 0.726     | 0.631     | 100.0%  | 10    |
1140     | nova.boot_server    | 10.03     | 11.695       | 12.539       | 12.808       | 13.076    | 11.597    | 100.0%  | 10    |
1141     | nova.delete_server  | 2.581     | 2.755        | 2.899        | 3.003        | 3.108     | 2.769     | 100.0%  | 10    |
1142     | nova.delete_keypair | 0.026     | 0.036        | 0.044        | 0.044        | 0.045     | 0.036     | 100.0%  | 10    |
1143     | total               | 13.194    | 15.135       | 15.888       | 16.111       | 16.334    | 15.033    | 100.0%  | 10    |
1144     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1145     Load duration: 43.7031610012
1146     Full duration: 84.4934301376
1147
1148     test scenario NovaKeypair.create_and_list_keypairs
1149     +------------------------------------------------------------------------------------------------------------------------+
1150     |                                                  Response Times (sec)                                                  |
1151     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1152     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1153     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1154     | nova.create_keypair | 0.613     | 0.68         | 0.8          | 0.83         | 0.859     | 0.701     | 100.0%  | 10    |
1155     | nova.list_keypairs  | 0.017     | 0.029        | 0.055        | 0.132        | 0.209     | 0.045     | 100.0%  | 10    |
1156     | total               | 0.631     | 0.715        | 0.893        | 0.919        | 0.945     | 0.746     | 100.0%  | 10    |
1157     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1158     Load duration: 2.10457396507
1159     Full duration: 25.5227000713
1160
1161     test scenario NovaServers.list_servers
1162     +----------------------------------------------------------------------------------------------------------------------+
1163     |                                                 Response Times (sec)                                                 |
1164     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1165     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1166     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1167     | nova.list_servers | 0.963     | 1.205        | 1.239        | 1.272        | 1.304     | 1.187     | 100.0%  | 10    |
1168     | total             | 0.963     | 1.205        | 1.239        | 1.272        | 1.305     | 1.187     | 100.0%  | 10    |
1169     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1170     Load duration: 3.61515402794
1171     Full duration: 89.3156220913
1172
1173     test scenario NovaServers.resize_server
1174     +------------------------------------------------------------------------------------------------------------------------+
1175     |                                                  Response Times (sec)                                                  |
1176     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1177     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1178     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1179     | nova.boot_server    | 11.077    | 11.648       | 13.586       | 13.788       | 13.99     | 12.144    | 100.0%  | 10    |
1180     | nova.resize         | 97.438    | 98.364       | 99.784       | 101.736      | 103.687   | 98.895    | 100.0%  | 10    |
1181     | nova.resize_confirm | 2.462     | 2.85         | 3.013        | 3.032        | 3.052     | 2.81      | 100.0%  | 10    |
1182     | nova.delete_server  | 2.362     | 2.635        | 2.717        | 2.759        | 2.802     | 2.576     | 100.0%  | 10    |
1183     | total               | 114.396   | 116.205      | 117.751      | 119.281      | 120.811   | 116.425   | 100.0%  | 10    |
1184     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1185     Load duration: 352.596132994
1186     Full duration: 373.961167812
1187
1188     test scenario NovaServers.boot_server_from_volume_and_delete
1189     +-------------------------------------------------------------------------------------------------------------------------+
1190     |                                                  Response Times (sec)                                                   |
1191     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1192     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1193     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1194     | cinder.create_volume | 9.652     | 10.151       | 10.573       | 10.621       | 10.669    | 10.165    | 100.0%  | 10    |
1195     | nova.boot_server     | 10.713    | 13.21        | 14.394       | 14.695       | 14.996    | 13.013    | 100.0%  | 10    |
1196     | nova.delete_server   | 4.701     | 4.969        | 5.039        | 5.159        | 5.279     | 4.942     | 100.0%  | 10    |
1197     | total                | 25.26     | 27.982       | 30.104       | 30.137       | 30.17     | 28.121    | 100.0%  | 10    |
1198     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1199     Load duration: 83.7665529251
1200     Full duration: 133.76401782
1201
1202     test scenario NovaServers.boot_and_migrate_server
1203     +------------------------------------------------------------------------------------------------------------------------+
1204     |                                                  Response Times (sec)                                                  |
1205     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1206     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1207     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1208     | nova.boot_server    | 9.342     | 11.196       | 12.987       | 13.225       | 13.463    | 11.305    | 80.0%   | 10    |
1209     | nova.stop_server    | 61.257    | 62.345       | 63.163       | 63.249       | 63.336    | 62.301    | 80.0%   | 10    |
1210     | nova.migrate        | 8.224     | 9.522        | 11.336       | 11.478       | 11.62     | 9.663     | 80.0%   | 10    |
1211     | nova.resize_confirm | 2.413     | 2.724        | 3.003        | 3.108        | 3.213     | 2.704     | 100.0%  | 8     |
1212     | nova.delete_server  | 2.397     | 2.418        | 2.638        | 2.652        | 2.666     | 2.495     | 100.0%  | 8     |
1213     | total               | 85.3      | 88.008       | 91.856       | 92.68        | 93.504    | 88.469    | 80.0%   | 10    |
1214     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1215     Load duration: 282.145553112
1216     Full duration: 310.275305033
1217
1218     test scenario NovaServers.boot_and_delete_server
1219     +-----------------------------------------------------------------------------------------------------------------------+
1220     |                                                 Response Times (sec)                                                  |
1221     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1222     | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1223     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1224     | nova.boot_server   | 10.164    | 10.763       | 21.145       | 31.824       | 42.503    | 14.815    | 80.0%   | 10    |
1225     | nova.delete_server | 2.439     | 2.701        | 2.959        | 2.97         | 2.982     | 2.728     | 88.9%   | 9     |
1226     | total              | 12.997    | 13.446       | 23.964       | 34.453       | 44.942    | 17.544    | 80.0%   | 10    |
1227     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1228     Load duration: 352.537348986
1229     Full duration: 997.781033993
1230
1231     test scenario NovaServers.boot_and_rebuild_server
1232     +------------------------------------------------------------------------------------------------------------------------+
1233     |                                                  Response Times (sec)                                                  |
1234     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1235     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1236     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1237     | nova.boot_server    | 10.618    | 11.665       | 12.726       | 12.764       | 12.802    | 11.718    | 70.0%   | 10    |
1238     | nova.rebuild_server | 69.264    | 71.18        | 72.314       | 72.575       | 72.836    | 71.097    | 100.0%  | 7     |
1239     | nova.delete_server  | 2.391     | 2.632        | 2.88         | 2.883        | 2.886     | 2.639     | 100.0%  | 7     |
1240     | total               | 83.337    | 85.019       | 87.645       | 87.923       | 88.201    | 85.454    | 70.0%   | 10    |
1241     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1242     Load duration: 477.006741047
1243     Full duration: 1121.04293394
1244
1245     test scenario NovaSecGroup.create_and_list_secgroups
1246     +-----------------------------------------------------------------------------------------------------------------------------------+
1247     |                                                       Response Times (sec)                                                        |
1248     +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1249     | Action                         | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1250     +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1251     | nova.create_10_security_groups | 3.03      | 3.488        | 3.933        | 3.989        | 4.044     | 3.487     | 100.0%  | 10    |
1252     | nova.create_100_rules          | 22.925    | 23.261       | 23.92        | 24.188       | 24.456    | 23.425    | 100.0%  | 10    |
1253     | nova.list_security_groups      | 0.126     | 0.16         | 0.213        | 0.294        | 0.376     | 0.18      | 100.0%  | 10    |
1254     | total                          | 26.54     | 26.984       | 27.591       | 27.704       | 27.817    | 27.092    | 100.0%  | 10    |
1255     +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1256     Load duration: 81.6362090111
1257     Full duration: 118.557869911
1258
1259     test scenario NovaSecGroup.create_and_delete_secgroups
1260     +-----------------------------------------------------------------------------------------------------------------------------------+
1261     |                                                       Response Times (sec)                                                        |
1262     +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1263     | Action                         | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1264     +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1265     | nova.create_10_security_groups | 2.934     | 3.533        | 3.804        | 3.912        | 4.021     | 3.522     | 100.0%  | 10    |
1266     | nova.create_100_rules          | 22.89     | 23.403       | 23.74        | 23.847       | 23.953    | 23.394    | 100.0%  | 10    |
1267     | nova.delete_10_security_groups | 1.219     | 1.282        | 1.629        | 1.634        | 1.64      | 1.372     | 100.0%  | 10    |
1268     | total                          | 27.6      | 28.387       | 28.547       | 28.634       | 28.722    | 28.288    | 100.0%  | 10    |
1269     +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1270     Load duration: 85.2456521988
1271     Full duration: 109.930608988
1272
1273     test scenario NovaServers.boot_and_bounce_server
1274     +----------------------------------------------------------------------------------------------------------------------------+
1275     |                                                    Response Times (sec)                                                    |
1276     +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1277     | Action                  | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1278     +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1279     | nova.boot_server        | 10.584    | 11.76        | 12.966       | 13.02        | 13.073    | 11.794    | 57.1%   | 7     |
1280     | nova.reboot_server      | 4.802     | 5.11         | 5.257        | 5.278        | 5.299     | 5.08      | 100.0%  | 4     |
1281     | nova.soft_reboot_server | 123.97    | 124.161      | 125.321      | 125.531      | 125.741   | 124.508   | 100.0%  | 4     |
1282     | nova.stop_server        | 61.413    | 62.307       | 63.351       | 63.532       | 63.713    | 62.435    | 100.0%  | 4     |
1283     | nova.start_server       | 2.747     | 2.775        | 2.996        | 3.039        | 3.082     | 2.845     | 100.0%  | 4     |
1284     | nova.rescue_server      | 64.447    | 66.021       | 66.521       | 66.564       | 66.607    | 65.774    | 100.0%  | 4     |
1285     | nova.unrescue_server    | 2.368     | 4.579        | 4.599        | 4.6          | 4.601     | 4.032     | 100.0%  | 4     |
1286     | nova.delete_server      | 2.398     | 2.511        | 2.663        | 2.679        | 2.694     | 2.528     | 100.0%  | 4     |
1287     | total                   | 274.414   | 278.786      | 282.788      | 283.426      | 284.064   | 279.013   | 57.1%   | 7     |
1288     +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1289     Load duration: 584.260617018
1290     Full duration: 1223.11469412
1291
1292     test scenario NovaServers.boot_server
1293     +---------------------------------------------------------------------------------------------------------------------+
1294     |                                                Response Times (sec)                                                 |
1295     +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1296     | Action           | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1297     +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1298     | nova.boot_server | 11.343    | 11.648       | 12.248       | 12.342       | 12.435    | 11.804    | 55.6%   | 9     |
1299     | total            | 11.344    | 11.648       | 12.249       | 12.342       | 12.435    | 11.804    | 55.6%   | 9     |
1300     +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1301     Load duration: 339.613210917
1302     Full duration: 959.207664013
1303
1304     test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
1305     +--------------------------------------------------------------------------------------------------------------------------------------+
1306     |                                                         Response Times (sec)                                                         |
1307     +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1308     | Action                            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1309     +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1310     | nova.create_10_security_groups    | 2.471     | 2.641        | 2.886        | 2.916        | 2.947     | 2.686     | 37.5%   | 8     |
1311     | nova.create_100_rules             | 20.403    | 20.759       | 21.005       | 21.036       | 21.067    | 20.743    | 37.5%   | 8     |
1312     | nova.boot_server                  | 8.329     | 10.397       | 10.543       | 10.561       | 10.58     | 9.768     | 37.5%   | 8     |
1313     | nova.get_attached_security_groups | 0.177     | 0.18         | 0.189        | 0.19         | 0.191     | 0.183     | 100.0%  | 3     |
1314     | nova.delete_server                | 2.417     | 2.424        | 2.563        | 2.58         | 2.597     | 2.48      | 100.0%  | 3     |
1315     | nova.delete_10_security_groups    | 1.146     | 1.185        | 1.295        | 1.309        | 1.323     | 1.218     | 100.0%  | 3     |
1316     | total                             | 35.785    | 37.72        | 37.728       | 37.729       | 37.73     | 37.079    | 37.5%   | 8     |
1317     +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1318     Load duration: 653.787332058
1319     Full duration: 698.373892784
1320
1321     test scenario NovaServers.pause_and_unpause_server
1322     +------------------------------------------------------------------------------------------------------------------------+
1323     |                                                  Response Times (sec)                                                  |
1324     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1325     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1326     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1327     | nova.boot_server    | 9.228     | 10.626       | 10.698       | 10.707       | 10.715    | 10.19     | 37.5%   | 8     |
1328     | nova.pause_server   | 2.325     | 2.628        | 2.631        | 2.631        | 2.631     | 2.528     | 100.0%  | 3     |
1329     | nova.unpause_server | 2.624     | 2.647        | 2.691        | 2.697        | 2.702     | 2.658     | 100.0%  | 3     |
1330     | nova.delete_server  | 2.596     | 2.732        | 2.747        | 2.749        | 2.751     | 2.693     | 100.0%  | 3     |
1331     | total               | 16.772    | 18.711       | 18.72        | 18.722       | 18.723    | 18.069    | 37.5%   | 8     |
1332     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1333     Load duration: 607.316802025
1334     Full duration: 645.979089022
1335
1336     test scenario NovaServers.boot_server_from_volume
1337     +-------------------------------------------------------------------------------------------------------------------------+
1338     |                                                  Response Times (sec)                                                   |
1339     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1340     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1341     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1342     | cinder.create_volume | 8.57      | 9.398        | 10.796       | 10.932       | 11.068    | 9.692     | 60.0%   | 10    |
1343     | nova.boot_server     | 11.064    | 12.084       | 12.627       | 12.859       | 13.092    | 12.061    | 60.0%   | 10    |
1344     | total                | 20.261    | 21.884       | 22.881       | 22.979       | 23.078    | 21.754    | 60.0%   | 10    |
1345     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1346     Load duration: 377.391654015
1347     Full duration: 411.411114931
1348
1349     test scenario NovaServers.boot_and_list_server
1350     +----------------------------------------------------------------------------------------------------------------------+
1351     |                                                 Response Times (sec)                                                 |
1352     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1353     | Action            | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1354     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1355     | nova.boot_server  | 9.689     | 10.784       | 12.049       | 12.245       | 12.44     | 10.872    | 60.0%   | 10    |
1356     | nova.list_servers | 0.2       | 0.431        | 0.5          | 0.513        | 0.526     | 0.414     | 100.0%  | 6     |
1357     | total             | 10.11     | 11.216       | 12.386       | 12.649       | 12.913    | 11.286    | 60.0%   | 10    |
1358     +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1359     Load duration: 339.637984037
1360     Full duration: 382.637588978
1361
1362     2016-04-26 07:03:20,320 - run_rally - INFO - Test scenario: "nova" Failed.
1363     2016-04-26 07:03:20,864 - run_rally - INFO - Starting test scenario "quotas" ...
1364     2016-04-26 07:04:24,690 - run_rally - INFO -
1365      Preparing input task
1366      Task  31d451cc-0c33-44e6-8ce1-a226ec4d3747: started
1367     Task 31d451cc-0c33-44e6-8ce1-a226ec4d3747: finished
1368
1369     test scenario Quotas.cinder_update
1370     +-------------------------------------------------------------------------------------------------------------------------+
1371     |                                                  Response Times (sec)                                                   |
1372     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1373     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1374     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1375     | quotas.update_quotas | 0.676     | 0.77         | 1.004        | 1.007        | 1.01      | 0.823     | 100.0%  | 10    |
1376     | total                | 0.676     | 0.77         | 1.005        | 1.007        | 1.01      | 0.823     | 100.0%  | 10    |
1377     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1378     Load duration: 2.49713397026
1379     Full duration: 10.5032558441
1380
1381     test scenario Quotas.neutron_update
1382     +-------------------------------------------------------------------------------------------------------------------------+
1383     |                                                  Response Times (sec)                                                   |
1384     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1385     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1386     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1387     | quotas.update_quotas | 0.214     | 0.235        | 0.26         | 0.262        | 0.263     | 0.238     | 100.0%  | 10    |
1388     | total                | 0.372     | 0.415        | 0.426        | 0.427        | 0.428     | 0.408     | 100.0%  | 10    |
1389     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1390     Load duration: 1.27715206146
1391     Full duration: 8.95948386192
1392
1393     test scenario Quotas.cinder_update_and_delete
1394     +-------------------------------------------------------------------------------------------------------------------------+
1395     |                                                  Response Times (sec)                                                   |
1396     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1397     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1398     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1399     | quotas.update_quotas | 0.77      | 0.834        | 0.965        | 0.99         | 1.015     | 0.857     | 100.0%  | 10    |
1400     | quotas.delete_quotas | 0.345     | 0.54         | 0.562        | 0.581        | 0.6       | 0.505     | 100.0%  | 10    |
1401     | total                | 1.127     | 1.365        | 1.437        | 1.498        | 1.56      | 1.362     | 100.0%  | 10    |
1402     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1403     Load duration: 4.07208108902
1404     Full duration: 12.2027239799
1405
1406     test scenario Quotas.nova_update_and_delete
1407     +-------------------------------------------------------------------------------------------------------------------------+
1408     |                                                  Response Times (sec)                                                   |
1409     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1410     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1411     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1412     | quotas.update_quotas | 0.448     | 0.48         | 0.54         | 0.679        | 0.819     | 0.511     | 100.0%  | 10    |
1413     | quotas.delete_quotas | 0.012     | 0.019        | 0.024        | 0.025        | 0.027     | 0.019     | 100.0%  | 10    |
1414     | total                | 0.463     | 0.499        | 0.563        | 0.699        | 0.836     | 0.53      | 100.0%  | 10    |
1415     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1416     Load duration: 1.53432106972
1417     Full duration: 9.25113201141
1418
1419     test scenario Quotas.nova_update
1420     +-------------------------------------------------------------------------------------------------------------------------+
1421     |                                                  Response Times (sec)                                                   |
1422     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1423     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1424     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1425     | quotas.update_quotas | 0.395     | 0.469        | 0.541        | 0.549        | 0.557     | 0.47      | 100.0%  | 10    |
1426     | total                | 0.395     | 0.469        | 0.541        | 0.549        | 0.557     | 0.47      | 100.0%  | 10    |
1427     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1428     Load duration: 1.49797797203
1429     Full duration: 8.86192798615
1430
1431     2016-04-26 07:04:26,066 - run_rally - INFO - Test scenario: "quotas" OK.
1432     2016-04-26 07:04:26,381 - run_rally - INFO - Starting test scenario "requests" ...
1433     2016-04-26 07:04:56,876 - run_rally - INFO -
1434      Preparing input task
1435      Task  1c6ea3eb-b807-414a-b07a-d9ecf1aa2344: started
1436     Task 1c6ea3eb-b807-414a-b07a-d9ecf1aa2344: finished
1437
1438     test scenario HttpRequests.check_random_request
1439     +---------------------------------------------------------------------------------------------------------------------------+
1440     |                                                   Response Times (sec)                                                    |
1441     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1442     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1443     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1444     | requests.check_request | 0.018     | 0.542        | 5.956        | 8.184        | 10.411    | 2.811     | 100.0%  | 10    |
1445     | total                  | 0.018     | 0.542        | 5.956        | 8.184        | 10.411    | 2.812     | 100.0%  | 10    |
1446     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1447     Load duration: 10.5026738644
1448     Full duration: 13.9263000488
1449
1450     test scenario HttpRequests.check_request
1451     +---------------------------------------------------------------------------------------------------------------------------+
1452     |                                                   Response Times (sec)                                                    |
1453     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1454     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
1455     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1456     | requests.check_request | 0.016     | 0.059        | 5.062        | 5.063        | 5.065     | 2.047     | 100.0%  | 10    |
1457     | total                  | 0.016     | 0.059        | 5.062        | 5.063        | 5.065     | 2.047     | 100.0%  | 10    |
1458     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
1459     Load duration: 5.16210699081
1460     Full duration: 8.87197899818
1461
1462     2016-04-26 07:04:58,210 - run_rally - INFO - Test scenario: "requests" OK.
1463     2016-04-26 07:04:58,402 - run_rally - INFO -
1464
1465                          Rally Summary Report
1466
1467     +===================+============+===============+===========+
1468     | Module            | Duration   | nb. Test Run  | Success   |
1469     +===================+============+===============+===========+
1470     | authenticate      | 00:50      | 12            | 100.00%   |
1471     +-------------------+------------+---------------+-----------+
1472     | glance            | 02:55      | 11            | 100.00%   |
1473     +-------------------+------------+---------------+-----------+
1474     | cinder            | 54:33      | 59            | 76.47%    |
1475     +-------------------+------------+---------------+-----------+
1476     | heat              | 18:00      | 48            | 92.31%    |
1477     +-------------------+------------+---------------+-----------+
1478     | keystone          | 01:53      | 40            | 100.00%   |
1479     +-------------------+------------+---------------+-----------+
1480     | neutron           | 06:04      | 43            | 100.00%   |
1481     +-------------------+------------+---------------+-----------+
1482     | nova              | 11:14      | 79            | 79.87%    |
1483     +-------------------+------------+---------------+-----------+
1484     | quotas            | 00:49      | 12            | 100.00%   |
1485     +-------------------+------------+---------------+-----------+
1486     | requests          | 00:22      | 4             | 100.00%   |
1487     +-------------------+------------+---------------+-----------+
1488     +===================+============+===============+===========+
1489     | TOTAL:            | 05:36:44   | 308           | 94.29%    |
1490     +===================+============+===============+===========+
1491
1492 Feature tests
1493 -------------
1494
1495 Promise
1496 ^^^^^^^
1497 ::
1498
1499     FUNCTEST.info: Running PROMISE test case...
1500     2016-04-26 01:23:01,296 - Promise- INFO - Creating tenant 'promise'...
1501     2016-04-26 01:23:01,461 - Promise- INFO - Adding role 'a6da18e9c7e94ee9975e85b6f26c974a' to tenant 'promise'...
1502     2016-04-26 01:23:01,553 - Promise- INFO - Creating user 'promiser'...
1503     2016-04-26 01:23:01,666 - Promise- INFO - Updating OpenStack credentials...
1504     2016-04-26 01:23:01,687 - Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
1505     2016-04-26 01:23:05,215 - Promise- INFO - Creating flavor 'promise-flavor'...
1506     2016-04-26 01:23:05,871 - Promise- INFO - Exporting environment variables...
1507     2016-04-26 01:23:05,871 - Promise- INFO - Running command: npm run -s test -- --reporter json
1508     2016-04-26 01:23:12,658 - Promise- INFO - The test succeeded.
1509     2016-04-26 01:23:12,660 - Promise- INFO -
1510     ****************************************
1511               Promise test report
1512
1513     ****************************************
1514      Suites:    23
1515      Tests:     33
1516      Passes:    33
1517      Pending:   0
1518      Failures:  0
1519      Start:     2016-04-26T01:23:08.348Z
1520      End:       2016-04-26T01:23:12.610Z
1521      Duration:  4.262