Colorado Release note
[functest.git] / docs / results / compass-os-nosdn-nofeature-ha.rst
1 .. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
2 .. http://creativecommons.org/licenses/by/4.0
3
4 Detailed test results for compass-os-nosdn-nofeature-ha
5 -------------------------------------------------------
6
7 VIM
8 ---
9
10 vping_ssh
11 ^^^^^^^^^
12 ::
13
14   FUNCTEST.info: Running vPing-SSH test...
15   vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
16   vPing_ssh- INFO - Creating neutron network vping-net...
17   vPing_ssh- INFO - Creating security group  'vPing-sg'...
18   vPing_ssh- INFO - Using existing Flavor 'm1.small'...
19   vPing_ssh- INFO - vPing Start Time:'2016-02-23 04:35:47'
20   vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
21    name=opnfv-vping-1
22    flavor=<Flavor: m1.small>
23    image=193891f9-6644-4668-9ac4-bd9336610a99
24    network=999caa31-8f28-4737-aa6e-3981e28a7e55
25
26   vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
27   vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
28   vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
29    name=opnfv-vping-2
30    flavor=<Flavor: m1.small>
31    image=193891f9-6644-4668-9ac4-bd9336610a99
32    network=999caa31-8f28-4737-aa6e-3981e28a7e55
33
34   vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
35   vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
36   vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
37   vPing_ssh- INFO - Floating IP created: '192.168.10.101'
38   vPing_ssh- INFO - Associating floating ip: '192.168.10.101' to VM 'opnfv-vping-2'
39   vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.101...
40   vPing_ssh- INFO - Waiting for ping...
41   vPing_ssh- INFO - vPing detected!
42   vPing_ssh- INFO - vPing duration:'43.2' s.
43   vPing_ssh- INFO - Cleaning up...
44   vPing_ssh- INFO - vPing OK
45
46
47 vping_userdata
48 ^^^^^^^^^^^^^^
49 ::
50
51   FUNCTEST.info: Running vPing-userdata test...
52   vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
53   vPing_userdata- INFO - Creating neutron network vping-net...
54   vPing_userdata- INFO - Creating security group  'vPing-sg'...
55   vPing_userdata- INFO - Flavor found 'm1.small'
56   vPing_userdata- INFO - vPing Start Time:'2016-02-23 04:36:44'
57   vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
58    name=opnfv-vping-1
59    flavor=<Flavor: m1.small>
60    image=53004632-aa69-4868-8234-2ef945681fcd
61    network=bf5529b1-1cb7-4ea6-93b8-5ff436c5ed3c
62
63   vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
64   vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
65    name=opnfv-vping-2
66    flavor=<Flavor: m1.small>
67    image=53004632-aa69-4868-8234-2ef945681fcd
68    network=bf5529b1-1cb7-4ea6-93b8-5ff436c5ed3c
69    userdata=
70   #!/bin/sh
71
72   while true; do
73    ping -c 1 192.168.130.3 2>&1 >/dev/null
74    RES=$?
75    if [ "Z$RES" = "Z0" ] ; then
76     echo 'vPing OK'
77    break
78    else
79     echo 'vPing KO'
80    fi
81    sleep 1
82   done
83
84   vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
85   vPing_userdata- INFO - Waiting for ping...
86   vPing_userdata- INFO - vPing detected!
87   vPing_userdata- INFO - vPing duration:'24.4'
88   vPing_userdata- INFO - vPing OK
89   vPing_userdata- INFO - Cleaning up...
90   vPing_userdata- INFO - Deleting network 'vping-net'...
91
92
93 Tempest
94 ^^^^^^^
95 ::
96
97   FUNCTEST.info: Running Tempest tests...
98   run_tempest - INFO - Creating tenant and user for Tempest suite
99   2016-02-23 04:37:19.865 23855 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
100   2016-02-23 04:37:24.332 23855 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
101
102   run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
103   Total results of verification:
104
105   +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
106   | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
107   +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
108   | 28be74fb-34e0-4247-833c-a8c5b3fd85d2 | d2a31b24-70b3-48ab-bd03-8d7a0dab20bd |          | 210   | 0        | 2016-02-23 04:37:25.793306 | finished |
109   +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
110
111   Tests:
112
113   +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
114   | name                                                                                                                                     | time      | status  |
115   +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
116   | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.20837   | success |
117   | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.20097   | success |
118   | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 27.41889  | success |
119   | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 6.64765   | success |
120   | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 7.27470   | success |
121   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.06285   | success |
122   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.06897   | success |
123   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.06414   | success |
124   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.11873   | success |
125   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.06762   | success |
126   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.06739   | success |
127   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.06986   | success |
128   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.06254   | success |
129   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.05104   | success |
130   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.12018   | success |
131   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.07818   | success |
132   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.10564   | success |
133   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.06481   | success |
134   | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.30634   | success |
135   | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 1.20722   | success |
136   | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.13093   | success |
137   | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.38276   | success |
138   | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 0.54540   | success |
139   | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 3.33321   | success |
140   | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 17.36469  | success |
141   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 3.15517   | success |
142   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.06856   | success |
143   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.18377   | success |
144   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.16882   | success |
145   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00068   | success |
146   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 3.15690   | success |
147   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.07962   | success |
148   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.15120   | success |
149   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.18218   | success |
150   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.00110   | success |
151   | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.06973   | success |
152   | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 6.27398   | success |
153   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.20951   | success |
154   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.18499   | success |
155   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.15917   | success |
156   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.31948   | success |
157   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.14946   | success |
158   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.07635   | success |
159   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.07788   | success |
160   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.06447   | success |
161   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.05937   | success |
162   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.07365   | success |
163   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.19332   | success |
164   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00071   | skip    |
165   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.15138   | success |
166   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.06312   | success |
167   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.01957   | success |
168   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.07095   | success |
169   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08593   | success |
170   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.01455   | success |
171   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01158   | success |
172   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.04029   | success |
173   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.06225   | success |
174   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.06189   | success |
175   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.26184   | success |
176   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.02082   | success |
177   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.06492   | success |
178   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00083   | skip    |
179   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 3.32560   | success |
180   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 8.17266   | success |
181   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 8.58619   | success |
182   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.29429   | skip    |
183   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 79.87435  | success |
184   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 14.54175  | success |
185   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 23.12381  | success |
186   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 6.94824   | success |
187   | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.08712   | success |
188   | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.16214   | success |
189   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.68228   | success |
190   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.29523   | success |
191   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.35906   | success |
192   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.68377   | success |
193   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.54206   | success |
194   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.55368   | success |
195   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 2.45879   | success |
196   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 29.40153  | success |
197   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 25.63768  | success |
198   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 14.29183  | success |
199   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 12.85255  | success |
200   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 0.59683   | success |
201   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 0.78070   | success |
202   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 0.64926   | success |
203   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 0.79184   | success |
204   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 0.62816   | success |
205   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 0.67889   | success |
206   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 0.91872   | success |
207   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.67651   | success |
208   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.39363   | success |
209   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.50851   | success |
210   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 0.57311   | success |
211   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.45111   | success |
212   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.39532   | success |
213   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.43734   | success |
214   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.62367   | success |
215   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 0.59665   | success |
216   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.38844   | success |
217   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.29632   | success |
218   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.34865   | success |
219   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 0.46513   | success |
220   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.41424   | success |
221   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.08979   | success |
222   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.01101   | success |
223   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.07763   | success |
224   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.01368   | success |
225   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.50557   | success |
226   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.08336   | success |
227   | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.23059   | success |
228   | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05377   | success |
229   | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 42.94954  | success |
230   | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.65627   | success |
231   | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.08496   | success |
232   | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.09567   | success |
233   | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.00685   | success |
234   | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.20509   | success |
235   | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.12058   | success |
236   | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.13306   | success |
237   | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.03344   | success |
238   | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.28451   | success |
239   | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.15089   | success |
240   | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.93789   | success |
241   | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.11553   | success |
242   | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.11774   | success |
243   | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.20859   | success |
244   | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.15701   | success |
245   | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 0.84413   | success |
246   | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.02197   | success |
247   | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01614   | success |
248   | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.01513   | success |
249   | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.01626   | success |
250   | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01377   | success |
251   | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.01219   | success |
252   | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.06385   | success |
253   | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 0.74490   | success |
254   | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 0.30669   | success |
255   | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 0.42703   | success |
256   | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 0.46679   | success |
257   | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.11398   | success |
258   | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 1.40153   | success |
259   | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 0.62250   | success |
260   | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 1.06048   | success |
261   | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 3.64767   | success |
262   | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 1.05674   | success |
263   | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 1.46703   | success |
264   | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 1.15288   | success |
265   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 1.19505   | success |
266   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.18705   | success |
267   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.16809   | success |
268   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.06150   | success |
269   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.06589   | success |
270   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.03918   | success |
271   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 1.09078   | success |
272   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.12778   | success |
273   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.04437   | success |
274   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.07037   | success |
275   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.08725   | success |
276   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.03485   | success |
277   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 0.94866   | success |
278   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 1.57085   | success |
279   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 0.63361   | success |
280   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.05208   | success |
281   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.04959   | success |
282   | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.22772   | success |
283   | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 1.51603   | success |
284   | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 0.89179   | success |
285   | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.16512   | success |
286   | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.05618   | success |
287   | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 4.21613   | success |
288   | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 1.92424   | success |
289   | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 1.44097   | success |
290   | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 1.08964   | success |
291   | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 3.05695   | success |
292   | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 1.48158   | success |
293   | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 1.24519   | success |
294   | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 1.01040   | success |
295   | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 0.40816   | success |
296   | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 0.55388   | success |
297   | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.02194   | success |
298   | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 0.51425   | success |
299   | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 0.62336   | success |
300   | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.02465   | success |
301   | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.31894   | success |
302   | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.32025   | success |
303   | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.02302   | success |
304   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.66552   | success |
305   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.40307   | success |
306   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.43128   | success |
307   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.50089   | success |
308   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.47817   | success |
309   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.50681   | success |
310   | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.37768   | success |
311   | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.07322   | success |
312   | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 0.82997   | success |
313   | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 1.47396   | success |
314   | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.64936   | success |
315   | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 1.83658   | success |
316   | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 12.39640  | success |
317   | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 11.41953  | success |
318   | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 11.27254  | success |
319   | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 11.80658  | success |
320   | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.05079   | success |
321   | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.05690   | success |
322   | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 44.43032  | success |
323   | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 21.90475  | success |
324   | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 121.16825 | success |
325   | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 117.34801 | success |
326   +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
327   run_tempest - INFO - Results: {'timestart': '2016-02-2304:37:25.793306', 'duration': 261, 'tests': 210, 'failures': 0}
328   run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
329   run_tempest - INFO - Deleting tenant and user for Tempest suite)
330
331
332 Rally
333 ^^^^^
334 ::
335
336   FUNCTEST.info: Running Rally benchmark suite...
337   run_rally - INFO - Starting test scenario "authenticate" ...
338   run_rally - INFO -
339    Preparing input task
340    Task  d78a7e66-b2a5-42de-ac0c-cc6145aaa77a: started
341   Task d78a7e66-b2a5-42de-ac0c-cc6145aaa77a: finished
342
343   test scenario Authenticate.validate_glance
344   +-------------------------------------------------------------------------------------------------------+
345   |                                         Response Times (sec)                                          |
346   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
347   | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
348   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
349   | authenticate.validate_glance     | 0.122 | 0.136  | 0.153  | 0.155  | 0.158 | 0.138 | 100.0%  | 10    |
350   | authenticate.validate_glance (2) | 0.039 | 0.045  | 0.056  | 0.06   | 0.064 | 0.047 | 100.0%  | 10    |
351   | total                            | 0.227 | 0.264  | 0.28   | 0.283  | 0.285 | 0.26  | 100.0%  | 10    |
352   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
353   Load duration: 0.795955181122
354   Full duration: 2.89371585846
355
356   test scenario Authenticate.keystone
357   +-----------------------------------------------------------------------------+
358   |                            Response Times (sec)                             |
359   +--------+-------+--------+--------+--------+-------+-------+---------+-------+
360   | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
361   +--------+-------+--------+--------+--------+-------+-------+---------+-------+
362   | total  | 0.064 | 0.077  | 0.097  | 0.114  | 0.131 | 0.081 | 100.0%  | 10    |
363   +--------+-------+--------+--------+--------+-------+-------+---------+-------+
364   Load duration: 0.246862888336
365   Full duration: 2.44218397141
366
367   test scenario Authenticate.validate_heat
368   +-----------------------------------------------------------------------------------------------------+
369   |                                        Response Times (sec)                                         |
370   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
371   | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
372   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
373   | authenticate.validate_heat     | 0.127 | 0.151  | 0.186  | 0.195  | 0.205 | 0.157 | 100.0%  | 10    |
374   | authenticate.validate_heat (2) | 0.026 | 0.09   | 0.113  | 0.133  | 0.153 | 0.08  | 100.0%  | 10    |
375   | total                          | 0.228 | 0.319  | 0.383  | 0.402  | 0.422 | 0.321 | 100.0%  | 10    |
376   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
377   Load duration: 0.963713884354
378   Full duration: 3.11927700043
379
380   test scenario Authenticate.validate_nova
381   +-----------------------------------------------------------------------------------------------------+
382   |                                        Response Times (sec)                                         |
383   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
384   | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
385   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
386   | authenticate.validate_nova     | 0.104 | 0.122  | 0.133  | 0.139  | 0.144 | 0.121 | 100.0%  | 10    |
387   | authenticate.validate_nova (2) | 0.028 | 0.031  | 0.04   | 0.041  | 0.042 | 0.034 | 100.0%  | 10    |
388   | total                          | 0.2   | 0.243  | 0.249  | 0.256  | 0.263 | 0.235 | 100.0%  | 10    |
389   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
390   Load duration: 0.704430103302
391   Full duration: 2.78888607025
392
393   test scenario Authenticate.validate_cinder
394   +-------------------------------------------------------------------------------------------------------+
395   |                                         Response Times (sec)                                          |
396   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
397   | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
398   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
399   | authenticate.validate_cinder     | 0.102 | 0.117  | 0.131  | 0.139  | 0.147 | 0.119 | 100.0%  | 10    |
400   | authenticate.validate_cinder (2) | 0.019 | 0.076  | 0.083  | 0.085  | 0.087 | 0.071 | 100.0%  | 10    |
401   | total                            | 0.229 | 0.263  | 0.304  | 0.317  | 0.331 | 0.269 | 100.0%  | 10    |
402   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
403   Load duration: 0.82511305809
404   Full duration: 2.97128987312
405
406   test scenario Authenticate.validate_neutron
407   +--------------------------------------------------------------------------------------------------------+
408   |                                          Response Times (sec)                                          |
409   +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
410   | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
411   +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
412   | authenticate.validate_neutron     | 0.111 | 0.12   | 0.134  | 0.135  | 0.135 | 0.123 | 100.0%  | 10    |
413   | authenticate.validate_neutron (2) | 0.03  | 0.086  | 0.104  | 0.104  | 0.104 | 0.084 | 100.0%  | 10    |
414   | total                             | 0.22  | 0.28   | 0.307  | 0.31   | 0.312 | 0.278 | 100.0%  | 10    |
415   +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
416   Load duration: 0.855668067932
417   Full duration: 3.13501811028
418
419   run_rally - INFO - Test scenario: "authenticate" OK.
420   run_rally - INFO - Starting test scenario "glance" ...
421   run_rally - INFO -
422    Preparing input task
423    Task  3234c959-6176-4a4f-adf4-50f3f3083d67: started
424   Task 3234c959-6176-4a4f-adf4-50f3f3083d67: finished
425
426   test scenario GlanceImages.list_images
427   +-----------------------------------------------------------------------------------------+
428   |                                  Response Times (sec)                                   |
429   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
430   | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
431   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
432   | glance.list_images | 0.189 | 0.215  | 0.246  | 0.252  | 0.258 | 0.218 | 100.0%  | 10    |
433   | total              | 0.189 | 0.215  | 0.246  | 0.252  | 0.258 | 0.218 | 100.0%  | 10    |
434   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
435   Load duration: 0.649740934372
436   Full duration: 3.67985486984
437
438   test scenario GlanceImages.create_image_and_boot_instances
439   +---------------------------------------------------------------------------------------------+
440   |                                    Response Times (sec)                                     |
441   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
442   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
443   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
444   | glance.create_image | 2.782  | 3.177  | 3.617  | 3.638  | 3.659  | 3.198  | 100.0%  | 10    |
445   | nova.boot_servers   | 9.48   | 13.931 | 17.26  | 17.274 | 17.287 | 13.824 | 100.0%  | 10    |
446   | total               | 12.296 | 16.956 | 20.848 | 20.857 | 20.866 | 17.022 | 100.0%  | 10    |
447   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
448   Load duration: 49.9618289471
449   Full duration: 73.9044458866
450
451   test scenario GlanceImages.create_and_list_image
452   +------------------------------------------------------------------------------------------+
453   |                                   Response Times (sec)                                   |
454   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
455   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
456   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
457   | glance.create_image | 2.779 | 3.406  | 3.655  | 3.673  | 3.692 | 3.306 | 100.0%  | 10    |
458   | glance.list_images  | 0.039 | 0.046  | 0.048  | 0.049  | 0.049 | 0.045 | 100.0%  | 10    |
459   | total               | 2.82  | 3.453  | 3.703  | 3.722  | 3.741 | 3.351 | 100.0%  | 10    |
460   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
461   Load duration: 9.77695393562
462   Full duration: 14.4172940254
463
464   test scenario GlanceImages.create_and_delete_image
465   +------------------------------------------------------------------------------------------+
466   |                                   Response Times (sec)                                   |
467   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
468   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
469   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
470   | glance.create_image | 2.788 | 3.69   | 3.785  | 3.83   | 3.876 | 3.489 | 100.0%  | 10    |
471   | glance.delete_image | 0.129 | 0.146  | 0.203  | 0.239  | 0.275 | 0.166 | 100.0%  | 10    |
472   | total               | 2.933 | 3.884  | 3.951  | 3.986  | 4.02  | 3.655 | 100.0%  | 10    |
473   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
474   Load duration: 10.762845993
475   Full duration: 13.6261451244
476
477   run_rally - INFO - Test scenario: "glance" OK.
478   run_rally - INFO - Starting test scenario "cinder" ...
479   run_rally - INFO -
480    Preparing input task
481    Task  21cb74f0-6bd9-44e3-aff3-99085ad0525f: started
482   Task 21cb74f0-6bd9-44e3-aff3-99085ad0525f: finished
483
484   test scenario CinderVolumes.create_and_attach_volume
485   +----------------------------------------------------------------------------------------------+
486   |                                     Response Times (sec)                                     |
487   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
488   | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
489   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
490   | nova.boot_server     | 7.723  | 10.184 | 13.839 | 13.936 | 14.032 | 10.913 | 100.0%  | 10    |
491   | cinder.create_volume | 2.731  | 2.833  | 2.935  | 3.005  | 3.076  | 2.847  | 100.0%  | 10    |
492   | nova.attach_volume   | 7.613  | 7.977  | 8.755  | 9.542  | 10.33  | 8.197  | 100.0%  | 10    |
493   | nova.detach_volume   | 3.034  | 3.429  | 5.352  | 5.414  | 5.476  | 4.052  | 100.0%  | 10    |
494   | cinder.delete_volume | 2.44   | 2.495  | 2.591  | 2.6    | 2.609  | 2.503  | 100.0%  | 10    |
495   | nova.delete_server   | 2.423  | 2.508  | 2.823  | 3.661  | 4.499  | 2.704  | 100.0%  | 10    |
496   | total                | 28.081 | 29.986 | 35.858 | 36.584 | 37.309 | 31.218 | 100.0%  | 10    |
497   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
498   Load duration: 93.1938638687
499   Full duration: 105.67930007
500
501   test scenario CinderVolumes.create_and_list_volume
502   +-------------------------------------------------------------------------------------------+
503   |                                   Response Times (sec)                                    |
504   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
505   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
506   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
507   | cinder.create_volume | 2.887 | 5.424  | 5.581  | 5.636  | 5.69  | 4.98  | 100.0%  | 10    |
508   | cinder.list_volumes  | 0.079 | 0.157  | 0.177  | 0.182  | 0.186 | 0.147 | 100.0%  | 10    |
509   | total                | 2.966 | 5.594  | 5.745  | 5.781  | 5.817 | 5.127 | 100.0%  | 10    |
510   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
511   Load duration: 14.3176538944
512   Full duration: 25.6212191582
513
514   test scenario CinderVolumes.create_and_list_volume
515   +-------------------------------------------------------------------------------------------+
516   |                                   Response Times (sec)                                    |
517   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
518   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
519   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
520   | cinder.create_volume | 2.813 | 2.965  | 3.036  | 3.048  | 3.059 | 2.962 | 100.0%  | 10    |
521   | cinder.list_volumes  | 0.08  | 0.127  | 0.142  | 0.161  | 0.18  | 0.128 | 100.0%  | 10    |
522   | total                | 2.893 | 3.093  | 3.178  | 3.209  | 3.239 | 3.09  | 100.0%  | 10    |
523   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
524   Load duration: 9.30827403069
525   Full duration: 19.9378697872
526
527   test scenario CinderVolumes.create_and_list_snapshots
528   +---------------------------------------------------------------------------------------------+
529   |                                    Response Times (sec)                                     |
530   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
531   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
532   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
533   | cinder.create_snapshot | 2.438 | 2.526  | 2.593  | 2.593  | 2.593 | 2.528 | 100.0%  | 10    |
534   | cinder.list_snapshots  | 0.018 | 0.088  | 0.099  | 0.104  | 0.109 | 0.083 | 100.0%  | 10    |
535   | total                  | 2.523 | 2.613  | 2.683  | 2.687  | 2.692 | 2.611 | 100.0%  | 10    |
536   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
537   Load duration: 7.79824590683
538   Full duration: 31.6265990734
539
540   test scenario CinderVolumes.create_and_delete_volume
541   +-------------------------------------------------------------------------------------------+
542   |                                   Response Times (sec)                                    |
543   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
544   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
545   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
546   | cinder.create_volume | 2.891 | 3.012  | 3.068  | 3.069  | 3.069 | 2.987 | 100.0%  | 10    |
547   | cinder.delete_volume | 2.505 | 2.583  | 2.686  | 2.713  | 2.739 | 2.598 | 100.0%  | 10    |
548   | total                | 5.445 | 5.6    | 5.697  | 5.7    | 5.703 | 5.586 | 100.0%  | 10    |
549   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
550   Load duration: 16.8130619526
551   Full duration: 23.3862919807
552
553   test scenario CinderVolumes.create_and_delete_volume
554   +-------------------------------------------------------------------------------------------+
555   |                                   Response Times (sec)                                    |
556   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
557   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
558   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
559   | cinder.create_volume | 3.06  | 5.419  | 5.676  | 5.725  | 5.774 | 4.793 | 100.0%  | 10    |
560   | cinder.delete_volume | 2.457 | 2.536  | 2.613  | 2.63   | 2.648 | 2.548 | 100.0%  | 10    |
561   | total                | 5.557 | 7.997  | 8.239  | 8.276  | 8.313 | 7.341 | 100.0%  | 10    |
562   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
563   Load duration: 21.6966080666
564   Full duration: 28.6927661896
565
566   test scenario CinderVolumes.create_and_delete_volume
567   +-------------------------------------------------------------------------------------------+
568   |                                   Response Times (sec)                                    |
569   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
570   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
571   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
572   | cinder.create_volume | 2.819 | 2.943  | 3.235  | 3.249  | 3.264 | 3.001 | 100.0%  | 10    |
573   | cinder.delete_volume | 2.545 | 2.581  | 2.665  | 2.684  | 2.702 | 2.603 | 100.0%  | 10    |
574   | total                | 5.375 | 5.546  | 5.826  | 5.896  | 5.966 | 5.604 | 100.0%  | 10    |
575   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
576   Load duration: 16.8036949635
577   Full duration: 23.085185051
578
579   test scenario CinderVolumes.create_and_upload_volume_to_image
580   +-------------------------------------------------------------------------------------------------------+
581   |                                         Response Times (sec)                                          |
582   +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
583   | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
584   +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
585   | cinder.create_volume          | 2.833  | 3.116  | 3.438  | 3.496  | 3.553  | 3.134  | 100.0%  | 10    |
586   | cinder.upload_volume_to_image | 25.838 | 62.678 | 78.019 | 78.434 | 78.85  | 55.7   | 100.0%  | 10    |
587   | cinder.delete_volume          | 2.358  | 2.511  | 2.619  | 2.684  | 2.749  | 2.531  | 100.0%  | 10    |
588   | nova.delete_image             | 0.221  | 0.371  | 3.025  | 13.33  | 23.635 | 2.707  | 100.0%  | 10    |
589   | total                         | 31.573 | 68.573 | 83.845 | 84.418 | 84.99  | 64.072 | 100.0%  | 10    |
590   +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
591   Load duration: 182.231485128
592   Full duration: 189.13320303
593
594   test scenario CinderVolumes.create_and_delete_snapshot
595   +---------------------------------------------------------------------------------------------+
596   |                                    Response Times (sec)                                     |
597   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
598   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
599   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
600   | cinder.create_snapshot | 2.43  | 2.545  | 2.599  | 2.6    | 2.602 | 2.539 | 100.0%  | 10    |
601   | cinder.delete_snapshot | 2.326 | 2.495  | 2.611  | 2.675  | 2.739 | 2.493 | 100.0%  | 10    |
602   | total                  | 4.887 | 5.04   | 5.173  | 5.186  | 5.199 | 5.032 | 100.0%  | 10    |
603   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
604   Load duration: 14.9942228794
605   Full duration: 33.8261451721
606
607   test scenario CinderVolumes.create_volume
608   +-------------------------------------------------------------------------------------------+
609   |                                   Response Times (sec)                                    |
610   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
611   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
612   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
613   | cinder.create_volume | 2.829 | 2.973  | 3.402  | 3.412  | 3.422 | 3.063 | 100.0%  | 10    |
614   | total                | 2.829 | 2.973  | 3.403  | 3.412  | 3.422 | 3.063 | 100.0%  | 10    |
615   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
616   Load duration: 9.0781109333
617   Full duration: 18.1423990726
618
619   test scenario CinderVolumes.create_volume
620   +-----------------------------------------------------------------------------------------+
621   |                                  Response Times (sec)                                   |
622   +----------------------+------+--------+--------+--------+------+-------+---------+-------+
623   | action               | min  | median | 90%ile | 95%ile | max  | avg   | success | count |
624   +----------------------+------+--------+--------+--------+------+-------+---------+-------+
625   | cinder.create_volume | 2.85 | 2.939  | 2.978  | 2.984  | 2.99 | 2.932 | 100.0%  | 10    |
626   | total                | 2.85 | 2.94   | 2.978  | 2.984  | 2.99 | 2.932 | 100.0%  | 10    |
627   +----------------------+------+--------+--------+--------+------+-------+---------+-------+
628   Load duration: 8.73497700691
629   Full duration: 19.4855289459
630
631   test scenario CinderVolumes.list_volumes
632   +------------------------------------------------------------------------------------------+
633   |                                   Response Times (sec)                                   |
634   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
635   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
636   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
637   | cinder.list_volumes | 0.211 | 0.266  | 0.312  | 0.327  | 0.342 | 0.274 | 100.0%  | 10    |
638   | total               | 0.211 | 0.266  | 0.312  | 0.327  | 0.342 | 0.275 | 100.0%  | 10    |
639   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
640   Load duration: 0.827063083649
641   Full duration: 47.6483559608
642
643   test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
644   +------------------------------------------------------------------------------------------------+
645   |                                      Response Times (sec)                                      |
646   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
647   | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
648   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
649   | cinder.create_volume   | 2.852  | 3.009  | 3.091  | 3.106  | 3.122  | 3.005  | 100.0%  | 10    |
650   | cinder.create_snapshot | 2.321  | 2.392  | 2.404  | 2.404  | 2.405  | 2.377  | 100.0%  | 10    |
651   | nova.attach_volume     | 5.473  | 7.981  | 11.399 | 12.215 | 13.031 | 8.96   | 100.0%  | 10    |
652   | nova.detach_volume     | 3.035  | 5.168  | 5.603  | 5.772  | 5.941  | 4.587  | 100.0%  | 10    |
653   | cinder.delete_snapshot | 2.209  | 2.347  | 2.41   | 2.417  | 2.424  | 2.349  | 100.0%  | 10    |
654   | cinder.delete_volume   | 2.412  | 2.494  | 2.582  | 2.616  | 2.65   | 2.508  | 100.0%  | 10    |
655   | total                  | 21.417 | 23.884 | 26.577 | 26.903 | 27.228 | 24.098 | 100.0%  | 10    |
656   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
657   Load duration: 70.9750390053
658   Full duration: 126.263324976
659
660   test scenario CinderVolumes.create_from_volume_and_delete_volume
661   +----------------------------------------------------------------------------------------------+
662   |                                     Response Times (sec)                                     |
663   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
664   | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
665   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
666   | cinder.create_volume | 9.872  | 12.204 | 17.525 | 19.351 | 21.177 | 13.167 | 100.0%  | 10    |
667   | cinder.delete_volume | 2.325  | 2.554  | 2.928  | 3.924  | 4.92   | 2.779  | 100.0%  | 10    |
668   | total                | 12.426 | 14.781 | 20.202 | 21.897 | 23.592 | 15.947 | 100.0%  | 10    |
669   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
670   Load duration: 43.4407100677
671   Full duration: 62.327357769
672
673   test scenario CinderVolumes.create_and_extend_volume
674   +-------------------------------------------------------------------------------------------+
675   |                                   Response Times (sec)                                    |
676   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
677   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
678   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
679   | cinder.create_volume | 2.858 | 2.94   | 3.074  | 3.087  | 3.1   | 2.956 | 100.0%  | 10    |
680   | cinder.extend_volume | 2.572 | 2.848  | 2.884  | 2.919  | 2.954 | 2.8   | 100.0%  | 10    |
681   | cinder.delete_volume | 2.433 | 2.567  | 2.67   | 2.693  | 2.716 | 2.567 | 100.0%  | 10    |
682   | total                | 7.982 | 8.292  | 8.558  | 8.616  | 8.674 | 8.323 | 100.0%  | 10    |
683   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
684   Load duration: 24.9033889771
685   Full duration: 31.5932898521
686
687   test scenario CinderVolumes.create_snapshot_and_attach_volume
688   +------------------------------------------------------------------------------------------------+
689   |                                      Response Times (sec)                                      |
690   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
691   | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
692   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
693   | cinder.create_volume   | 2.882  | 2.947  | 3.229  | 3.231  | 3.233  | 3.005  | 100.0%  | 10    |
694   | cinder.create_snapshot | 2.268  | 2.345  | 2.421  | 2.456  | 2.491  | 2.36   | 100.0%  | 10    |
695   | nova.attach_volume     | 7.593  | 8.071  | 12.707 | 13.727 | 14.747 | 9.373  | 100.0%  | 10    |
696   | nova.detach_volume     | 2.962  | 5.331  | 5.412  | 5.491  | 5.57   | 5.076  | 100.0%  | 10    |
697   | cinder.delete_snapshot | 2.185  | 2.286  | 2.366  | 2.374  | 2.381  | 2.298  | 100.0%  | 10    |
698   | cinder.delete_volume   | 2.425  | 2.524  | 2.593  | 2.61   | 2.627  | 2.52   | 100.0%  | 10    |
699   | total                  | 21.713 | 23.963 | 28.368 | 29.657 | 30.947 | 24.974 | 100.0%  | 10    |
700   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
701   Load duration: 73.7474370003
702   Full duration: 132.963656902
703
704   test scenario CinderVolumes.create_snapshot_and_attach_volume
705   +------------------------------------------------------------------------------------------------+
706   |                                      Response Times (sec)                                      |
707   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
708   | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
709   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
710   | cinder.create_volume   | 2.739  | 2.89   | 3.033  | 3.058  | 3.084  | 2.914  | 100.0%  | 10    |
711   | cinder.create_snapshot | 2.247  | 2.401  | 2.466  | 2.485  | 2.503  | 2.388  | 100.0%  | 10    |
712   | nova.attach_volume     | 7.882  | 8.891  | 10.439 | 11.312 | 12.186 | 9.222  | 100.0%  | 10    |
713   | nova.detach_volume     | 2.94   | 5.373  | 5.635  | 5.661  | 5.687  | 4.764  | 100.0%  | 10    |
714   | cinder.delete_snapshot | 2.283  | 2.332  | 2.481  | 2.585  | 2.688  | 2.381  | 100.0%  | 10    |
715   | cinder.delete_volume   | 2.425  | 2.495  | 2.547  | 2.558  | 2.569  | 2.489  | 100.0%  | 10    |
716   | total                  | 21.386 | 24.555 | 26.13  | 26.247 | 26.365 | 24.746 | 100.0%  | 10    |
717   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
718   Load duration: 76.0001449585
719   Full duration: 139.533368111
720
721   run_rally - INFO - Test scenario: "cinder" OK.
722   run_rally - INFO - Starting test scenario "heat" ...
723   run_rally - INFO -
724    Preparing input task
725    Task  7d1551b5-51d4-480b-816d-571bc61773ac: started
726   Task 7d1551b5-51d4-480b-816d-571bc61773ac: finished
727
728   test scenario HeatStacks.create_suspend_resume_delete_stack
729   +-----------------------------------------------------------------------------------------+
730   |                                  Response Times (sec)                                   |
731   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
732   | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
733   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
734   | heat.create_stack  | 2.896 | 3.025  | 3.297  | 3.342  | 3.386 | 3.075 | 100.0%  | 10    |
735   | heat.suspend_stack | 0.444 | 1.622  | 1.791  | 1.817  | 1.844 | 1.332 | 100.0%  | 10    |
736   | heat.resume_stack  | 1.365 | 1.657  | 1.701  | 1.755  | 1.809 | 1.598 | 100.0%  | 10    |
737   | heat.delete_stack  | 0.499 | 1.531  | 1.644  | 1.655  | 1.665 | 1.451 | 100.0%  | 10    |
738   | total              | 5.782 | 7.652  | 8.146  | 8.28   | 8.414 | 7.455 | 100.0%  | 10    |
739   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
740   Load duration: 21.9193868637
741   Full duration: 25.3411290646
742
743   test scenario HeatStacks.create_and_delete_stack
744   +----------------------------------------------------------------------------------------+
745   |                                  Response Times (sec)                                  |
746   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
747   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
748   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
749   | heat.create_stack | 3.023 | 3.144  | 3.331  | 3.531  | 3.73  | 3.206 | 100.0%  | 10    |
750   | heat.delete_stack | 0.437 | 0.646  | 1.617  | 1.676  | 1.734 | 0.972 | 100.0%  | 10    |
751   | total             | 3.54  | 3.767  | 4.914  | 5.114  | 5.314 | 4.178 | 100.0%  | 10    |
752   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
753   Load duration: 12.2326231003
754   Full duration: 15.3595271111
755
756   test scenario HeatStacks.create_and_delete_stack
757   +-------------------------------------------------------------------------------------------+
758   |                                   Response Times (sec)                                    |
759   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
760   | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
761   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
762   | heat.create_stack | 14.933 | 16.348 | 17.828 | 18.321 | 18.813 | 16.471 | 100.0%  | 10    |
763   | heat.delete_stack | 6.665  | 8.038  | 8.335  | 8.772  | 9.208  | 7.711  | 100.0%  | 10    |
764   | total             | 22.386 | 24.346 | 25.661 | 25.74  | 25.818 | 24.182 | 100.0%  | 10    |
765   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
766   Load duration: 72.8466770649
767   Full duration: 76.0618572235
768
769   test scenario HeatStacks.create_and_delete_stack
770   +-------------------------------------------------------------------------------------------+
771   |                                   Response Times (sec)                                    |
772   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
773   | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
774   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
775   | heat.create_stack | 16.663 | 19.357 | 20.553 | 21.32  | 22.088 | 19.17  | 100.0%  | 10    |
776   | heat.delete_stack | 9.144  | 9.269  | 10.036 | 10.227 | 10.417 | 9.461  | 100.0%  | 10    |
777   | total             | 25.982 | 28.953 | 30.462 | 30.847 | 31.232 | 28.631 | 100.0%  | 10    |
778   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
779   Load duration: 84.6888990402
780   Full duration: 88.1814341545
781
782   test scenario HeatStacks.list_stacks_and_resources
783   +------------------------------------------------------------------------------------------------------+
784   |                                         Response Times (sec)                                         |
785   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
786   | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
787   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
788   | heat.list_stacks                | 0.219 | 0.246  | 0.383  | 0.4    | 0.417 | 0.287 | 100.0%  | 10    |
789   | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
790   | total                           | 0.219 | 0.246  | 0.383  | 0.4    | 0.418 | 0.287 | 100.0%  | 10    |
791   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
792   Load duration: 0.863615989685
793   Full duration: 3.55412602425
794
795   test scenario HeatStacks.create_update_delete_stack
796   +----------------------------------------------------------------------------------------+
797   |                                  Response Times (sec)                                  |
798   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
799   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
800   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
801   | heat.create_stack | 2.866 | 3.102  | 3.266  | 3.29   | 3.314 | 3.097 | 100.0%  | 10    |
802   | heat.update_stack | 2.641 | 3.637  | 3.803  | 3.813  | 3.822 | 3.497 | 100.0%  | 10    |
803   | heat.delete_stack | 1.394 | 1.515  | 1.651  | 1.666  | 1.681 | 1.534 | 100.0%  | 10    |
804   | total             | 7.247 | 8.255  | 8.454  | 8.543  | 8.631 | 8.127 | 100.0%  | 10    |
805   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
806   Load duration: 24.2989928722
807   Full duration: 27.7337241173
808
809   test scenario HeatStacks.create_update_delete_stack
810   +----------------------------------------------------------------------------------------+
811   |                                  Response Times (sec)                                  |
812   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
813   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
814   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
815   | heat.create_stack | 2.799 | 3.033  | 3.19   | 3.306  | 3.422 | 3.046 | 100.0%  | 10    |
816   | heat.update_stack | 2.509 | 3.732  | 3.845  | 3.847  | 3.849 | 3.321 | 100.0%  | 10    |
817   | heat.delete_stack | 1.302 | 1.538  | 1.641  | 1.733  | 1.824 | 1.542 | 100.0%  | 10    |
818   | total             | 7.14  | 8.084  | 8.351  | 8.371  | 8.39  | 7.909 | 100.0%  | 10    |
819   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
820   Load duration: 23.4465420246
821   Full duration: 27.0243220329
822
823   test scenario HeatStacks.create_update_delete_stack
824   +------------------------------------------------------------------------------------------+
825   |                                   Response Times (sec)                                   |
826   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
827   | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
828   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
829   | heat.create_stack | 2.894 | 3.127  | 3.22   | 3.399  | 3.579  | 3.129  | 100.0%  | 10    |
830   | heat.update_stack | 4.739 | 5.169  | 6.092  | 6.105  | 6.119  | 5.309  | 100.0%  | 10    |
831   | heat.delete_stack | 1.422 | 1.839  | 2.562  | 2.565  | 2.567  | 1.989  | 100.0%  | 10    |
832   | total             | 9.674 | 10.622 | 10.9   | 10.921 | 10.941 | 10.427 | 100.0%  | 10    |
833   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
834   Load duration: 30.9374701977
835   Full duration: 34.6409509182
836
837   test scenario HeatStacks.create_update_delete_stack
838   +-----------------------------------------------------------------------+
839   |                         Response Times (sec)                          |
840   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
841   | action | min | median | 90%ile | 95%ile | max | avg | success | count |
842   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
843   | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
844   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
845   Load duration: 6.25441002846
846   Full duration: 14.2524240017
847
848   test scenario HeatStacks.create_update_delete_stack
849   +------------------------------------------------------------------------------------------+
850   |                                   Response Times (sec)                                   |
851   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
852   | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
853   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
854   | heat.create_stack | 2.776 | 3.256  | 3.502  | 3.878  | 4.255  | 3.292  | 100.0%  | 10    |
855   | heat.update_stack | 4.632 | 4.964  | 5.353  | 5.818  | 6.284  | 5.076  | 100.0%  | 10    |
856   | heat.delete_stack | 1.439 | 2.134  | 2.645  | 2.668  | 2.691  | 2.088  | 100.0%  | 10    |
857   | total             | 9.373 | 10.496 | 11.129 | 11.584 | 12.039 | 10.455 | 100.0%  | 10    |
858   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
859   Load duration: 31.1429200172
860   Full duration: 34.8937320709
861
862   test scenario HeatStacks.create_update_delete_stack
863   +----------------------------------------------------------------------------------------+
864   |                                  Response Times (sec)                                  |
865   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
866   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
867   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
868   | heat.create_stack | 2.804 | 3.071  | 3.166  | 3.186  | 3.206 | 3.026 | 100.0%  | 10    |
869   | heat.update_stack | 2.737 | 3.748  | 4.018  | 4.043  | 4.068 | 3.617 | 100.0%  | 10    |
870   | heat.delete_stack | 1.31  | 1.555  | 1.823  | 1.832  | 1.841 | 1.569 | 100.0%  | 10    |
871   | total             | 7.424 | 8.294  | 8.696  | 8.74   | 8.783 | 8.212 | 100.0%  | 10    |
872   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
873   Load duration: 24.5028841496
874   Full duration: 28.3026170731
875
876   test scenario HeatStacks.create_and_list_stack
877   +----------------------------------------------------------------------------------------+
878   |                                  Response Times (sec)                                  |
879   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
880   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
881   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
882   | heat.create_stack | 2.956 | 3.13   | 3.324  | 3.341  | 3.359 | 3.141 | 100.0%  | 10    |
883   | heat.list_stacks  | 0.033 | 0.168  | 0.248  | 0.276  | 0.304 | 0.14  | 100.0%  | 10    |
884   | total             | 3.124 | 3.262  | 3.41   | 3.453  | 3.497 | 3.281 | 100.0%  | 10    |
885   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
886   Load duration: 10.0396568775
887   Full duration: 17.6087501049
888
889   test scenario HeatStacks.create_check_delete_stack
890   +----------------------------------------------------------------------------------------+
891   |                                  Response Times (sec)                                  |
892   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
893   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
894   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
895   | heat.create_stack | 2.922 | 3.155  | 3.412  | 3.413  | 3.415 | 3.159 | 100.0%  | 10    |
896   | heat.check_stack  | 0.418 | 0.518  | 1.02   | 1.361  | 1.702 | 0.701 | 100.0%  | 10    |
897   | heat.delete_stack | 0.687 | 1.665  | 1.773  | 1.786  | 1.799 | 1.56  | 100.0%  | 10    |
898   | total             | 4.445 | 5.362  | 5.863  | 6.138  | 6.413 | 5.42  | 100.0%  | 10    |
899   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
900   Load duration: 16.1680779457
901   Full duration: 20.0481300354
902
903   run_rally - INFO - Test scenario: "heat" Failed.
904   run_rally - INFO - Starting test scenario "keystone" ...
905   run_rally - INFO -
906    Preparing input task
907    Task  5cfc1b63-088e-4840-a525-13064451e8d6: started
908   Task 5cfc1b63-088e-4840-a525-13064451e8d6: finished
909
910   test scenario KeystoneBasic.create_tenant_with_users
911   +---------------------------------------------------------------------------------------------+
912   |                                    Response Times (sec)                                     |
913   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
914   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
915   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
916   | keystone.create_tenant | 0.105 | 0.119  | 0.16   | 0.16   | 0.161 | 0.125 | 100.0%  | 10    |
917   | keystone.create_users  | 0.592 | 0.653  | 0.694  | 0.719  | 0.744 | 0.657 | 100.0%  | 10    |
918   | total                  | 0.706 | 0.77   | 0.844  | 0.874  | 0.905 | 0.782 | 100.0%  | 10    |
919   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
920   Load duration: 2.32407808304
921   Full duration: 12.4144320488
922
923   test scenario KeystoneBasic.create_add_and_list_user_roles
924   +-------------------------------------------------------------------------------------------+
925   |                                   Response Times (sec)                                    |
926   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
927   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
928   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
929   | keystone.create_role | 0.116 | 0.119  | 0.144  | 0.149  | 0.154 | 0.125 | 100.0%  | 10    |
930   | keystone.add_role    | 0.088 | 0.099  | 0.107  | 0.107  | 0.107 | 0.099 | 100.0%  | 10    |
931   | keystone.list_roles  | 0.054 | 0.058  | 0.095  | 0.097  | 0.1   | 0.067 | 100.0%  | 10    |
932   | total                | 0.27  | 0.28   | 0.345  | 0.35   | 0.355 | 0.292 | 100.0%  | 10    |
933   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
934   Load duration: 0.863723993301
935   Full duration: 6.29958295822
936
937   test scenario KeystoneBasic.add_and_remove_user_role
938   +-------------------------------------------------------------------------------------------+
939   |                                   Response Times (sec)                                    |
940   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
941   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
942   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
943   | keystone.create_role | 0.121 | 0.217  | 0.274  | 0.281  | 0.288 | 0.2   | 100.0%  | 10    |
944   | keystone.add_role    | 0.089 | 0.092  | 0.098  | 0.098  | 0.099 | 0.093 | 100.0%  | 10    |
945   | keystone.remove_role | 0.058 | 0.061  | 0.156  | 0.161  | 0.167 | 0.081 | 100.0%  | 10    |
946   | total                | 0.274 | 0.371  | 0.497  | 0.517  | 0.537 | 0.373 | 100.0%  | 10    |
947   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
948   Load duration: 1.090020895
949   Full duration: 6.37877011299
950
951   test scenario KeystoneBasic.create_update_and_delete_tenant
952   +---------------------------------------------------------------------------------------------+
953   |                                    Response Times (sec)                                     |
954   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
955   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
956   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
957   | keystone.create_tenant | 0.123 | 0.223  | 0.286  | 0.291  | 0.296 | 0.209 | 100.0%  | 10    |
958   | keystone.update_tenant | 0.052 | 0.056  | 0.065  | 0.066  | 0.068 | 0.057 | 100.0%  | 10    |
959   | keystone.delete_tenant | 0.125 | 0.135  | 0.286  | 0.307  | 0.327 | 0.18  | 100.0%  | 10    |
960   | total                  | 0.302 | 0.416  | 0.63   | 0.632  | 0.634 | 0.446 | 100.0%  | 10    |
961   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
962   Load duration: 1.29043102264
963   Full duration: 5.07875084877
964
965   test scenario KeystoneBasic.create_and_delete_service
966   +----------------------------------------------------------------------------------------------+
967   |                                     Response Times (sec)                                     |
968   +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
969   | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
970   +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
971   | keystone.create_service | 0.109 | 0.123  | 0.128  | 0.132  | 0.135 | 0.122 | 100.0%  | 10    |
972   | keystone.delete_service | 0.059 | 0.07   | 0.121  | 0.128  | 0.134 | 0.079 | 100.0%  | 10    |
973   | total                   | 0.174 | 0.196  | 0.234  | 0.245  | 0.255 | 0.201 | 100.0%  | 10    |
974   +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
975   Load duration: 0.603389024734
976   Full duration: 4.27351093292
977
978   test scenario KeystoneBasic.create_tenant
979   +---------------------------------------------------------------------------------------------+
980   |                                    Response Times (sec)                                     |
981   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
982   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
983   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
984   | keystone.create_tenant | 0.118 | 0.133  | 0.186  | 0.187  | 0.188 | 0.142 | 100.0%  | 10    |
985   | total                  | 0.118 | 0.133  | 0.186  | 0.187  | 0.188 | 0.142 | 100.0%  | 10    |
986   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
987   Load duration: 0.428766012192
988   Full duration: 4.18886899948
989
990   test scenario KeystoneBasic.create_user
991   +------------------------------------------------------------------------------------------+
992   |                                   Response Times (sec)                                   |
993   +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
994   | action               | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
995   +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
996   | keystone.create_user | 0.137 | 0.138  | 0.145  | 0.145  | 0.146 | 0.14 | 100.0%  | 10    |
997   | total                | 0.137 | 0.138  | 0.145  | 0.145  | 0.146 | 0.14 | 100.0%  | 10    |
998   +----------------------+-------+--------+--------+--------+-------+------+---------+-------+
999   Load duration: 0.443462133408
1000   Full duration: 4.19236207008
1001
1002   test scenario KeystoneBasic.create_and_list_tenants
1003   +---------------------------------------------------------------------------------------------+
1004   |                                    Response Times (sec)                                     |
1005   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1006   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1007   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1008   | keystone.create_tenant | 0.111 | 0.117  | 0.165  | 0.178  | 0.191 | 0.132 | 100.0%  | 10    |
1009   | keystone.list_tenants  | 0.046 | 0.055  | 0.065  | 0.066  | 0.067 | 0.055 | 100.0%  | 10    |
1010   | total                  | 0.163 | 0.179  | 0.214  | 0.231  | 0.247 | 0.187 | 100.0%  | 10    |
1011   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1012   Load duration: 0.561487913132
1013   Full duration: 5.7246799469
1014
1015   test scenario KeystoneBasic.create_and_delete_role
1016   +-------------------------------------------------------------------------------------------+
1017   |                                   Response Times (sec)                                    |
1018   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1019   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1020   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1021   | keystone.create_role | 0.12  | 0.232  | 0.282  | 0.289  | 0.296 | 0.206 | 100.0%  | 10    |
1022   | keystone.delete_role | 0.104 | 0.117  | 0.133  | 0.169  | 0.206 | 0.124 | 100.0%  | 10    |
1023   | total                | 0.239 | 0.342  | 0.401  | 0.452  | 0.502 | 0.33  | 100.0%  | 10    |
1024   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1025   Load duration: 0.990566015244
1026   Full duration: 4.97686004639
1027
1028   test scenario KeystoneBasic.get_entities
1029   +---------------------------------------------------------------------------------------------+
1030   |                                    Response Times (sec)                                     |
1031   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1032   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1033   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1034   | keystone.create_tenant | 0.106 | 0.133  | 0.16   | 0.174  | 0.187 | 0.139 | 100.0%  | 10    |
1035   | keystone.create_user   | 0.058 | 0.066  | 0.07   | 0.071  | 0.071 | 0.065 | 100.0%  | 10    |
1036   | keystone.create_role   | 0.046 | 0.053  | 0.07   | 0.086  | 0.103 | 0.059 | 100.0%  | 10    |
1037   | keystone.get_tenant    | 0.044 | 0.048  | 0.055  | 0.076  | 0.098 | 0.053 | 100.0%  | 10    |
1038   | keystone.get_user      | 0.051 | 0.057  | 0.063  | 0.063  | 0.063 | 0.057 | 100.0%  | 10    |
1039   | keystone.get_role      | 0.044 | 0.047  | 0.055  | 0.056  | 0.058 | 0.049 | 100.0%  | 10    |
1040   | keystone.service_list  | 0.045 | 0.049  | 0.06   | 0.081  | 0.101 | 0.054 | 100.0%  | 10    |
1041   | keystone.get_service   | 0.043 | 0.049  | 0.062  | 0.079  | 0.097 | 0.053 | 100.0%  | 10    |
1042   | total                  | 0.475 | 0.518  | 0.577  | 0.6    | 0.622 | 0.529 | 100.0%  | 10    |
1043   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1044   Load duration: 1.58831310272
1045   Full duration: 9.76444888115
1046
1047   test scenario KeystoneBasic.create_and_list_users
1048   +-------------------------------------------------------------------------------------------+
1049   |                                   Response Times (sec)                                    |
1050   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1051   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1052   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1053   | keystone.create_user | 0.13  | 0.145  | 0.177  | 0.195  | 0.213 | 0.152 | 100.0%  | 10    |
1054   | keystone.list_users  | 0.052 | 0.055  | 0.08   | 0.093  | 0.106 | 0.062 | 100.0%  | 10    |
1055   | total                | 0.183 | 0.2    | 0.269  | 0.274  | 0.279 | 0.214 | 100.0%  | 10    |
1056   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1057   Load duration: 0.642003059387
1058   Full duration: 4.59805297852
1059
1060   run_rally - INFO - Test scenario: "keystone" OK.
1061   run_rally - INFO - Starting test scenario "neutron" ...
1062   run_rally - INFO -
1063    Preparing input task
1064    Task  aa890d07-7f64-4bf2-9cc1-adb8d5a95c9e: started
1065   Task aa890d07-7f64-4bf2-9cc1-adb8d5a95c9e: finished
1066
1067   test scenario NeutronNetworks.create_and_delete_ports
1068   +------------------------------------------------------------------------------------------+
1069   |                                   Response Times (sec)                                   |
1070   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1071   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1072   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1073   | neutron.create_port | 0.42  | 0.516  | 0.669  | 0.677  | 0.684 | 0.538 | 100.0%  | 10    |
1074   | neutron.delete_port | 0.149 | 0.287  | 0.338  | 0.344  | 0.349 | 0.274 | 100.0%  | 10    |
1075   | total               | 0.65  | 0.787  | 0.989  | 0.992  | 0.996 | 0.812 | 100.0%  | 10    |
1076   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1077   Load duration: 2.28342914581
1078   Full duration: 25.3548538685
1079
1080   test scenario NeutronNetworks.create_and_list_routers
1081   +---------------------------------------------------------------------------------------------------+
1082   |                                       Response Times (sec)                                        |
1083   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1084   | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1085   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1086   | neutron.create_subnet        | 0.389 | 0.492  | 0.542  | 0.564  | 0.587 | 0.479 | 100.0%  | 10    |
1087   | neutron.create_router        | 0.034 | 0.165  | 0.179  | 0.18   | 0.181 | 0.118 | 100.0%  | 10    |
1088   | neutron.add_interface_router | 0.273 | 0.398  | 0.459  | 0.475  | 0.492 | 0.378 | 100.0%  | 10    |
1089   | neutron.list_routers         | 0.042 | 0.111  | 0.208  | 0.214  | 0.219 | 0.12  | 100.0%  | 10    |
1090   | total                        | 0.873 | 1.083  | 1.266  | 1.32   | 1.373 | 1.095 | 100.0%  | 10    |
1091   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1092   Load duration: 3.14495706558
1093   Full duration: 27.2623529434
1094
1095   test scenario NeutronNetworks.create_and_delete_routers
1096   +------------------------------------------------------------------------------------------------------+
1097   |                                         Response Times (sec)                                         |
1098   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1099   | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1100   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1101   | neutron.create_subnet           | 0.421 | 0.528  | 0.576  | 0.593  | 0.609 | 0.516 | 100.0%  | 10    |
1102   | neutron.create_router           | 0.037 | 0.174  | 0.193  | 0.194  | 0.196 | 0.138 | 100.0%  | 10    |
1103   | neutron.add_interface_router    | 0.372 | 0.44   | 0.726  | 0.729  | 0.732 | 0.499 | 100.0%  | 10    |
1104   | neutron.remove_interface_router | 0.231 | 0.385  | 0.445  | 0.495  | 0.545 | 0.365 | 100.0%  | 10    |
1105   | neutron.delete_router           | 0.155 | 0.243  | 0.363  | 0.374  | 0.385 | 0.257 | 100.0%  | 10    |
1106   | total                           | 1.492 | 1.722  | 2.126  | 2.135  | 2.145 | 1.776 | 100.0%  | 10    |
1107   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1108   Load duration: 5.06723308563
1109   Full duration: 27.7173280716
1110
1111   test scenario NeutronNetworks.create_and_list_ports
1112   +------------------------------------------------------------------------------------------+
1113   |                                   Response Times (sec)                                   |
1114   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1115   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1116   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1117   | neutron.create_port | 0.429 | 0.479  | 0.682  | 0.709  | 0.736 | 0.518 | 100.0%  | 10    |
1118   | neutron.list_ports  | 0.101 | 0.302  | 0.368  | 0.377  | 0.386 | 0.267 | 100.0%  | 10    |
1119   | total               | 0.565 | 0.819  | 0.9    | 0.971  | 1.042 | 0.785 | 100.0%  | 10    |
1120   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1121   Load duration: 2.22692918777
1122   Full duration: 25.9097590446
1123
1124   test scenario NeutronNetworks.create_and_delete_subnets
1125   +--------------------------------------------------------------------------------------------+
1126   |                                    Response Times (sec)                                    |
1127   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1128   | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1129   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1130   | neutron.create_subnet | 0.383 | 0.414  | 0.558  | 0.562  | 0.565 | 0.439 | 100.0%  | 10    |
1131   | neutron.delete_subnet | 0.134 | 0.271  | 0.307  | 0.34   | 0.372 | 0.235 | 100.0%  | 10    |
1132   | total                 | 0.522 | 0.677  | 0.872  | 0.901  | 0.93  | 0.674 | 100.0%  | 10    |
1133   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1134   Load duration: 1.97971510887
1135   Full duration: 24.8733260632
1136
1137   test scenario NeutronNetworks.create_and_delete_networks
1138   +---------------------------------------------------------------------------------------------+
1139   |                                    Response Times (sec)                                     |
1140   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1141   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1142   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1143   | neutron.create_network | 0.3   | 0.32   | 0.403  | 0.407  | 0.411 | 0.338 | 100.0%  | 10    |
1144   | neutron.delete_network | 0.107 | 0.248  | 0.316  | 0.32   | 0.325 | 0.228 | 100.0%  | 10    |
1145   | total                  | 0.411 | 0.556  | 0.697  | 0.698  | 0.699 | 0.566 | 100.0%  | 10    |
1146   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1147   Load duration: 1.71673607826
1148   Full duration: 13.4693968296
1149
1150   test scenario NeutronNetworks.create_and_list_networks
1151   +---------------------------------------------------------------------------------------------+
1152   |                                    Response Times (sec)                                     |
1153   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1154   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1155   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1156   | neutron.create_network | 0.279 | 0.326  | 0.389  | 0.406  | 0.423 | 0.334 | 100.0%  | 10    |
1157   | neutron.list_networks  | 0.043 | 0.11   | 0.18   | 0.187  | 0.194 | 0.112 | 100.0%  | 10    |
1158   | total                  | 0.328 | 0.437  | 0.564  | 0.59   | 0.617 | 0.446 | 100.0%  | 10    |
1159   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1160   Load duration: 1.4160130024
1161   Full duration: 15.1821639538
1162
1163   test scenario NeutronNetworks.create_and_update_routers
1164   +---------------------------------------------------------------------------------------------------+
1165   |                                       Response Times (sec)                                        |
1166   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1167   | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1168   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1169   | neutron.create_subnet        | 0.401 | 0.436  | 0.454  | 0.473  | 0.492 | 0.433 | 100.0%  | 10    |
1170   | neutron.create_router        | 0.035 | 0.175  | 0.181  | 0.186  | 0.191 | 0.123 | 100.0%  | 10    |
1171   | neutron.add_interface_router | 0.293 | 0.416  | 0.46   | 0.461  | 0.461 | 0.401 | 100.0%  | 10    |
1172   | neutron.update_router        | 0.131 | 0.215  | 0.311  | 0.331  | 0.35  | 0.219 | 100.0%  | 10    |
1173   | total                        | 1.012 | 1.171  | 1.336  | 1.359  | 1.381 | 1.176 | 100.0%  | 10    |
1174   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1175   Load duration: 3.52523398399
1176   Full duration: 28.7934508324
1177
1178   test scenario NeutronNetworks.create_and_update_networks
1179   +---------------------------------------------------------------------------------------------+
1180   |                                    Response Times (sec)                                     |
1181   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1182   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1183   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1184   | neutron.create_network | 0.299 | 0.338  | 0.397  | 0.408  | 0.418 | 0.346 | 100.0%  | 10    |
1185   | neutron.update_network | 0.095 | 0.24   | 0.297  | 0.299  | 0.302 | 0.202 | 100.0%  | 10    |
1186   | total                  | 0.41  | 0.543  | 0.699  | 0.707  | 0.714 | 0.549 | 100.0%  | 10    |
1187   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1188   Load duration: 1.61482715607
1189   Full duration: 15.459831953
1190
1191   test scenario NeutronNetworks.create_and_update_ports
1192   +------------------------------------------------------------------------------------------+
1193   |                                   Response Times (sec)                                   |
1194   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1195   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1196   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1197   | neutron.create_port | 0.436 | 0.465  | 0.588  | 0.595  | 0.601 | 0.487 | 100.0%  | 10    |
1198   | neutron.update_port | 0.114 | 0.282  | 0.317  | 0.326  | 0.335 | 0.255 | 100.0%  | 10    |
1199   | total               | 0.576 | 0.751  | 0.862  | 0.899  | 0.936 | 0.742 | 100.0%  | 10    |
1200   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1201   Load duration: 2.15260481834
1202   Full duration: 25.8613479137
1203
1204   test scenario NeutronNetworks.create_and_list_subnets
1205   +--------------------------------------------------------------------------------------------+
1206   |                                    Response Times (sec)                                    |
1207   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1208   | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1209   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1210   | neutron.create_subnet | 0.4   | 0.495  | 0.538  | 0.551  | 0.564 | 0.483 | 100.0%  | 10    |
1211   | neutron.list_subnets  | 0.065 | 0.217  | 0.28   | 0.319  | 0.357 | 0.22  | 100.0%  | 10    |
1212   | total                 | 0.563 | 0.718  | 0.793  | 0.798  | 0.802 | 0.703 | 100.0%  | 10    |
1213   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1214   Load duration: 2.06506896019
1215   Full duration: 25.971654892
1216
1217   test scenario NeutronNetworks.create_and_update_subnets
1218   +--------------------------------------------------------------------------------------------+
1219   |                                    Response Times (sec)                                    |
1220   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1221   | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1222   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1223   | neutron.create_subnet | 0.398 | 0.465  | 0.543  | 0.564  | 0.584 | 0.475 | 100.0%  | 10    |
1224   | neutron.update_subnet | 0.152 | 0.178  | 0.348  | 0.366  | 0.383 | 0.234 | 100.0%  | 10    |
1225   | total                 | 0.557 | 0.693  | 0.85   | 0.867  | 0.883 | 0.709 | 100.0%  | 10    |
1226   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1227   Load duration: 2.06711506844
1228   Full duration: 25.9731898308
1229
1230   run_rally - INFO - Test scenario: "neutron" OK.
1231   run_rally - INFO - Starting test scenario "nova" ...
1232   run_rally - INFO -
1233    Preparing input task
1234    Task  84ecab73-326c-41f9-9d80-ffb7b41c7f0d: started
1235   Task 84ecab73-326c-41f9-9d80-ffb7b41c7f0d: finished
1236
1237   test scenario NovaKeypair.create_and_delete_keypair
1238   +------------------------------------------------------------------------------------------+
1239   |                                   Response Times (sec)                                   |
1240   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1241   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1242   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1243   | nova.create_keypair | 0.374 | 0.484  | 0.667  | 0.672  | 0.678 | 0.503 | 100.0%  | 10    |
1244   | nova.delete_keypair | 0.016 | 0.021  | 0.025  | 0.027  | 0.028 | 0.021 | 100.0%  | 10    |
1245   | total               | 0.399 | 0.51   | 0.687  | 0.692  | 0.698 | 0.524 | 100.0%  | 10    |
1246   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1247   Load duration: 1.59278798103
1248   Full duration: 15.4121351242
1249
1250   test scenario NovaServers.snapshot_server
1251   +--------------------------------------------------------------------------------------------------+
1252   |                                       Response Times (sec)                                       |
1253   +------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
1254   | action                 | min    | median | 90%ile  | 95%ile  | max    | avg    | success | count |
1255   +------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
1256   | nova.boot_server       | 9.938  | 10.314 | 11.977  | 12.384  | 12.791 | 10.711 | 100.0%  | 10    |
1257   | nova.create_image      | 33.802 | 39.898 | 69.264  | 70.135  | 71.005 | 45.583 | 100.0%  | 10    |
1258   | nova.delete_server     | 2.408  | 2.848  | 3.266   | 4.121   | 4.975  | 2.967  | 100.0%  | 10    |
1259   | nova.boot_server (2)   | 19.438 | 33.013 | 43.809  | 46.043  | 48.276 | 33.839 | 100.0%  | 10    |
1260   | nova.delete_server (2) | 2.395  | 2.453  | 4.821   | 4.891   | 4.961  | 3.009  | 100.0%  | 10    |
1261   | nova.delete_image      | 0.264  | 0.373  | 0.749   | 1.036   | 1.323  | 0.484  | 100.0%  | 10    |
1262   | total                  | 70.267 | 96.724 | 117.768 | 118.599 | 119.43 | 96.593 | 100.0%  | 10    |
1263   +------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
1264   Load duration: 280.300797939
1265   Full duration: 304.846863985
1266
1267   test scenario NovaKeypair.boot_and_delete_server_with_keypair
1268   +---------------------------------------------------------------------------------------------+
1269   |                                    Response Times (sec)                                     |
1270   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1271   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1272   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1273   | nova.create_keypair | 0.406  | 0.458  | 0.533  | 0.575  | 0.616  | 0.474  | 100.0%  | 10    |
1274   | nova.boot_server    | 8.324  | 10.158 | 11.335 | 11.766 | 12.197 | 10.115 | 100.0%  | 10    |
1275   | nova.delete_server  | 2.382  | 2.425  | 2.618  | 2.621  | 2.625  | 2.456  | 100.0%  | 10    |
1276   | nova.delete_keypair | 0.014  | 0.019  | 0.028  | 0.029  | 0.029  | 0.02   | 100.0%  | 10    |
1277   | total               | 11.352 | 13.038 | 14.228 | 14.667 | 15.107 | 13.066 | 100.0%  | 10    |
1278   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1279   Load duration: 39.3250300884
1280   Full duration: 62.0274989605
1281
1282   test scenario NovaKeypair.create_and_list_keypairs
1283   +------------------------------------------------------------------------------------------+
1284   |                                   Response Times (sec)                                   |
1285   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1286   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1287   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1288   | nova.create_keypair | 0.389 | 0.483  | 0.646  | 0.673  | 0.701 | 0.503 | 100.0%  | 10    |
1289   | nova.list_keypairs  | 0.013 | 0.018  | 0.021  | 0.024  | 0.027 | 0.018 | 100.0%  | 10    |
1290   | total               | 0.405 | 0.504  | 0.659  | 0.688  | 0.716 | 0.521 | 100.0%  | 10    |
1291   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1292   Load duration: 1.55672502518
1293   Full duration: 16.8414058685
1294
1295   test scenario NovaServers.list_servers
1296   +----------------------------------------------------------------------------------------+
1297   |                                  Response Times (sec)                                  |
1298   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1299   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1300   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1301   | nova.list_servers | 0.604 | 0.661  | 0.751  | 0.753  | 0.755 | 0.667 | 100.0%  | 10    |
1302   | total             | 0.604 | 0.661  | 0.751  | 0.753  | 0.755 | 0.667 | 100.0%  | 10    |
1303   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1304   Load duration: 1.98178386688
1305   Full duration: 66.4639019966
1306
1307   test scenario NovaServers.resize_server
1308   +---------------------------------------------------------------------------------------------+
1309   |                                    Response Times (sec)                                     |
1310   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1311   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1312   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1313   | nova.boot_server    | 8.516  | 10.952 | 12.492 | 12.717 | 12.943 | 11.085 | 100.0%  | 10    |
1314   | nova.resize         | 21.055 | 26.446 | 42.177 | 42.263 | 42.349 | 29.612 | 100.0%  | 10    |
1315   | nova.resize_confirm | 2.392  | 2.451  | 2.573  | 2.592  | 2.611  | 2.47   | 100.0%  | 10    |
1316   | nova.delete_server  | 2.375  | 2.427  | 2.595  | 2.673  | 2.751  | 2.475  | 100.0%  | 10    |
1317   | total               | 34.884 | 42.48  | 59.742 | 59.88  | 60.019 | 45.642 | 100.0%  | 10    |
1318   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1319   Load duration: 133.771182775
1320   Full duration: 147.319270134
1321
1322   test scenario NovaServers.boot_server_from_volume_and_delete
1323   +----------------------------------------------------------------------------------------------+
1324   |                                     Response Times (sec)                                     |
1325   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1326   | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1327   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1328   | cinder.create_volume | 3.421  | 5.82   | 6.128  | 6.151  | 6.173  | 5.197  | 100.0%  | 10    |
1329   | nova.boot_server     | 13.462 | 15.116 | 17.314 | 17.513 | 17.711 | 15.217 | 100.0%  | 10    |
1330   | nova.delete_server   | 4.532  | 4.689  | 6.776  | 6.8    | 6.823  | 5.275  | 100.0%  | 10    |
1331   | total                | 21.563 | 26.332 | 28.183 | 28.315 | 28.446 | 25.689 | 100.0%  | 10    |
1332   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1333   Load duration: 76.1264929771
1334   Full duration: 105.501106024
1335
1336   test scenario NovaServers.boot_and_migrate_server
1337   +---------------------------------------------------------------------------------------------+
1338   |                                    Response Times (sec)                                     |
1339   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1340   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1341   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1342   | nova.boot_server    | 8.668  | 10.279 | 12.669 | 12.746 | 12.824 | 10.808 | 100.0%  | 10    |
1343   | nova.stop_server    | 4.695  | 14.48  | 15.73  | 15.737 | 15.745 | 11.929 | 100.0%  | 10    |
1344   | nova.migrate        | 16.259 | 18.003 | 25.275 | 25.347 | 25.419 | 19.085 | 100.0%  | 10    |
1345   | nova.resize_confirm | 2.394  | 2.416  | 2.564  | 2.604  | 2.644  | 2.46   | 100.0%  | 10    |
1346   | nova.delete_server  | 2.383  | 2.408  | 2.55   | 2.58   | 2.61   | 2.448  | 100.0%  | 10    |
1347   | total               | 35.744 | 47.034 | 56.397 | 57.427 | 58.457 | 46.73  | 100.0%  | 10    |
1348   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1349   Load duration: 131.940564156
1350   Full duration: 145.82509613
1351
1352   test scenario NovaServers.boot_and_delete_server
1353   +--------------------------------------------------------------------------------------------+
1354   |                                    Response Times (sec)                                    |
1355   +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1356   | action             | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1357   +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1358   | nova.boot_server   | 8.359  | 10.277 | 11.312 | 11.367 | 11.422 | 10.063 | 100.0%  | 10    |
1359   | nova.delete_server | 2.388  | 2.607  | 4.826  | 4.853  | 4.881  | 3.21   | 100.0%  | 10    |
1360   | total              | 11.023 | 12.798 | 15.929 | 16.116 | 16.303 | 13.273 | 100.0%  | 10    |
1361   +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1362   Load duration: 39.1904668808
1363   Full duration: 62.8628950119
1364
1365   test scenario NovaServers.boot_and_rebuild_server
1366   +---------------------------------------------------------------------------------------------+
1367   |                                    Response Times (sec)                                     |
1368   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1369   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1370   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1371   | nova.boot_server    | 8.636  | 9.789  | 12.354 | 12.414 | 12.474 | 10.12  | 100.0%  | 10    |
1372   | nova.rebuild_server | 11.032 | 13.82  | 21.821 | 22.321 | 22.821 | 16.342 | 100.0%  | 10    |
1373   | nova.delete_server  | 2.382  | 2.461  | 2.664  | 2.759  | 2.854  | 2.524  | 100.0%  | 10    |
1374   | total               | 24.342 | 28.632 | 33.812 | 34.242 | 34.671 | 28.986 | 100.0%  | 10    |
1375   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1376   Load duration: 82.0937809944
1377   Full duration: 105.129650116
1378
1379   test scenario NovaSecGroup.create_and_list_secgroups
1380   +--------------------------------------------------------------------------------------------------------+
1381   |                                          Response Times (sec)                                          |
1382   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1383   | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1384   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1385   | nova.create_10_security_groups | 1.596  | 2.105  | 2.35   | 2.351  | 2.352  | 2.061  | 100.0%  | 10    |
1386   | nova.create_100_rules          | 8.873  | 10.349 | 10.555 | 10.65  | 10.745 | 10.067 | 100.0%  | 10    |
1387   | nova.list_security_groups      | 0.129  | 0.183  | 0.281  | 0.318  | 0.354  | 0.201  | 100.0%  | 10    |
1388   | total                          | 11.189 | 12.51  | 12.822 | 12.823 | 12.823 | 12.329 | 100.0%  | 10    |
1389   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1390   Load duration: 36.4927339554
1391   Full duration: 63.6400220394
1392
1393   test scenario NovaSecGroup.create_and_delete_secgroups
1394   +-------------------------------------------------------------------------------------------------------+
1395   |                                         Response Times (sec)                                          |
1396   +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1397   | action                         | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1398   +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1399   | nova.create_10_security_groups | 1.326 | 1.779  | 1.959  | 1.983  | 2.006  | 1.748  | 100.0%  | 10    |
1400   | nova.create_100_rules          | 9.29  | 10.389 | 10.656 | 10.731 | 10.805 | 10.241 | 100.0%  | 10    |
1401   | nova.delete_10_security_groups | 0.833 | 0.896  | 1.02   | 1.03   | 1.04   | 0.918  | 100.0%  | 10    |
1402   | total                          | 11.55 | 13.143 | 13.488 | 13.549 | 13.611 | 12.907 | 100.0%  | 10    |
1403   +--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1404   Load duration: 38.0758161545
1405   Full duration: 52.9351670742
1406
1407   test scenario NovaServers.boot_and_bounce_server
1408   +----------------------------------------------------------------------------------------------------+
1409   |                                        Response Times (sec)                                        |
1410   +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1411   | action                  | min    | median | 90%ile  | 95%ile  | max     | avg    | success | count |
1412   +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1413   | nova.boot_server        | 8.49   | 12.054 | 12.335  | 12.336  | 12.338  | 11.077 | 100.0%  | 10    |
1414   | nova.reboot_server      | 4.412  | 4.746  | 6.676   | 6.794   | 6.912   | 5.252  | 100.0%  | 10    |
1415   | nova.soft_reboot_server | 6.592  | 7.729  | 125.626 | 125.9   | 126.174 | 31.142 | 100.0%  | 10    |
1416   | nova.stop_server        | 4.709  | 4.817  | 4.999   | 5.006   | 5.013   | 4.835  | 100.0%  | 10    |
1417   | nova.start_server       | 2.636  | 3.348  | 4.108   | 4.153   | 4.198   | 3.361  | 100.0%  | 10    |
1418   | nova.rescue_server      | 6.613  | 6.787  | 17.596  | 17.726  | 17.855  | 11.037 | 100.0%  | 10    |
1419   | nova.unrescue_server    | 2.324  | 4.485  | 6.647   | 6.653   | 6.659   | 4.948  | 100.0%  | 10    |
1420   | nova.delete_server      | 2.375  | 2.416  | 4.666   | 4.731   | 4.797   | 3.1    | 100.0%  | 10    |
1421   | total                   | 39.617 | 54.891 | 166.239 | 170.845 | 175.451 | 74.764 | 100.0%  | 10    |
1422   +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1423   Load duration: 241.107405901
1424   Full duration: 264.433083773
1425
1426   test scenario NovaServers.boot_server
1427   +-----------------------------------------------------------------------------------------+
1428   |                                  Response Times (sec)                                   |
1429   +------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1430   | action           | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1431   +------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1432   | nova.boot_server | 9.537 | 9.723  | 12.302 | 12.597 | 12.891 | 10.539 | 100.0%  | 10    |
1433   | total            | 9.537 | 9.723  | 12.302 | 12.597 | 12.891 | 10.539 | 100.0%  | 10    |
1434   +------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1435   Load duration: 31.5377810001
1436   Full duration: 56.3936619759
1437
1438   test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
1439   +-----------------------------------------------------------------------------------------------------------+
1440   |                                           Response Times (sec)                                            |
1441   +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1442   | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1443   +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1444   | nova.create_10_security_groups    | 1.677  | 1.957  | 2.26   | 2.317  | 2.373  | 1.975  | 100.0%  | 10    |
1445   | nova.create_100_rules             | 9.032  | 10.031 | 10.512 | 10.585 | 10.658 | 9.992  | 100.0%  | 10    |
1446   | nova.boot_server                  | 8.152  | 11.436 | 11.645 | 11.66  | 11.675 | 10.446 | 100.0%  | 10    |
1447   | nova.get_attached_security_groups | 0.145  | 0.154  | 0.17   | 0.185  | 0.2    | 0.158  | 100.0%  | 10    |
1448   | nova.delete_server                | 2.412  | 4.581  | 4.637  | 4.667  | 4.696  | 3.741  | 100.0%  | 10    |
1449   | nova.delete_10_security_groups    | 0.791  | 0.902  | 0.983  | 0.993  | 1.003  | 0.901  | 100.0%  | 10    |
1450   | total                             | 22.687 | 29.402 | 29.574 | 29.639 | 29.704 | 27.213 | 100.0%  | 10    |
1451   +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1452   Load duration: 81.6792809963
1453   Full duration: 106.045881033
1454
1455   test scenario NovaServers.pause_and_unpause_server
1456   +---------------------------------------------------------------------------------------------+
1457   |                                    Response Times (sec)                                     |
1458   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1459   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1460   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1461   | nova.boot_server    | 9.557  | 11.959 | 12.616 | 12.617 | 12.618 | 11.399 | 100.0%  | 10    |
1462   | nova.pause_server   | 2.3    | 2.488  | 2.647  | 2.73   | 2.813  | 2.485  | 100.0%  | 10    |
1463   | nova.unpause_server | 2.313  | 2.338  | 2.459  | 2.519  | 2.579  | 2.376  | 100.0%  | 10    |
1464   | nova.delete_server  | 2.379  | 4.554  | 4.593  | 4.6    | 4.608  | 3.72   | 100.0%  | 10    |
1465   | total               | 16.731 | 21.47  | 21.938 | 22.069 | 22.201 | 19.98  | 100.0%  | 10    |
1466   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1467   Load duration: 60.1143479347
1468   Full duration: 84.1553788185
1469
1470   test scenario NovaServers.boot_server_from_volume
1471   +----------------------------------------------------------------------------------------------+
1472   |                                     Response Times (sec)                                     |
1473   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1474   | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1475   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1476   | cinder.create_volume | 3.296  | 3.584  | 6.23   | 6.254  | 6.278  | 4.296  | 100.0%  | 10    |
1477   | nova.boot_server     | 13.316 | 14.103 | 15.99  | 16.029 | 16.068 | 14.371 | 100.0%  | 10    |
1478   | total                | 16.8   | 18.338 | 20.779 | 21.536 | 22.293 | 18.667 | 100.0%  | 10    |
1479   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1480   Load duration: 55.7340800762
1481   Full duration: 89.9920220375
1482
1483   test scenario NovaServers.boot_and_list_server
1484   +------------------------------------------------------------------------------------------+
1485   |                                   Response Times (sec)                                   |
1486   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1487   | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1488   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1489   | nova.boot_server  | 8.714 | 10.615 | 12.468 | 12.501 | 12.535 | 10.613 | 100.0%  | 10    |
1490   | nova.list_servers | 0.14  | 0.241  | 0.434  | 0.454  | 0.474  | 0.274  | 100.0%  | 10    |
1491   | total             | 8.854 | 10.943 | 12.715 | 12.756 | 12.798 | 10.887 | 100.0%  | 10    |
1492   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1493   Load duration: 30.5609071255
1494   Full duration: 64.9602191448
1495
1496   run_rally - INFO - Test scenario: "nova" OK.
1497
1498   run_rally - INFO - Starting test scenario "quotas" ...
1499   run_rally - INFO -
1500    Preparing input task
1501    Task  98d9ffba-dd50-429a-ab90-4549e00b19cf: started
1502   Task 98d9ffba-dd50-429a-ab90-4549e00b19cf: finished
1503
1504   test scenario Quotas.cinder_update
1505   +------------------------------------------------------------------------------------------+
1506   |                                   Response Times (sec)                                   |
1507   +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
1508   | action               | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
1509   +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
1510   | quotas.update_quotas | 0.58 | 0.646  | 0.661  | 0.671  | 0.682 | 0.636 | 100.0%  | 10    |
1511   | total                | 0.58 | 0.646  | 0.661  | 0.671  | 0.682 | 0.636 | 100.0%  | 10    |
1512   +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
1513   Load duration: 1.98423290253
1514   Full duration: 7.3744559288
1515
1516   test scenario Quotas.neutron_update
1517   +-------------------------------------------------------------------------------------------+
1518   |                                   Response Times (sec)                                    |
1519   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1520   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1521   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1522   | quotas.update_quotas | 0.232 | 0.251  | 0.276  | 0.281  | 0.286 | 0.254 | 100.0%  | 10    |
1523   | total                | 0.295 | 0.324  | 0.348  | 0.352  | 0.355 | 0.325 | 100.0%  | 10    |
1524   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1525   Load duration: 0.987355947495
1526   Full duration: 6.55621004105
1527
1528   test scenario Quotas.cinder_update_and_delete
1529   +-------------------------------------------------------------------------------------------+
1530   |                                   Response Times (sec)                                    |
1531   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1532   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1533   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1534   | quotas.update_quotas | 0.609 | 0.648  | 0.736  | 0.755  | 0.775 | 0.663 | 100.0%  | 10    |
1535   | quotas.delete_quotas | 0.267 | 0.474  | 0.498  | 0.518  | 0.539 | 0.454 | 100.0%  | 10    |
1536   | total                | 0.95  | 1.099  | 1.254  | 1.262  | 1.271 | 1.117 | 100.0%  | 10    |
1537   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1538   Load duration: 3.2654209137
1539   Full duration: 8.84793901443
1540
1541   test scenario Quotas.nova_update_and_delete
1542   +-------------------------------------------------------------------------------------------+
1543   |                                   Response Times (sec)                                    |
1544   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1545   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1546   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1547   | quotas.update_quotas | 0.319 | 0.353  | 0.393  | 0.4    | 0.408 | 0.358 | 100.0%  | 8     |
1548   | quotas.delete_quotas | 0.015 | 0.025  | 0.031  | 0.032  | 0.033 | 0.025 | 75.0%   | 8     |
1549   | total                | 0.351 | 0.366  | 0.405  | 0.416  | 0.428 | 0.374 | 75.0%   | 8     |
1550   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1551   Load duration: 0.80732011795
1552   Full duration: 6.24122095108
1553
1554   test scenario Quotas.nova_update
1555   +-------------------------------------------------------------------------------------------+
1556   |                                   Response Times (sec)                                    |
1557   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1558   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1559   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1560   | quotas.update_quotas | 0.346 | 0.366  | 0.413  | 0.414  | 0.416 | 0.373 | 100.0%  | 10    |
1561   | total                | 0.346 | 0.366  | 0.413  | 0.414  | 0.416 | 0.373 | 100.0%  | 10    |
1562   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1563   Load duration: 1.10930514336
1564   Full duration: 6.21793103218
1565
1566   run_rally - INFO - Test scenario: "quotas" Failed.
1567   run_rally - INFO - Starting test scenario "requests" ...
1568   run_rally - INFO -
1569    Preparing input task
1570    Task  712d1722-52e2-4e3a-93dc-515e3fea5977: started
1571   Task 712d1722-52e2-4e3a-93dc-515e3fea5977: finished
1572
1573   test scenario HttpRequests.check_random_request
1574   +--------------------------------------------------------------------------------------------+
1575   |                                    Response Times (sec)                                    |
1576   +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
1577   | action                 | min   | median | 90%ile | 95%ile | max   | avg  | success | count |
1578   +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
1579   | requests.check_request | 5.462 | 5.488  | 5.976  | 5.991  | 6.006 | 5.59 | 100.0%  | 10    |
1580   | total                  | 5.462 | 5.488  | 5.976  | 5.991  | 6.006 | 5.59 | 100.0%  | 10    |
1581   +------------------------+-------+--------+--------+--------+-------+------+---------+-------+
1582   Load duration: 16.976375103
1583   Full duration: 19.3119690418
1584
1585   test scenario HttpRequests.check_request
1586   +---------------------------------------------------------------------------------------------+
1587   |                                    Response Times (sec)                                     |
1588   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1589   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1590   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1591   | requests.check_request | 5.466 | 5.48   | 5.487  | 5.491  | 5.496 | 5.479 | 100.0%  | 10    |
1592   | total                  | 5.466 | 5.48   | 5.487  | 5.491  | 5.496 | 5.479 | 100.0%  | 10    |
1593   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1594   Load duration: 16.4575350285
1595   Full duration: 18.7219369411
1596
1597   run_rally - INFO - Test scenario: "requests" OK.
1598   run_rally - INFO -
1599
1600                        Rally Summary Report
1601   +===================+============+===============+===========+
1602   | Module            | Duration   | nb. Test Run  | Success   |
1603   +===================+============+===============+===========+
1604   | authenticate      | 00:17      | 10            | 100.00%   |
1605   +-------------------+------------+---------------+-----------+
1606   | glance            | 01:45      | 7             | 100.00%   |
1607   +-------------------+------------+---------------+-----------+
1608   | cinder            | 17:38      | 50            | 100.00%   |
1609   +-------------------+------------+---------------+-----------+
1610   | heat              | 06:53      | 32            | 92.31%    |
1611   +-------------------+------------+---------------+-----------+
1612   | keystone          | 01:07      | 29            | 100.00%   |
1613   +-------------------+------------+---------------+-----------+
1614   | neutron           | 04:41      | 31            | 100.00%   |
1615   +-------------------+------------+---------------+-----------+
1616   | nova              | 30:14      | 61            | 100.00%   |
1617   +-------------------+------------+---------------+-----------+
1618   | quotas            | 00:35      | 7             | 95.00%    |
1619   +-------------------+------------+---------------+-----------+
1620   | requests          | 00:38      | 2             | 100.00%   |
1621   +-------------------+------------+---------------+-----------+
1622   +===================+============+===============+===========+
1623   | TOTAL:            | 01:03:52   | 229           | 98.59%    |
1624   +===================+============+===============+===========+
1625
1626
1627
1628 Feature tests
1629 -------------
1630
1631 vIMS
1632 ^^^^
1633 ::
1634
1635   FUNCTEST.info: Running vIMS test...
1636   vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
1637   vIMS - INFO - Update OpenStack creds informations
1638   vIMS - INFO - Upload some OS images if it doesn't exist
1639   vIMS - INFO - centos_7 image doesn't exist on glance repository.
1640                               Try downloading this image and upload on glance !
1641   vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
1642                               Try downloading this image and upload on glance !
1643   vIMS - INFO - Update security group quota for this tenant
1644   vIMS - INFO - Update cinder quota for this tenant
1645   vIMS - INFO - Collect flavor id for cloudify manager server
1646   vIMS - INFO - Prepare virtualenv for cloudify-cli
1647   vIMS - INFO - Downloading the cloudify manager server blueprint
1648   vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 04:47:07'
1649   vIMS - INFO - Writing the inputs file
1650   vIMS - INFO - Launching the cloudify-manager deployment
1651   vIMS - INFO - Cloudify-manager server is UP !
1652   vIMS - INFO - Cloudify deployment duration:'432.5'
1653   vIMS - INFO - Collect flavor id for all clearwater vm
1654   vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 04:54:20'
1655   vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
1656   vIMS - INFO - Writing the inputs file
1657   vIMS - INFO - Launching the clearwater deployment
1658   vIMS - INFO - The deployment of clearwater-opnfv is ended
1659   vIMS - INFO - vIMS VNF deployment duration:'616.2'
1660   vIMS - INFO - vIMS functional test Start Time:'2016-02-23 05:07:44'
1661   vIMS - INFO - vIMS functional test duration:'3.5'
1662   vIMS - INFO - Launching the clearwater-opnfv undeployment
1663   vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
1664   vIMS - INFO - Launching the cloudify-manager undeployment
1665   vIMS - INFO - Cloudify-manager server has been successfully removed!
1666   vIMS - INFO - Removing vIMS tenant ..
1667   vIMS - INFO - Removing vIMS user ..