Moving testusage.rst to introduction.rst to avoid being pulled into the userguide.
[functest.git] / docs / results / compass-os-odl_l2-nofeature-ha.rst
1 .. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
2 .. http://creativecommons.org/licenses/by/4.0
3
4 Detailed test results for compass-os-odl_l2-nofeature-ha
5 ========================================================
6
7 Running test case: vping_ssh
8 ----------------------------
9
10 ::
11   FUNCTEST.info: Running vPing-SSH test...
12   2016-02-10 22:41:11,118 - vPing_ssh- DEBUG - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
13   2016-02-10 22:41:11,947 - vPing_ssh- DEBUG - Image 'functest-vping' with ID=e900cadf-5723-426e-b269-df5aee4a8af3 created successfully.
14   2016-02-10 22:41:12,053 - vPing_ssh- INFO - Creating neutron network vping-net...
15   2016-02-10 22:41:12,551 - vPing_ssh- DEBUG - Network '91e17a47-73f4-4e27-bcc3-345ad77b4e95' created successfully
16   2016-02-10 22:41:12,551 - vPing_ssh- DEBUG - Creating Subnet....
17   2016-02-10 22:41:12,935 - vPing_ssh- DEBUG - Subnet '2ef1274b-31b7-4f19-8acc-be0e756ee9fd' created successfully
18   2016-02-10 22:41:12,935 - vPing_ssh- DEBUG - Creating Router...
19   2016-02-10 22:41:12,990 - vPing_ssh- DEBUG - Router '16002c8b-fd20-49d5-a36c-97c7f30c0578' created successfully
20   2016-02-10 22:41:12,990 - vPing_ssh- DEBUG - Adding router to subnet...
21   2016-02-10 22:41:13,262 - vPing_ssh- DEBUG - Interface added successfully.
22   2016-02-10 22:41:13,262 - vPing_ssh- DEBUG - Adding gateway to router...
23   2016-02-10 22:41:13,737 - vPing_ssh- DEBUG - Gateway added successfully.
24   2016-02-10 22:41:13,912 - vPing_ssh- INFO - Flavor found 'm1.small'
25   2016-02-10 22:41:14,703 - vPing_ssh- INFO - Creating security group  'vPing-sg'...
26   2016-02-10 22:41:14,859 - vPing_ssh- DEBUG - Security group 'vPing-sg' with ID=78dd100f-bdf4-44bc-8794-cc5b22a42ef6 created successfully.
27   2016-02-10 22:41:14,859 - vPing_ssh- DEBUG - Adding ICMP rules in security group 'vPing-sg'...
28   2016-02-10 22:41:14,930 - vPing_ssh- DEBUG - Adding SSH rules in security group 'vPing-sg'...
29   2016-02-10 22:41:15,089 - vPing_ssh- INFO - vPing Start Time:'2016-02-10 22:41:15'
30   2016-02-10 22:41:15,089 - vPing_ssh- DEBUG - Creating port 'vping-port-1' with IP 192.168.130.30...
31   2016-02-10 22:41:15,284 - vPing_ssh- INFO - Creating instance 'opnfv-vping-1' with IP 192.168.130.30...
32   2016-02-10 22:41:15,284 - vPing_ssh- DEBUG - Configuration:
33    name=opnfv-vping-1
34    flavor=<Flavor: m1.small>
35    image=e900cadf-5723-426e-b269-df5aee4a8af3
36    network=91e17a47-73f4-4e27-bcc3-345ad77b4e95
37
38   2016-02-10 22:41:16,649 - vPing_ssh- DEBUG - Status: BUILD
39   2016-02-10 22:41:20,440 - vPing_ssh- DEBUG - Status: ACTIVE
40   2016-02-10 22:41:20,440 - vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
41   2016-02-10 22:41:20,440 - vPing_ssh- DEBUG - Instance 'opnfv-vping-1' got 192.168.130.30
42   2016-02-10 22:41:20,440 - vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
43   2016-02-10 22:41:20,834 - vPing_ssh- DEBUG - Creating port 'vping-port-2' with IP 192.168.130.40...
44   2016-02-10 22:41:21,370 - vPing_ssh- INFO - Creating instance 'opnfv-vping-2' with IP 192.168.130.40...
45   2016-02-10 22:41:21,371 - vPing_ssh- DEBUG - Configuration:
46    name=opnfv-vping-2
47    flavor=<Flavor: m1.small>
48    image=e900cadf-5723-426e-b269-df5aee4a8af3
49    network=91e17a47-73f4-4e27-bcc3-345ad77b4e95
50
51   2016-02-10 22:41:22,575 - vPing_ssh- DEBUG - Status: BUILD
52   2016-02-10 22:41:26,400 - vPing_ssh- DEBUG - Status: ACTIVE
53   2016-02-10 22:41:26,400 - vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
54   2016-02-10 22:41:26,400 - vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
55   2016-02-10 22:41:27,208 - vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
56   2016-02-10 22:41:27,625 - vPing_ssh- INFO - Floating IP created: '192.168.10.101'
57   2016-02-10 22:41:27,626 - vPing_ssh- INFO - Associating floating ip: '192.168.10.101' to VM 'opnfv-vping-2'
58   2016-02-10 22:41:28,113 - vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.101...
59   2016-02-10 22:41:30,115 - vPing_ssh- DEBUG - Waiting for 192.168.10.101...
60   2016-02-10 22:41:36,254 - vPing_ssh- DEBUG - SSH connection established to 192.168.10.101.
61   2016-02-10 22:41:37,330 - vPing_ssh- INFO - Waiting for ping...
62   2016-02-10 22:41:38,340 - vPing_ssh- INFO - vPing detected!
63   2016-02-10 22:41:38,340 - vPing_ssh- INFO - vPing duration:'23.3' s.
64   2016-02-10 22:41:38,340 - vPing_ssh- INFO - Cleaning up...
65   2016-02-10 22:41:38,341 - vPing_ssh- DEBUG - Deleting image...
66   2016-02-10 22:41:38,933 - vPing_ssh- DEBUG - Deleting 'opnfv-vping-1'...
67   2016-02-10 22:41:43,182 - vPing_ssh- DEBUG - Instance opnfv-vping-1 terminated.
68   2016-02-10 22:41:43,987 - vPing_ssh- DEBUG - Deleting 'opnfv-vping-2'...
69   2016-02-10 22:41:47,579 - vPing_ssh- DEBUG - Instance opnfv-vping-2 terminated.
70   2016-02-10 22:41:47,579 - vPing_ssh- DEBUG - Deleting network 'vping-net'...
71   2016-02-10 22:41:47,733 - vPing_ssh- DEBUG - Port 'ce5f4b77-b1db-4b71-9064-b6808d2c7276' removed successfully
72   2016-02-10 22:41:47,981 - vPing_ssh- DEBUG - Port '2448f8c7-242e-48d2-944b-6472c61e6140' removed successfully
73   2016-02-10 22:41:48,261 - vPing_ssh- DEBUG - Interface removed successfully
74   2016-02-10 22:41:48,462 - vPing_ssh- DEBUG - Router deleted successfully
75   2016-02-10 22:41:48,735 - vPing_ssh- DEBUG - Subnet 'vping-subnet' deleted successfully
76   2016-02-10 22:41:48,933 - vPing_ssh- DEBUG - Network 'vping-net' deleted successfully
77   2016-02-10 22:41:49,030 - vPing_ssh- DEBUG - Security group '78dd100f-bdf4-44bc-8794-cc5b22a42ef6' deleted successfully
78   2016-02-10 22:41:49,030 - vPing_ssh- INFO - vPing OK
79   2016-02-10 22:41:49,030 - vPing_ssh- DEBUG - Pushing result into DB...
80   2016-02-10 22:41:49,711 - vPing_ssh- DEBUG - <Response [200]>
81 ::
82
83 Running test case: vping_userdata
84 ---------------------------------
85
86 ::
87   FUNCTEST.info: Running vPing-userdata test...
88   2016-02-10 22:41:50,210 - vPing_userdata- DEBUG - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
89   2016-02-10 22:41:51,069 - vPing_userdata- INFO - Creating neutron network vping-net...
90   2016-02-10 22:41:51,283 - vPing_userdata- DEBUG - Network '7162ccaa-ea23-4309-ba80-3e03715361bc' created successfully
91   2016-02-10 22:41:51,283 - vPing_userdata- DEBUG - Creating Subnet....
92   2016-02-10 22:41:51,414 - vPing_userdata- DEBUG - Subnet '6cbdc816-707c-4e14-9766-76a557ef1ee1' created successfully
93   2016-02-10 22:41:51,414 - vPing_userdata- DEBUG - Creating Router...
94   2016-02-10 22:41:51,457 - vPing_userdata- DEBUG - Router 'bd344d4b-e382-4368-a7a4-8d14f8e1b280' created successfully
95   2016-02-10 22:41:51,457 - vPing_userdata- DEBUG - Adding router to subnet...
96   2016-02-10 22:41:51,680 - vPing_userdata- DEBUG - Interface added successfully.
97   2016-02-10 22:41:51,969 - vPing_userdata- INFO - Flavor found 'm1.small'
98   2016-02-10 22:41:52,020 - vPing_userdata- INFO - vPing Start Time:'2016-02-10 22:41:52'
99   2016-02-10 22:41:52,020 - vPing_userdata- DEBUG - Creating port 'vping-port-1' with IP 192.168.130.30...
100   2016-02-10 22:41:52,278 - vPing_userdata- INFO - Creating instance 'opnfv-vping-1' with IP 192.168.130.30...
101   2016-02-10 22:41:52,278 - vPing_userdata- DEBUG - Configuration:
102    name=opnfv-vping-1
103    flavor=<Flavor: m1.small>
104    image=5bea5f62-77dc-4abe-b538-8770356f678e
105    network=7162ccaa-ea23-4309-ba80-3e03715361bc
106
107   2016-02-10 22:41:53,720 - vPing_userdata- DEBUG - Status: BUILD
108   2016-02-10 22:41:56,836 - vPing_userdata- DEBUG - Status: ACTIVE
109   2016-02-10 22:41:56,836 - vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
110   2016-02-10 22:41:56,836 - vPing_userdata- DEBUG - Instance 'opnfv-vping-1' got 192.168.130.30
111   2016-02-10 22:41:56,837 - vPing_userdata- DEBUG - Creating port 'vping-port-2' with IP 192.168.130.40...
112   2016-02-10 22:41:57,048 - vPing_userdata- INFO - Creating instance 'opnfv-vping-2' with IP 192.168.130.40...
113   2016-02-10 22:41:57,049 - vPing_userdata- DEBUG - Configuration:
114    name=opnfv-vping-2
115    flavor=<Flavor: m1.small>
116    image=5bea5f62-77dc-4abe-b538-8770356f678e
117    network=7162ccaa-ea23-4309-ba80-3e03715361bc
118    userdata=
119   #!/bin/sh
120
121   while true; do
122    ping -c 1 192.168.130.30 2>&1 >/dev/null
123    RES=$?
124    if [ "Z$RES" = "Z0" ] ; then
125     echo 'vPing OK'
126    break
127    else
128     echo 'vPing KO'
129    fi
130    sleep 1
131   done
132
133   2016-02-10 22:41:58,941 - vPing_userdata- DEBUG - Status: BUILD
134   2016-02-10 22:42:02,084 - vPing_userdata- DEBUG - Status: ACTIVE
135   2016-02-10 22:42:02,084 - vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
136   2016-02-10 22:42:02,084 - vPing_userdata- INFO - Waiting for ping...
137   2016-02-10 22:42:03,473 - vPing_userdata- DEBUG - Pinging 192.168.130.40. Waiting for response...
138   2016-02-10 22:42:06,431 - vPing_userdata- INFO - vPing detected!
139   2016-02-10 22:42:06,431 - vPing_userdata- INFO - vPing duration:'14.4'
140   2016-02-10 22:42:06,431 - vPing_userdata- INFO - vPing OK
141   2016-02-10 22:42:06,431 - vPing_userdata- INFO - Cleaning up...
142   2016-02-10 22:42:06,431 - vPing_userdata- DEBUG - Deleting image...
143   2016-02-10 22:42:06,911 - vPing_userdata- DEBUG - Deleting 'opnfv-vping-1'...
144   2016-02-10 22:42:10,262 - vPing_userdata- DEBUG - Instance opnfv-vping-1 terminated.
145   2016-02-10 22:42:11,054 - vPing_userdata- DEBUG - Deleting 'opnfv-vping-2'...
146   2016-02-10 22:42:15,311 - vPing_userdata- DEBUG - Instance opnfv-vping-2 terminated.
147   2016-02-10 22:42:15,311 - vPing_userdata- INFO - Deleting network 'vping-net'...
148   2016-02-10 22:42:15,457 - vPing_userdata- DEBUG - Port 'ddc5ecfa-6678-432e-aad0-51d1c1c94dfd' removed successfully
149   2016-02-10 22:42:15,611 - vPing_userdata- DEBUG - Port '0ebb366d-2e52-4dc6-9c3f-34d0c8c01a00' removed successfully
150   2016-02-10 22:42:15,817 - vPing_userdata- DEBUG - Interface removed successfully
151   2016-02-10 22:42:16,011 - vPing_userdata- DEBUG - Router deleted successfully
152   2016-02-10 22:42:16,222 - vPing_userdata- DEBUG - Subnet 'vping-subnet' deleted successfully
153   2016-02-10 22:42:16,443 - vPing_userdata- DEBUG - Network 'vping-net' deleted successfully
154   2016-02-10 22:42:16,443 - vPing_userdata- DEBUG - Pushing result into DB...
155   2016-02-10 22:42:17,319 - vPing_userdata- DEBUG - <Response [200]>
156 ::
157
158 Running test case: tempest
159 --------------------------
160 ::
161   FUNCTEST.info: Running Tempest tests...
162   2016-02-10 22:42:17,647 - run_tempest - INFO - Creating tenant and user for Tempest suite
163   2016-02-10 22:42:17,798 - run_tempest - DEBUG - Generating tempest.conf file...
164   2016-02-10 22:42:17,798 - run_tempest - DEBUG - Executing command : rally verify genconfig
165   2016-02-10 22:42:24,250 - run_tempest - DEBUG - 2016-02-10 22:42:18.326 23844 INFO rally.verification.tempest.tempest [-] Tempest is not configured.
166   2016-02-10 22:42:18.326 23844 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
167   2016-02-10 22:42:24.194 23844 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
168
169   2016-02-10 22:42:24,250 - run_tempest - DEBUG - Resolving deployment UUID...
170   2016-02-10 22:42:24,825 - run_tempest - DEBUG - Finding tempest.conf file...
171   2016-02-10 22:42:24,826 - run_tempest - DEBUG -   Updating fixed_network_name...
172   2016-02-10 22:42:25,075 - run_tempest - DEBUG - Executing command : crudini --set /home/opnfv/.rally/tempest/for-deployment-e76f88e3-5f6d-4757-8755-8dd8a09c6870/tempest.conf compute fixed_network_name functest-net
173   2016-02-10 22:42:25,115 - run_tempest - DEBUG -   Updating non-admin credentials...
174   2016-02-10 22:42:25,115 - run_tempest - DEBUG - Executing command : crudini --set /home/opnfv/.rally/tempest/for-deployment-e76f88e3-5f6d-4757-8755-8dd8a09c6870/tempest.conf identity tenant_name tempest
175   2016-02-10 22:42:25,142 - run_tempest - DEBUG - Executing command : crudini --set /home/opnfv/.rally/tempest/for-deployment-e76f88e3-5f6d-4757-8755-8dd8a09c6870/tempest.conf identity username tempest
176   2016-02-10 22:42:25,168 - run_tempest - DEBUG - Executing command : crudini --set /home/opnfv/.rally/tempest/for-deployment-e76f88e3-5f6d-4757-8755-8dd8a09c6870/tempest.conf identity password tempest
177   2016-02-10 22:42:25,195 - run_tempest - DEBUG - Executing command : sed -i 's/.*ssh_user_regex.*/ssh_user_regex = [["^.*[Cc]irros.*$", "cirros"], ["^.*[Tt]est[VvMm].*$", "cirros"], ["^.*rally_verify.*$", "cirros"]]/' /home/opnfv/.rally/tempest/for-deployment-e76f88e3-5f6d-4757-8755-8dd8a09c6870/tempest.conf
178   2016-02-10 22:42:25,199 - run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
179   2016-02-10 22:42:25,199 - run_tempest - DEBUG - Executing command : rally verify start --tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt
180   Total results of verification:
181
182   +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
183   | UUID                                 | Deployment UUID                      | Set name | Tests | Failures | Created at                 | Status   |
184   +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
185   | b11691a3-df31-4681-8493-e8e723d76da2 | e76f88e3-5f6d-4757-8755-8dd8a09c6870 |          | 210   | 0        | 2016-02-10 22:42:25.742171 | finished |
186   +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
187
188   Tests:
189
190   +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
191   | name                                                                                                                                     | time      | status  |
192   +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
193   | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.14508   | success |
194   | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.20886   | success |
195   | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 8.74633   | success |
196   | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 10.96331  | success |
197   | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 6.91667   | success |
198   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.06609   | success |
199   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.05652   | success |
200   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.05475   | success |
201   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 0.11525   | success |
202   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.06320   | success |
203   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.06529   | success |
204   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.07598   | success |
205   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.07994   | success |
206   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.05164   | success |
207   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.17071   | success |
208   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.07382   | success |
209   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.12124   | success |
210   | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.07097   | success |
211   | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.35923   | success |
212   | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.05248   | success |
213   | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 1.12419   | success |
214   | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 0.44629   | success |
215   | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 0.81959   | success |
216   | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 2.61632   | success |
217   | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 6.64787   | success |
218   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 60.19994  | success |
219   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.06927   | success |
220   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.17946   | success |
221   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.20048   | success |
222   | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.00062   | success |
223   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 69.94540  | success |
224   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.05355   | success |
225   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.15865   | success |
226   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.42541   | success |
227   | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.00108   | success |
228   | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.06548   | success |
229   | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 4.28395   | success |
230   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.23946   | success |
231   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.19532   | success |
232   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.15850   | success |
233   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.30121   | success |
234   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.15893   | success |
235   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.08980   | success |
236   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.06970   | success |
237   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.07757   | success |
238   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.10192   | success |
239   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.11599   | success |
240   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.30575   | success |
241   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.00066   | skip    |
242   | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.17553   | success |
243   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.06515   | success |
244   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.01091   | success |
245   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.06001   | success |
246   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.07683   | success |
247   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.01042   | success |
248   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.01260   | success |
249   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.04293   | success |
250   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.07701   | success |
251   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.07658   | success |
252   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.17401   | success |
253   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.01225   | success |
254   | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.06247   | success |
255   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.00063   | skip    |
256   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 6.81169   | success |
257   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 8.35726   | success |
258   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 9.24775   | success |
259   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 0.34307   | skip    |
260   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 17.09147  | success |
261   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 13.46313  | success |
262   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 17.64490  | success |
263   | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 6.85623   | success |
264   | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.08484   | success |
265   | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.16624   | success |
266   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.67482   | success |
267   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.34319   | success |
268   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.49805   | success |
269   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.69403   | success |
270   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.70458   | success |
271   | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.57632   | success |
272   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 2.37325   | success |
273   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 12.72787  | success |
274   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 14.59892  | success |
275   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 8.81944   | success |
276   | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 7.57375   | success |
277   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 0.68768   | success |
278   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 1.03345   | success |
279   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 0.69325   | success |
280   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 1.61747   | success |
281   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 0.74262   | success |
282   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 1.62312   | success |
283   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant                         | 0.63504   | success |
284   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 0.44757   | success |
285   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 0.44857   | success |
286   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.41970   | success |
287   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 1.59286   | success |
288   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 0.41213   | success |
289   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.53150   | success |
290   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.47482   | success |
291   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.32116   | success |
292   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 0.74411   | success |
293   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 0.37262   | success |
294   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 0.39655   | success |
295   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.56090   | success |
296   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant                           | 0.54267   | success |
297   | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 0.32880   | success |
298   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant                                    | 0.21189   | success |
299   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect                              | 0.00958   | success |
300   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image                                  | 0.06951   | success |
301   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails                                       | 0.01997   | success |
302   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails                               | 0.49170   | success |
303   | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails                               | 0.23047   | success |
304   | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.14871   | success |
305   | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.05185   | success |
306   | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 40.10260  | success |
307   | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.10161   | success |
308   | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.73083   | success |
309   | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.13569   | success |
310   | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.01176   | success |
311   | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.17854   | success |
312   | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.09300   | success |
313   | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.14146   | success |
314   | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.03207   | success |
315   | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.36702   | success |
316   | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.15345   | success |
317   | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 0.90773   | success |
318   | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.11017   | success |
319   | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.09102   | success |
320   | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list                                                | 0.14059   | success |
321   | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.20332   | success |
322   | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 0.78806   | success |
323   | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.04671   | success |
324   | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.03335   | success |
325   | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.02244   | success |
326   | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.02764   | success |
327   | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.01660   | success |
328   | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.04047   | success |
329   | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.05473   | success |
330   | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 0.45763   | success |
331   | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 0.29059   | success |
332   | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 0.43753   | success |
333   | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 0.58785   | success |
334   | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 2.37173   | success |
335   | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 1.16911   | success |
336   | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network                                             | 0.68115   | success |
337   | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port                                                | 1.12936   | success |
338   | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet                                              | 3.57963   | success |
339   | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network                                                 | 0.78922   | success |
340   | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port                                                    | 1.65769   | success |
341   | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet                                                  | 1.83194   | success |
342   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 1.68524   | success |
343   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.11621   | success |
344   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.04856   | success |
345   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.06497   | success |
346   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.04008   | success |
347   | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.03337   | success |
348   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet                                          | 1.32422   | success |
349   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility                                                  | 0.26639   | success |
350   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks                                                                | 0.03927   | success |
351   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets                                                                 | 0.05712   | success |
352   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network                                                                 | 0.02959   | success |
353   | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet                                                                  | 0.03932   | success |
354   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 1.19901   | success |
355   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 1.25554   | success |
356   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 0.92929   | success |
357   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.08330   | success |
358   | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.05240   | success |
359   | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 1.45070   | success |
360   | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 1.52472   | success |
361   | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 0.77372   | success |
362   | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.07141   | success |
363   | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.07359   | success |
364   | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 3.13508   | success |
365   | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 1.71626   | success |
366   | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 1.62675   | success |
367   | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 1.30657   | success |
368   | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 3.14422   | success |
369   | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 2.10530   | success |
370   | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 1.26380   | success |
371   | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 0.96604   | success |
372   | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 0.42206   | success |
373   | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 0.53726   | success |
374   | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.02176   | success |
375   | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 0.62941   | success |
376   | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 0.73604   | success |
377   | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.08043   | success |
378   | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.52518   | success |
379   | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 6.69041   | success |
380   | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.02086   | success |
381   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 0.59957   | success |
382   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.42389   | success |
383   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.35662   | success |
384   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.31285   | success |
385   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.41824   | success |
386   | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.44749   | success |
387   | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 2.48091   | success |
388   | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.02451   | success |
389   | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 11.01904  | success |
390   | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 1.56618   | success |
391   | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.39593   | success |
392   | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 2.90553   | success |
393   | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 10.69341  | success |
394   | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 10.81400  | success |
395   | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 9.37884   | success |
396   | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 11.22059  | success |
397   | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.12832   | success |
398   | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.10186   | success |
399   | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 27.37465  | success |
400   | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops                                                           | 13.36483  | success |
401   | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 79.30317  | success |
402   | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 101.24914 | success |
403   +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
404   2016-02-10 22:45:16,505 - run_tempest - DEBUG - Executing command : rally verify list
405   2016-02-10 22:45:17,075 - run_tempest - INFO - Results: {'timestart': '2016-02-1022:42:25.742171', 'duration': 170, 'tests': 210, 'failures': 0}
406   2016-02-10 22:45:17,076 - run_tempest - DEBUG - Push result into DB
407   2016-02-10 22:45:17,076 - run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
408   2016-02-10 22:45:17,875 - run_tempest - DEBUG - <Response [200]>
409   2016-02-10 22:45:17,875 - run_tempest - INFO - Deleting tenant and user for Tempest suite)
410 ::
411
412 Running test case: odl
413 ----------------------
414
415 ::
416   FUNCTEST.info: Running ODL test...
417   \e[0;32mCurrent environment parameters for ODL suite.\e[0m
418   + ODL_IP=192.168.10.51
419   + ODL_PORT=8181
420   + USR_NAME=admin
421   + PASS=console
422   + NEUTRON_IP=192.168.10.51
423   + KEYSTONE_IP=192.168.10.51
424   + set +x
425   '/home/opnfv/repos/functest/testcases/Controllers/ODL/CI/custom_tests/neutron/010__networks.robot' -> '/home/opnfv/repos/odl_integration/test/csit/suites/openstack/neutron/010__networks.robot'
426   '/home/opnfv/repos/functest/testcases/Controllers/ODL/CI/custom_tests/neutron/020__subnets.robot' -> '/home/opnfv/repos/odl_integration/test/csit/suites/openstack/neutron/020__subnets.robot'
427   '/home/opnfv/repos/functest/testcases/Controllers/ODL/CI/custom_tests/neutron/030__ports.robot' -> '/home/opnfv/repos/odl_integration/test/csit/suites/openstack/neutron/030__ports.robot'
428   '/home/opnfv/repos/functest/testcases/Controllers/ODL/CI/custom_tests/neutron/040__delete_ports.txt' -> '/home/opnfv/repos/odl_integration/test/csit/suites/openstack/neutron/040__delete_ports.txt'
429   '/home/opnfv/repos/functest/testcases/Controllers/ODL/CI/custom_tests/neutron/050__delete_subnets.txt' -> '/home/opnfv/repos/odl_integration/test/csit/suites/openstack/neutron/050__delete_subnets.txt'
430   '/home/opnfv/repos/functest/testcases/Controllers/ODL/CI/custom_tests/neutron/060__delete_networks.txt' -> '/home/opnfv/repos/odl_integration/test/csit/suites/openstack/neutron/060__delete_networks.txt'
431   ==============================================================================
432   Basic
433   ==============================================================================
434   Basic.010 Restconf OK :: Test suite to verify Restconf is OK
435   ==============================================================================
436   Get Controller Modules :: Get the controller modules via Restconf     | PASS |
437   ------------------------------------------------------------------------------
438   Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
439   1 critical test, 1 passed, 0 failed
440   1 test total, 1 passed, 0 failed
441   ==============================================================================
442   Basic                                                                 | PASS |
443   1 critical test, 1 passed, 0 failed
444   1 test total, 1 passed, 0 failed
445   ==============================================================================
446   Output:  /home/opnfv/repos/functest/output.xml
447   Log:     /home/opnfv/repos/functest/log.html
448   Report:  /home/opnfv/repos/functest/report.html
449   ==============================================================================
450   Neutron :: Test suite for Neutron Plugin
451   ==============================================================================
452   Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
453   ==============================================================================
454   Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
455   ------------------------------------------------------------------------------
456   Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
457   ------------------------------------------------------------------------------
458   Create Network :: Create new network in OpenStack                     | PASS |
459   ------------------------------------------------------------------------------
460   Check Network :: Check Network created in OpenDaylight                | PASS |
461   ------------------------------------------------------------------------------
462   Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
463   4 critical tests, 4 passed, 0 failed
464   4 tests total, 4 passed, 0 failed
465   ==============================================================================
466   Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
467   ==============================================================================
468   Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
469   ------------------------------------------------------------------------------
470   Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
471   ------------------------------------------------------------------------------
472   Create New subnet :: Create new subnet in OpenStack                   | PASS |
473   ------------------------------------------------------------------------------
474   Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
475   ------------------------------------------------------------------------------
476   Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
477   4 critical tests, 4 passed, 0 failed
478   4 tests total, 4 passed, 0 failed
479   ==============================================================================
480   Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
481   ==============================================================================
482   Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
483   ------------------------------------------------------------------------------
484   Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
485   ------------------------------------------------------------------------------
486   Create New Port :: Create new port in OpenStack                       | PASS |
487   ------------------------------------------------------------------------------
488   Check New Port :: Check new subnet created in OpenDaylight            | PASS |
489   ------------------------------------------------------------------------------
490   Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
491   4 critical tests, 4 passed, 0 failed
492   4 tests total, 4 passed, 0 failed
493   ==============================================================================
494   Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
495   ==============================================================================
496   Delete New Port :: Delete previously created port in OpenStack        | PASS |
497   ------------------------------------------------------------------------------
498   Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
499   ------------------------------------------------------------------------------
500   Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
501   2 critical tests, 2 passed, 0 failed
502   2 tests total, 2 passed, 0 failed
503   ==============================================================================
504   Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
505   ==============================================================================
506   Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
507   ------------------------------------------------------------------------------
508   Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
509   ------------------------------------------------------------------------------
510   Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
511   2 critical tests, 2 passed, 0 failed
512   2 tests total, 2 passed, 0 failed
513   ==============================================================================
514   Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
515   ==============================================================================
516   Delete Network :: Delete network in OpenStack                         | PASS |
517   ------------------------------------------------------------------------------
518   Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
519   ------------------------------------------------------------------------------
520   Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
521   2 critical tests, 2 passed, 0 failed
522   2 tests total, 2 passed, 0 failed
523   ==============================================================================
524   Neutron :: Test suite for Neutron Plugin                              | PASS |
525   18 critical tests, 18 passed, 0 failed
526   18 tests total, 18 passed, 0 failed
527   ==============================================================================
528   Output:  /home/opnfv/repos/functest/output.xml
529   Log:     /home/opnfv/repos/functest/log.html
530   Report:  /home/opnfv/repos/functest/report.html
531   Log:     /home/opnfv/repos/functest/log.html
532   Report:  /home/opnfv/repos/functest/report.html
533 ::
534
535 Running test case: vims
536 -----------------------
537
538 ::
539   FUNCTEST.info: Running vIMS test...
540   2016-02-10 22:45:37,147 - vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
541   2016-02-10 22:45:37,406 - vIMS - INFO - Update OpenStack creds informations
542   2016-02-10 22:45:37,406 - vIMS - INFO - Upload some OS images if it doesn't exist
543   2016-02-10 22:45:37,529 - vIMS - INFO - centos_7 image doesn't exist on glance repository.
544                               Try downloading this image and upload on glance !
545   2016-02-10 22:48:29,605 - vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
546                               Try downloading this image and upload on glance !
547   2016-02-10 22:49:31,380 - vIMS - INFO - Update security group quota for this tenant
548   2016-02-10 22:49:31,609 - vIMS - INFO - Update cinder quota for this tenant
549   2016-02-10 22:49:32,080 - vIMS - INFO - Collect flavor id for cloudify manager server
550   2016-02-10 22:49:32,529 - vIMS - INFO - Prepare virtualenv for cloudify-cli
551   2016-02-10 22:50:07,340 - vIMS - INFO - Downloading the cloudify manager server blueprint
552   2016-02-10 22:50:12,979 - vIMS - INFO - Cloudify deployment Start Time:'2016-02-10 22:50:12'
553   2016-02-10 22:50:12,979 - vIMS - INFO - Writing the inputs file
554   2016-02-10 22:50:12,981 - vIMS - INFO - Launching the cloudify-manager deployment
555   2016-02-10 22:59:18,207 - vIMS - INFO - Cloudify-manager server is UP !
556   2016-02-10 22:59:18,207 - vIMS - INFO - Cloudify deployment duration:'545.2'
557   2016-02-10 22:59:18,208 - vIMS - INFO - Collect flavor id for all clearwater vm
558   2016-02-10 22:59:18,674 - vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-10 22:59:18'
559   2016-02-10 22:59:18,674 - vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
560   2016-02-10 22:59:23,285 - vIMS - INFO - Writing the inputs file
561   2016-02-10 22:59:23,287 - vIMS - INFO - Launching the clearwater deployment
562   2016-02-10 23:10:25,235 - vIMS - INFO - The deployment of clearwater-opnfv is ended
563   2016-02-10 23:10:25,235 - vIMS - INFO - vIMS VNF deployment duration:'666.6'
564   2016-02-10 23:13:32,648 - vIMS - INFO - vIMS functional test Start Time:'2016-02-10 23:13:32'
565   2016-02-10 23:13:35,583 - vIMS - INFO - vIMS functional test duration:'2.9'
566   2016-02-10 23:13:36,745 - vIMS - INFO - Launching the clearwater-opnfv undeployment
567   2016-02-10 23:17:11,897 - vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
568   2016-02-10 23:17:11,898 - vIMS - INFO - Launching the cloudify-manager undeployment
569   2016-02-10 23:17:59,430 - vIMS - INFO - Cloudify-manager server has been successfully removed!
570   2016-02-10 23:17:59,499 - vIMS - INFO - Removing vIMS tenant ..
571   2016-02-10 23:18:00,350 - vIMS - INFO - Removing vIMS user ..
572 ::
573
574 Running test case: rally
575 ------------------------
576
577 ::
578   FUNCTEST.info: Running Rally benchmark suite...
579   2016-02-10 23:18:03,367 - run_rally - DEBUG - Volume type 'volume_test' created succesfully...
580   2016-02-10 23:18:03,490 - run_rally - DEBUG - Creating image 'functest-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
581   2016-02-10 23:18:04,074 - run_rally - DEBUG - Image 'functest-img' with ID 'a4efc793-1195-482b-9da6-87299b33d650' created succesfully .
582   2016-02-10 23:18:04,074 - run_rally - INFO - Starting test scenario "authenticate" ...
583   2016-02-10 23:18:04,075 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-authenticate.yaml
584   2016-02-10 23:18:04,257 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['authenticate'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
585   2016-02-10 23:18:31,567 - run_rally - INFO -
586    Preparing input task
587    Task  70024948-2531-471d-9c30-9fdc69d0e1e4: started
588   Task 70024948-2531-471d-9c30-9fdc69d0e1e4: finished
589
590   test scenario Authenticate.validate_glance
591   +-------------------------------------------------------------------------------------------------------+
592   |                                         Response Times (sec)                                          |
593   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
594   | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
595   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
596   | authenticate.validate_glance     | 0.116 | 0.148  | 0.228  | 0.254  | 0.279 | 0.168 | 100.0%  | 10    |
597   | authenticate.validate_glance (2) | 0.035 | 0.041  | 0.06   | 0.075  | 0.09  | 0.047 | 100.0%  | 10    |
598   | total                            | 0.219 | 0.297  | 0.353  | 0.376  | 0.399 | 0.292 | 100.0%  | 10    |
599   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
600   Load duration: 0.857667922974
601   Full duration: 3.24089407921
602
603   test scenario Authenticate.keystone
604   +-----------------------------------------------------------------------------+
605   |                            Response Times (sec)                             |
606   +--------+-------+--------+--------+--------+-------+-------+---------+-------+
607   | action | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
608   +--------+-------+--------+--------+--------+-------+-------+---------+-------+
609   | total  | 0.064 | 0.074  | 0.084  | 0.11   | 0.135 | 0.079 | 100.0%  | 10    |
610   +--------+-------+--------+--------+--------+-------+-------+---------+-------+
611   Load duration: 0.234832048416
612   Full duration: 2.53488898277
613
614   test scenario Authenticate.validate_heat
615   +-----------------------------------------------------------------------------------------------------+
616   |                                        Response Times (sec)                                         |
617   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
618   | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
619   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
620   | authenticate.validate_heat     | 0.123 | 0.162  | 0.298  | 0.343  | 0.387 | 0.194 | 100.0%  | 10    |
621   | authenticate.validate_heat (2) | 0.025 | 0.077  | 0.111  | 0.13   | 0.148 | 0.071 | 100.0%  | 10    |
622   | total                          | 0.217 | 0.316  | 0.482  | 0.495  | 0.508 | 0.344 | 100.0%  | 10    |
623   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
624   Load duration: 0.990710020065
625   Full duration: 3.20668816566
626
627   test scenario Authenticate.validate_nova
628   +-----------------------------------------------------------------------------------------------------+
629   |                                        Response Times (sec)                                         |
630   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
631   | action                         | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
632   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
633   | authenticate.validate_nova     | 0.11  | 0.129  | 0.156  | 0.16   | 0.163 | 0.132 | 100.0%  | 10    |
634   | authenticate.validate_nova (2) | 0.024 | 0.032  | 0.041  | 0.041  | 0.041 | 0.032 | 100.0%  | 10    |
635   | total                          | 0.212 | 0.233  | 0.268  | 0.273  | 0.278 | 0.238 | 100.0%  | 10    |
636   +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
637   Load duration: 0.725275993347
638   Full duration: 2.92799592018
639
640   test scenario Authenticate.validate_cinder
641   +-------------------------------------------------------------------------------------------------------+
642   |                                         Response Times (sec)                                          |
643   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
644   | action                           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
645   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
646   | authenticate.validate_cinder     | 0.094 | 0.107  | 0.115  | 0.116  | 0.117 | 0.107 | 100.0%  | 10    |
647   | authenticate.validate_cinder (2) | 0.06  | 0.072  | 0.082  | 0.091  | 0.099 | 0.073 | 100.0%  | 10    |
648   | total                            | 0.223 | 0.254  | 0.293  | 0.302  | 0.311 | 0.261 | 100.0%  | 10    |
649   +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
650   Load duration: 0.787709951401
651   Full duration: 3.0150449276
652
653   test scenario Authenticate.validate_neutron
654   +--------------------------------------------------------------------------------------------------------+
655   |                                          Response Times (sec)                                          |
656   +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
657   | action                            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
658   +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
659   | authenticate.validate_neutron     | 0.105 | 0.126  | 0.162  | 0.168  | 0.173 | 0.132 | 100.0%  | 10    |
660   | authenticate.validate_neutron (2) | 0.071 | 0.087  | 0.109  | 0.117  | 0.124 | 0.091 | 100.0%  | 10    |
661   | total                             | 0.255 | 0.304  | 0.327  | 0.327  | 0.327 | 0.297 | 100.0%  | 10    |
662   +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
663   Load duration: 0.891720056534
664   Full duration: 2.96198296547
665
666   2016-02-10 23:18:31,567 - run_rally - DEBUG - task_id : 70024948-2531-471d-9c30-9fdc69d0e1e4
667   2016-02-10 23:18:31,567 - run_rally - DEBUG - running command line : rally task report 70024948-2531-471d-9c30-9fdc69d0e1e4 --out /home/opnfv/functest/results/rally/opnfv-authenticate.html
668   2016-02-10 23:18:32,178 - run_rally - DEBUG - running command line : rally task results 70024948-2531-471d-9c30-9fdc69d0e1e4
669   2016-02-10 23:18:32,759 - run_rally - DEBUG - saving json file
670   2016-02-10 23:18:32,761 - run_rally - DEBUG - Push result into DB
671   2016-02-10 23:18:38,906 - run_rally - DEBUG - <Response [200]>
672   2016-02-10 23:18:38,907 - run_rally - INFO - Test scenario: "authenticate" OK.
673
674   2016-02-10 23:18:38,907 - run_rally - INFO - Starting test scenario "glance" ...
675   2016-02-10 23:18:38,907 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-glance.yaml
676   2016-02-10 23:18:39,085 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['glance'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
677   2016-02-10 23:20:14,436 - run_rally - INFO -
678    Preparing input task
679    Task  ea3d6cbe-0d37-4f26-8030-7096d3db372f: started
680   Task ea3d6cbe-0d37-4f26-8030-7096d3db372f: finished
681
682   test scenario GlanceImages.list_images
683   +-----------------------------------------------------------------------------------------+
684   |                                  Response Times (sec)                                   |
685   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
686   | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
687   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
688   | glance.list_images | 0.188 | 0.24   | 0.276  | 0.284  | 0.292 | 0.238 | 100.0%  | 10    |
689   | total              | 0.188 | 0.24   | 0.276  | 0.284  | 0.292 | 0.238 | 100.0%  | 10    |
690   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
691   Load duration: 0.762142896652
692   Full duration: 3.6355650425
693
694   test scenario GlanceImages.create_image_and_boot_instances
695   +--------------------------------------------------------------------------------------------+
696   |                                    Response Times (sec)                                    |
697   +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
698   | action              | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
699   +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
700   | glance.create_image | 2.794 | 3.209  | 3.48   | 3.489  | 3.497  | 3.171  | 100.0%  | 10    |
701   | nova.boot_servers   | 6.0   | 8.224  | 9.515  | 9.569  | 9.623  | 8.214  | 100.0%  | 10    |
702   | total               | 8.795 | 11.646 | 12.43  | 12.637 | 12.843 | 11.385 | 100.0%  | 10    |
703   +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
704   Load duration: 32.6185789108
705   Full duration: 56.808437109
706
707   test scenario GlanceImages.create_and_list_image
708   +------------------------------------------------------------------------------------------+
709   |                                   Response Times (sec)                                   |
710   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
711   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
712   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
713   | glance.create_image | 3.004 | 3.141  | 3.359  | 3.379  | 3.399 | 3.183 | 100.0%  | 10    |
714   | glance.list_images  | 0.039 | 0.045  | 0.052  | 0.052  | 0.053 | 0.046 | 100.0%  | 10    |
715   | total               | 3.044 | 3.186  | 3.409  | 3.426  | 3.443 | 3.229 | 100.0%  | 10    |
716   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
717   Load duration: 9.54856610298
718   Full duration: 14.0860719681
719
720   test scenario GlanceImages.create_and_delete_image
721   +------------------------------------------------------------------------------------------+
722   |                                   Response Times (sec)                                   |
723   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
724   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
725   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
726   | glance.create_image | 2.785 | 3.041  | 3.554  | 3.569  | 3.584 | 3.099 | 100.0%  | 10    |
727   | glance.delete_image | 0.135 | 0.154  | 0.322  | 0.33   | 0.338 | 0.193 | 100.0%  | 10    |
728   | total               | 2.921 | 3.202  | 3.718  | 3.72   | 3.722 | 3.292 | 100.0%  | 10    |
729   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
730   Load duration: 9.6310031414
731   Full duration: 12.5532770157
732
733   2016-02-10 23:20:14,436 - run_rally - DEBUG - task_id : ea3d6cbe-0d37-4f26-8030-7096d3db372f
734   2016-02-10 23:20:14,436 - run_rally - DEBUG - running command line : rally task report ea3d6cbe-0d37-4f26-8030-7096d3db372f --out /home/opnfv/functest/results/rally/opnfv-glance.html
735   2016-02-10 23:20:15,028 - run_rally - DEBUG - running command line : rally task results ea3d6cbe-0d37-4f26-8030-7096d3db372f
736   2016-02-10 23:20:15,597 - run_rally - DEBUG - saving json file
737   2016-02-10 23:20:15,598 - run_rally - DEBUG - Push result into DB
738   2016-02-10 23:20:21,300 - run_rally - DEBUG - <Response [200]>
739   2016-02-10 23:20:21,301 - run_rally - INFO - Test scenario: "glance" OK.
740
741   2016-02-10 23:20:21,301 - run_rally - INFO - Starting test scenario "cinder" ...
742   2016-02-10 23:20:21,301 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-cinder.yaml
743   2016-02-10 23:20:21,503 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['cinder'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
744   2016-02-10 23:36:46,743 - run_rally - INFO -
745    Preparing input task
746    Task  c4bf15f0-eb49-4723-9aa9-81d6ea24dc2f: started
747   Task c4bf15f0-eb49-4723-9aa9-81d6ea24dc2f: finished
748
749   test scenario CinderVolumes.create_and_attach_volume
750   +---------------------------------------------------------------------------------------------+
751   |                                    Response Times (sec)                                     |
752   +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
753   | action               | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
754   +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
755   | nova.boot_server     | 3.178  | 4.424  | 5.766  | 5.877  | 5.988  | 4.733 | 100.0%  | 10    |
756   | cinder.create_volume | 2.542  | 2.787  | 2.835  | 2.848  | 2.861  | 2.767 | 100.0%  | 10    |
757   | nova.attach_volume   | 5.467  | 7.793  | 8.194  | 9.28   | 10.367 | 7.799 | 100.0%  | 10    |
758   | nova.detach_volume   | 3.029  | 4.298  | 5.62   | 5.643  | 5.665  | 4.322 | 100.0%  | 10    |
759   | cinder.delete_volume | 2.392  | 2.493  | 2.58   | 2.583  | 2.586  | 2.498 | 100.0%  | 10    |
760   | nova.delete_server   | 2.388  | 2.444  | 2.56   | 2.6    | 2.639  | 2.47  | 100.0%  | 10    |
761   | total                | 20.696 | 23.97  | 27.209 | 28.172 | 29.135 | 24.59 | 100.0%  | 10    |
762   +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
763   Load duration: 72.9981839657
764   Full duration: 85.4548120499
765
766   test scenario CinderVolumes.create_and_list_volume
767   +-------------------------------------------------------------------------------------------+
768   |                                   Response Times (sec)                                    |
769   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
770   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
771   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
772   | cinder.create_volume | 5.187 | 5.33   | 5.429  | 5.456  | 5.483 | 5.334 | 100.0%  | 10    |
773   | cinder.list_volumes  | 0.059 | 0.112  | 0.177  | 0.185  | 0.194 | 0.118 | 100.0%  | 10    |
774   | total                | 5.341 | 5.465  | 5.527  | 5.557  | 5.587 | 5.452 | 100.0%  | 10    |
775   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
776   Load duration: 16.3163900375
777   Full duration: 28.575948
778
779   test scenario CinderVolumes.create_and_list_volume
780   +-------------------------------------------------------------------------------------------+
781   |                                   Response Times (sec)                                    |
782   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
783   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
784   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
785   | cinder.create_volume | 2.838 | 2.956  | 3.08   | 3.084  | 3.087 | 2.969 | 100.0%  | 10    |
786   | cinder.list_volumes  | 0.053 | 0.114  | 0.138  | 0.143  | 0.147 | 0.112 | 100.0%  | 10    |
787   | total                | 2.986 | 3.065  | 3.185  | 3.195  | 3.204 | 3.081 | 100.0%  | 10    |
788   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
789   Load duration: 9.18667793274
790   Full duration: 20.0336208344
791
792   test scenario CinderVolumes.create_and_list_snapshots
793   +---------------------------------------------------------------------------------------------+
794   |                                    Response Times (sec)                                     |
795   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
796   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
797   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
798   | cinder.create_snapshot | 2.442 | 2.523  | 2.591  | 2.618  | 2.645 | 2.524 | 100.0%  | 10    |
799   | cinder.list_snapshots  | 0.016 | 0.083  | 0.108  | 0.124  | 0.14  | 0.085 | 100.0%  | 10    |
800   | total                  | 2.524 | 2.612  | 2.668  | 2.679  | 2.69  | 2.609 | 100.0%  | 10    |
801   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
802   Load duration: 7.86018610001
803   Full duration: 30.7561271191
804
805   test scenario CinderVolumes.create_and_delete_volume
806   +-------------------------------------------------------------------------------------------+
807   |                                   Response Times (sec)                                    |
808   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
809   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
810   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
811   | cinder.create_volume | 2.759 | 2.905  | 3.103  | 3.117  | 3.131 | 2.942 | 100.0%  | 10    |
812   | cinder.delete_volume | 2.41  | 2.503  | 2.632  | 2.653  | 2.675 | 2.522 | 100.0%  | 10    |
813   | total                | 5.203 | 5.482  | 5.651  | 5.689  | 5.727 | 5.464 | 100.0%  | 10    |
814   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
815   Load duration: 16.1656489372
816   Full duration: 22.7390818596
817
818   test scenario CinderVolumes.create_and_delete_volume
819   +-------------------------------------------------------------------------------------------+
820   |                                   Response Times (sec)                                    |
821   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
822   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
823   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
824   | cinder.create_volume | 3.117 | 5.408  | 5.501  | 5.525  | 5.55  | 4.983 | 100.0%  | 10    |
825   | cinder.delete_volume | 2.409 | 2.505  | 2.582  | 2.597  | 2.611 | 2.509 | 100.0%  | 10    |
826   | total                | 5.606 | 7.887  | 8.077  | 8.079  | 8.081 | 7.493 | 100.0%  | 10    |
827   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
828   Load duration: 21.5610911846
829   Full duration: 28.1375927925
830
831   test scenario CinderVolumes.create_and_delete_volume
832   +-------------------------------------------------------------------------------------------+
833   |                                   Response Times (sec)                                    |
834   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
835   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
836   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
837   | cinder.create_volume | 2.814 | 2.926  | 3.051  | 3.073  | 3.095 | 2.928 | 100.0%  | 10    |
838   | cinder.delete_volume | 2.41  | 2.549  | 2.65   | 2.673  | 2.697 | 2.549 | 100.0%  | 10    |
839   | total                | 5.352 | 5.455  | 5.622  | 5.663  | 5.704 | 5.477 | 100.0%  | 10    |
840   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
841   Load duration: 16.3862950802
842   Full duration: 22.6357138157
843
844   test scenario CinderVolumes.create_and_upload_volume_to_image
845   +-------------------------------------------------------------------------------------------------------+
846   |                                         Response Times (sec)                                          |
847   +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
848   | action                        | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
849   +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
850   | cinder.create_volume          | 2.833  | 2.963  | 3.129  | 3.234  | 3.338  | 3.004  | 100.0%  | 10    |
851   | cinder.upload_volume_to_image | 25.735 | 58.927 | 69.934 | 72.964 | 75.993 | 54.211 | 100.0%  | 10    |
852   | cinder.delete_volume          | 2.334  | 2.516  | 2.645  | 2.672  | 2.699  | 2.509  | 100.0%  | 10    |
853   | nova.delete_image             | 0.372  | 0.524  | 1.216  | 3.884  | 6.553  | 1.093  | 100.0%  | 10    |
854   | total                         | 31.617 | 64.977 | 75.831 | 78.899 | 81.966 | 60.818 | 100.0%  | 10    |
855   +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
856   Load duration: 160.993555069
857   Full duration: 168.269435883
858
859   test scenario CinderVolumes.create_and_delete_snapshot
860   +---------------------------------------------------------------------------------------------+
861   |                                    Response Times (sec)                                     |
862   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
863   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
864   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
865   | cinder.create_snapshot | 2.442 | 2.556  | 2.583  | 2.604  | 2.626 | 2.537 | 100.0%  | 10    |
866   | cinder.delete_snapshot | 2.27  | 2.415  | 2.466  | 2.505  | 2.543 | 2.398 | 100.0%  | 10    |
867   | total                  | 4.819 | 4.941  | 5.014  | 5.018  | 5.023 | 4.935 | 100.0%  | 10    |
868   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
869   Load duration: 14.7615189552
870   Full duration: 34.2201139927
871
872   test scenario CinderVolumes.create_volume
873   +-------------------------------------------------------------------------------------------+
874   |                                   Response Times (sec)                                    |
875   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
876   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
877   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
878   | cinder.create_volume | 2.817 | 2.994  | 3.104  | 3.11   | 3.117 | 3.002 | 100.0%  | 10    |
879   | total                | 2.817 | 2.994  | 3.104  | 3.11   | 3.117 | 3.002 | 100.0%  | 10    |
880   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
881   Load duration: 9.08546304703
882   Full duration: 18.2949140072
883
884   test scenario CinderVolumes.create_volume
885   +-------------------------------------------------------------------------------------------+
886   |                                   Response Times (sec)                                    |
887   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
888   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
889   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
890   | cinder.create_volume | 2.832 | 2.912  | 2.992  | 3.008  | 3.024 | 2.923 | 100.0%  | 10    |
891   | total                | 2.832 | 2.912  | 2.992  | 3.008  | 3.024 | 2.924 | 100.0%  | 10    |
892   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
893   Load duration: 8.71728801727
894   Full duration: 19.7889790535
895
896   test scenario CinderVolumes.list_volumes
897   +------------------------------------------------------------------------------------------+
898   |                                   Response Times (sec)                                   |
899   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
900   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
901   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
902   | cinder.list_volumes | 0.227 | 0.247  | 0.356  | 0.361  | 0.366 | 0.266 | 100.0%  | 10    |
903   | total               | 0.227 | 0.247  | 0.356  | 0.361  | 0.366 | 0.266 | 100.0%  | 10    |
904   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
905   Load duration: 0.759625911713
906   Full duration: 46.0351030827
907
908   test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
909   +------------------------------------------------------------------------------------------------+
910   |                                      Response Times (sec)                                      |
911   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
912   | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
913   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
914   | cinder.create_volume   | 2.773  | 2.893  | 3.164  | 3.194  | 3.225  | 2.949  | 100.0%  | 10    |
915   | cinder.create_snapshot | 2.253  | 2.369  | 2.477  | 2.49   | 2.502  | 2.386  | 100.0%  | 10    |
916   | nova.attach_volume     | 7.591  | 10.702 | 13.689 | 15.195 | 16.702 | 10.764 | 100.0%  | 10    |
917   | nova.detach_volume     | 3.011  | 5.222  | 5.741  | 6.526  | 7.311  | 4.85   | 100.0%  | 10    |
918   | cinder.delete_snapshot | 2.194  | 2.285  | 2.418  | 2.46   | 2.501  | 2.305  | 100.0%  | 10    |
919   | cinder.delete_volume   | 2.361  | 2.489  | 2.6    | 2.604  | 2.608  | 2.479  | 100.0%  | 10    |
920   | total                  | 21.273 | 25.722 | 28.871 | 29.897 | 30.924 | 26.045 | 100.0%  | 10    |
921   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
922   Load duration: 77.9808602333
923   Full duration: 116.938727856
924
925   test scenario CinderVolumes.create_from_volume_and_delete_volume
926   +----------------------------------------------------------------------------------------------+
927   |                                     Response Times (sec)                                     |
928   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
929   | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
930   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
931   | cinder.create_volume | 9.917  | 12.187 | 19.547 | 21.624 | 23.7   | 14.261 | 100.0%  | 10    |
932   | cinder.delete_volume | 2.394  | 2.493  | 2.568  | 2.578  | 2.589  | 2.491  | 100.0%  | 10    |
933   | total                | 12.495 | 14.721 | 22.041 | 24.068 | 26.095 | 16.752 | 100.0%  | 10    |
934   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
935   Load duration: 48.7536959648
936   Full duration: 67.4493231773
937
938   test scenario CinderVolumes.create_and_extend_volume
939   +-------------------------------------------------------------------------------------------+
940   |                                   Response Times (sec)                                    |
941   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
942   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
943   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
944   | cinder.create_volume | 2.771 | 2.913  | 3.041  | 3.063  | 3.085 | 2.927 | 100.0%  | 10    |
945   | cinder.extend_volume | 2.697 | 2.781  | 2.903  | 2.93   | 2.956 | 2.795 | 100.0%  | 10    |
946   | cinder.delete_volume | 2.34  | 2.51   | 2.59   | 2.642  | 2.694 | 2.497 | 100.0%  | 10    |
947   | total                | 7.894 | 8.268  | 8.419  | 8.459  | 8.5   | 8.219 | 100.0%  | 10    |
948   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
949   Load duration: 24.6035699844
950   Full duration: 31.5182521343
951
952   test scenario CinderVolumes.create_snapshot_and_attach_volume
953   +------------------------------------------------------------------------------------------------+
954   |                                      Response Times (sec)                                      |
955   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
956   | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
957   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
958   | cinder.create_volume   | 2.784  | 2.988  | 3.085  | 3.115  | 3.144  | 2.97   | 100.0%  | 10    |
959   | cinder.create_snapshot | 2.237  | 2.369  | 2.43   | 2.51   | 2.589  | 2.363  | 100.0%  | 10    |
960   | nova.attach_volume     | 7.638  | 7.847  | 12.52  | 12.525 | 12.531 | 8.973  | 100.0%  | 10    |
961   | nova.detach_volume     | 2.933  | 3.436  | 5.288  | 5.554  | 5.82   | 4.018  | 100.0%  | 10    |
962   | cinder.delete_snapshot | 2.181  | 2.279  | 2.323  | 2.335  | 2.347  | 2.266  | 100.0%  | 10    |
963   | cinder.delete_volume   | 2.357  | 2.56   | 2.744  | 2.749  | 2.754  | 2.569  | 100.0%  | 10    |
964   | total                  | 21.343 | 23.631 | 26.003 | 26.089 | 26.175 | 23.505 | 100.0%  | 10    |
965   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
966   Load duration: 69.038891077
967   Full duration: 113.245260954
968
969   test scenario CinderVolumes.create_snapshot_and_attach_volume
970   +------------------------------------------------------------------------------------------------+
971   |                                      Response Times (sec)                                      |
972   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
973   | action                 | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
974   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
975   | cinder.create_volume   | 2.584  | 2.826  | 2.916  | 2.939  | 2.961  | 2.795  | 100.0%  | 10    |
976   | cinder.create_snapshot | 2.241  | 2.314  | 2.41   | 2.42   | 2.43   | 2.327  | 100.0%  | 10    |
977   | nova.attach_volume     | 7.565  | 7.759  | 10.721 | 11.639 | 12.557 | 8.502  | 100.0%  | 10    |
978   | nova.detach_volume     | 2.942  | 5.21   | 5.401  | 5.552  | 5.704  | 4.438  | 100.0%  | 10    |
979   | cinder.delete_snapshot | 2.184  | 2.317  | 2.388  | 2.423  | 2.458  | 2.308  | 100.0%  | 10    |
980   | cinder.delete_volume   | 2.337  | 2.526  | 2.603  | 2.635  | 2.667  | 2.515  | 100.0%  | 10    |
981   | total                  | 20.941 | 23.531 | 25.945 | 26.128 | 26.31  | 23.419 | 100.0%  | 10    |
982   +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
983   Load duration: 68.828496933
984   Full duration: 109.817329884
985
986   2016-02-10 23:36:46,743 - run_rally - DEBUG - task_id : c4bf15f0-eb49-4723-9aa9-81d6ea24dc2f
987   2016-02-10 23:36:46,744 - run_rally - DEBUG - running command line : rally task report c4bf15f0-eb49-4723-9aa9-81d6ea24dc2f --out /home/opnfv/functest/results/rally/opnfv-cinder.html
988   2016-02-10 23:36:47,453 - run_rally - DEBUG - running command line : rally task results c4bf15f0-eb49-4723-9aa9-81d6ea24dc2f
989   2016-02-10 23:36:48,043 - run_rally - DEBUG - saving json file
990   2016-02-10 23:36:48,049 - run_rally - DEBUG - Push result into DB
991   2016-02-10 23:36:54,688 - run_rally - DEBUG - <Response [200]>
992   2016-02-10 23:36:54,691 - run_rally - INFO - Test scenario: "cinder" OK.
993
994   2016-02-10 23:36:54,691 - run_rally - INFO - Starting test scenario "heat" ...
995   2016-02-10 23:36:54,691 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-heat.yaml
996   2016-02-10 23:36:54,959 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['heat'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
997   2016-02-10 23:43:35,907 - run_rally - INFO -
998    Preparing input task
999    Task  b51e2f18-5a6b-4dfe-a8d1-c70fe9c89809: started
1000   Task b51e2f18-5a6b-4dfe-a8d1-c70fe9c89809: finished
1001
1002   test scenario HeatStacks.create_suspend_resume_delete_stack
1003   +-----------------------------------------------------------------------------------------+
1004   |                                  Response Times (sec)                                   |
1005   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1006   | action             | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1007   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1008   | heat.create_stack  | 2.705 | 3.144  | 3.332  | 3.38   | 3.429 | 3.107 | 100.0%  | 10    |
1009   | heat.suspend_stack | 0.51  | 0.746  | 1.69   | 1.77   | 1.849 | 1.06  | 100.0%  | 10    |
1010   | heat.resume_stack  | 0.575 | 1.511  | 1.753  | 1.755  | 1.758 | 1.484 | 100.0%  | 10    |
1011   | heat.delete_stack  | 1.294 | 1.509  | 1.637  | 1.669  | 1.701 | 1.49  | 100.0%  | 10    |
1012   | total              | 6.41  | 7.029  | 7.873  | 8.014  | 8.155 | 7.142 | 100.0%  | 10    |
1013   +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1014   Load duration: 21.2204399109
1015   Full duration: 24.590711832
1016
1017   test scenario HeatStacks.create_and_delete_stack
1018   +----------------------------------------------------------------------------------------+
1019   |                                  Response Times (sec)                                  |
1020   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1021   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1022   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1023   | heat.create_stack | 2.801 | 2.965  | 3.344  | 3.35   | 3.355 | 3.031 | 100.0%  | 10    |
1024   | heat.delete_stack | 0.298 | 1.513  | 1.627  | 1.666  | 1.705 | 1.42  | 100.0%  | 10    |
1025   | total             | 3.641 | 4.476  | 4.797  | 4.861  | 4.924 | 4.451 | 100.0%  | 10    |
1026   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1027   Load duration: 13.2714350224
1028   Full duration: 16.4613649845
1029
1030   test scenario HeatStacks.create_and_delete_stack
1031   +-------------------------------------------------------------------------------------------+
1032   |                                   Response Times (sec)                                    |
1033   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1034   | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1035   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1036   | heat.create_stack | 10.292 | 11.433 | 13.021 | 13.279 | 13.538 | 11.632 | 100.0%  | 10    |
1037   | heat.delete_stack | 6.906  | 8.131  | 10.135 | 10.169 | 10.203 | 8.488  | 100.0%  | 10    |
1038   | total             | 18.35  | 20.557 | 21.396 | 21.472 | 21.548 | 20.12  | 100.0%  | 10    |
1039   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1040   Load duration: 58.9332971573
1041   Full duration: 62.2598938942
1042
1043   test scenario HeatStacks.create_and_delete_stack
1044   +-------------------------------------------------------------------------------------------+
1045   |                                   Response Times (sec)                                    |
1046   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1047   | action            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1048   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1049   | heat.create_stack | 12.909 | 13.935 | 16.654 | 17.691 | 18.729 | 14.656 | 100.0%  | 10    |
1050   | heat.delete_stack | 7.878  | 9.348  | 10.069 | 10.137 | 10.205 | 9.303  | 100.0%  | 10    |
1051   | total             | 21.856 | 23.051 | 26.606 | 27.304 | 28.002 | 23.959 | 100.0%  | 10    |
1052   +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1053   Load duration: 71.925632
1054   Full duration: 75.6575791836
1055
1056   test scenario HeatStacks.list_stacks_and_resources
1057   +------------------------------------------------------------------------------------------------------+
1058   |                                         Response Times (sec)                                         |
1059   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1060   | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1061   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1062   | heat.list_stacks                | 0.225 | 0.243  | 0.265  | 0.273  | 0.282 | 0.246 | 100.0%  | 10    |
1063   | heat.list_resources_of_0_stacks | 0.0   | 0.0    | 0.0    | 0.0    | 0.0   | 0.0   | 100.0%  | 10    |
1064   | total                           | 0.226 | 0.243  | 0.265  | 0.273  | 0.282 | 0.247 | 100.0%  | 10    |
1065   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1066   Load duration: 0.744506120682
1067   Full duration: 3.46860694885
1068
1069   test scenario HeatStacks.create_update_delete_stack
1070   +----------------------------------------------------------------------------------------+
1071   |                                  Response Times (sec)                                  |
1072   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1073   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1074   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1075   | heat.create_stack | 2.813 | 3.014  | 3.162  | 3.185  | 3.208 | 3.005 | 100.0%  | 10    |
1076   | heat.update_stack | 2.615 | 3.625  | 3.829  | 3.855  | 3.882 | 3.569 | 100.0%  | 10    |
1077   | heat.delete_stack | 1.297 | 1.459  | 1.597  | 1.69   | 1.783 | 1.476 | 100.0%  | 10    |
1078   | total             | 6.833 | 8.129  | 8.414  | 8.465  | 8.515 | 8.049 | 100.0%  | 10    |
1079   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1080   Load duration: 24.4935848713
1081   Full duration: 27.9353289604
1082
1083   test scenario HeatStacks.create_update_delete_stack
1084   +----------------------------------------------------------------------------------------+
1085   |                                  Response Times (sec)                                  |
1086   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1087   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1088   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1089   | heat.create_stack | 2.712 | 2.948  | 3.15   | 3.177  | 3.203 | 2.968 | 100.0%  | 10    |
1090   | heat.update_stack | 2.505 | 2.769  | 3.755  | 3.798  | 3.841 | 2.978 | 100.0%  | 10    |
1091   | heat.delete_stack | 0.41  | 1.398  | 1.579  | 1.602  | 1.626 | 1.239 | 100.0%  | 10    |
1092   | total             | 5.681 | 7.006  | 8.392  | 8.423  | 8.454 | 7.185 | 100.0%  | 10    |
1093   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1094   Load duration: 22.0256738663
1095   Full duration: 25.4327590466
1096
1097   test scenario HeatStacks.create_update_delete_stack
1098   +------------------------------------------------------------------------------------------+
1099   |                                   Response Times (sec)                                   |
1100   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1101   | action            | min   | median | 90%ile | 95%ile | max    | avg    | success | count |
1102   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1103   | heat.create_stack | 2.851 | 3.082  | 3.313  | 3.327  | 3.34   | 3.094  | 100.0%  | 10    |
1104   | heat.update_stack | 4.859 | 5.059  | 5.825  | 5.846  | 5.867  | 5.181  | 100.0%  | 10    |
1105   | heat.delete_stack | 1.459 | 2.448  | 2.821  | 2.894  | 2.968  | 2.222  | 100.0%  | 10    |
1106   | total             | 9.546 | 10.498 | 11.42  | 11.439 | 11.457 | 10.497 | 100.0%  | 10    |
1107   +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
1108   Load duration: 31.3824648857
1109   Full duration: 35.0282361507
1110
1111   test scenario HeatStacks.create_update_delete_stack
1112   +-----------------------------------------------------------------------+
1113   |                         Response Times (sec)                          |
1114   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1115   | action | min | median | 90%ile | 95%ile | max | avg | success | count |
1116   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1117   | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
1118   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1119   Load duration: 6.58436203003
1120   Full duration: 13.4351229668
1121
1122   test scenario HeatStacks.create_update_delete_stack
1123   +-----------------------------------------------------------------------------------------+
1124   |                                  Response Times (sec)                                   |
1125   +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
1126   | action            | min   | median | 90%ile | 95%ile | max   | avg    | success | count |
1127   +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
1128   | heat.create_stack | 3.053 | 3.139  | 3.256  | 3.339  | 3.422 | 3.161  | 100.0%  | 10    |
1129   | heat.update_stack | 4.769 | 4.927  | 5.262  | 5.626  | 5.989 | 5.053  | 100.0%  | 10    |
1130   | heat.delete_stack | 1.405 | 2.531  | 2.685  | 2.73   | 2.775 | 2.201  | 100.0%  | 10    |
1131   | total             | 9.427 | 10.614 | 11.08  | 11.32  | 11.56 | 10.415 | 100.0%  | 10    |
1132   +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
1133   Load duration: 31.9777891636
1134   Full duration: 35.6663069725
1135
1136   test scenario HeatStacks.create_update_delete_stack
1137   +----------------------------------------------------------------------------------------+
1138   |                                  Response Times (sec)                                  |
1139   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1140   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1141   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1142   | heat.create_stack | 2.863 | 2.98   | 3.296  | 3.358  | 3.42  | 3.049 | 100.0%  | 10    |
1143   | heat.update_stack | 3.505 | 3.801  | 3.997  | 4.081  | 4.165 | 3.804 | 100.0%  | 10    |
1144   | heat.delete_stack | 1.338 | 1.583  | 1.668  | 1.68   | 1.691 | 1.568 | 100.0%  | 10    |
1145   | total             | 7.943 | 8.385  | 8.655  | 8.755  | 8.855 | 8.421 | 100.0%  | 10    |
1146   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1147   Load duration: 25.0527100563
1148   Full duration: 28.7379829884
1149
1150   test scenario HeatStacks.create_and_list_stack
1151   +----------------------------------------------------------------------------------------+
1152   |                                  Response Times (sec)                                  |
1153   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1154   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1155   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1156   | heat.create_stack | 2.845 | 3.135  | 3.391  | 3.404  | 3.418 | 3.147 | 100.0%  | 10    |
1157   | heat.list_stacks  | 0.036 | 0.162  | 0.205  | 0.239  | 0.272 | 0.131 | 100.0%  | 10    |
1158   | total             | 3.014 | 3.266  | 3.453  | 3.517  | 3.581 | 3.278 | 100.0%  | 10    |
1159   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1160   Load duration: 9.90862584114
1161   Full duration: 17.3963320255
1162
1163   test scenario HeatStacks.create_check_delete_stack
1164   +----------------------------------------------------------------------------------------+
1165   |                                  Response Times (sec)                                  |
1166   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1167   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1168   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1169   | heat.create_stack | 2.902 | 3.042  | 3.151  | 3.168  | 3.186 | 3.037 | 100.0%  | 10    |
1170   | heat.check_stack  | 0.317 | 0.552  | 0.774  | 0.918  | 1.062 | 0.597 | 100.0%  | 10    |
1171   | heat.delete_stack | 1.314 | 1.551  | 1.784  | 1.868  | 1.952 | 1.601 | 100.0%  | 10    |
1172   | total             | 4.91  | 5.201  | 5.487  | 5.636  | 5.784 | 5.236 | 100.0%  | 10    |
1173   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1174   Load duration: 15.5446360111
1175   Full duration: 19.7330510616
1176
1177   2016-02-10 23:43:35,907 - run_rally - DEBUG - task_id : b51e2f18-5a6b-4dfe-a8d1-c70fe9c89809
1178   2016-02-10 23:43:35,907 - run_rally - DEBUG - running command line : rally task report b51e2f18-5a6b-4dfe-a8d1-c70fe9c89809 --out /home/opnfv/functest/results/rally/opnfv-heat.html
1179   2016-02-10 23:43:36,536 - run_rally - DEBUG - running command line : rally task results b51e2f18-5a6b-4dfe-a8d1-c70fe9c89809
1180   2016-02-10 23:43:37,131 - run_rally - DEBUG - saving json file
1181   2016-02-10 23:43:37,133 - run_rally - DEBUG - Push result into DB
1182   2016-02-10 23:43:43,814 - run_rally - DEBUG - <Response [200]>
1183   2016-02-10 23:43:43,816 - run_rally - INFO - Test scenario: "heat" Failed.
1184
1185   2016-02-10 23:43:43,816 - run_rally - INFO - Starting test scenario "keystone" ...
1186   2016-02-10 23:43:43,816 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-keystone.yaml
1187   2016-02-10 23:43:44,240 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['keystone'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
1188   2016-02-10 23:45:10,505 - run_rally - INFO -
1189    Preparing input task
1190    Task  a2dc597b-35dc-4b85-a214-5ff65687a80d: started
1191   Task a2dc597b-35dc-4b85-a214-5ff65687a80d: finished
1192
1193   test scenario KeystoneBasic.create_tenant_with_users
1194   +---------------------------------------------------------------------------------------------+
1195   |                                    Response Times (sec)                                     |
1196   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1197   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1198   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1199   | keystone.create_tenant | 0.108 | 0.12   | 0.133  | 0.144  | 0.154 | 0.122 | 100.0%  | 10    |
1200   | keystone.create_users  | 0.627 | 0.66   | 0.746  | 0.753  | 0.759 | 0.679 | 100.0%  | 10    |
1201   | total                  | 0.746 | 0.783  | 0.882  | 0.891  | 0.899 | 0.8   | 100.0%  | 10    |
1202   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1203   Load duration: 2.38129496574
1204   Full duration: 12.5912969112
1205
1206   test scenario KeystoneBasic.create_add_and_list_user_roles
1207   +-------------------------------------------------------------------------------------------+
1208   |                                   Response Times (sec)                                    |
1209   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1210   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1211   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1212   | keystone.create_role | 0.108 | 0.123  | 0.137  | 0.139  | 0.142 | 0.123 | 100.0%  | 10    |
1213   | keystone.add_role    | 0.088 | 0.094  | 0.105  | 0.11   | 0.115 | 0.096 | 100.0%  | 10    |
1214   | keystone.list_roles  | 0.051 | 0.053  | 0.057  | 0.06   | 0.062 | 0.054 | 100.0%  | 10    |
1215   | total                | 0.252 | 0.275  | 0.287  | 0.294  | 0.301 | 0.274 | 100.0%  | 10    |
1216   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1217   Load duration: 0.828149080276
1218   Full duration: 6.11214399338
1219
1220   test scenario KeystoneBasic.add_and_remove_user_role
1221   +-------------------------------------------------------------------------------------------+
1222   |                                   Response Times (sec)                                    |
1223   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1224   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1225   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1226   | keystone.create_role | 0.124 | 0.223  | 0.305  | 0.336  | 0.367 | 0.218 | 100.0%  | 10    |
1227   | keystone.add_role    | 0.088 | 0.1    | 0.111  | 0.111  | 0.111 | 0.101 | 100.0%  | 10    |
1228   | keystone.remove_role | 0.057 | 0.068  | 0.098  | 0.137  | 0.177 | 0.079 | 100.0%  | 10    |
1229   | total                | 0.284 | 0.411  | 0.525  | 0.555  | 0.585 | 0.398 | 100.0%  | 10    |
1230   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1231   Load duration: 1.2285490036
1232   Full duration: 6.55177402496
1233
1234   test scenario KeystoneBasic.create_update_and_delete_tenant
1235   +---------------------------------------------------------------------------------------------+
1236   |                                    Response Times (sec)                                     |
1237   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1238   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1239   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1240   | keystone.create_tenant | 0.13  | 0.238  | 0.275  | 0.281  | 0.287 | 0.213 | 100.0%  | 10    |
1241   | keystone.update_tenant | 0.05  | 0.06   | 0.197  | 0.2    | 0.203 | 0.093 | 100.0%  | 10    |
1242   | keystone.delete_tenant | 0.126 | 0.131  | 0.243  | 0.27   | 0.297 | 0.158 | 100.0%  | 10    |
1243   | total                  | 0.307 | 0.431  | 0.616  | 0.642  | 0.667 | 0.464 | 100.0%  | 10    |
1244   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1245   Load duration: 1.3783249855
1246   Full duration: 5.19503498077
1247
1248   test scenario KeystoneBasic.create_and_delete_service
1249   +----------------------------------------------------------------------------------------------+
1250   |                                     Response Times (sec)                                     |
1251   +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1252   | action                  | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1253   +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1254   | keystone.create_service | 0.125 | 0.13   | 0.149  | 0.159  | 0.169 | 0.136 | 100.0%  | 10    |
1255   | keystone.delete_service | 0.057 | 0.07   | 0.086  | 0.088  | 0.091 | 0.073 | 100.0%  | 10    |
1256   | total                   | 0.187 | 0.209  | 0.233  | 0.237  | 0.241 | 0.209 | 100.0%  | 10    |
1257   +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1258   Load duration: 0.616975784302
1259   Full duration: 4.38122606277
1260
1261   test scenario KeystoneBasic.create_tenant
1262   +---------------------------------------------------------------------------------------------+
1263   |                                    Response Times (sec)                                     |
1264   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1265   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1266   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1267   | keystone.create_tenant | 0.118 | 0.142  | 0.156  | 0.161  | 0.167 | 0.141 | 100.0%  | 10    |
1268   | total                  | 0.118 | 0.142  | 0.156  | 0.162  | 0.167 | 0.141 | 100.0%  | 10    |
1269   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1270   Load duration: 0.460291147232
1271   Full duration: 4.38871192932
1272
1273   test scenario KeystoneBasic.create_user
1274   +------------------------------------------------------------------------------------------+
1275   |                                   Response Times (sec)                                   |
1276   +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
1277   | action               | min  | median | 90%ile | 95%ile | max   | avg   | success | count |
1278   +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
1279   | keystone.create_user | 0.12 | 0.141  | 0.17   | 0.178  | 0.185 | 0.148 | 100.0%  | 10    |
1280   | total                | 0.12 | 0.141  | 0.17   | 0.178  | 0.185 | 0.148 | 100.0%  | 10    |
1281   +----------------------+------+--------+--------+--------+-------+-------+---------+-------+
1282   Load duration: 0.443107843399
1283   Full duration: 4.33838415146
1284
1285   test scenario KeystoneBasic.create_and_list_tenants
1286   +---------------------------------------------------------------------------------------------+
1287   |                                    Response Times (sec)                                     |
1288   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1289   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1290   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1291   | keystone.create_tenant | 0.12  | 0.124  | 0.17   | 0.178  | 0.186 | 0.136 | 100.0%  | 10    |
1292   | keystone.list_tenants  | 0.05  | 0.054  | 0.071  | 0.088  | 0.106 | 0.06  | 100.0%  | 10    |
1293   | total                  | 0.175 | 0.179  | 0.231  | 0.242  | 0.254 | 0.196 | 100.0%  | 10    |
1294   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1295   Load duration: 0.603140115738
1296   Full duration: 5.95085787773
1297
1298   test scenario KeystoneBasic.create_and_delete_role
1299   +-------------------------------------------------------------------------------------------+
1300   |                                   Response Times (sec)                                    |
1301   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1302   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1303   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1304   | keystone.create_role | 0.109 | 0.202  | 0.275  | 0.311  | 0.347 | 0.205 | 100.0%  | 10    |
1305   | keystone.delete_role | 0.105 | 0.12   | 0.231  | 0.237  | 0.243 | 0.142 | 100.0%  | 10    |
1306   | total                | 0.236 | 0.352  | 0.43   | 0.503  | 0.576 | 0.348 | 100.0%  | 10    |
1307   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1308   Load duration: 1.02657985687
1309   Full duration: 4.95588898659
1310
1311   test scenario KeystoneBasic.get_entities
1312   +---------------------------------------------------------------------------------------------+
1313   |                                    Response Times (sec)                                     |
1314   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1315   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1316   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1317   | keystone.create_tenant | 0.113 | 0.129  | 0.165  | 0.166  | 0.167 | 0.136 | 100.0%  | 10    |
1318   | keystone.create_user   | 0.06  | 0.069  | 0.08   | 0.097  | 0.115 | 0.071 | 100.0%  | 10    |
1319   | keystone.create_role   | 0.047 | 0.053  | 0.094  | 0.095  | 0.097 | 0.061 | 100.0%  | 10    |
1320   | keystone.get_tenant    | 0.045 | 0.047  | 0.054  | 0.056  | 0.058 | 0.049 | 100.0%  | 10    |
1321   | keystone.get_user      | 0.051 | 0.054  | 0.059  | 0.06   | 0.062 | 0.055 | 100.0%  | 10    |
1322   | keystone.get_role      | 0.043 | 0.049  | 0.06   | 0.079  | 0.099 | 0.053 | 100.0%  | 10    |
1323   | keystone.service_list  | 0.047 | 0.06   | 0.099  | 0.105  | 0.111 | 0.067 | 100.0%  | 10    |
1324   | keystone.get_service   | 0.041 | 0.048  | 0.055  | 0.061  | 0.067 | 0.049 | 100.0%  | 10    |
1325   | total                  | 0.491 | 0.543  | 0.573  | 0.582  | 0.591 | 0.541 | 100.0%  | 10    |
1326   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1327   Load duration: 1.64348506927
1328   Full duration: 9.77697682381
1329
1330   test scenario KeystoneBasic.create_and_list_users
1331   +-------------------------------------------------------------------------------------------+
1332   |                                   Response Times (sec)                                    |
1333   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1334   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1335   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1336   | keystone.create_user | 0.133 | 0.142  | 0.187  | 0.192  | 0.196 | 0.151 | 100.0%  | 10    |
1337   | keystone.list_users  | 0.05  | 0.056  | 0.068  | 0.068  | 0.069 | 0.057 | 100.0%  | 10    |
1338   | total                | 0.183 | 0.202  | 0.244  | 0.25   | 0.257 | 0.208 | 100.0%  | 10    |
1339   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1340   Load duration: 0.625062942505
1341   Full duration: 4.61658096313
1342
1343   2016-02-10 23:45:10,506 - run_rally - DEBUG - task_id : a2dc597b-35dc-4b85-a214-5ff65687a80d
1344   2016-02-10 23:45:10,506 - run_rally - DEBUG - running command line : rally task report a2dc597b-35dc-4b85-a214-5ff65687a80d --out /home/opnfv/functest/results/rally/opnfv-keystone.html
1345   2016-02-10 23:45:11,115 - run_rally - DEBUG - running command line : rally task results a2dc597b-35dc-4b85-a214-5ff65687a80d
1346   2016-02-10 23:45:11,706 - run_rally - DEBUG - saving json file
1347   2016-02-10 23:45:11,708 - run_rally - DEBUG - Push result into DB
1348   2016-02-10 23:45:17,896 - run_rally - DEBUG - <Response [200]>
1349   2016-02-10 23:45:17,900 - run_rally - INFO - Test scenario: "keystone" OK.
1350
1351   2016-02-10 23:45:17,900 - run_rally - INFO - Starting test scenario "neutron" ...
1352   2016-02-10 23:45:17,900 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-neutron.yaml
1353   2016-02-10 23:45:18,243 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['neutron'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
1354   2016-02-10 23:50:17,508 - run_rally - INFO -
1355    Preparing input task
1356    Task  9f432e5d-104a-4b3a-b844-aa338a0da828: started
1357   Task 9f432e5d-104a-4b3a-b844-aa338a0da828: finished
1358
1359   test scenario NeutronNetworks.create_and_delete_ports
1360   +------------------------------------------------------------------------------------------+
1361   |                                   Response Times (sec)                                   |
1362   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1363   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1364   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1365   | neutron.create_port | 0.427 | 0.554  | 0.614  | 0.643  | 0.673 | 0.536 | 100.0%  | 10    |
1366   | neutron.delete_port | 0.142 | 0.237  | 0.342  | 0.476  | 0.611 | 0.256 | 100.0%  | 10    |
1367   | total               | 0.569 | 0.743  | 0.925  | 1.104  | 1.283 | 0.792 | 100.0%  | 10    |
1368   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1369   Load duration: 2.1176700592
1370   Full duration: 24.8256268501
1371
1372   test scenario NeutronNetworks.create_and_list_routers
1373   +---------------------------------------------------------------------------------------------------+
1374   |                                       Response Times (sec)                                        |
1375   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1376   | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1377   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1378   | neutron.create_subnet        | 0.423 | 0.477  | 0.542  | 0.576  | 0.609 | 0.489 | 100.0%  | 10    |
1379   | neutron.create_router        | 0.037 | 0.106  | 0.208  | 0.212  | 0.217 | 0.116 | 100.0%  | 10    |
1380   | neutron.add_interface_router | 0.283 | 0.413  | 0.456  | 0.492  | 0.527 | 0.403 | 100.0%  | 10    |
1381   | neutron.list_routers         | 0.032 | 0.094  | 0.183  | 0.188  | 0.193 | 0.103 | 100.0%  | 10    |
1382   | total                        | 0.953 | 1.114  | 1.232  | 1.246  | 1.261 | 1.11  | 100.0%  | 10    |
1383   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1384   Load duration: 3.33451294899
1385   Full duration: 27.7111759186
1386
1387   test scenario NeutronNetworks.create_and_delete_routers
1388   +------------------------------------------------------------------------------------------------------+
1389   |                                         Response Times (sec)                                         |
1390   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1391   | action                          | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1392   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1393   | neutron.create_subnet           | 0.395 | 0.424  | 0.48   | 0.489  | 0.499 | 0.436 | 100.0%  | 10    |
1394   | neutron.create_router           | 0.039 | 0.189  | 0.242  | 0.345  | 0.448 | 0.176 | 100.0%  | 10    |
1395   | neutron.add_interface_router    | 0.281 | 0.434  | 0.596  | 0.618  | 0.641 | 0.424 | 100.0%  | 10    |
1396   | neutron.remove_interface_router | 0.252 | 0.36   | 0.398  | 0.4    | 0.402 | 0.341 | 100.0%  | 10    |
1397   | neutron.delete_router           | 0.147 | 0.172  | 0.315  | 0.358  | 0.401 | 0.213 | 100.0%  | 10    |
1398   | total                           | 1.34  | 1.578  | 1.726  | 1.746  | 1.765 | 1.589 | 100.0%  | 10    |
1399   +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1400   Load duration: 4.79766583443
1401   Full duration: 28.1387701035
1402
1403   test scenario NeutronNetworks.create_and_list_ports
1404   +------------------------------------------------------------------------------------------+
1405   |                                   Response Times (sec)                                   |
1406   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1407   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1408   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1409   | neutron.create_port | 0.426 | 0.518  | 0.617  | 0.63   | 0.643 | 0.527 | 100.0%  | 10    |
1410   | neutron.list_ports  | 0.093 | 0.212  | 0.314  | 0.332  | 0.351 | 0.213 | 100.0%  | 10    |
1411   | total               | 0.522 | 0.731  | 0.94   | 0.953  | 0.966 | 0.74  | 100.0%  | 10    |
1412   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1413   Load duration: 2.09701919556
1414   Full duration: 25.6951978207
1415
1416   test scenario NeutronNetworks.create_and_delete_subnets
1417   +--------------------------------------------------------------------------------------------+
1418   |                                    Response Times (sec)                                    |
1419   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1420   | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1421   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1422   | neutron.create_subnet | 0.397 | 0.522  | 0.625  | 0.631  | 0.636 | 0.502 | 100.0%  | 10    |
1423   | neutron.delete_subnet | 0.14  | 0.314  | 0.383  | 0.398  | 0.413 | 0.308 | 100.0%  | 10    |
1424   | total                 | 0.537 | 0.83   | 0.98   | 0.992  | 1.004 | 0.809 | 100.0%  | 10    |
1425   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1426   Load duration: 2.3898100853
1427   Full duration: 25.9560959339
1428
1429   test scenario NeutronNetworks.create_and_delete_networks
1430   +---------------------------------------------------------------------------------------------+
1431   |                                    Response Times (sec)                                     |
1432   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1433   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1434   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1435   | neutron.create_network | 0.321 | 0.355  | 0.463  | 0.468  | 0.472 | 0.371 | 100.0%  | 10    |
1436   | neutron.delete_network | 0.123 | 0.252  | 0.327  | 0.331  | 0.336 | 0.249 | 100.0%  | 10    |
1437   | total                  | 0.47  | 0.627  | 0.737  | 0.762  | 0.787 | 0.62  | 100.0%  | 10    |
1438   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1439   Load duration: 1.76910996437
1440   Full duration: 13.8404121399
1441
1442   test scenario NeutronNetworks.create_and_list_networks
1443   +---------------------------------------------------------------------------------------------+
1444   |                                    Response Times (sec)                                     |
1445   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1446   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1447   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1448   | neutron.create_network | 0.307 | 0.34   | 0.401  | 0.433  | 0.466 | 0.353 | 100.0%  | 10    |
1449   | neutron.list_networks  | 0.042 | 0.165  | 0.233  | 0.241  | 0.248 | 0.135 | 100.0%  | 10    |
1450   | total                  | 0.351 | 0.479  | 0.628  | 0.64   | 0.652 | 0.488 | 100.0%  | 10    |
1451   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1452   Load duration: 1.40053105354
1453   Full duration: 15.5931649208
1454
1455   test scenario NeutronNetworks.create_and_update_routers
1456   +---------------------------------------------------------------------------------------------------+
1457   |                                       Response Times (sec)                                        |
1458   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1459   | action                       | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1460   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1461   | neutron.create_subnet        | 0.375 | 0.475  | 0.507  | 0.549  | 0.592 | 0.469 | 100.0%  | 10    |
1462   | neutron.create_router        | 0.037 | 0.057  | 0.215  | 0.303  | 0.392 | 0.119 | 100.0%  | 10    |
1463   | neutron.add_interface_router | 0.289 | 0.427  | 0.468  | 0.469  | 0.47  | 0.402 | 100.0%  | 10    |
1464   | neutron.update_router        | 0.119 | 0.135  | 0.264  | 0.265  | 0.266 | 0.17  | 100.0%  | 10    |
1465   | total                        | 0.998 | 1.14   | 1.363  | 1.364  | 1.366 | 1.16  | 100.0%  | 10    |
1466   +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1467   Load duration: 3.51950502396
1468   Full duration: 28.7816469669
1469
1470   test scenario NeutronNetworks.create_and_update_networks
1471   +---------------------------------------------------------------------------------------------+
1472   |                                    Response Times (sec)                                     |
1473   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1474   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1475   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1476   | neutron.create_network | 0.306 | 0.352  | 0.562  | 0.585  | 0.609 | 0.395 | 100.0%  | 10    |
1477   | neutron.update_network | 0.105 | 0.264  | 0.323  | 0.353  | 0.383 | 0.241 | 100.0%  | 10    |
1478   | total                  | 0.41  | 0.658  | 0.751  | 0.752  | 0.753 | 0.635 | 100.0%  | 10    |
1479   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1480   Load duration: 1.86403417587
1481   Full duration: 16.0056118965
1482
1483   test scenario NeutronNetworks.create_and_update_ports
1484   +------------------------------------------------------------------------------------------+
1485   |                                   Response Times (sec)                                   |
1486   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1487   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1488   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1489   | neutron.create_port | 0.431 | 0.582  | 0.66   | 0.679  | 0.698 | 0.557 | 100.0%  | 10    |
1490   | neutron.update_port | 0.12  | 0.289  | 0.348  | 0.355  | 0.362 | 0.272 | 100.0%  | 10    |
1491   | total               | 0.569 | 0.834  | 1.002  | 1.003  | 1.003 | 0.829 | 100.0%  | 10    |
1492   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1493   Load duration: 2.53265404701
1494   Full duration: 26.9364058971
1495
1496   test scenario NeutronNetworks.create_and_list_subnets
1497   +--------------------------------------------------------------------------------------------+
1498   |                                    Response Times (sec)                                    |
1499   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1500   | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1501   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1502   | neutron.create_subnet | 0.392 | 0.427  | 0.55   | 0.556  | 0.561 | 0.453 | 100.0%  | 10    |
1503   | neutron.list_subnets  | 0.058 | 0.194  | 0.283  | 0.287  | 0.291 | 0.173 | 100.0%  | 10    |
1504   | total                 | 0.477 | 0.627  | 0.753  | 0.786  | 0.819 | 0.626 | 100.0%  | 10    |
1505   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1506   Load duration: 1.75291109085
1507   Full duration: 25.8106958866
1508
1509   test scenario NeutronNetworks.create_and_update_subnets
1510   +--------------------------------------------------------------------------------------------+
1511   |                                    Response Times (sec)                                    |
1512   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1513   | action                | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1514   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1515   | neutron.create_subnet | 0.396 | 0.418  | 0.526  | 0.526  | 0.526 | 0.449 | 100.0%  | 10    |
1516   | neutron.update_subnet | 0.162 | 0.299  | 0.393  | 0.393  | 0.394 | 0.293 | 100.0%  | 10    |
1517   | total                 | 0.583 | 0.755  | 0.812  | 0.817  | 0.822 | 0.742 | 100.0%  | 10    |
1518   +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1519   Load duration: 2.20696282387
1520   Full duration: 26.2696731091
1521
1522   2016-02-10 23:50:17,509 - run_rally - DEBUG - task_id : 9f432e5d-104a-4b3a-b844-aa338a0da828
1523   2016-02-10 23:50:17,509 - run_rally - DEBUG - running command line : rally task report 9f432e5d-104a-4b3a-b844-aa338a0da828 --out /home/opnfv/functest/results/rally/opnfv-neutron.html
1524   2016-02-10 23:50:18,133 - run_rally - DEBUG - running command line : rally task results 9f432e5d-104a-4b3a-b844-aa338a0da828
1525   2016-02-10 23:50:18,739 - run_rally - DEBUG - saving json file
1526   2016-02-10 23:50:18,743 - run_rally - DEBUG - Push result into DB
1527   2016-02-10 23:50:25,367 - run_rally - DEBUG - <Response [200]>
1528   2016-02-10 23:50:25,369 - run_rally - INFO - Test scenario: "neutron" OK.
1529
1530   2016-02-10 23:50:25,370 - run_rally - INFO - Starting test scenario "nova" ...
1531   2016-02-10 23:50:25,370 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-nova.yaml
1532   2016-02-10 23:50:25,701 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['nova'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
1533   2016-02-11 00:19:05,621 - run_rally - INFO -
1534    Preparing input task
1535    Task  08b4bf35-51b4-464d-84ec-8b7381b19b6d: started
1536   Task 08b4bf35-51b4-464d-84ec-8b7381b19b6d: finished
1537
1538   test scenario NovaKeypair.create_and_delete_keypair
1539   +------------------------------------------------------------------------------------------+
1540   |                                   Response Times (sec)                                   |
1541   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1542   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1543   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1544   | nova.create_keypair | 0.373 | 0.448  | 0.655  | 0.661  | 0.667 | 0.492 | 100.0%  | 10    |
1545   | nova.delete_keypair | 0.011 | 0.016  | 0.021  | 0.022  | 0.024 | 0.017 | 100.0%  | 10    |
1546   | total               | 0.39  | 0.461  | 0.672  | 0.676  | 0.681 | 0.509 | 100.0%  | 10    |
1547   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1548   Load duration: 1.5162088871
1549   Full duration: 15.1700220108
1550
1551   test scenario NovaServers.boot_and_live_migrate_server
1552   +-----------------------------------------------------------------------+
1553   |                         Response Times (sec)                          |
1554   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1555   | action | min | median | 90%ile | 95%ile | max | avg | success | count |
1556   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1557   | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
1558   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1559   Load duration: 10.2629051208
1560   Full duration: 30.6517119408
1561
1562   test scenario NovaServers.resize_server
1563   +---------------------------------------------------------------------------------------------+
1564   |                                    Response Times (sec)                                     |
1565   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1566   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1567   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1568   | nova.boot_server    | 3.503  | 4.665  | 6.416  | 6.423  | 6.43   | 4.859  | 100.0%  | 10    |
1569   | nova.resize         | 21.142 | 31.559 | 41.868 | 42.148 | 42.428 | 30.669 | 100.0%  | 10    |
1570   | nova.resize_confirm | 2.369  | 2.404  | 2.581  | 2.608  | 2.635  | 2.45   | 100.0%  | 10    |
1571   | nova.delete_server  | 2.382  | 2.537  | 2.6    | 2.657  | 2.714  | 2.509  | 100.0%  | 10    |
1572   | total               | 30.071 | 41.459 | 53.105 | 53.46  | 53.814 | 40.487 | 100.0%  | 10    |
1573   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1574   Load duration: 103.749622822
1575   Full duration: 117.664920807
1576
1577   test scenario NovaServers.snapshot_server
1578   +---------------------------------------------------------------------------------------------------+
1579   |                                       Response Times (sec)                                        |
1580   +------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1581   | action                 | min    | median | 90%ile  | 95%ile  | max     | avg    | success | count |
1582   +------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1583   | nova.boot_server       | 4.697  | 6.722  | 7.381   | 7.412   | 7.443   | 6.421  | 100.0%  | 10    |
1584   | nova.create_image      | 27.446 | 56.176 | 75.464  | 77.263  | 79.062  | 54.113 | 100.0%  | 10    |
1585   | nova.delete_server     | 2.392  | 2.567  | 2.878   | 3.031   | 3.183   | 2.647  | 100.0%  | 10    |
1586   | nova.boot_server (2)   | 14.757 | 28.959 | 37.432  | 44.257  | 51.082  | 28.154 | 100.0%  | 10    |
1587   | nova.delete_server (2) | 2.427  | 4.698  | 4.989   | 5.204   | 5.419   | 3.966  | 100.0%  | 10    |
1588   | nova.delete_image      | 0.318  | 0.432  | 0.622   | 0.654   | 0.687   | 0.46   | 100.0%  | 10    |
1589   | total                  | 62.068 | 97.916 | 124.362 | 125.622 | 126.882 | 95.762 | 100.0%  | 10    |
1590   +------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1591   Load duration: 263.444504976
1592   Full duration: 287.171573877
1593
1594   test scenario NovaKeypair.boot_and_delete_server_with_keypair
1595   +-------------------------------------------------------------------------------------------+
1596   |                                   Response Times (sec)                                    |
1597   +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1598   | action              | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
1599   +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1600   | nova.create_keypair | 0.4   | 0.479  | 0.545  | 0.548  | 0.551  | 0.473 | 100.0%  | 10    |
1601   | nova.boot_server    | 3.185 | 4.612  | 5.917  | 5.941  | 5.965  | 4.6   | 100.0%  | 10    |
1602   | nova.delete_server  | 2.378 | 2.573  | 4.795  | 4.817  | 4.839  | 3.194 | 100.0%  | 10    |
1603   | nova.delete_keypair | 0.012 | 0.016  | 0.021  | 0.022  | 0.023  | 0.016 | 100.0%  | 10    |
1604   | total               | 6.115 | 7.563  | 11.095 | 11.205 | 11.315 | 8.283 | 100.0%  | 10    |
1605   +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1606   Load duration: 24.9650418758
1607   Full duration: 48.4524579048
1608
1609   test scenario NovaKeypair.create_and_list_keypairs
1610   +------------------------------------------------------------------------------------------+
1611   |                                   Response Times (sec)                                   |
1612   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1613   | action              | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1614   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1615   | nova.create_keypair | 0.38  | 0.482  | 0.568  | 0.573  | 0.577 | 0.477 | 100.0%  | 10    |
1616   | nova.list_keypairs  | 0.012 | 0.016  | 0.022  | 0.024  | 0.026 | 0.017 | 100.0%  | 10    |
1617   | total               | 0.393 | 0.501  | 0.584  | 0.587  | 0.59  | 0.494 | 100.0%  | 10    |
1618   +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1619   Load duration: 1.60101890564
1620   Full duration: 16.9254760742
1621
1622   test scenario NovaServers.list_servers
1623   +----------------------------------------------------------------------------------------+
1624   |                                  Response Times (sec)                                  |
1625   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1626   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1627   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1628   | nova.list_servers | 0.578 | 0.653  | 0.856  | 0.868  | 0.879 | 0.695 | 100.0%  | 10    |
1629   | total             | 0.578 | 0.653  | 0.856  | 0.868  | 0.879 | 0.695 | 100.0%  | 10    |
1630   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1631   Load duration: 2.03527998924
1632   Full duration: 49.9647991657
1633
1634   test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate
1635   +-----------------------------------------------------------------------+
1636   |                         Response Times (sec)                          |
1637   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1638   | action | min | median | 90%ile | 95%ile | max | avg | success | count |
1639   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1640   | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
1641   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1642   Load duration: 36.9445459843
1643   Full duration: 71.067373991
1644
1645   test scenario NovaServers.boot_server_from_volume_and_delete
1646   +----------------------------------------------------------------------------------------------+
1647   |                                     Response Times (sec)                                     |
1648   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1649   | action               | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1650   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1651   | cinder.create_volume | 3.284  | 4.347  | 5.917  | 5.935  | 5.953  | 4.57   | 100.0%  | 10    |
1652   | nova.boot_server     | 8.656  | 8.975  | 11.751 | 12.822 | 13.894 | 9.979  | 100.0%  | 10    |
1653   | nova.delete_server   | 4.469  | 4.629  | 4.902  | 5.77   | 6.637  | 4.795  | 100.0%  | 10    |
1654   | total                | 16.705 | 18.797 | 22.17  | 23.265 | 24.359 | 19.344 | 100.0%  | 10    |
1655   +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1656   Load duration: 56.6653358936
1657   Full duration: 86.5513851643
1658
1659   test scenario NovaServers.boot_and_migrate_server
1660   +---------------------------------------------------------------------------------------------+
1661   |                                    Response Times (sec)                                     |
1662   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1663   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1664   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1665   | nova.boot_server    | 3.545  | 5.453  | 6.379  | 6.388  | 6.397  | 5.304  | 100.0%  | 10    |
1666   | nova.stop_server    | 4.889  | 5.218  | 15.761 | 15.837 | 15.913 | 8.914  | 100.0%  | 10    |
1667   | nova.migrate        | 16.4   | 33.87  | 34.769 | 37.772 | 40.775 | 29.605 | 100.0%  | 10    |
1668   | nova.resize_confirm | 2.374  | 2.413  | 2.564  | 2.628  | 2.693  | 2.457  | 100.0%  | 10    |
1669   | nova.delete_server  | 2.375  | 2.505  | 2.571  | 2.596  | 2.622  | 2.49   | 100.0%  | 10    |
1670   | total               | 31.462 | 49.989 | 59.92  | 62.401 | 64.881 | 48.769 | 100.0%  | 10    |
1671   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1672   Load duration: 139.907422066
1673   Full duration: 153.807698965
1674
1675   test scenario NovaServers.boot_and_delete_server
1676   +------------------------------------------------------------------------------------------+
1677   |                                   Response Times (sec)                                   |
1678   +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1679   | action             | min   | median | 90%ile | 95%ile | max    | avg   | success | count |
1680   +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1681   | nova.boot_server   | 3.504 | 4.938  | 6.215  | 6.23   | 6.245  | 4.81  | 100.0%  | 10    |
1682   | nova.delete_server | 2.413 | 2.601  | 2.875  | 3.698  | 4.52   | 2.761 | 100.0%  | 10    |
1683   | total              | 5.933 | 7.491  | 9.071  | 9.902  | 10.733 | 7.571 | 100.0%  | 10    |
1684   +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
1685   Load duration: 22.7597670555
1686   Full duration: 46.605672121
1687
1688   test scenario NovaServers.boot_and_rebuild_server
1689   +---------------------------------------------------------------------------------------------+
1690   |                                    Response Times (sec)                                     |
1691   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1692   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1693   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1694   | nova.boot_server    | 3.637  | 6.025  | 6.449  | 6.453  | 6.457  | 5.483  | 100.0%  | 10    |
1695   | nova.rebuild_server | 6.436  | 7.77   | 15.755 | 15.76  | 15.766 | 9.178  | 100.0%  | 10    |
1696   | nova.delete_server  | 2.369  | 2.424  | 2.61   | 2.678  | 2.747  | 2.483  | 100.0%  | 10    |
1697   | total               | 13.692 | 16.387 | 21.826 | 21.969 | 22.111 | 17.143 | 100.0%  | 10    |
1698   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1699   Load duration: 47.7669019699
1700   Full duration: 71.1696259975
1701
1702   test scenario NovaSecGroup.create_and_list_secgroups
1703   +--------------------------------------------------------------------------------------------------------+
1704   |                                          Response Times (sec)                                          |
1705   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1706   | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1707   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1708   | nova.create_10_security_groups | 1.519  | 1.756  | 1.917  | 1.969  | 2.021  | 1.735  | 100.0%  | 10    |
1709   | nova.create_100_rules          | 9.199  | 10.422 | 10.663 | 10.758 | 10.853 | 10.254 | 100.0%  | 10    |
1710   | nova.list_security_groups      | 0.093  | 0.136  | 0.157  | 0.158  | 0.159  | 0.132  | 100.0%  | 10    |
1711   | total                          | 10.904 | 12.348 | 12.613 | 12.632 | 12.652 | 12.121 | 100.0%  | 10    |
1712   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1713   Load duration: 35.5776119232
1714   Full duration: 63.5648519993
1715
1716   test scenario NovaSecGroup.create_and_delete_secgroups
1717   +--------------------------------------------------------------------------------------------------------+
1718   |                                          Response Times (sec)                                          |
1719   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1720   | action                         | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1721   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1722   | nova.create_10_security_groups | 1.885  | 2.052  | 2.253  | 2.296  | 2.338  | 2.073  | 100.0%  | 10    |
1723   | nova.create_100_rules          | 8.876  | 10.379 | 10.859 | 10.946 | 11.032 | 10.212 | 100.0%  | 10    |
1724   | nova.delete_10_security_groups | 0.846  | 0.986  | 1.172  | 1.231  | 1.289  | 1.008  | 100.0%  | 10    |
1725   | total                          | 12.057 | 13.517 | 13.809 | 13.925 | 14.042 | 13.293 | 100.0%  | 10    |
1726   +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1727   Load duration: 39.1708610058
1728   Full duration: 53.6136760712
1729
1730   test scenario NovaServers.boot_and_bounce_server
1731   +----------------------------------------------------------------------------------------------------+
1732   |                                        Response Times (sec)                                        |
1733   +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1734   | action                  | min    | median | 90%ile  | 95%ile  | max     | avg    | success | count |
1735   +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1736   | nova.boot_server        | 3.443  | 3.823  | 6.488   | 6.515   | 6.543   | 4.601  | 100.0%  | 10    |
1737   | nova.reboot_server      | 2.592  | 4.623  | 6.671   | 6.813   | 6.955   | 4.866  | 100.0%  | 10    |
1738   | nova.soft_reboot_server | 4.646  | 6.73   | 126.895 | 127.35  | 127.805 | 30.601 | 100.0%  | 10    |
1739   | nova.stop_server        | 4.646  | 4.94   | 15.518  | 15.693  | 15.867  | 7.046  | 100.0%  | 10    |
1740   | nova.start_server       | 2.619  | 2.794  | 2.96    | 3.449   | 3.939   | 2.861  | 100.0%  | 10    |
1741   | nova.rescue_server      | 6.623  | 11.184 | 17.613  | 17.639  | 17.665  | 11.717 | 100.0%  | 10    |
1742   | nova.unrescue_server    | 2.299  | 3.39   | 4.596   | 4.626   | 4.655   | 3.421  | 100.0%  | 10    |
1743   | nova.delete_server      | 2.374  | 2.396  | 2.532   | 2.554   | 2.575   | 2.437  | 100.0%  | 10    |
1744   | total                   | 33.772 | 47.069 | 161.92  | 168.976 | 176.031 | 67.561 | 100.0%  | 10    |
1745   +-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
1746   Load duration: 176.050487041
1747   Full duration: 199.794572115
1748
1749   test scenario NovaServers.boot_server
1750   +---------------------------------------------------------------------------------------+
1751   |                                 Response Times (sec)                                  |
1752   +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1753   | action           | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1754   +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1755   | nova.boot_server | 3.535 | 3.971  | 6.359  | 6.504  | 6.649 | 4.691 | 100.0%  | 10    |
1756   | total            | 3.535 | 3.971  | 6.359  | 6.504  | 6.649 | 4.691 | 100.0%  | 10    |
1757   +------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1758   Load duration: 13.4904000759
1759   Full duration: 36.8076519966
1760
1761   test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
1762   +-----------------------------------------------------------------------------------------------------------+
1763   |                                           Response Times (sec)                                            |
1764   +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1765   | action                            | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1766   +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1767   | nova.create_10_security_groups    | 1.778  | 2.057  | 2.4    | 2.444  | 2.487  | 2.078  | 100.0%  | 10    |
1768   | nova.create_100_rules             | 9.291  | 10.066 | 10.404 | 10.686 | 10.967 | 10.061 | 100.0%  | 10    |
1769   | nova.boot_server                  | 3.293  | 4.462  | 6.701  | 6.838  | 6.974  | 5.006  | 100.0%  | 10    |
1770   | nova.get_attached_security_groups | 0.142  | 0.159  | 0.188  | 0.199  | 0.209  | 0.164  | 100.0%  | 10    |
1771   | nova.delete_server                | 2.412  | 2.535  | 4.677  | 4.713  | 4.749  | 3.154  | 100.0%  | 10    |
1772   | nova.delete_10_security_groups    | 0.818  | 0.916  | 1.001  | 1.014  | 1.027  | 0.911  | 100.0%  | 10    |
1773   | total                             | 17.852 | 20.4   | 24.95  | 25.046 | 25.142 | 21.375 | 100.0%  | 10    |
1774   +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1775   Load duration: 62.7762010098
1776   Full duration: 86.571160078
1777
1778   test scenario NovaServers.pause_and_unpause_server
1779   +---------------------------------------------------------------------------------------------+
1780   |                                    Response Times (sec)                                     |
1781   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1782   | action              | min    | median | 90%ile | 95%ile | max    | avg    | success | count |
1783   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1784   | nova.boot_server    | 3.511  | 4.668  | 6.119  | 6.135  | 6.15   | 4.767  | 100.0%  | 10    |
1785   | nova.pause_server   | 2.307  | 2.47   | 2.577  | 2.655  | 2.732  | 2.457  | 100.0%  | 10    |
1786   | nova.unpause_server | 2.32   | 2.461  | 2.57   | 2.585  | 2.601  | 2.458  | 100.0%  | 10    |
1787   | nova.delete_server  | 2.381  | 2.591  | 4.596  | 4.613  | 4.631  | 2.953  | 100.0%  | 10    |
1788   | total               | 10.769 | 12.136 | 15.599 | 15.6   | 15.601 | 12.635 | 100.0%  | 10    |
1789   +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
1790   Load duration: 36.0108971596
1791   Full duration: 59.3288369179
1792
1793   test scenario NovaServers.boot_server_from_volume_and_live_migrate
1794   +-----------------------------------------------------------------------+
1795   |                         Response Times (sec)                          |
1796   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1797   | action | min | median | 90%ile | 95%ile | max | avg | success | count |
1798   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1799   | total  | n/a | n/a    | n/a    | n/a    | n/a | n/a | 0.0%    | 5     |
1800   +--------+-----+--------+--------+--------+-----+-----+---------+-------+
1801   Load duration: 41.4217681885
1802   Full duration: 71.6037459373
1803
1804   test scenario NovaServers.boot_server_from_volume
1805   +---------------------------------------------------------------------------------------------+
1806   |                                    Response Times (sec)                                     |
1807   +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1808   | action               | min    | median | 90%ile | 95%ile | max    | avg   | success | count |
1809   +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1810   | cinder.create_volume | 3.252  | 3.677  | 5.937  | 5.975  | 6.013  | 4.432 | 100.0%  | 10    |
1811   | nova.boot_server     | 8.451  | 8.987  | 11.258 | 11.268 | 11.279 | 9.688 | 100.0%  | 10    |
1812   | total                | 11.839 | 13.981 | 17.047 | 17.065 | 17.084 | 14.12 | 100.0%  | 10    |
1813   +----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
1814   Load duration: 40.1873419285
1815   Full duration: 75.1306819916
1816
1817   test scenario NovaServers.boot_and_list_server
1818   +----------------------------------------------------------------------------------------+
1819   |                                  Response Times (sec)                                  |
1820   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1821   | action            | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1822   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1823   | nova.boot_server  | 3.455 | 4.931  | 6.206  | 6.338  | 6.471 | 4.88  | 100.0%  | 10    |
1824   | nova.list_servers | 0.147 | 0.36   | 0.432  | 0.434  | 0.436 | 0.307 | 100.0%  | 10    |
1825   | total             | 3.886 | 5.15   | 6.374  | 6.601  | 6.828 | 5.187 | 100.0%  | 10    |
1826   +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1827   Load duration: 15.448579073
1828   Full duration: 49.2652499676
1829
1830   2016-02-11 00:19:05,622 - run_rally - DEBUG - task_id : 08b4bf35-51b4-464d-84ec-8b7381b19b6d
1831   2016-02-11 00:19:05,622 - run_rally - DEBUG - running command line : rally task report 08b4bf35-51b4-464d-84ec-8b7381b19b6d --out /home/opnfv/functest/results/rally/opnfv-nova.html
1832   2016-02-11 00:19:06,337 - run_rally - DEBUG - running command line : rally task results 08b4bf35-51b4-464d-84ec-8b7381b19b6d
1833   2016-02-11 00:19:06,947 - run_rally - DEBUG - saving json file
1834   2016-02-11 00:19:06,954 - run_rally - DEBUG - Push result into DB
1835   2016-02-11 00:19:14,145 - run_rally - DEBUG - <Response [200]>
1836   2016-02-11 00:19:14,149 - run_rally - INFO - Test scenario: "nova" Failed.
1837
1838   2016-02-11 00:19:14,150 - run_rally - INFO - Starting test scenario "quotas" ...
1839   2016-02-11 00:19:14,150 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-quotas.yaml
1840   2016-02-11 00:19:14,610 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['quotas'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
1841   2016-02-11 00:19:58,886 - run_rally - INFO -
1842    Preparing input task
1843    Task  4b88c6b5-6d04-41f1-b7bf-0530d1460380: started
1844   Task 4b88c6b5-6d04-41f1-b7bf-0530d1460380: finished
1845
1846   test scenario Quotas.cinder_update
1847   +-------------------------------------------------------------------------------------------+
1848   |                                   Response Times (sec)                                    |
1849   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1850   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1851   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1852   | quotas.update_quotas | 0.571 | 0.661  | 0.724  | 0.726  | 0.728 | 0.653 | 100.0%  | 10    |
1853   | total                | 0.571 | 0.661  | 0.724  | 0.726  | 0.728 | 0.654 | 100.0%  | 10    |
1854   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1855   Load duration: 1.99102902412
1856   Full duration: 7.71833896637
1857
1858   test scenario Quotas.neutron_update
1859   +-------------------------------------------------------------------------------------------+
1860   |                                   Response Times (sec)                                    |
1861   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1862   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1863   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1864   | quotas.update_quotas | 0.22  | 0.241  | 0.351  | 0.373  | 0.396 | 0.268 | 100.0%  | 10    |
1865   | total                | 0.276 | 0.305  | 0.415  | 0.441  | 0.467 | 0.331 | 100.0%  | 10    |
1866   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1867   Load duration: 0.942007064819
1868   Full duration: 6.36414504051
1869
1870   test scenario Quotas.cinder_update_and_delete
1871   +-------------------------------------------------------------------------------------------+
1872   |                                   Response Times (sec)                                    |
1873   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1874   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1875   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1876   | quotas.update_quotas | 0.587 | 0.616  | 0.682  | 0.704  | 0.726 | 0.629 | 100.0%  | 10    |
1877   | quotas.delete_quotas | 0.41  | 0.461  | 0.544  | 0.562  | 0.579 | 0.472 | 100.0%  | 10    |
1878   | total                | 1.006 | 1.112  | 1.204  | 1.235  | 1.267 | 1.101 | 100.0%  | 10    |
1879   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1880   Load duration: 3.30020499229
1881   Full duration: 9.0813190937
1882
1883   test scenario Quotas.nova_update_and_delete
1884   +-------------------------------------------------------------------------------------------+
1885   |                                   Response Times (sec)                                    |
1886   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1887   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1888   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1889   | quotas.update_quotas | 0.327 | 0.339  | 0.357  | 0.358  | 0.359 | 0.342 | 100.0%  | 8     |
1890   | quotas.delete_quotas | 0.016 | 0.023  | 0.027  | 0.027  | 0.028 | 0.022 | 75.0%   | 8     |
1891   | total                | 0.353 | 0.356  | 0.372  | 0.374  | 0.377 | 0.361 | 75.0%   | 8     |
1892   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1893   Load duration: 0.749735832214
1894   Full duration: 5.99576282501
1895
1896   test scenario Quotas.nova_update
1897   +-------------------------------------------------------------------------------------------+
1898   |                                   Response Times (sec)                                    |
1899   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1900   | action               | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1901   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1902   | quotas.update_quotas | 0.321 | 0.364  | 0.452  | 0.48   | 0.507 | 0.379 | 100.0%  | 10    |
1903   | total                | 0.321 | 0.364  | 0.452  | 0.48   | 0.507 | 0.379 | 100.0%  | 10    |
1904   +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1905   Load duration: 1.10366201401
1906   Full duration: 6.54270100594
1907
1908   2016-02-11 00:19:58,886 - run_rally - DEBUG - task_id : 4b88c6b5-6d04-41f1-b7bf-0530d1460380
1909   2016-02-11 00:19:58,886 - run_rally - DEBUG - running command line : rally task report 4b88c6b5-6d04-41f1-b7bf-0530d1460380 --out /home/opnfv/functest/results/rally/opnfv-quotas.html
1910   2016-02-11 00:19:59,507 - run_rally - DEBUG - running command line : rally task results 4b88c6b5-6d04-41f1-b7bf-0530d1460380
1911   2016-02-11 00:20:00,092 - run_rally - DEBUG - saving json file
1912   2016-02-11 00:20:00,093 - run_rally - DEBUG - Push result into DB
1913   2016-02-11 00:20:06,245 - run_rally - DEBUG - <Response [200]>
1914   2016-02-11 00:20:06,246 - run_rally - INFO - Test scenario: "quotas" Failed.
1915
1916   2016-02-11 00:20:06,246 - run_rally - INFO - Starting test scenario "requests" ...
1917   2016-02-11 00:20:06,246 - run_rally - DEBUG - Scenario fetched from : /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/opnfv-requests.yaml
1918   2016-02-11 00:20:06,678 - run_rally - DEBUG - running command line : rally task start --abort-on-sla-failure --task /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/task.yaml --task-args "{'floating_network': 'ext-net', 'iterations': 10, 'tmpl_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/templates', 'netid': '5333b06c-91ae-407b-8a20-a5c0adff52ee', 'service_list': ['requests'], 'concurrency': 4, 'tenants_amount': 3, 'image_name': 'functest-img', 'glance_image_location': '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img', 'flavor_name': 'm1.tiny', 'smoke': False, 'users_amount': 2, 'sup_dir': '/home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/rally_cert/scenario/support'}"
1919   2016-02-11 00:20:50,664 - run_rally - INFO -
1920    Preparing input task
1921    Task  f71c7e36-d999-42c9-affb-028670a5b248: started
1922   Task f71c7e36-d999-42c9-affb-028670a5b248: finished
1923
1924   test scenario HttpRequests.check_random_request
1925   +---------------------------------------------------------------------------------------------+
1926   |                                    Response Times (sec)                                     |
1927   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1928   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1929   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1930   | requests.check_request | 5.458 | 5.495  | 5.881  | 5.973  | 6.065 | 5.612 | 100.0%  | 10    |
1931   | total                  | 5.458 | 5.495  | 5.881  | 5.973  | 6.065 | 5.612 | 100.0%  | 10    |
1932   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1933   Load duration: 16.8338370323
1934   Full duration: 19.1276738644
1935
1936   test scenario HttpRequests.check_request
1937   +---------------------------------------------------------------------------------------------+
1938   |                                    Response Times (sec)                                     |
1939   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1940   | action                 | min   | median | 90%ile | 95%ile | max   | avg   | success | count |
1941   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1942   | requests.check_request | 5.435 | 5.459  | 5.504  | 5.521  | 5.537 | 5.472 | 100.0%  | 10    |
1943   | total                  | 5.435 | 5.459  | 5.504  | 5.521  | 5.537 | 5.472 | 100.0%  | 10    |
1944   +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
1945   Load duration: 16.4511258602
1946   Full duration: 18.9822120667
1947
1948   2016-02-11 00:20:50,664 - run_rally - DEBUG - task_id : f71c7e36-d999-42c9-affb-028670a5b248
1949   2016-02-11 00:20:50,664 - run_rally - DEBUG - running command line : rally task report f71c7e36-d999-42c9-affb-028670a5b248 --out /home/opnfv/functest/results/rally/opnfv-requests.html
1950   2016-02-11 00:20:51,254 - run_rally - DEBUG - running command line : rally task results f71c7e36-d999-42c9-affb-028670a5b248
1951   2016-02-11 00:20:51,824 - run_rally - DEBUG - saving json file
1952   2016-02-11 00:20:51,825 - run_rally - DEBUG - Push result into DB
1953   2016-02-11 00:20:57,506 - run_rally - DEBUG - <Response [200]>
1954   2016-02-11 00:20:57,507 - run_rally - INFO - Test scenario: "requests" OK.
1955
1956   2016-02-11 00:20:57,507 - run_rally - INFO -
1957
1958                        Rally Summary Report
1959   +===================+============+===============+===========+
1960   | Module            | Duration   | nb. Test Run  | Success   |
1961   +===================+============+===============+===========+
1962   | authenticate      | 00:17      | 10            | 100.00%   |
1963   +-------------------+------------+---------------+-----------+
1964   | glance            | 01:27      | 7             | 100.00%   |
1965   +-------------------+------------+---------------+-----------+
1966   | cinder            | 16:03      | 50            | 100.00%   |
1967   +-------------------+------------+---------------+-----------+
1968   | heat              | 06:25      | 32            | 92.31%    |
1969   +-------------------+------------+---------------+-----------+
1970   | keystone          | 01:08      | 29            | 100.00%   |
1971   +-------------------+------------+---------------+-----------+
1972   | neutron           | 04:45      | 31            | 100.00%   |
1973   +-------------------+------------+---------------+-----------+
1974   | nova              | 28:10      | 61            | 85.71%    |
1975   +-------------------+------------+---------------+-----------+
1976   | quotas            | 00:35      | 7             | 95.00%    |
1977   +-------------------+------------+---------------+-----------+
1978   | requests          | 00:38      | 2             | 100.00%   |
1979   +-------------------+------------+---------------+-----------+
1980   +===================+============+===============+===========+
1981   | TOTAL:            | 00:59:33   | 229           | 97.00%    |
1982   +===================+============+===============+===========+
1983
1984   2016-02-11 00:20:57,507 - run_rally - DEBUG - Pushing Rally summary into DB...
1985   2016-02-11 00:21:03,070 - run_rally - DEBUG - <Response [200]>
1986   2016-02-11 00:21:03,071 - run_rally - DEBUG - Deleting image 'functest-img' with ID 'a4efc793-1195-482b-9da6-87299b33d650'...
1987   2016-02-11 00:21:03,614 - run_rally - DEBUG - Deleting volume type 'volume_test'...
1988 ::