Merge "Prepare Brahmaputra 3.0 release"
[functest.git] / docs / results / fuel-os-odl_l2-sfc-ha.rst
1 .. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
2 .. http://creativecommons.org/licenses/by/4.0
3
4 Detailed test results for fuel-os-odl_l2-sfc-ha
5 -----------------------------------------------------
6
7 VIM
8 ---
9
10 vping_ssh
11 ^^^^^^^^^
12 ::
13
14     FUNCTEST.info: Running vPing-SSH test...
15     vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
16     vPing_ssh- INFO - Creating neutron network vping-net...
17     vPing_ssh- INFO - Creating security group  'vPing-sg'...
18     vPing_ssh- INFO - Using existing Flavor 'm1.small'...
19     vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
20     vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
21      name=opnfv-vping-1
22      flavor=<Flavor: m1.small>
23      image=fff41d5d-579a-4c26-844d-4e86700c44f6
24      network=a5137d46-dea8-4f85-8872-08c4a5927182
25
26     vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
27     vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
28     vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
29      name=opnfv-vping-2
30      flavor=<Flavor: m1.small>
31      image=fff41d5d-579a-4c26-844d-4e86700c44f6
32      network=a5137d46-dea8-4f85-8872-08c4a5927182
33
34     vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
35     vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
36     vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
37     vPing_ssh- INFO - Floating IP created: '10.118.101.200'
38     vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
39     vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
40     vPing_ssh- INFO - Waiting for ping...
41     vPing_ssh- INFO - vPing detected!
42     vPing_ssh- INFO - vPing duration:'34.7' s.
43     vPing_ssh- INFO - Cleaning up...
44     vPing_ssh- INFO - vPing OK
45
46 vping_userdata
47 ^^^^^^^^^^^^^^
48 ::
49
50     FUNCTEST.info: Running vPing-userdata test...
51     vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
52     vPing_userdata- INFO - Creating neutron network vping-net...
53     vPing_userdata- INFO - Creating security group  'vPing-sg'...
54     vPing_userdata- INFO - Flavor found 'm1.small'
55     vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
56     vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
57      name=opnfv-vping-1
58      flavor=<Flavor: m1.small>
59      image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
60      network=a1efb318-1338-436f-8f26-3a1bacab0538
61
62     vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
63     vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
64      name=opnfv-vping-2
65      flavor=<Flavor: m1.small>
66      image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
67      network=a1efb318-1338-436f-8f26-3a1bacab0538
68      userdata=
69     #!/bin/sh
70
71     while true; do
72      ping -c 1 192.168.130.4 2>&1 >/dev/null
73      RES=$?
74      if [ "Z$RES" = "Z0" ] ; then
75       echo 'vPing OK'
76      break
77      else
78       echo 'vPing KO'
79      fi
80      sleep 1
81     done
82
83     vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
84     vPing_userdata- INFO - Waiting for ping...
85     vPing_userdata- INFO - vPing detected!
86     vPing_userdata- INFO - vPing duration:'20.2'
87     vPing_userdata- INFO - vPing OK
88     vPing_userdata- INFO - Cleaning up...
89     vPing_userdata- INFO - Deleting network 'vping-net'...
90
91 Tempest
92 ^^^^^^^
93 ::
94     +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
95     | name                                                                                                                                     | time    | status  |
96     +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
97     | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor                                                               | 0.254   | success |
98     | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors                                                             | 0.125   | success |
99     | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image                                                           | 12.388  | success |
100     | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image                                        | 24.859  | success |
101     | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name        | 11.610  | success |
102     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since                     | 0.780   | success |
103     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name                              | 0.301   | success |
104     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id                         | 0.308   | success |
105     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref                        | 1.031   | success |
106     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status                            | 0.525   | success |
107     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type                              | 0.310   | success |
108     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results                               | 0.327   | success |
109     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since         | 0.451   | success |
110     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name                  | 0.657   | success |
111     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref            | 0.624   | success |
112     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status                | 0.325   | success |
113     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type                  | 0.614   | success |
114     | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results                   | 0.537   | success |
115     | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image                                                            | 0.637   | success |
116     | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images                                                          | 0.480   | success |
117     | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail                                              | 0.480   | success |
118     | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create                | 1.447   | success |
119     | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list                  | 2.524   | success |
120     | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete                  | 5.127   | success |
121     | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip                                     | 9.604   | success |
122     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name                                     | 3.288   | success |
123     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers                                                         | 0.114   | success |
124     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail                                             | 0.489   | success |
125     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus                                          | 0.209   | success |
126     | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details                                                | 0.001   | success |
127     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name                               | 15.311  | success |
128     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers                                                   | 0.090   | success |
129     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail                                       | 0.467   | success |
130     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus                                    | 0.207   | success |
131     | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details                                          | 0.001   | success |
132     | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action                                       | 0.085   | success |
133     | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions                                     | 3.900   | success |
134     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor               | 0.712   | success |
135     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image                | 0.001   | skip    |
136     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name          | 0.713   | success |
137     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status        | 0.622   | success |
138     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results                  | 0.433   | success |
139     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor                        | 0.110   | success |
140     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image                         | 0.001   | skip    |
141     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit                         | 0.094   | success |
142     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name                   | 0.076   | success |
143     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status                 | 0.093   | success |
144     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip                          | 0.528   | success |
145     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex                    | 0.001   | skip    |
146     | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard               | 0.173   | success |
147     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date        | 0.093   | success |
148     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date       | 0.025   | success |
149     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits                           | 0.093   | success |
150     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.080   | success |
151     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value       | 0.020   | success |
152     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string               | 0.025   | success |
153     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor              | 0.043   | success |
154     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image               | 0.581   | success |
155     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name         | 0.066   | success |
156     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted            | 0.288   | success |
157     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing                 | 0.030   | success |
158     | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server               | 0.096   | success |
159     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password                                        | 0.001   | skip    |
160     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output                                            | 5.780   | success |
161     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server                                            | 10.302  | success |
162     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard                                            | 11.027  | success |
163     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft                                            | 1.138   | skip    |
164     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server                                                | 11.793  | success |
165     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm                                         | 14.743  | success |
166     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert                                          | 24.954  | success |
167     | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server                                             | 8.319   | success |
168     | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses                                     | 0.102   | success |
169     | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network                          | 0.170   | success |
170     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item                                 | 0.536   | success |
171     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item                                    | 0.507   | success |
172     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata                                        | 0.449   | success |
173     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata                                         | 0.688   | success |
174     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item                                    | 0.515   | success |
175     | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata                                      | 0.556   | success |
176     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password                                          | 3.590   | success |
177     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair                                                     | 12.764  | success |
178     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name                                           | 21.680  | success |
179     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address                                               | 9.787   | success |
180     | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name                                                         | 11.049  | success |
181     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name                                | 2.045   | success |
182     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit               | 2.190   | success |
183     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256                     | 2.549   | success |
184     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor                                | 2.194   | success |
185     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image                                 | 2.236   | success |
186     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid                          | 2.806   | success |
187     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit              | 1.026   | success |
188     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id                            | 1.050   | success |
189     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server                                   | 0.552   | success |
190     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address                                     | 1.557   | success |
191     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server                                | 1.266   | success |
192     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server                               | 0.803   | success |
193     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor                    | 0.824   | success |
194     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor                            | 0.778   | success |
195     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank                                         | 1.357   | success |
196     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server                                  | 1.212   | success |
197     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server                        | 1.691   | success |
198     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256                     | 0.931   | success |
199     | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name                              | 1.165   | success |
200     | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas                                                                   | 0.248   | success |
201     | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas                                                                           | 0.078   | success |
202     | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume                                            | 47.118  | success |
203     | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list                                                           | 0.111   | success |
204     | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details                                              | 0.097   | success |
205     | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id                                         | 0.262   | success |
206     | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id                          | 0.016   | success |
207     | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services                                                          | 0.809   | success |
208     | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user                                                                  | 0.233   | success |
209     | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete                             | 0.397   | success |
210     | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists                                              | 0.077   | success |
211     | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain                                              | 0.966   | success |
212     | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint                                                      | 0.513   | success |
213     | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete                                              | 2.311   | success |
214     | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy                                            | 0.401   | success |
215     | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id                                           | 0.332   | success |
216     | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service                                              | 0.555   | success |
217     | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all                                                           | 2.059   | success |
218     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.086   | success |
219     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.091   | success |
220     | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.078   | success |
221     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types                                                         | 0.087   | success |
222     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources                                                   | 0.083   | success |
223     | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses                                                    | 0.076   | success |
224     | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params                                                                     | 0.579   | success |
225     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image                                                             | 2.026   | success |
226     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file                                           | 2.947   | success |
227     | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image                                                             | 15.745  | success |
228     | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions                                                         | 4.489   | success |
229     | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address                           | 1.373   | success |
230     | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip                                 | 3.080   | success |
231     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet                                         | 2.565   | success |
232     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility                                                 | 0.671   | success |
233     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks                                                               | 0.317   | success |
234     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets                                                                | 0.042   | success |
235     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network                                                                | 0.282   | success |
236     | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet                                                                 | 0.045   | success |
237     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools                                            | 2.800   | success |
238     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups                                                 | 2.487   | success |
239     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port                                                          | 1.722   | success |
240     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports                                                                         | 0.272   | success |
241     | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port                                                                          | 0.282   | success |
242     | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools                                                | 2.391   | success |
243     | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups                                                     | 2.499   | success |
244     | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port                                                              | 1.658   | success |
245     | tempest.api.network.test_ports.PortsTestJSON.test_list_ports                                                                             | 0.062   | success |
246     | tempest.api.network.test_ports.PortsTestJSON.test_show_port                                                                              | 0.087   | success |
247     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces                                                     | 5.549   | success |
248     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id                                           | 3.796   | success |
249     | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id                                         | 3.120   | success |
250     | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router                                              | 2.261   | success |
251     | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces                                                         | 6.149   | success |
252     | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id                                               | 3.659   | success |
253     | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id                                             | 2.738   | success |
254     | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router                                                  | 2.213   | success |
255     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group                             | 1.612   | success |
256     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule                                    | 2.371   | success |
257     | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups                                                      | 0.043   | success |
258     | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group                                 | 1.383   | success |
259     | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule                                        | 3.275   | success |
260     | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups                                                          | 0.237   | success |
261     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list                                           | 0.531   | success |
262     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show                                           | 5.699   | success |
263     | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template                                       | 0.045   | success |
264     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list                                              | 1.426   | success |
265     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata                                          | 0.579   | success |
266     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config                                              | 0.680   | success |
267     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate                              | 0.622   | success |
268     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change                    | 0.799   | success |
269     | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change                  | 0.770   | success |
270     | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources                                                 | 3.216   | success |
271     | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds                                                     | 0.051   | success |
272     | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications                | 18.428  | success |
273     | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications                | 3.313   | success |
274     | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance                                       | 2.580   | success |
275     | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance                                       | 3.176   | success |
276     | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete                                                | 10.232  | success |
277     | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image                                     | 17.327  | success |
278     | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete                                                | 11.862  | success |
279     | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image                                     | 17.953  | success |
280     | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list                                                              | 0.304   | success |
281     | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list                                                              | 0.680   | success |
282     | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops                                                       | 45.140  | success |
283     | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern                                                 | 115.284 | success |
284     | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern                                               | 88.143  | success |
285     +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
286     run_tempest - INFO - Results: {'timestart': '2016-04-2701:33:43.774958', 'duration': 1541, 'tests': 188, 'failures': 0}
287
288 Rally
289 ^^^^^
290 ::
291
292     FUNCTEST.info: Running Rally benchmark suite...
293     2016-04-27 02:14:20,172 - run_rally - INFO - Starting test scenario "authenticate" ...
294     2016-04-27 02:15:40,641 - run_rally - INFO -
295      Preparing input task
296      Task  1491f5fb-1f66-45d3-b04b-31a8cf53eb71: started
297     Task 1491f5fb-1f66-45d3-b04b-31a8cf53eb71: finished
298
299     test scenario Authenticate.validate_glance
300     +-----------------------------------------------------------------------------------------------------------------------------------------+
301     |                                                          Response Times (sec)                                                           |
302     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
303     | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
304     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
305     | authenticate.validate_glance_2_times | 0.966     | 1.042        | 1.146        | 1.191        | 1.236     | 1.063     | 100.0%  | 10    |
306     | total                                | 1.21      | 1.272        | 1.393        | 1.45         | 1.507     | 1.307     | 100.0%  | 10    |
307     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
308     Load duration: 3.89922785759
309     Full duration: 12.1358039379
310
311     test scenario Authenticate.keystone
312     +--------------------------------------------------------------------------------------------------------------------------+
313     |                                                   Response Times (sec)                                                   |
314     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
315     | Action                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
316     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
317     | authenticate.keystone | 0.216     | 0.247        | 0.379        | 0.382        | 0.385     | 0.267     | 100.0%  | 10    |
318     | total                 | 0.216     | 0.247        | 0.379        | 0.382        | 0.386     | 0.268     | 100.0%  | 10    |
319     +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
320     Load duration: 0.732311964035
321     Full duration: 8.95613193512
322
323     test scenario Authenticate.validate_heat
324     +---------------------------------------------------------------------------------------------------------------------------------------+
325     |                                                         Response Times (sec)                                                          |
326     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
327     | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
328     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
329     | authenticate.validate_heat_2_times | 0.346     | 0.575        | 0.619        | 0.625        | 0.63      | 0.505     | 100.0%  | 10    |
330     | total                              | 0.575     | 0.807        | 0.866        | 0.899        | 0.932     | 0.77      | 100.0%  | 10    |
331     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
332     Load duration: 2.38545608521
333     Full duration: 11.1800699234
334
335     test scenario Authenticate.validate_nova
336     +---------------------------------------------------------------------------------------------------------------------------------------+
337     |                                                         Response Times (sec)                                                          |
338     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
339     | Action                             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
340     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
341     | authenticate.validate_nova_2_times | 0.31      | 0.388        | 0.536        | 0.54         | 0.543     | 0.409     | 100.0%  | 10    |
342     | total                              | 0.553     | 0.635        | 0.773        | 0.794        | 0.814     | 0.663     | 100.0%  | 10    |
343     +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
344     Load duration: 1.93493509293
345     Full duration: 10.6224660873
346
347     test scenario Authenticate.validate_cinder
348     +-----------------------------------------------------------------------------------------------------------------------------------------+
349     |                                                          Response Times (sec)                                                           |
350     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
351     | Action                               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
352     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
353     | authenticate.validate_cinder_2_times | 0.296     | 0.55         | 0.598        | 0.713        | 0.828     | 0.553     | 100.0%  | 10    |
354     | total                                | 0.525     | 0.815        | 0.942        | 1.052        | 1.162     | 0.829     | 100.0%  | 10    |
355     +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
356     Load duration: 2.46085309982
357     Full duration: 10.4235949516
358
359     test scenario Authenticate.validate_neutron
360     +------------------------------------------------------------------------------------------------------------------------------------------+
361     |                                                           Response Times (sec)                                                           |
362     +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
363     | Action                                | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
364     +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
365     | authenticate.validate_neutron_2_times | 0.526     | 0.601        | 0.73         | 0.74         | 0.749     | 0.615     | 100.0%  | 10    |
366     | total                                 | 0.797     | 0.826        | 0.973        | 0.981        | 0.989     | 0.86      | 100.0%  | 10    |
367     +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
368     Load duration: 2.49738502502
369     Full duration: 11.2271738052
370
371     2016-04-27 02:15:42,749 - run_rally - INFO - Test scenario: "authenticate" OK.
372     2016-04-27 02:15:42,749 - run_rally - INFO - Starting test scenario "glance" ...
373     2016-04-27 02:19:48,692 - run_rally - INFO -
374      Preparing input task
375      Task  661ec9b2-9c4d-4fcd-b522-0cf3f1dbc4ec: started
376     Task 661ec9b2-9c4d-4fcd-b522-0cf3f1dbc4ec: finished
377
378     test scenario GlanceImages.list_images
379     +-----------------------------------------------------------------------------------------------------------------------+
380     |                                                 Response Times (sec)                                                  |
381     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
382     | Action             | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
383     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
384     | glance.list_images | 0.763     | 0.847        | 0.96         | 0.961        | 0.962     | 0.858     | 100.0%  | 10    |
385     | total              | 0.763     | 0.847        | 0.96         | 0.961        | 0.962     | 0.859     | 100.0%  | 10    |
386     +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
387     Load duration: 2.59311103821
388     Full duration: 13.8837060928
389
390     test scenario GlanceImages.create_image_and_boot_instances
391     +------------------------------------------------------------------------------------------------------------------------+
392     |                                                  Response Times (sec)                                                  |
393     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
394     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
395     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
396     | glance.create_image | 7.004     | 7.656        | 20.755       | 26.239       | 31.723    | 11.873    | 100.0%  | 10    |
397     | nova.boot_servers   | 8.947     | 10.367       | 10.531       | 10.637       | 10.744    | 10.109    | 100.0%  | 10    |
398     | total               | 15.951    | 18.072       | 31.179       | 36.629       | 42.078    | 21.982    | 100.0%  | 10    |
399     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
400     Load duration: 66.442127943
401     Full duration: 112.407797098
402
403     test scenario GlanceImages.create_and_list_image
404     +------------------------------------------------------------------------------------------------------------------------+
405     |                                                  Response Times (sec)                                                  |
406     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
407     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
408     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
409     | glance.create_image | 7.244     | 7.582        | 7.891        | 7.95         | 8.009     | 7.634     | 100.0%  | 10    |
410     | glance.list_images  | 0.306     | 0.566        | 0.613        | 0.638        | 0.663     | 0.546     | 100.0%  | 10    |
411     | total               | 7.774     | 8.159        | 8.369        | 8.413        | 8.457     | 8.181     | 100.0%  | 10    |
412     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
413     Load duration: 24.4534111023
414     Full duration: 55.2102069855
415
416     test scenario GlanceImages.create_and_delete_image
417     +------------------------------------------------------------------------------------------------------------------------+
418     |                                                  Response Times (sec)                                                  |
419     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
420     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
421     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
422     | glance.create_image | 7.177     | 7.831        | 16.251       | 17.887       | 19.523    | 9.669     | 100.0%  | 10    |
423     | glance.delete_image | 1.407     | 2.22         | 2.375        | 2.45         | 2.525     | 2.125     | 100.0%  | 10    |
424     | total               | 9.332     | 9.768        | 18.192       | 20.001       | 21.809    | 11.794    | 100.0%  | 10    |
425     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
426     Load duration: 40.9665431976
427     Full duration: 52.3726029396
428
429     22016-04-27 02:19:50,772 - run_rally - INFO - Test scenario: "glance" OK.
430     2016-04-27 02:19:50,773 - run_rally - INFO - Starting test scenario "cinder" ...
431     2016-04-27 02:41:55,538 - run_rally - INFO -
432      Preparing input task
433      Task  a74fb68a-1212-4fff-afdd-a8ad044039fd: started
434     Task a74fb68a-1212-4fff-afdd-a8ad044039fd: finished
435
436     test scenario CinderVolumes.create_and_attach_volume
437     +-------------------------------------------------------------------------------------------------------------------------+
438     |                                                  Response Times (sec)                                                   |
439     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
440     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
441     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
442     | nova.boot_server     | 7.389     | 8.334        | 9.206        | 9.56         | 9.914     | 8.417     | 100.0%  | 10    |
443     | cinder.create_volume | 3.216     | 3.747        | 4.031        | 4.195        | 4.359     | 3.726     | 100.0%  | 10    |
444     | nova.attach_volume   | 3.856     | 4.202        | 7.174        | 7.341        | 7.508     | 4.8       | 100.0%  | 10    |
445     | nova.detach_volume   | 4.017     | 4.272        | 4.467        | 4.641        | 4.815     | 4.302     | 100.0%  | 10    |
446     | cinder.delete_volume | 0.631     | 2.93         | 3.151        | 3.193        | 3.235     | 2.346     | 100.0%  | 10    |
447     | nova.delete_server   | 2.937     | 3.051        | 3.119        | 3.273        | 3.426     | 3.078     | 100.0%  | 10    |
448     | total                | 23.718    | 25.911       | 29.125       | 29.723       | 30.322    | 26.67     | 100.0%  | 10    |
449     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
450     Load duration: 78.0439009666
451     Full duration: 110.455639839
452
453     test scenario CinderVolumes.create_and_list_volume
454     +-------------------------------------------------------------------------------------------------------------------------+
455     |                                                  Response Times (sec)                                                   |
456     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
457     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
458     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
459     | cinder.create_volume | 9.979     | 10.793       | 11.421       | 11.46        | 11.499    | 10.766    | 100.0%  | 10    |
460     | cinder.list_volumes  | 0.074     | 0.299        | 0.372        | 0.384        | 0.397     | 0.235     | 100.0%  | 10    |
461     | total                | 10.062    | 11.109       | 11.668       | 11.734       | 11.8      | 11.002    | 100.0%  | 10    |
462     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
463     Load duration: 32.7168459892
464     Full duration: 54.91467309
465
466     test scenario CinderVolumes.create_and_list_volume
467     +-------------------------------------------------------------------------------------------------------------------------+
468     |                                                  Response Times (sec)                                                   |
469     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
470     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
471     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
472     | cinder.create_volume | 3.417     | 3.882        | 4.164        | 4.19         | 4.217     | 3.871     | 100.0%  | 10    |
473     | cinder.list_volumes  | 0.077     | 0.338        | 0.473        | 0.485        | 0.497     | 0.335     | 100.0%  | 10    |
474     | total                | 3.881     | 4.176        | 4.51         | 4.539        | 4.568     | 4.206     | 100.0%  | 10    |
475     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
476     Load duration: 12.7357430458
477     Full duration: 32.5659849644
478
479     test scenario CinderVolumes.create_and_list_snapshots
480     +---------------------------------------------------------------------------------------------------------------------------+
481     |                                                   Response Times (sec)                                                    |
482     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
483     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
484     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
485     | cinder.create_snapshot | 3.051     | 3.454        | 5.626        | 5.696        | 5.765     | 3.827     | 100.0%  | 10    |
486     | cinder.list_snapshots  | 0.035     | 0.296        | 0.325        | 0.325        | 0.325     | 0.227     | 100.0%  | 10    |
487     | total                  | 3.355     | 3.657        | 5.947        | 6.0          | 6.052     | 4.054     | 100.0%  | 10    |
488     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
489     Load duration: 13.0978519917
490     Full duration: 50.9691619873
491
492     test scenario CinderVolumes.create_and_delete_volume
493     +-------------------------------------------------------------------------------------------------------------------------+
494     |                                                  Response Times (sec)                                                   |
495     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
496     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
497     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
498     | cinder.create_volume | 3.632     | 3.83         | 4.025        | 4.124        | 4.223     | 3.857     | 100.0%  | 10    |
499     | cinder.delete_volume | 0.55      | 0.83         | 2.782        | 2.965        | 3.147     | 1.365     | 100.0%  | 10    |
500     | total                | 4.281     | 4.87         | 6.615        | 6.841        | 7.066     | 5.222     | 100.0%  | 10    |
501     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
502     Load duration: 15.9277088642
503     Full duration: 34.237901926
504
505     test scenario CinderVolumes.create_and_delete_volume
506     +-------------------------------------------------------------------------------------------------------------------------+
507     |                                                  Response Times (sec)                                                   |
508     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
509     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
510     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
511     | cinder.create_volume | 10.252    | 10.977       | 11.943       | 11.948       | 11.953    | 11.097    | 100.0%  | 10    |
512     | cinder.delete_volume | 0.82      | 1.996        | 2.99         | 3.013        | 3.036     | 1.938     | 100.0%  | 10    |
513     | total                | 11.877    | 12.968       | 14.015       | 14.471       | 14.927    | 13.036    | 100.0%  | 10    |
514     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
515     Load duration: 37.8433139324
516     Full duration: 56.9522650242
517
518     test scenario CinderVolumes.create_and_delete_volume
519     +-------------------------------------------------------------------------------------------------------------------------+
520     |                                                  Response Times (sec)                                                   |
521     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
522     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
523     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
524     | cinder.create_volume | 3.852     | 4.061        | 4.498        | 4.604        | 4.711     | 4.133     | 100.0%  | 10    |
525     | cinder.delete_volume | 0.835     | 0.977        | 2.77         | 2.939        | 3.108     | 1.5       | 100.0%  | 10    |
526     | total                | 4.799     | 5.266        | 6.888        | 6.964        | 7.039     | 5.634     | 100.0%  | 10    |
527     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
528     Load duration: 17.0594739914
529     Full duration: 34.639097929
530
531     test scenario CinderVolumes.create_and_upload_volume_to_image
532     +----------------------------------------------------------------------------------------------------------------------------------+
533     |                                                       Response Times (sec)                                                       |
534     +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
535     | Action                        | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
536     +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
537     | cinder.create_volume          | 3.582     | 3.801        | 4.194        | 4.213        | 4.231     | 3.878     | 100.0%  | 10    |
538     | cinder.upload_volume_to_image | 19.387    | 31.495       | 32.341       | 32.354       | 32.367    | 29.335    | 100.0%  | 10    |
539     | cinder.delete_volume          | 0.844     | 2.45         | 2.784        | 2.825        | 2.866     | 1.905     | 100.0%  | 10    |
540     | nova.delete_image             | 2.332     | 2.682        | 2.872        | 2.969        | 3.065     | 2.677     | 100.0%  | 10    |
541     | total                         | 26.258    | 39.786       | 40.849       | 41.006       | 41.163    | 37.796    | 100.0%  | 10    |
542     +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
543     Load duration: 111.222266197
544     Full duration: 129.783249855
545
546     test scenario CinderVolumes.create_and_delete_snapshot
547     +---------------------------------------------------------------------------------------------------------------------------+
548     |                                                   Response Times (sec)                                                    |
549     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
550     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
551     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
552     | cinder.create_snapshot | 3.34      | 3.423        | 5.731        | 5.746        | 5.76      | 3.87      | 100.0%  | 10    |
553     | cinder.delete_snapshot | 2.556     | 3.104        | 3.272        | 3.285        | 3.299     | 3.068     | 100.0%  | 10    |
554     | total                  | 6.365     | 6.599        | 8.332        | 8.543        | 8.755     | 6.938     | 100.0%  | 10    |
555     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
556     Load duration: 19.7357230186
557     Full duration: 50.7531559467
558
559     test scenario CinderVolumes.create_volume
560     +-------------------------------------------------------------------------------------------------------------------------+
561     |                                                  Response Times (sec)                                                   |
562     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
563     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
564     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
565     | cinder.create_volume | 3.497     | 3.901        | 4.226        | 4.246        | 4.266     | 3.883     | 100.0%  | 10    |
566     | total                | 3.497     | 3.901        | 4.226        | 4.246        | 4.266     | 3.883     | 100.0%  | 10    |
567     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
568     Load duration: 11.6317541599
569     Full duration: 29.422949791
570
571     test scenario CinderVolumes.create_volume
572     +-------------------------------------------------------------------------------------------------------------------------+
573     |                                                  Response Times (sec)                                                   |
574     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
575     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
576     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
577     | cinder.create_volume | 3.649     | 3.933        | 4.176        | 4.178        | 4.179     | 3.939     | 100.0%  | 10    |
578     | total                | 3.649     | 3.933        | 4.176        | 4.178        | 4.179     | 3.939     | 100.0%  | 10    |
579     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
580     Load duration: 11.7954070568
581     Full duration: 33.4074928761
582
583     test scenario CinderVolumes.list_volumes
584     +------------------------------------------------------------------------------------------------------------------------+
585     |                                                  Response Times (sec)                                                  |
586     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
587     | Action              | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
588     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
589     | cinder.list_volumes | 0.559     | 0.596        | 0.645        | 0.658        | 0.671     | 0.603     | 100.0%  | 10    |
590     | total               | 0.559     | 0.596        | 0.645        | 0.658        | 0.671     | 0.603     | 100.0%  | 10    |
591     +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
592     Load duration: 1.80386185646
593     Full duration: 65.103438139
594
595     test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
596     +---------------------------------------------------------------------------------------------------------------------------+
597     |                                                   Response Times (sec)                                                    |
598     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
599     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
600     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
601     | cinder.create_volume   | 3.223     | 4.031        | 4.142        | 4.196        | 4.25      | 3.949     | 100.0%  | 10    |
602     | cinder.create_snapshot | 2.821     | 3.096        | 3.318        | 3.349        | 3.38      | 3.082     | 100.0%  | 10    |
603     | nova.attach_volume     | 4.011     | 4.73         | 9.508        | 10.629       | 11.75     | 5.874     | 100.0%  | 10    |
604     | nova.detach_volume     | 3.603     | 4.136        | 4.42         | 4.481        | 4.542     | 4.112     | 100.0%  | 10    |
605     | cinder.delete_snapshot | 2.532     | 2.593        | 2.862        | 2.973        | 3.084     | 2.691     | 100.0%  | 10    |
606     | cinder.delete_volume   | 0.626     | 2.709        | 3.035        | 3.087        | 3.139     | 2.413     | 100.0%  | 10    |
607     | total                  | 20.294    | 22.503       | 27.052       | 28.211       | 29.37     | 23.272    | 100.0%  | 10    |
608     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
609     Load duration: 67.9758191109
610     Full duration: 167.151215076
611
612     test scenario CinderVolumes.create_from_volume_and_delete_volume
613     +-------------------------------------------------------------------------------------------------------------------------+
614     |                                                  Response Times (sec)                                                   |
615     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
616     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
617     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
618     | cinder.create_volume | 3.396     | 4.269        | 4.654        | 5.616        | 6.578     | 4.385     | 100.0%  | 10    |
619     | cinder.delete_volume | 2.712     | 3.275        | 3.476        | 3.485        | 3.493     | 3.193     | 100.0%  | 10    |
620     | total                | 6.117     | 7.6          | 8.118        | 8.975        | 9.831     | 7.578     | 100.0%  | 10    |
621     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
622     Load duration: 24.3931138515
623     Full duration: 56.1436901093
624
625     test scenario CinderVolumes.create_and_extend_volume
626     +-------------------------------------------------------------------------------------------------------------------------+
627     |                                                  Response Times (sec)                                                   |
628     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
629     | Action               | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
630     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
631     | cinder.create_volume | 3.562     | 4.002        | 4.303        | 4.334        | 4.364     | 4.012     | 100.0%  | 10    |
632     | cinder.extend_volume | 0.691     | 1.1          | 3.236        | 3.411        | 3.587     | 1.713     | 100.0%  | 10    |
633     | cinder.delete_volume | 0.583     | 0.974        | 3.176        | 3.253        | 3.33      | 1.51      | 100.0%  | 10    |
634     | total                | 5.58      | 6.337        | 10.123       | 10.341       | 10.559    | 7.236     | 100.0%  | 10    |
635     +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
636     Load duration: 20.3285830021
637     Full duration: 37.9043469429
638
639     test scenario CinderVolumes.create_snapshot_and_attach_volume
640     +---------------------------------------------------------------------------------------------------------------------------+
641     |                                                   Response Times (sec)                                                    |
642     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
643     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
644     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
645     | cinder.create_volume   | 3.524     | 4.049        | 4.167        | 4.196        | 4.225     | 3.94      | 100.0%  | 10    |
646     | cinder.create_snapshot | 2.743     | 3.026        | 3.356        | 3.408        | 3.46      | 3.053     | 100.0%  | 10    |
647     | nova.attach_volume     | 4.113     | 4.635        | 6.974        | 7.136        | 7.298     | 5.464     | 100.0%  | 10    |
648     | nova.detach_volume     | 3.695     | 4.078        | 4.306        | 4.692        | 5.078     | 4.146     | 100.0%  | 10    |
649     | cinder.delete_snapshot | 2.489     | 2.864        | 3.117        | 3.127        | 3.136     | 2.861     | 100.0%  | 10    |
650     | cinder.delete_volume   | 0.577     | 2.556        | 2.985        | 3.013        | 3.041     | 2.272     | 100.0%  | 10    |
651     | total                  | 19.553    | 22.646       | 25.102       | 25.135       | 25.168    | 22.862    | 100.0%  | 10    |
652     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
653     Load duration: 67.4835031033
654     Full duration: 178.220266819
655
656     test scenario CinderVolumes.create_snapshot_and_attach_volume
657     +---------------------------------------------------------------------------------------------------------------------------+
658     |                                                   Response Times (sec)                                                    |
659     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
660     | Action                 | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
661     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
662     | cinder.create_volume   | 3.143     | 3.843        | 3.997        | 4.099        | 4.2       | 3.793     | 100.0%  | 10    |
663     | cinder.create_snapshot | 2.558     | 2.892        | 3.176        | 3.328        | 3.48      | 2.92      | 100.0%  | 10    |
664     | nova.attach_volume     | 4.209     | 5.877        | 7.368        | 8.681        | 9.994     | 6.076     | 100.0%  | 10    |
665     | nova.detach_volume     | 3.533     | 3.91         | 4.349        | 4.363        | 4.378     | 3.99      | 100.0%  | 10    |
666     | cinder.delete_snapshot | 2.531     | 2.847        | 3.044        | 3.101        | 3.158     | 2.802     | 100.0%  | 10    |
667     | cinder.delete_volume   | 0.626     | 2.561        | 2.989        | 3.03         | 3.071     | 2.206     | 100.0%  | 10    |
668     | total                  | 20.143    | 23.986       | 25.362       | 26.711       | 28.06     | 23.469    | 100.0%  | 10    |
669     +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
670     Load duration: 67.7886071205
671     Full duration: 169.118987083
672
673     2016-04-27 02:41:57,893 - run_rally - INFO - Test scenario: "cinder" OK.
674
675 SDN Controller
676 --------------
677
678 ODL
679 ^^^^
680 ::
681
682     ==============================================================================
683     Basic
684     ==============================================================================
685     Basic.010 Restconf OK :: Test suite to verify Restconf is OK
686     ==============================================================================
687     Get Controller Modules :: Get the controller modules via Restconf     | PASS |
688     ------------------------------------------------------------------------------
689     Basic.010 Restconf OK :: Test suite to verify Restconf is OK          | PASS |
690     1 critical test, 1 passed, 0 failed
691     1 test total, 1 passed, 0 failed
692     ==============================================================================
693     Basic                                                                 | PASS |
694     1 critical test, 1 passed, 0 failed
695     1 test total, 1 passed, 0 failed
696     ==============================================================================
697     Output:  /home/opnfv/repos/functest/output.xml
698     Log:     /home/opnfv/repos/functest/log.html
699     Report:  /home/opnfv/repos/functest/report.html
700     [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
701     ==============================================================================
702     Neutron :: Test suite for Neutron Plugin
703     ==============================================================================
704     Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
705     ==============================================================================
706     Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
707     ------------------------------------------------------------------------------
708     Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
709     ------------------------------------------------------------------------------
710     Create Network :: Create new network in OpenStack                     | PASS |
711     ------------------------------------------------------------------------------
712     Check Network :: Check Network created in OpenDaylight                | PASS |
713     ------------------------------------------------------------------------------
714     Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
715     4 critical tests, 4 passed, 0 failed
716     4 tests total, 4 passed, 0 failed
717     ==============================================================================
718     Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
719     ==============================================================================
720     Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
721     ------------------------------------------------------------------------------
722     Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
723     ------------------------------------------------------------------------------
724     Create New subnet :: Create new subnet in OpenStack                   | PASS |
725     ------------------------------------------------------------------------------
726     Check New subnet :: Check new subnet created in OpenDaylight          | PASS |
727     ------------------------------------------------------------------------------
728     Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
729     4 critical tests, 4 passed, 0 failed
730     4 tests total, 4 passed, 0 failed
731     ==============================================================================
732     Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
733     ==============================================================================
734     Check OpenStack ports :: Checking OpenStack Neutron for known ports   | PASS |
735     ------------------------------------------------------------------------------
736     Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
737     ------------------------------------------------------------------------------
738     Create New Port :: Create new port in OpenStack                       | PASS |
739     ------------------------------------------------------------------------------
740     Check New Port :: Check new subnet created in OpenDaylight            | PASS |
741     ------------------------------------------------------------------------------
742     Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
743     4 critical tests, 4 passed, 0 failed
744     4 tests total, 4 passed, 0 failed
745     ==============================================================================
746     Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
747     ==============================================================================
748     Delete New Port :: Delete previously created port in OpenStack        | PASS |
749     ------------------------------------------------------------------------------
750     Check Port Deleted :: Check port deleted in OpenDaylight              | PASS |
751     ------------------------------------------------------------------------------
752     Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
753     2 critical tests, 2 passed, 0 failed
754     2 tests total, 2 passed, 0 failed
755     ==============================================================================
756     Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
757     ==============================================================================
758     Delete New subnet :: Delete previously created subnet in OpenStack    | PASS |
759     ------------------------------------------------------------------------------
760     Check New subnet deleted :: Check subnet deleted in OpenDaylight      | PASS |
761     ------------------------------------------------------------------------------
762     Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
763     2 critical tests, 2 passed, 0 failed
764     2 tests total, 2 passed, 0 failed
765     ==============================================================================
766     Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
767     ==============================================================================
768     Delete Network :: Delete network in OpenStack                         | PASS |
769     ------------------------------------------------------------------------------
770     Check Network deleted :: Check Network deleted in OpenDaylight        | PASS |
771     ------------------------------------------------------------------------------
772     Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
773     2 critical tests, 2 passed, 0 failed
774     2 tests total, 2 passed, 0 failed
775     ==============================================================================
776     Neutron :: Test suite for Neutron Plugin                              | PASS |
777     18 critical tests, 18 passed, 0 failed
778     18 tests total, 18 passed, 0 failed
779     ==============================================================================
780     Output:  /home/opnfv/repos/functest/output.xml
781     Log:     /home/opnfv/repos/functest/log.html
782     Report:  /home/opnfv/repos/functest/report.html
783     [0;32mFinal report is located:[0m
784     Log:     /home/opnfv/repos/functest/log.html
785     Report:  /home/opnfv/repos/functest/report.html
786
787 Feature tests
788 -------------
789
790 Promise
791 ^^^^^^^
792 ::
793
794     FUNCTEST.info: Running PROMISE test case...
795     Promise- INFO - Creating tenant 'promise'...
796     Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
797     Promise- INFO - Creating user 'promiser'...
798     Promise- INFO - Updating OpenStack credentials...
799     Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
800     Promise- INFO - Creating flavor 'promise-flavor'...
801     Promise- INFO - Exporting environment variables...
802     Promise- INFO - Running command: npm run -s test -- --reporter json
803     Promise- INFO - The test succeeded.
804     Promise- DEBUG -
805     {
806       "stats": {
807         "suites": 23,
808         "tests": 33,
809         "passes": 33,
810         "pending": 0,
811         "failures": 0,
812         "start": "2016-04-27T02:00:03.021Z",
813         "end": "2016-04-27T02:00:08.968Z",
814         "duration": 5947
815       },
816       "tests": [
817         {
818           "title": "should add a new OpenStack provider without error",
819           "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
820           "duration": 1217,
821           "err": {}
822         },
823         {
824           "title": "should update promise.providers with a new entry",
825           "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
826           "duration": 10,
827           "err": {}
828         },
829         {
830           "title": "should contain a new ResourceProvider record in the store",
831           "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
832           "duration": 0,
833           "err": {}
834         },
835         {
836           "title": "should add more capacity to the reservation service without error",
837           "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
838           "duration": 25,
839           "err": {}
840         },
841         {
842           "title": "should update promise.pools with a new entry",
843           "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
844           "duration": 1,
845           "err": {}
846         },
847         {
848           "title": "should contain a ResourcePool record in the store",
849           "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
850           "duration": 0,
851           "err": {}
852         },
853         {
854           "title": "should report total collections and utilizations",
855           "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
856           "duration": 18,
857           "err": {}
858         },
859         {
860           "title": "should contain newly added capacity pool",
861           "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
862           "duration": 8,
863           "err": {}
864         },
865         {
866           "title": "should create a new server in target provider without error",
867           "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
868           "duration": 1768,
869           "err": {}
870         },
871         {
872           "title": "should update promise.allocations with a new entry",
873           "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
874           "duration": 2,
875           "err": {}
876         },
877         {
878           "title": "should contain a new ResourceAllocation record in the store",
879           "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
880           "duration": 0,
881           "err": {}
882         },
883         {
884           "title": "should reference the created server ID from the provider",
885           "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
886           "duration": 1,
887           "err": {}
888         },
889         {
890           "title": "should have low priority state",
891           "fullTitle": "promise allocation without reservation create-instance should have low priority state",
892           "duration": 0,
893           "err": {}
894         },
895         {
896           "title": "should create reservation record (no start/end) without error",
897           "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
898           "duration": 41,
899           "err": {}
900         },
901         {
902           "title": "should update promise.reservations with a new entry",
903           "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
904           "duration": 7,
905           "err": {}
906         },
907         {
908           "title": "should contain a new ResourceReservation record in the store",
909           "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
910           "duration": 0,
911           "err": {}
912         },
913         {
914           "title": "should create a new server in target provider (with reservation) without error",
915           "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
916           "duration": 1617,
917           "err": {}
918         },
919         {
920           "title": "should contain a new ResourceAllocation record in the store",
921           "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
922           "duration": 1,
923           "err": {}
924         },
925         {
926           "title": "should be referenced in the reservation record",
927           "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
928           "duration": 7,
929           "err": {}
930         },
931         {
932           "title": "should have high priority state",
933           "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
934           "duration": 0,
935           "err": {}
936         },
937         {
938           "title": "should create reservation record (for future) without error",
939           "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
940           "duration": 75,
941           "err": {}
942         },
943         {
944           "title": "should update promise.reservations with a new entry",
945           "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
946           "duration": 17,
947           "err": {}
948         },
949         {
950           "title": "should contain a new ResourceReservation record in the store",
951           "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
952           "duration": 0,
953           "err": {}
954         },
955         {
956           "title": "should contain newly created future reservation",
957           "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
958           "duration": 61,
959           "err": {}
960         },
961         {
962           "title": "should modify existing reservation without error",
963           "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
964           "duration": 65,
965           "err": {}
966         },
967         {
968           "title": "should modify existing reservation without error",
969           "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
970           "duration": 17,
971           "err": {}
972         },
973         {
974           "title": "should no longer contain record of the deleted reservation",
975           "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
976           "duration": 0,
977           "err": {}
978         },
979         {
980           "title": "should decrease available capacity from a provider in the future",
981           "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
982           "duration": 15,
983           "err": {}
984         },
985         {
986           "title": "should increase available capacity from a provider in the future",
987           "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
988           "duration": 11,
989           "err": {}
990         },
991         {
992           "title": "should report available collections and utilizations",
993           "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
994           "duration": 56,
995           "err": {}
996         },
997         {
998           "title": "should fail to create immediate reservation record with proper error",
999           "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
1000           "duration": 60,
1001           "err": {}
1002         },
1003         {
1004           "title": "should fail to create future reservation record with proper error",
1005           "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
1006           "duration": 38,
1007           "err": {}
1008         },
1009         {
1010           "title": "should successfully destroy all allocations",
1011           "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
1012           "duration": 361,
1013           "err": {}
1014         }
1015       ],
1016       "pending": [],
1017       "failures": [],
1018       "passes": [
1019         {
1020           "title": "should add a new OpenStack provider without error",
1021           "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
1022           "duration": 1217,
1023           "err": {}
1024         },
1025         {
1026           "title": "should update promise.providers with a new entry",
1027           "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
1028           "duration": 10,
1029           "err": {}
1030         },
1031         {
1032           "title": "should contain a new ResourceProvider record in the store",
1033           "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
1034           "duration": 0,
1035           "err": {}
1036         },
1037         {
1038           "title": "should add more capacity to the reservation service without error",
1039           "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
1040           "duration": 25,
1041           "err": {}
1042         },
1043         {
1044           "title": "should update promise.pools with a new entry",
1045           "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
1046           "duration": 1,
1047           "err": {}
1048         },
1049         {
1050           "title": "should contain a ResourcePool record in the store",
1051           "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
1052           "duration": 0,
1053           "err": {}
1054         },
1055         {
1056           "title": "should report total collections and utilizations",
1057           "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
1058           "duration": 18,
1059           "err": {}
1060         },
1061         {
1062           "title": "should contain newly added capacity pool",
1063           "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
1064           "duration": 8,
1065           "err": {}
1066         },
1067         {
1068           "title": "should create a new server in target provider without error",
1069           "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
1070           "duration": 1768,
1071           "err": {}
1072         },
1073         {
1074           "title": "should update promise.allocations with a new entry",
1075           "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
1076           "duration": 2,
1077           "err": {}
1078         },
1079         {
1080           "title": "should contain a new ResourceAllocation record in the store",
1081           "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
1082           "duration": 0,
1083           "err": {}
1084         },
1085         {
1086           "title": "should reference the created server ID from the provider",
1087           "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
1088           "duration": 1,
1089           "err": {}
1090         },
1091         {
1092           "title": "should have low priority state",
1093           "fullTitle": "promise allocation without reservation create-instance should have low priority state",
1094           "duration": 0,
1095           "err": {}
1096         },
1097         {
1098           "title": "should create reservation record (no start/end) without error",
1099           "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
1100           "duration": 41,
1101           "err": {}
1102         },
1103         {
1104           "title": "should update promise.reservations with a new entry",
1105           "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
1106           "duration": 7,
1107           "err": {}
1108         },
1109         {
1110           "title": "should contain a new ResourceReservation record in the store",
1111           "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
1112           "duration": 0,
1113           "err": {}
1114         },
1115         {
1116           "title": "should create a new server in target provider (with reservation) without error",
1117           "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
1118           "duration": 1617,
1119           "err": {}
1120         },
1121         {
1122           "title": "should contain a new ResourceAllocation record in the store",
1123           "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
1124           "duration": 1,
1125           "err": {}
1126         },
1127         {
1128           "title": "should be referenced in the reservation record",
1129           "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
1130           "duration": 7,
1131           "err": {}
1132         },
1133         {
1134           "title": "should have high priority state",
1135           "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
1136           "duration": 0,
1137           "err": {}
1138         },
1139         {
1140           "title": "should create reservation record (for future) without error",
1141           "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
1142           "duration": 75,
1143           "err": {}
1144         },
1145         {
1146           "title": "should update promise.reservations with a new entry",
1147           "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
1148           "duration": 17,
1149           "err": {}
1150         },
1151         {
1152           "title": "should contain a new ResourceReservation record in the store",
1153           "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
1154           "duration": 0,
1155           "err": {}
1156         },
1157         {
1158           "title": "should contain newly created future reservation",
1159           "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
1160           "duration": 61,
1161           "err": {}
1162         },
1163         {
1164           "title": "should modify existing reservation without error",
1165           "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
1166           "duration": 65,
1167           "err": {}
1168         },
1169         {
1170           "title": "should modify existing reservation without error",
1171           "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
1172           "duration": 17,
1173           "err": {}
1174         },
1175         {
1176           "title": "should no longer contain record of the deleted reservation",
1177           "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
1178           "duration": 0,
1179           "err": {}
1180         },
1181         {
1182           "title": "should decrease available capacity from a provider in the future",
1183           "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
1184           "duration": 15,
1185           "err": {}
1186         },
1187         {
1188           "title": "should increase available capacity from a provider in the future",
1189           "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
1190           "duration": 11,
1191           "err": {}
1192         },
1193         {
1194           "title": "should report available collections and utilizations",
1195           "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
1196           "duration": 56,
1197           "err": {}
1198         },
1199         {
1200           "title": "should fail to create immediate reservation record with proper error",
1201           "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
1202           "duration": 60,
1203           "err": {}
1204         },
1205         {
1206           "title": "should fail to create future reservation record with proper error",
1207           "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
1208           "duration": 38,
1209           "err": {}
1210         },
1211         {
1212           "title": "should successfully destroy all allocations",
1213           "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
1214           "duration": 361,
1215           "err": {}
1216         }
1217       ]
1218     }
1219     Promise- INFO -
1220     ****************************************
1221               Promise test report
1222
1223     ****************************************
1224      Suites:    23
1225      Tests:     33
1226      Passes:    33
1227      Pending:   0
1228      Failures:  0
1229      Start:     2016-04-27T02:00:03.021Z
1230      End:       2016-04-27T02:00:08.968Z
1231      Duration:  5.947
1232     ****************************************
1233
1234 vIMS
1235 ^^^^^^^
1236 ::
1237
1238     FUNCTEST.info: Running vIMS test...
1239     2016-04-27 02:00:26,953 - vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
1240     2016-04-27 02:00:27,734 - vIMS - INFO - Update OpenStack creds informations
1241     2016-04-27 02:00:27,734 - vIMS - INFO - Upload some OS images if it doesn't exist
1242     2016-04-27 02:00:28,202 - vIMS - INFO - centos_7 image doesn't exist on glance repository.
1243                                 Try downloading this image and upload on glance !
1244     2016-04-27 02:01:55,022 - vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
1245                                 Try downloading this image and upload on glance !
1246     2016-04-27 02:03:39,709 - vIMS - INFO - Update security group quota for this tenant
1247     2016-04-27 02:03:40,572 - vIMS - INFO - Update cinder quota for this tenant
1248     2016-04-27 02:03:41,548 - vIMS - INFO - Collect flavor id for cloudify manager server
1249     2016-04-27 02:03:43,403 - vIMS - INFO - Prepare virtualenv for cloudify-cli
1250     2016-04-27 02:04:20,255 - vIMS - INFO - Downloading the cloudify manager server blueprint
1251     2016-04-27 02:04:21,701 - vIMS - INFO - Cloudify deployment Start Time:'2016-04-27 02:04:21'
1252     2016-04-27 02:04:21,701 - vIMS - INFO - Writing the inputs file
1253     2016-04-27 02:04:21,706 - vIMS - INFO - Launching the cloudify-manager deployment
1254     2016-04-27 02:11:57,797 - vIMS - INFO - Cloudify-manager server is UP !
1255     2016-04-27 02:11:57,797 - vIMS - INFO - Cloudify deployment duration:'456.1'
1256     2016-04-27 02:11:57,798 - vIMS - INFO - Collect flavor id for all clearwater vm
1257     2016-04-27 02:12:00,174 - vIMS - INFO - vIMS VNF deployment Start Time:'2016-04-27 02:12:00'
1258     2016-04-27 02:12:00,174 - vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
1259     2016-04-27 02:12:01,517 - vIMS - INFO - Writing the inputs file
1260     2016-04-27 02:12:01,520 - vIMS - INFO - Launching the clearwater deployment
1261     2016-04-27 02:13:46,397 - vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/opnfv-cloudify-clearwater; cfy blueprints upload -b clearwater -p openstack-blueprint.yaml; cfy deployments create -b clearwater -d clearwater-opnfv --inputs inputs.yaml; cfy executions start -w install -d clearwater-opnfv --timeout 1800; '
1262     2016-04-27 02:13:46,398 - vIMS - ERROR - RuntimeError: Workflow failed: Task failed 'nova_plugin.server.start' -> NonRecoverableError('Unexpected server state ERROR:None',)