1 .. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
2 .. http://creativecommons.org/licenses/by/4.0
4 Detailed test results for apex-os-odl_l2-bgpvpn-ha
5 -----------------------------------------------------
15 FUNCTEST.info: Running vPing-userdata test...
16 vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
17 vPing_userdata- INFO - Creating neutron network vping-net...
18 vPing_userdata- INFO - Creating security group 'vPing-sg'...
19 vPing_userdata- INFO - Flavor found 'm1.small'
20 vPing_userdata- INFO - vPing Start Time:'2016-04-26 15:40:43'
21 vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
22 vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
23 vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
24 vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
25 vPing_userdata- INFO - Waiting for ping...
26 vPing_userdata- INFO - vPing detected!
27 vPing_userdata- INFO - vPing duration:'87.1'
28 vPing_userdata- INFO - vPing OK
29 vPing_userdata- INFO - Cleaning up...
30 vPing_userdata- INFO - Deleting network 'vping-net'...
36 FUNCTEST.info: Running Tempest tests...
37 run_tempest - INFO - Creating tenant and user for Tempest suite
38 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
39 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
40 run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
41 Total results of verification:
43 +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
44 | UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
45 +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
46 | 97cda33b-5d92-46c5-8425-861d087d0d57 | 938a64f1-d650-497c-897d-8964906711fb | | 188 | 27 | 2016-04-26 15:42:30.384572 | finished |
47 +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
51 +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
52 | name | time | status |
53 +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
54 | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.643 | success |
55 | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.048 | success |
56 | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 6.046 | success |
57 | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 6.507 | success |
58 | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 5.748 | success |
59 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.049 | success |
60 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.325 | success |
61 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.053 | success |
62 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.251 | success |
63 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.048 | success |
64 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.044 | success |
65 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.085 | success |
66 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.102 | success |
67 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.131 | success |
68 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.137 | success |
69 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.323 | success |
70 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.081 | success |
71 | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.430 | success |
72 | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.350 | success |
73 | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.198 | success |
74 | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.132 | success |
75 | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.367 | success |
76 | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 0.577 | success |
77 | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 1.641 | success |
78 | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 4.390 | success |
79 | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 303.566 | fail |
80 | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.154 | success |
81 | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.173 | success |
82 | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 300.550 | fail |
83 | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.001 | success |
84 | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 303.713 | fail |
85 | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.094 | success |
86 | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.674 | success |
87 | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 300.091 | fail |
88 | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.001 | success |
89 | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.043 | success |
90 | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 1.587 | success |
91 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.262 | success |
92 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.121 | success |
93 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.178 | success |
94 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.135 | success |
95 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.113 | success |
96 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.047 | success |
97 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.040 | success |
98 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.040 | success |
99 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.038 | success |
100 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.259 | success |
101 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.391 | success |
102 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.001 | skip |
103 | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.090 | success |
104 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.053 | success |
105 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.009 | success |
106 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.041 | success |
107 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.041 | success |
108 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.014 | success |
109 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.009 | success |
110 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.023 | success |
111 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.036 | success |
112 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.045 | success |
113 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.649 | success |
114 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.012 | success |
115 | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.042 | success |
116 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.000 | skip |
117 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 2.819 | success |
118 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 6.846 | success |
119 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 303.888 | fail |
120 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.347 | skip |
121 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 317.471 | fail |
122 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 301.431 | fail |
123 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 301.068 | fail |
124 | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 5.488 | success |
125 | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.041 | success |
126 | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.080 | success |
127 | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.308 | success |
128 | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.170 | success |
129 | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.174 | success |
130 | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.306 | success |
131 | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.331 | success |
132 | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.307 | success |
133 | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 1.770 | success |
134 | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 6.074 | success |
135 | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 8.126 | success |
136 | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 5.697 | success |
137 | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 5.928 | success |
138 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 0.458 | success |
139 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 1.032 | success |
140 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 0.597 | success |
141 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 1.087 | success |
142 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 0.463 | success |
143 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 0.398 | success |
144 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 0.439 | success |
145 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.445 | success |
146 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.312 | success |
147 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 1.065 | success |
148 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.301 | success |
149 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.304 | success |
150 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.432 | success |
151 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.221 | success |
152 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 0.459 | success |
153 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.313 | success |
154 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 0.249 | success |
155 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.275 | success |
156 | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.284 | success |
157 | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.125 | success |
158 | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.043 | success |
159 | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 323.768 | fail |
160 | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.055 | success |
161 | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.289 | success |
162 | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.052 | success |
163 | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.009 | success |
164 | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.238 | success |
165 | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.107 | success |
166 | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.214 | success |
167 | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.102 | success |
168 | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.382 | success |
169 | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.000 | fail |
170 | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.894 | success |
171 | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.129 | success |
172 | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.168 | success |
173 | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.172 | success |
174 | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 0.000 | fail |
175 | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.018 | success |
176 | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.018 | success |
177 | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.027 | success |
178 | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.019 | success |
179 | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.082 | success |
180 | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.019 | success |
181 | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.091 | success |
182 | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 0.630 | success |
183 | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 1.296 | success |
184 | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 2.890 | success |
185 | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 1.435 | success |
186 | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.663 | success |
187 | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 0.946 | success |
188 | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 0.000 | fail |
189 | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.000 | fail |
190 | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.000 | fail |
191 | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.000 | fail |
192 | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.000 | fail |
193 | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.000 | fail |
194 | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 0.000 | fail |
195 | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 0.000 | fail |
196 | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 0.000 | fail |
197 | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.000 | fail |
198 | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.000 | fail |
199 | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.425 | success |
200 | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.459 | success |
201 | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 0.711 | success |
202 | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.099 | success |
203 | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.094 | success |
204 | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 3.077 | success |
205 | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 1.372 | success |
206 | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 1.769 | success |
207 | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 0.889 | success |
208 | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 3.092 | success |
209 | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 1.691 | success |
210 | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 1.689 | success |
211 | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.001 | success |
212 | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 0.748 | success |
213 | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 1.306 | success |
214 | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.142 | success |
215 | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 0.748 | success |
216 | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 1.189 | success |
217 | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.074 | success |
218 | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.278 | success |
219 | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 2.527 | success |
220 | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.015 | success |
221 | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.629 | success |
222 | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.355 | success |
223 | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.333 | success |
224 | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.335 | success |
225 | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.353 | success |
226 | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.339 | success |
227 | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 2.951 | success |
228 | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.022 | success |
229 | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 303.959 | fail |
230 | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 302.043 | fail |
231 | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 1.600 | success |
232 | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 1.606 | success |
233 | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 8.446 | success |
234 | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 8.743 | success |
235 | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 8.966 | success |
236 | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 10.497 | success |
237 | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.105 | success |
238 | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.038 | success |
239 | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 134.544 | fail |
240 | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 333.942 | fail |
241 | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 336.063 | fail |
242 +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
243 run_tempest - INFO - Results: {'timestart': '2016-04-2615:42:30.384572', 'duration': 1497, 'tests': 188, 'failures': 27}
244 run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
245 run_tempest - INFO - Deleting tenant and user for Tempest suite)
251 FUNCTEST.info: Running Rally benchmark suite...
252 run_rally - INFO - Starting test scenario "authenticate" ...
255 Task ad742546-c147-4903-a31f-841de938dd68: started
256 Task ad742546-c147-4903-a31f-841de938dd68: finished
258 test scenario Authenticate.validate_glance
259 +-----------------------------------------------------------------------------------------------------------------------------------------+
260 | Response Times (sec) |
261 +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
262 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
263 +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
264 | authenticate.validate_glance_2_times | 0.196 | 0.321 | 0.365 | 0.372 | 0.38 | 0.302 | 100.0% | 10 |
265 | total | 0.278 | 0.405 | 0.481 | 0.487 | 0.492 | 0.398 | 100.0% | 10 |
266 +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
267 Load duration: 1.25959300995
268 Full duration: 4.72824001312
270 test scenario Authenticate.keystone
271 +--------------------------------------------------------------------------------------------------------------------------+
272 | Response Times (sec) |
273 +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
274 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
275 +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
276 | authenticate.keystone | 0.076 | 0.084 | 0.111 | 0.116 | 0.121 | 0.09 | 100.0% | 10 |
277 | total | 0.076 | 0.084 | 0.111 | 0.116 | 0.121 | 0.09 | 100.0% | 10 |
278 +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
279 Load duration: 0.271264076233
280 Full duration: 3.62738013268
282 test scenario Authenticate.validate_heat
283 +---------------------------------------------------------------------------------------------------------------------------------------+
284 | Response Times (sec) |
285 +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
286 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
287 +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
288 | authenticate.validate_heat_2_times | 0.175 | 0.197 | 0.249 | 0.254 | 0.258 | 0.207 | 100.0% | 10 |
289 | total | 0.254 | 0.297 | 0.383 | 0.398 | 0.413 | 0.316 | 100.0% | 10 |
290 +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
291 Load duration: 0.942983865738
292 Full duration: 4.24797916412
294 test scenario Authenticate.validate_nova
295 +---------------------------------------------------------------------------------------------------------------------------------------+
296 | Response Times (sec) |
297 +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
298 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
299 +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
300 | authenticate.validate_nova_2_times | 0.119 | 0.158 | 0.214 | 0.226 | 0.237 | 0.164 | 100.0% | 10 |
301 | total | 0.206 | 0.255 | 0.317 | 0.323 | 0.329 | 0.261 | 100.0% | 10 |
302 +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
303 Load duration: 0.78842997551
304 Full duration: 4.25593304634
306 test scenario Authenticate.validate_cinder
307 +-----------------------------------------------------------------------------------------------------------------------------------------+
308 | Response Times (sec) |
309 +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
310 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
311 +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
312 | authenticate.validate_cinder_2_times | 0.119 | 0.189 | 0.375 | 0.376 | 0.378 | 0.229 | 100.0% | 10 |
313 | total | 0.2 | 0.333 | 0.46 | 0.479 | 0.499 | 0.336 | 100.0% | 10 |
314 +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
315 Load duration: 0.973871946335
316 Full duration: 4.23989796638
318 test scenario Authenticate.validate_neutron
319 +------------------------------------------------------------------------------------------------------------------------------------------+
320 | Response Times (sec) |
321 +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
322 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
323 +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
324 | authenticate.validate_neutron_2_times | 0.195 | 0.211 | 0.231 | 0.247 | 0.263 | 0.215 | 100.0% | 10 |
325 | total | 0.277 | 0.305 | 0.331 | 0.345 | 0.359 | 0.309 | 100.0% | 10 |
326 +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
327 Load duration: 0.916023015976
328 Full duration: 4.58919405937
330 2016-04-26 17:13:30,899 - run_rally - INFO - Test scenario: "authenticate" OK.
331 2016-04-26 17:13:30,899 - run_rally - INFO - Starting test scenario "glance" ...
332 2016-04-26 17:15:24,362 - run_rally - INFO -
334 Task 9f0a1a59-63ee-4c5c-83b4-fda6ca64d4d3: started
335 Task 9f0a1a59-63ee-4c5c-83b4-fda6ca64d4d3: finished
337 test scenario GlanceImages.list_images
338 +-----------------------------------------------------------------------------------------------------------------------+
339 | Response Times (sec) |
340 +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
341 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
342 +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
343 | glance.list_images | 0.265 | 0.322 | 0.356 | 0.383 | 0.411 | 0.319 | 100.0% | 10 |
344 | total | 0.265 | 0.322 | 0.356 | 0.383 | 0.411 | 0.319 | 100.0% | 10 |
345 +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
346 Load duration: 0.958132982254
347 Full duration: 5.75791287422
349 test scenario GlanceImages.create_image_and_boot_instances
350 +------------------------------------------------------------------------------------------------------------------------+
351 | Response Times (sec) |
352 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
353 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
354 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
355 | glance.create_image | 3.814 | 4.56 | 5.238 | 5.417 | 5.597 | 4.572 | 100.0% | 10 |
356 | nova.boot_servers | 6.063 | 7.369 | 7.972 | 8.963 | 9.955 | 7.357 | 100.0% | 10 |
357 | total | 10.969 | 11.692 | 12.712 | 13.839 | 14.965 | 11.929 | 100.0% | 10 |
358 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
359 Load duration: 34.7748630047
360 Full duration: 56.4055418968
362 test scenario GlanceImages.create_and_list_image
363 +------------------------------------------------------------------------------------------------------------------------+
364 | Response Times (sec) |
365 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
366 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
367 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
368 | glance.create_image | 3.733 | 4.173 | 4.872 | 4.909 | 4.946 | 4.299 | 100.0% | 10 |
369 | glance.list_images | 0.034 | 0.108 | 0.128 | 0.141 | 0.153 | 0.1 | 100.0% | 10 |
370 | total | 3.841 | 4.25 | 4.982 | 5.018 | 5.055 | 4.399 | 100.0% | 10 |
371 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
372 Load duration: 13.4400930405
373 Full duration: 21.2837600708
375 test scenario GlanceImages.create_and_delete_image
376 +------------------------------------------------------------------------------------------------------------------------+
377 | Response Times (sec) |
378 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
379 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
380 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
381 | glance.create_image | 3.579 | 4.549 | 4.615 | 4.621 | 4.627 | 4.302 | 100.0% | 10 |
382 | glance.delete_image | 0.561 | 0.882 | 1.06 | 1.077 | 1.093 | 0.878 | 100.0% | 10 |
383 | total | 4.529 | 5.366 | 5.55 | 5.629 | 5.707 | 5.18 | 100.0% | 10 |
384 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
385 Load duration: 15.3838078976
386 Full duration: 20.4000329971
388 2016-04-26 17:15:25,993 - run_rally - INFO - Test scenario: "glance" OK.
389 2016-04-26 17:15:25,993 - run_rally - INFO - Starting test scenario "cinder" ...
390 2016-04-26 17:30:47,609 - run_rally - INFO -
392 Task 814c7265-77f0-4627-b851-4d6307469184: started
393 Task 814c7265-77f0-4627-b851-4d6307469184: finished
395 test scenario CinderVolumes.create_and_attach_volume
396 +-------------------------------------------------------------------------------------------------------------------------+
397 | Response Times (sec) |
398 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
399 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
400 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
401 | nova.boot_server | 3.253 | 3.8 | 5.748 | 5.876 | 6.003 | 4.299 | 100.0% | 10 |
402 | cinder.create_volume | 2.647 | 2.849 | 3.122 | 3.314 | 3.506 | 2.905 | 100.0% | 10 |
403 | nova.attach_volume | 2.828 | 2.941 | 3.024 | 3.139 | 3.253 | 2.956 | 100.0% | 10 |
404 | nova.detach_volume | 2.694 | 2.805 | 3.047 | 3.066 | 3.085 | 2.854 | 100.0% | 10 |
405 | cinder.delete_volume | 0.465 | 2.501 | 2.589 | 2.62 | 2.652 | 2.292 | 100.0% | 10 |
406 | nova.delete_server | 2.31 | 2.432 | 2.572 | 2.61 | 2.647 | 2.445 | 100.0% | 10 |
407 | total | 17.005 | 17.344 | 19.667 | 19.684 | 19.702 | 17.752 | 100.0% | 10 |
408 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
409 Load duration: 52.3380470276
410 Full duration: 62.1368570328
412 test scenario CinderVolumes.create_and_list_volume
413 +-------------------------------------------------------------------------------------------------------------------------+
414 | Response Times (sec) |
415 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
416 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
417 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
418 | cinder.create_volume | 5.365 | 5.628 | 6.335 | 7.213 | 8.09 | 5.894 | 100.0% | 10 |
419 | cinder.list_volumes | 0.12 | 0.13 | 0.179 | 0.324 | 0.47 | 0.165 | 100.0% | 10 |
420 | total | 5.492 | 5.753 | 6.503 | 7.531 | 8.56 | 6.059 | 100.0% | 10 |
421 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
422 Load duration: 17.5699410439
423 Full duration: 32.550137043
425 test scenario CinderVolumes.create_and_list_volume
426 +-------------------------------------------------------------------------------------------------------------------------+
427 | Response Times (sec) |
428 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
429 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
430 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
431 | cinder.create_volume | 2.66 | 2.948 | 3.145 | 3.171 | 3.197 | 2.939 | 100.0% | 10 |
432 | cinder.list_volumes | 0.039 | 0.124 | 0.137 | 0.145 | 0.153 | 0.12 | 100.0% | 10 |
433 | total | 2.765 | 3.073 | 3.28 | 3.3 | 3.32 | 3.059 | 100.0% | 10 |
434 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
435 Load duration: 8.95114684105
436 Full duration: 20.4319190979
438 test scenario CinderVolumes.create_and_list_snapshots
439 +---------------------------------------------------------------------------------------------------------------------------+
440 | Response Times (sec) |
441 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
442 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
443 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
444 | cinder.create_snapshot | 2.53 | 4.717 | 6.846 | 6.861 | 6.875 | 4.502 | 100.0% | 10 |
445 | cinder.list_snapshots | 0.017 | 0.106 | 0.12 | 0.135 | 0.15 | 0.094 | 100.0% | 10 |
446 | total | 2.68 | 4.789 | 6.9 | 6.926 | 6.953 | 4.596 | 100.0% | 10 |
447 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
448 Load duration: 12.3801140785
449 Full duration: 44.4814119339
451 test scenario CinderVolumes.create_and_delete_volume
452 +-------------------------------------------------------------------------------------------------------------------------+
453 | Response Times (sec) |
454 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
455 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
456 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
457 | cinder.create_volume | 2.72 | 2.87 | 2.984 | 3.001 | 3.018 | 2.88 | 100.0% | 10 |
458 | cinder.delete_volume | 2.327 | 2.533 | 2.641 | 2.663 | 2.685 | 2.526 | 100.0% | 10 |
459 | total | 5.148 | 5.386 | 5.625 | 5.664 | 5.703 | 5.406 | 100.0% | 10 |
460 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
461 Load duration: 16.1617929935
462 Full duration: 23.7529392242
464 test scenario CinderVolumes.create_and_delete_volume
465 +-------------------------------------------------------------------------------------------------------------------------+
466 | Response Times (sec) |
467 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
468 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
469 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
470 | cinder.create_volume | 5.261 | 5.487 | 5.686 | 5.742 | 5.797 | 5.493 | 100.0% | 10 |
471 | cinder.delete_volume | 2.393 | 2.591 | 2.671 | 2.776 | 2.881 | 2.572 | 100.0% | 10 |
472 | total | 7.72 | 8.0 | 8.304 | 8.491 | 8.679 | 8.065 | 100.0% | 10 |
473 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
474 Load duration: 23.9920217991
475 Full duration: 31.16101408
477 test scenario CinderVolumes.create_and_delete_volume
478 +-------------------------------------------------------------------------------------------------------------------------+
479 | Response Times (sec) |
480 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
481 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
482 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
483 | cinder.create_volume | 2.683 | 2.83 | 2.958 | 3.031 | 3.105 | 2.838 | 100.0% | 10 |
484 | cinder.delete_volume | 2.446 | 2.601 | 2.755 | 2.757 | 2.759 | 2.621 | 100.0% | 10 |
485 | total | 5.209 | 5.463 | 5.632 | 5.673 | 5.715 | 5.459 | 100.0% | 10 |
486 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
487 Load duration: 16.2941839695
488 Full duration: 23.1591808796
490 test scenario CinderVolumes.create_and_upload_volume_to_image
491 +----------------------------------------------------------------------------------------------------------------------------------+
492 | Response Times (sec) |
493 +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
494 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
495 +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
496 | cinder.create_volume | 2.705 | 3.234 | 5.839 | 6.009 | 6.178 | 4.101 | 100.0% | 10 |
497 | cinder.upload_volume_to_image | 25.866 | 34.579 | 36.121 | 36.966 | 37.811 | 33.004 | 100.0% | 10 |
498 | cinder.delete_volume | 2.425 | 2.516 | 2.859 | 3.79 | 4.722 | 2.741 | 100.0% | 10 |
499 | nova.delete_image | 1.063 | 1.781 | 2.315 | 2.368 | 2.421 | 1.768 | 100.0% | 10 |
500 | total | 33.42 | 42.477 | 46.051 | 46.561 | 47.071 | 41.614 | 100.0% | 10 |
501 +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
502 Load duration: 122.33260107
503 Full duration: 130.417927027
505 test scenario CinderVolumes.create_and_delete_snapshot
506 +---------------------------------------------------------------------------------------------------------------------------+
507 | Response Times (sec) |
508 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
509 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
510 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
511 | cinder.create_snapshot | 2.619 | 4.753 | 5.128 | 5.998 | 6.868 | 4.741 | 100.0% | 10 |
512 | cinder.delete_snapshot | 2.341 | 4.464 | 4.614 | 4.628 | 4.642 | 3.881 | 100.0% | 10 |
513 | total | 5.069 | 9.108 | 9.651 | 10.58 | 11.51 | 8.622 | 100.0% | 10 |
514 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
515 Load duration: 23.5147559643
516 Full duration: 42.4243760109
518 test scenario CinderVolumes.create_volume
519 +-------------------------------------------------------------------------------------------------------------------------+
520 | Response Times (sec) |
521 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
522 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
523 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
524 | cinder.create_volume | 2.687 | 2.862 | 5.341 | 5.342 | 5.342 | 3.334 | 100.0% | 10 |
525 | total | 2.687 | 2.862 | 5.341 | 5.342 | 5.343 | 3.335 | 100.0% | 10 |
526 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
527 Load duration: 8.59894013405
528 Full duration: 18.9968831539
530 test scenario CinderVolumes.create_volume
531 +-------------------------------------------------------------------------------------------------------------------------+
532 | Response Times (sec) |
533 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
534 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
535 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
536 | cinder.create_volume | 2.891 | 3.117 | 5.147 | 5.186 | 5.225 | 3.853 | 100.0% | 10 |
537 | total | 2.892 | 3.118 | 5.147 | 5.186 | 5.225 | 3.853 | 100.0% | 10 |
538 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
539 Load duration: 11.1855640411
540 Full duration: 23.8357381821
542 test scenario CinderVolumes.list_volumes
543 +------------------------------------------------------------------------------------------------------------------------+
544 | Response Times (sec) |
545 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
546 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
547 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
548 | cinder.list_volumes | 0.23 | 0.276 | 0.313 | 0.333 | 0.353 | 0.281 | 100.0% | 10 |
549 | total | 0.23 | 0.276 | 0.313 | 0.333 | 0.354 | 0.281 | 100.0% | 10 |
550 +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
551 Load duration: 0.832192182541
552 Full duration: 49.1499869823
554 test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
555 +---------------------------------------------------------------------------------------------------------------------------+
556 | Response Times (sec) |
557 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
558 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
559 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
560 | cinder.create_volume | 2.745 | 3.988 | 5.311 | 5.419 | 5.527 | 4.036 | 100.0% | 10 |
561 | cinder.create_snapshot | 2.448 | 3.519 | 4.951 | 5.828 | 6.704 | 3.762 | 100.0% | 10 |
562 | nova.attach_volume | 2.902 | 4.661 | 5.677 | 6.517 | 7.356 | 4.515 | 100.0% | 10 |
563 | nova.detach_volume | 2.665 | 3.03 | 5.013 | 5.036 | 5.058 | 3.398 | 100.0% | 10 |
564 | cinder.delete_snapshot | 2.347 | 2.526 | 4.474 | 4.544 | 4.615 | 3.094 | 100.0% | 10 |
565 | cinder.delete_volume | 2.357 | 2.512 | 2.616 | 2.622 | 2.629 | 2.497 | 100.0% | 10 |
566 | total | 16.23 | 22.038 | 24.243 | 25.404 | 26.565 | 21.659 | 100.0% | 10 |
567 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
568 Load duration: 61.302448988
569 Full duration: 101.445744038
571 test scenario CinderVolumes.create_from_volume_and_delete_volume
572 +-------------------------------------------------------------------------------------------------------------------------+
573 | Response Times (sec) |
574 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
575 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
576 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
577 | cinder.create_volume | 3.012 | 5.284 | 7.846 | 8.73 | 9.613 | 5.488 | 100.0% | 10 |
578 | cinder.delete_volume | 2.465 | 4.731 | 6.986 | 7.116 | 7.247 | 4.39 | 100.0% | 10 |
579 | total | 5.537 | 10.039 | 14.516 | 14.707 | 14.898 | 9.877 | 100.0% | 10 |
580 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
581 Load duration: 25.7450320721
582 Full duration: 44.7656638622
584 test scenario CinderVolumes.create_and_extend_volume
585 +-------------------------------------------------------------------------------------------------------------------------+
586 | Response Times (sec) |
587 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
588 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
589 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
590 | cinder.create_volume | 2.809 | 2.87 | 3.171 | 3.173 | 3.174 | 2.925 | 100.0% | 10 |
591 | cinder.extend_volume | 2.68 | 2.828 | 5.155 | 5.156 | 5.157 | 3.67 | 100.0% | 10 |
592 | cinder.delete_volume | 2.351 | 2.533 | 2.633 | 2.64 | 2.648 | 2.537 | 100.0% | 10 |
593 | total | 8.073 | 8.443 | 10.604 | 10.657 | 10.711 | 9.133 | 100.0% | 10 |
594 +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
595 Load duration: 26.884996891
596 Full duration: 34.1721270084
598 test scenario CinderVolumes.create_snapshot_and_attach_volume
599 +---------------------------------------------------------------------------------------------------------------------------+
600 | Response Times (sec) |
601 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
602 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
603 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
604 | cinder.create_volume | 2.775 | 2.863 | 2.974 | 3.062 | 3.151 | 2.888 | 100.0% | 10 |
605 | cinder.create_snapshot | 2.383 | 3.589 | 6.958 | 7.815 | 8.672 | 4.208 | 100.0% | 10 |
606 | nova.attach_volume | 2.875 | 3.242 | 5.488 | 6.395 | 7.302 | 4.124 | 100.0% | 10 |
607 | nova.detach_volume | 2.665 | 2.896 | 3.035 | 3.047 | 3.059 | 2.879 | 100.0% | 10 |
608 | cinder.delete_snapshot | 2.154 | 2.468 | 2.771 | 3.49 | 4.209 | 2.6 | 100.0% | 10 |
609 | cinder.delete_volume | 0.443 | 2.52 | 2.652 | 2.664 | 2.677 | 2.341 | 100.0% | 10 |
610 | total | 16.386 | 19.141 | 21.529 | 23.357 | 25.184 | 19.466 | 100.0% | 10 |
611 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
612 Load duration: 56.0006937981
613 Full duration: 103.148792982
615 test scenario CinderVolumes.create_snapshot_and_attach_volume
616 +---------------------------------------------------------------------------------------------------------------------------+
617 | Response Times (sec) |
618 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
619 | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
620 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
621 | cinder.create_volume | 2.734 | 2.837 | 2.972 | 2.98 | 2.987 | 2.853 | 100.0% | 10 |
622 | cinder.create_snapshot | 2.361 | 4.585 | 7.125 | 7.96 | 8.794 | 4.799 | 100.0% | 10 |
623 | nova.attach_volume | 2.861 | 3.062 | 5.2 | 5.255 | 5.311 | 3.579 | 100.0% | 10 |
624 | nova.detach_volume | 2.776 | 2.919 | 3.111 | 3.147 | 3.183 | 2.942 | 100.0% | 10 |
625 | cinder.delete_snapshot | 2.381 | 3.48 | 6.541 | 6.595 | 6.649 | 3.908 | 100.0% | 10 |
626 | cinder.delete_volume | 2.273 | 2.579 | 4.795 | 5.881 | 6.967 | 3.176 | 100.0% | 10 |
627 | total | 16.565 | 23.291 | 23.896 | 24.12 | 24.344 | 21.919 | 100.0% | 10 |
628 +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
629 Load duration: 62.6618189812
630 Full duration: 108.85529089
639 FUNCTEST.info: Running ODL test...
640 ==============================================================================
642 ==============================================================================
643 Basic.010 Restconf OK :: Test suite to verify Restconf is OK
644 ==============================================================================
645 Get Controller Modules :: Get the controller modules via Restconf | PASS |
646 ------------------------------------------------------------------------------
647 Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
648 1 critical test, 1 passed, 0 failed
649 1 test total, 1 passed, 0 failed
650 ==============================================================================
652 1 critical test, 1 passed, 0 failed
653 1 test total, 1 passed, 0 failed
654 ==============================================================================
655 Output: /home/opnfv/output.xml
656 Log: /home/opnfv/log.html
657 Report: /home/opnfv/report.html
658 ==============================================================================
659 Neutron :: Test suite for Neutron Plugin
660 ==============================================================================
661 Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
662 ==============================================================================
663 Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
664 ------------------------------------------------------------------------------
665 Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
666 ------------------------------------------------------------------------------
667 Create Network :: Create new network in OpenStack | PASS |
668 ------------------------------------------------------------------------------
669 Check Network :: Check Network created in OpenDaylight | FAIL |
671 ------------------------------------------------------------------------------
672 Neutron.Networks :: Checking Network created in OpenStack are push... | FAIL |
673 4 critical tests, 3 passed, 1 failed
674 4 tests total, 3 passed, 1 failed
675 ==============================================================================
676 Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
677 ==============================================================================
678 Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
679 ------------------------------------------------------------------------------
680 Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
681 ------------------------------------------------------------------------------
682 Create New subnet :: Create new subnet in OpenStack | PASS |
683 ------------------------------------------------------------------------------
684 Check New subnet :: Check new subnet created in OpenDaylight | FAIL |
686 ------------------------------------------------------------------------------
687 Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | FAIL |
688 4 critical tests, 3 passed, 1 failed
689 4 tests total, 3 passed, 1 failed
690 ==============================================================================
691 Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
692 ==============================================================================
693 Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
694 ------------------------------------------------------------------------------
695 Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
696 ------------------------------------------------------------------------------
697 Create New Port :: Create new port in OpenStack | PASS |
698 ------------------------------------------------------------------------------
699 Check New Port :: Check new subnet created in OpenDaylight | FAIL |
701 ------------------------------------------------------------------------------
702 Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | FAIL |
703 4 critical tests, 3 passed, 1 failed
704 4 tests total, 3 passed, 1 failed
705 ==============================================================================
706 Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
707 ==============================================================================
708 Delete New Port :: Delete previously created port in OpenStack | PASS |
709 ------------------------------------------------------------------------------
710 Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
711 ------------------------------------------------------------------------------
712 Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
713 2 critical tests, 2 passed, 0 failed
714 2 tests total, 2 passed, 0 failed
715 ==============================================================================
716 Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
717 ==============================================================================
718 Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
719 ------------------------------------------------------------------------------
720 Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
721 ------------------------------------------------------------------------------
722 Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
723 2 critical tests, 2 passed, 0 failed
724 2 tests total, 2 passed, 0 failed
725 ==============================================================================
726 Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
727 ==============================================================================
728 Delete Network :: Delete network in OpenStack | PASS |
729 ------------------------------------------------------------------------------
730 Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
731 ------------------------------------------------------------------------------
732 Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
733 2 critical tests, 2 passed, 0 failed
734 2 tests total, 2 passed, 0 failed
735 ==============================================================================
736 Neutron :: Test suite for Neutron Plugin | FAIL |
737 18 critical tests, 15 passed, 3 failed
738 18 tests total, 15 passed, 3 failed
739 ==============================================================================
740 Output: /home/opnfv/output.xml
741 Log: /home/opnfv/log.html
742 Report: /home/opnfv/report.html
743 Log: /home/opnfv/log.html
744 Report: /home/opnfv/report.html
754 FUNCTEST.info: Running vIMS test...
755 vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
756 vIMS - INFO - Update OpenStack creds informations
757 vIMS - INFO - Upload some OS images if it doesn't exist
758 vIMS - INFO - centos_7 image doesn't exist on glance repository.
759 Try downloading this image and upload on glance !
760 vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
761 Try downloading this image and upload on glance !
762 vIMS - INFO - Update security group quota for this tenant
763 vIMS - INFO - Update cinder quota for this tenant
764 vIMS - INFO - Collect flavor id for cloudify manager server
765 vIMS - INFO - Prepare virtualenv for cloudify-cli
766 vIMS - INFO - Downloading the cloudify manager server blueprint
767 vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 08:04:17'
768 vIMS - INFO - Writing the inputs file
769 vIMS - INFO - Launching the cloudify-manager deployment
770 vIMS - INFO - Cloudify-manager server is UP !
771 vIMS - INFO - Cloudify deployment duration:'495.7'
772 vIMS - INFO - Collect flavor id for all clearwater vm
773 vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 08:12:33'
774 vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
775 vIMS - INFO - Writing the inputs file
776 vIMS - INFO - Launching the clearwater deployment
777 vIMS - INFO - The deployment of clearwater-opnfv is ended
778 vIMS - INFO - vIMS VNF deployment duration:'759.1'
779 vIMS - INFO - vIMS functional test Start Time:'2016-02-23 08:28:17'
780 vIMS - INFO - vIMS functional test duration:'109.1'
781 vIMS - INFO - Launching the clearwater-opnfv undeployment
782 vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
783 vIMS - INFO - Launching the cloudify-manager undeployment
784 vIMS - INFO - Cloudify-manager server has been successfully removed!
785 vIMS - INFO - Removing vIMS tenant ..
786 vIMS - INFO - Removing vIMS user ..
793 FUNCTEST.info: Running Doctor test...
794 doctor - DEBUG - Executing command : cd /home/opnfv/repos/doctor/tests && ./run.sh
795 doctor - DEBUG - + IMAGE_URL=https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
796 Note: doctor/tests/run.sh has been executed.
797 PING 192.30.9.7 (192.30.9.7) 56(84) bytes of data.
798 64 bytes from 192.30.9.7: icmp_seq=1 ttl=63 time=0.753 ms
800 --- 192.30.9.7 ping statistics ---
801 1 packets transmitted, 1 received, 0% packet loss, time 0ms
802 rtt min/avg/max/mdev = 0.753/0.753/0.753/0.000 ms
803 preparing VM image...
804 +------------------+--------------------------------------+
806 +------------------+--------------------------------------+
807 | checksum | 7ca2842a166c276d49880998e4b397d5 |
808 | container_format | bare |
809 | created_at | 2016-04-26T17:07:58Z |
810 | disk_format | qcow2 |
811 | id | ccc11584-d901-4c83-9bbe-1e35b12f03ee |
815 | owner | 8f39920048ea444d9dedb35e601c1292 |
816 | protected | False |
820 | updated_at | 2016-04-26T17:07:59Z |
821 | virtual_size | None |
822 | visibility | public |
823 +------------------+--------------------------------------+
824 starting doctor sample components...
825 creating VM and alarm...
826 +--------------------------------------+-----------------------------------------------+
828 +--------------------------------------+-----------------------------------------------+
829 | OS-DCF:diskConfig | MANUAL |
830 | OS-EXT-AZ:availability_zone | |
831 | OS-EXT-SRV-ATTR:host | - |
832 | OS-EXT-SRV-ATTR:hypervisor_hostname | - |
833 | OS-EXT-SRV-ATTR:instance_name | instance-00000048 |
834 | OS-EXT-STS:power_state | 0 |
835 | OS-EXT-STS:task_state | scheduling |
836 | OS-EXT-STS:vm_state | building |
837 | OS-SRV-USG:launched_at | - |
838 | OS-SRV-USG:terminated_at | - |
841 | adminPass | AaUNZaoqw74Q |
843 | created | 2016-04-26T17:08:01Z |
844 | flavor | m1.tiny (1) |
846 | id | 1ab94214-1d8c-46b5-8467-3d3e3b602f04 |
847 | image | cirros (0074bf80-807e-4cb7-b904-bf4347c2a668) |
850 | name | doctor_vm1 |
851 | os-extended-volumes:volumes_attached | [] |
853 | security_groups | default |
855 | tenant_id | 3d15a63c2519439f839df6785236b0e1 |
856 | updated | 2016-02-24T07:59:49Z |
857 | user_id | 0cfa3d72e33b490880278ff6676aa961 |
858 +--------------------------------------+-----------------------------------------------+
860 +---------------------------+----------------------------------------------------------------------+
862 +---------------------------+----------------------------------------------------------------------+
863 | alarm_actions | ["http://localhost:12346/failure"] |
864 | alarm_id | 739ca887-1a9d-4fb4-ad77-17793de1db16 |
865 | description | VM failure |
867 | event_type | compute.instance.update |
868 | insufficient_data_actions | [] |
869 | name | doctor_alarm1 |
871 | project_id | 3d15a63c2519439f839df6785236b0e1 |
872 | query | [{"field": "traits.state", "type": "string", "value": "error", "op": |
873 | | "eq"}, {"field": "traits.instance_id", "type": "string", "value": |
874 | | "1ab94214-1d8c-46b5-8467-3d3e3b602f04", "op": "eq"}] |
875 | repeat_actions | False |
876 | severity | moderate |
877 | state | insufficient data |
879 | user_id | 0cfa3d72e33b490880278ff6676aa961 |
880 +---------------------------+----------------------------------------------------------------------+
881 waiting for vm launch...
882 injecting host failure...
883 disabling network of comupte host [overcloud-novacompute-0] for 3 mins...
884 Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
885 Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
893 Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
894 Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
895 Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
896 Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
899 + ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i instack_key heat-admin@192.30.9.7 '[ -e disable_network.log ] && cat disable_network.log'
900 Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
901 sudo ip link set enp8s0 down
903 Request to delete server doctor_vm1 has been accepted.
904 waiting disabled compute host back to be enabled...
906 doctor - INFO - doctor OK
913 ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover} --load-list /tmp/tmpvjQxKe
914 {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn [0.191925s] ... ok
915 {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail [0.078978s] ... ok
920 Ran: 2 tests in 7.0000 sec.
924 - Unexpected Success: 0
926 Sum of execute time for each test: 0.2709 sec.
Code Review / functest.git / blob