docs/how-to-use/APITests.rst

   1 SNAPS OpenStack API Testing
   2 ===========================
   3
   4 Tests designated as component tests extend the snaps.openstack.tests.OSComponentTestCase class and must be exercised
   5 with OpenStack credentials for all as well as an external network for many. When leveraging the unit\_test\_suite.py
   6 application, the -e argument and -n arguments will suffice. When attempting to execute these tests within your IDE
   7 of choice (tested on IntelliJ), you will need to edit the [repo\_dir]/snaps/openstack/tests/conf/os\_env.yaml file as well
   8 as ensuring that your run configuration's working directory is set to [repo\_dir]/snaps.
   9
  10 The Test Classes
  11 ================
  12
  13 glance_utils_tests.py - GlanceSmokeTests
  14 ----------------------------------------
  15
  16 Ensures that a Glance client can be obtained as well as the proper
  17 exceptions thrown with the wrong credentials.
  18
  19 keystone_utils_tests.py - KeystoneSmokeTests
  20 --------------------------------------------
  21
  22 Ensures that a Keystone client can be obtained as well as the proper
  23 exceptions thrown with the wrong credentials.
  24
  25 neutron_utils_tests.py - NeutronSmokeTests
  26 ------------------------------------------
  27
  28 Ensures that a Neutron client can be obtained as well as the proper
  29 exceptions thrown with the wrong credentials.
  30
  31 nova_utils_tests.py - NovaSmokeTests
  32 ------------------------------------
  33
  34 Ensures that a Nova client can be obtained as well as the proper
  35 exceptions thrown with the wrong credentials.
  36
  37 cinder_utils_tests.py - CinderSmokeTests
  38 ----------------------------------------
  39
  40 Ensures that a Cinder client can be obtained as well as the proper
  41 exceptions thrown with the wrong credentials.
  42
  43 heat_utils_tests.py - HeatSmokeTests
  44 ------------------------------------
  45
  46 Ensures that a Heat client can be obtained as well as the proper
  47 exceptions thrown with the wrong credentials.
  48
  49 keystone_utils_tests.py - KeystoneUtilsTests
  50 --------------------------------------------
  51
  52 +----------------------------------+---------------+-----------------------------------------------------------+
  53 | Test Name                        | Keystone API  | Description                                               |
  54 +==================================+===============+===========================================================+
  55 | test_create_user_minimal         | 2 & 3         | Tests the creation of a user with minimal configuration   |
  56 |                                  |               | settings via the utility functions                        |
  57 +----------------------------------+---------------+-----------------------------------------------------------+
  58 | test_create_project_minimal      | 2 & 3         | Tests the creation of a project with minimal configuration|
  59 |                                  |               | settings via the utility functions                        |
  60 +----------------------------------+---------------+-----------------------------------------------------------+
  61 | test_get_endpoint_success        | 2 & 3         | Tests to ensure that proper credentials and proper service|
  62 |                                  |               | type can succeed                                          |
  63 +----------------------------------+---------------+-----------------------------------------------------------+
  64 | test_get_endpoint_fail_without   | 2 & 3         | Tests to ensure that proper credentials and improper      |
  65 | _proper_service                  |               | service type cannot succeed                               |
  66 +----------------------------------+---------------+-----------------------------------------------------------+
  67 | test_get_endpoint_fail_without   | 2 & 3         | Tests to ensure that improper credentials and proper      |
  68 | _proper_credentials              |               | service type cannot succeed                               |
  69 +----------------------------------+---------------+-----------------------------------------------------------+
  70 | test_get_endpoint_with_each      | 2 & 3         | Tests to ensure that an interface URL is returned for each|
  71 | _interface                       |               | supported interface type (i.e. public, internal, & admin) |
  72 +----------------------------------+---------------+-----------------------------------------------------------+
  73 | test_grant_user_role_to_project  | 2 & 3         | Tests to ensure that one can grant a new user's role to a |
  74 |                                  |               | new project                                               |
  75 +----------------------------------+---------------+-----------------------------------------------------------+
  76
  77 create_user_tests.py - CreateUserSuccessTests
  78 ---------------------------------------------
  79 +----------------------------------+---------------+-----------------------------------------------------------+
  80 | Test Name                        | Keystone API  | Description                                               |
  81 +==================================+===============+===========================================================+
  82 | test_create_user                 | 2 & 3         | Tests the creation of a user with minimal configuration   |
  83 |                                  |               | settings via the utility functions                        |
  84 +----------------------------------+---------------+-----------------------------------------------------------+
  85 | test_create_user_2x              | 2 & 3         | Tests the creation of a user 2x and ensure it has been    |
  86 |                                  |               | done only once                                            |
  87 +----------------------------------+---------------+-----------------------------------------------------------+
  88 | test_create_delete_user          | 2 & 3         | Tests the creation of a user and ensure clean can be      |
  89 |                                  |               | called 2x without exceptions being raised                 |
  90 +----------------------------------+---------------+-----------------------------------------------------------+
  91 | test_create_admin_user           | 2 & 3         | Tests the creation of a user with an 'admin' role         |
  92 +----------------------------------+---------------+-----------------------------------------------------------+
  93
  94 create_project_tests.py - CreateProjectSuccessTests
  95 ---------------------------------------------------
  96
  97 +----------------------------------+---------------+-----------------------------------------------------------+
  98 | Test Name                        | Keystone API  | Description                                               |
  99 +==================================+===============+===========================================================+
 100 | test_create_project_bad_domain   | 3             | Ensures that keystone v3 clients using the domain ID      |
 101 |                                  |               | project setting project creation will fail with an invalid|
 102 |                                  |               | domain id/name                                            |
 103 +----------------------------------+---------------+-----------------------------------------------------------+
 104 | test_create_project              | 2 & 3         | Tests the creation of a project via the OpenStackProject  |
 105 |                                  |               | class                                                     |
 106 +----------------------------------+---------------+-----------------------------------------------------------+
 107 | test_create_project_2x           | 2 & 3         | Tests the creation of a project a second time via the     |
 108 |                                  |               | OpenStackProject class to ensure it is only created once  |
 109 +----------------------------------+---------------+-----------------------------------------------------------+
 110 | test_create_delete_project       | 2 & 3         | Tests the creation and deletion of a project via the      |
 111 |                                  |               | OpenStackProject class to ensure that clean will not raise|
 112 |                                  |               | an exception                                              |
 113 +----------------------------------+---------------+-----------------------------------------------------------+
 114 | test_update_quotas               | 2 & 3         | Tests the ability to update quota values                  |
 115 |                                  | nova & neutron|                                                           |
 116 +----------------------------------+---------------+-----------------------------------------------------------+
 117
 118 create_project_tests.py - CreateProjectUserTests
 119 ------------------------------------------------
 120
 121 +---------------------------------------+---------------+-----------------------------------------------------------+
 122 | Test Name                             | Keystone API  | Description                                               |
 123 +=======================================+===============+===========================================================+
 124 | test_create_project_sec_grp_one_user  | 2 & 3         | Tests the creation of an OpenStack object to a project    |
 125 |                                       |               | with a new users and to create a security group           |
 126 |                                       |               |                                                           |
 127 +---------------------------------------+---------------+-----------------------------------------------------------+
 128 | test_create_project_sec_grp_two_users | 2 & 3         | Tests the creation of an OpenStack object to a project    |
 129 |                                       |               | with two new users and to create a security group under   |
 130 |                                       |               | each                                                      |
 131 +---------------------------------------+---------------+-----------------------------------------------------------+
 132
 133 glance_utils_tests.py - GlanceUtilsTests
 134 ----------------------------------------
 135
 136 +---------------------------------------+---------------+-----------------------------------------------------------+
 137 | Test Name                             | Glance API    | Description                                               |
 138 +=======================================+===============+===========================================================+
 139 | test_create_image_minimal_url         | 1             | Tests the glance_utils.create_image() function with a URL |
 140 +---------------------------------------+---------------+-----------------------------------------------------------+
 141 | test_create_image_minimal_file        | 1             | Tests the glance_utils.create_image() function with a file|
 142 +---------------------------------------+---------------+-----------------------------------------------------------+
 143
 144 neutron_utils_tests.py - NeutronUtilsNetworkTests
 145 -------------------------------------------------
 146
 147 +---------------------------------------+---------------+-----------------------------------------------------------+
 148 | Test Name                             | Neutron API   | Description                                               |
 149 +=======================================+===============+===========================================================+
 150 | test_create_network                   | 2             | Ensures neutron_utils.create_network() properly creates a |
 151 |                                       |               | network                                                   |
 152 +---------------------------------------+---------------+-----------------------------------------------------------+
 153 | test_create_network_empty_name        | 2             | Ensures neutron_utils.create_network() raises an exception|
 154 |                                       |               | when the network name is an empty string                  |
 155 +---------------------------------------+---------------+-----------------------------------------------------------+
 156 | test_create_network_null_name         | 2             | Ensures neutron_utils.create_network() raises an exception|
 157 |                                       |               | when the network name is None                             |
 158 +---------------------------------------+---------------+-----------------------------------------------------------+
 159
 160 neutron_utils_tests.py - NeutronUtilsSubnetTests
 161 ------------------------------------------------
 162
 163 +---------------------------------------+---------------+-----------------------------------------------------------+
 164 | Test Name                             | Neutron API   | Description                                               |
 165 +=======================================+===============+===========================================================+
 166 | test_create_subnet                    | 2             | Ensures neutron_utils.create_network() can properly create|
 167 |                                       |               | an OpenStack subnet object                                |
 168 +---------------------------------------+---------------+-----------------------------------------------------------+
 169 | test_create_subnet_null_name          | 2             | Ensures neutron_utils.create_network() raises an exception|
 170 |                                       |               | when the subnet name is None                              |
 171 +---------------------------------------+---------------+-----------------------------------------------------------+
 172 | test_create_subnet_empty_name         | 2             | Ensures neutron_utils.create_network() raises an exception|
 173 |                                       |               | when the subnet name is an empty string                   |
 174 +---------------------------------------+---------------+-----------------------------------------------------------+
 175 | test_create_subnet_null_cidr          | 2             | Ensures neutron_utils.create_network() raises an exception|
 176 |                                       |               | when the subnet CIDR is None                              |
 177 +---------------------------------------+---------------+-----------------------------------------------------------+
 178 | test_create_subnet_empty_cidr         | 2             | Ensures neutron_utils.create_network() raises an exception|
 179 |                                       |               | when the subnet CIDR is an empty string                   |
 180 +---------------------------------------+---------------+-----------------------------------------------------------+
 181
 182 neutron_utils_tests.py - NeutronUtilsIPv6Tests
 183 ----------------------------------------------
 184
 185 +---------------------------------------+---------------+-----------------------------------------------------------+
 186 | Test Name                             | Neutron API   | Description                                               |
 187 +=======================================+===============+===========================================================+
 188 | test_create_network_slaac             | 2             | Ensures neutron_utils.create_network() can properly create|
 189 |                                       |               | an OpenStack network with an IPv6 subnet when DHCP is True|
 190 |                                       |               | and modes are 'slaac'                                     |
 191 +---------------------------------------+---------------+-----------------------------------------------------------+
 192 | test_create_network_stateful          | 2             | Ensures neutron_utils.create_network() can properly create|
 193 |                                       |               | an OpenStack network with an IPv6 subnet when DHCP is True|
 194 |                                       |               | and modes are 'stateful'                                  |
 195 +---------------------------------------+---------------+-----------------------------------------------------------+
 196 | test_create_network_stateless         | 2             | Ensures neutron_utils.create_network() can properly create|
 197 |                                       |               | an OpenStack network with an IPv6 subnet when DHCP is True|
 198 |                                       |               | and modes are 'stateless'                                 |
 199 +---------------------------------------+---------------+-----------------------------------------------------------+
 200 | test_create_network_no_dhcp_slaac     | 2             | Ensures neutron_utils.create_network() raises a BadRequest|
 201 |                                       |               | exception when deploying the network with an IPv6 subnet  |
 202 |                                       |               | when DHCP is False and modes are 'slaac'                  |
 203 +---------------------------------------+---------------+-----------------------------------------------------------+
 204 | test_create_network_invalid_start_ip  | 2             | Ensures neutron_utils.create_network() sets the start IP  |
 205 |                                       |               | address to the minimum value when the start configuration |
 206 |                                       |               | parameter is some garbage value                           |
 207 +---------------------------------------+---------------+-----------------------------------------------------------+
 208 | test_create_network_invalid_end_ip    | 2             | Ensures neutron_utils.create_network() sets the end IP    |
 209 |                                       |               | address to the maximum value when the end configuration   |
 210 |                                       |               | parameter is some garbage value                           |
 211 +---------------------------------------+---------------+-----------------------------------------------------------+
 212 | test_create_network_with_bad_cidr     | 2             | Ensures neutron_utils.create_network() raises a BadRequest|
 213 |                                       |               | exception when the IPv6 CIDR is incorrect                 |
 214 +---------------------------------------+---------------+-----------------------------------------------------------+
 215 | test_create_network_invalid_gateway_ip| 2             | Ensures neutron_utils.create_network() raises a BadRequest|
 216 |                                       |               | exception when the IPv6 gateway IP does not match the CIDR|
 217 +---------------------------------------+---------------+-----------------------------------------------------------+
 218 | test_create_network_with_bad_dns      | 2             | Ensures neutron_utils.create_network() raises a BadRequest|
 219 |                                       |               | exception when the IPv6 DNS IP address is not a valid IPv6|
 220 |                                       |               | address                                                   |
 221 +---------------------------------------+---------------+-----------------------------------------------------------+
 222
 223 neutron_utils_tests.py - NeutronUtilsRouterTests
 224 ------------------------------------------------
 225
 226 +---------------------------------------+---------------+-----------------------------------------------------------+
 227 | Test Name                             | Neutron API   | Description                                               |
 228 +=======================================+===============+===========================================================+
 229 | test_create_router_simple             | 2             | Ensures neutron_utils.create_router() can properly create |
 230 |                                       |               | a simple OpenStack router object                          |
 231 +---------------------------------------+---------------+-----------------------------------------------------------+
 232 | test_create_router_with_public_inter  | 2             | Ensures neutron_utils.create_router() can properly create |
 233 | face                                  |               | an OpenStack router object with an interface to the       |
 234 |                                       |               | external network                                          |
 235 +---------------------------------------+---------------+-----------------------------------------------------------+
 236 | test_add_interface_router             | 2             | Ensures neutron_utils.add_interface_router() properly adds|
 237 |                                       |               | an interface to another subnet                            |
 238 +---------------------------------------+---------------+-----------------------------------------------------------+
 239 | test_add_interface_router_null_router | 2             | Ensures neutron_utils.add_interface_router() raises an    |
 240 |                                       |               | exception when the router object is None                  |
 241 +---------------------------------------+---------------+-----------------------------------------------------------+
 242 | test_add_interface_router_null_subnet | 2             | Ensures neutron_utils.add_interface_router() raises an    |
 243 |                                       |               | exception when the subnet object is None                  |
 244 +---------------------------------------+---------------+-----------------------------------------------------------+
 245 | test_add_interface_router_missing_sub | 2             | Ensures neutron_utils.add_interface_router() raises an    |
 246 | net                                   |               | exception when the subnet object had been deleted         |
 247 +---------------------------------------+---------------+-----------------------------------------------------------+
 248 | test_create_port                      | 2             | Ensures neutron_utils.create_port() can properly create an|
 249 |                                       |               | OpenStack port object                                     |
 250 +---------------------------------------+---------------+-----------------------------------------------------------+
 251 | test_create_port_empty_name           | 2             | Ensures neutron_utils.create_port() raises an exception   |
 252 |                                       |               | when the port name is an empty string                     |
 253 +---------------------------------------+---------------+-----------------------------------------------------------+
 254 | test_create_port_null_name            | 2             | Ensures neutron_utils.create_port() raises an exception   |
 255 |                                       |               | when the port name is None                                |
 256 +---------------------------------------+---------------+-----------------------------------------------------------+
 257 | test_create_port_null_network_object  | 2             | Ensures neutron_utils.create_port() raises an exception   |
 258 |                                       |               | when the network object is None                           |
 259 +---------------------------------------+---------------+-----------------------------------------------------------+
 260 | test_create_port_null_ip              | 2             | Ensures neutron_utils.create_port() raises an exception   |
 261 |                                       |               | when the assigned IP value is None                        |
 262 +---------------------------------------+---------------+-----------------------------------------------------------+
 263 | test_create_port_invalid_ip           | 2             | Ensures neutron_utils.create_port() raises an exception   |
 264 |                                       |               | when the assigned IP value is invalid                     |
 265 +---------------------------------------+---------------+-----------------------------------------------------------+
 266 | test_create_port_invalid_ip_to_subnet | 2             | Ensures neutron_utils.create_port() raises an exception   |
 267 |                                       |               | when the assigned IP value is not part of CIDR            |
 268 +---------------------------------------+---------------+-----------------------------------------------------------+
 269
 270 neutron_utils_tests.py - NeutronUtilsSecurityGroupTests
 271 -------------------------------------------------------
 272
 273 +---------------------------------------+---------------+-----------------------------------------------------------+
 274 | Test Name                             | Neutron API   | Description                                               |
 275 +=======================================+===============+===========================================================+
 276 | test_create_delete_simple_sec_grp     | 2             | Ensures that a security group can be created              |
 277 |                                       |               | (neutron_utils.create_security_group() and deleted via    |
 278 |                                       |               | neutron_utils.delete_security_group()                     |
 279 +---------------------------------------+---------------+-----------------------------------------------------------+
 280 | test_create_sec_grp_no_name           | 2             | Ensures that neutron_utils.create_security_group() raises |
 281 |                                       |               | an exception when attempting to create a security group   |
 282 |                                       |               | without a name                                            |
 283 +---------------------------------------+---------------+-----------------------------------------------------------+
 284 | test_create_sec_grp_no_rules          | 2             | Ensures that neutron_utils.create_security_group() can    |
 285 |                                       |               | create a security group without any rules                 |
 286 +---------------------------------------+---------------+-----------------------------------------------------------+
 287 | test_create_sec_grp_one_rule          | 2             | Ensures that neutron_utils.create_security_group_rule()   |
 288 |                                       |               | can add a rule to a security group                        |
 289 +---------------------------------------+---------------+-----------------------------------------------------------+
 290 | test_get_sec_grp_by_id                | 2             | Ensures that neutron_utils.get_security_group_by_id()     |
 291 |                                       |               | returns the expected security group                       |
 292 +---------------------------------------+---------------+-----------------------------------------------------------+
 293
 294 neutron_utils_tests.py - NeutronUtilsFloatingIpTests
 295 ----------------------------------------------------
 296
 297 +---------------------------------------+---------------+-----------------------------------------------------------+
 298 | Test Name                             | Neutron API   | Description                                               |
 299 +=======================================+===============+===========================================================+
 300 | test_floating_ips                     | 2             | Ensures that a floating IP can be created                 |
 301 +---------------------------------------+---------------+-----------------------------------------------------------+
 302
 303 cinder_utils_tests.py - CinderUtilsQoSTests
 304 -------------------------------------------
 305
 306 +---------------------------------------+---------------+-----------------------------------------------------------+
 307 | Test Name                             |  Cinder API   | Description                                               |
 308 +=======================================+===============+===========================================================+
 309 | test_create_qos_both                  | 2 & 3         | Ensures that a QoS Spec can be created with a Consumer    |
 310 |                                       |               | value of 'both'                                           |
 311 +---------------------------------------+---------------+-----------------------------------------------------------+
 312 | test_create_qos_front                 | 2 & 3         | Ensures that a QoS Spec can be created with a Consumer    |
 313 |                                       |               | value of 'front-end'                                      |
 314 +---------------------------------------+---------------+-----------------------------------------------------------+
 315 | test_create_qos_back                  | 2 & 3         | Ensures that a QoS Spec can be created with a Consumer    |
 316 |                                       |               | value of 'back-end'                                       |
 317 +---------------------------------------+---------------+-----------------------------------------------------------+
 318 | test_create_delete_qos                | 2 & 3         | Ensures that a QoS Spec can be created and deleted        |
 319 +---------------------------------------+---------------+-----------------------------------------------------------+
 320
 321 cinder_utils_tests.py - CinderUtilsSimpleVolumeTypeTests
 322 --------------------------------------------------------
 323
 324 +---------------------------------------+---------------+-----------------------------------------------------------+
 325 | Test Name                             |  Cinder API   | Description                                               |
 326 +=======================================+===============+===========================================================+
 327 | test_create_simple_volume_type        | 2 & 3         | Tests the creation of a simple volume type with the       |
 328 |                                       |               | function cinder_utils#create_volume_type()                |
 329 +---------------------------------------+---------------+-----------------------------------------------------------+
 330 | test_create_delete_volume_type        | 2 & 3         | Tests the creation of a simple volume type with the       |
 331 |                                       |               | function cinder_utils#create_volume_type() then deletes   |
 332 |                                       |               | with the function cinder_utils#delete_volume_type()       |
 333 +---------------------------------------+---------------+-----------------------------------------------------------+
 334
 335 cinder_utils_tests.py - CinderUtilsAddEncryptionTests
 336 -----------------------------------------------------
 337
 338 +---------------------------------------+---------------+-----------------------------------------------------------+
 339 | Test Name                             |  Cinder API   | Description                                               |
 340 +=======================================+===============+===========================================================+
 341 | test_create_simple_encryption         | 2 & 3         | Tests the creation of a simple volume type encryption     |
 342 |                                       |               | with the function cinder_utils#create_volume_encryption() |
 343 +---------------------------------------+---------------+-----------------------------------------------------------+
 344 | test_create_delete_encryption         | 2 & 3         | Tests the creation of a simple volume type encryption     |
 345 |                                       |               | with the function cinder_utils#create_volume_encryption() |
 346 |                                       |               | then deletes with the function                            |
 347 |                                       |               | cinder_utils#delete_volume_type_encryption()              |
 348 +---------------------------------------+---------------+-----------------------------------------------------------+
 349 | test_create_with_all_attrs            | 2 & 3         | Tests the creation of a simple volume type encryption     |
 350 |                                       |               | with the function cinder_utils#create_volume_encryption() |
 351 |                                       |               | where all configuration attributes have been set          |
 352 +---------------------------------------+---------------+-----------------------------------------------------------+
 353 | test_create_bad_key_size              | 2 & 3         | Tests to ensure that the function                         |
 354 |                                       |               | cinder_utils#create_volume_encryption() raises a          |
 355 |                                       |               | BadRequest exception when the key_size attribute is -1    |
 356 +---------------------------------------+---------------+-----------------------------------------------------------+
 357
 358 cinder_utils_tests.py - CinderUtilsVolumeTypeCompleteTests
 359 ----------------------------------------------------------
 360
 361 +---------------------------------------+---------------+-----------------------------------------------------------+
 362 | Test Name                             |  Cinder API   | Description                                               |
 363 +=======================================+===============+===========================================================+
 364 | test_create_with_encryption           | 2 & 3         | Tests the creation of a volume type with encryption       |
 365 |                                       |               | with the function cinder_utils#create_volume_type()       |
 366 +---------------------------------------+---------------+-----------------------------------------------------------+
 367 | test_create_with_qos                  | 2 & 3         | Tests the creation of a volume type with a QoS Spec       |
 368 |                                       |               | with the function cinder_utils#create_volume_type()       |
 369 +---------------------------------------+---------------+-----------------------------------------------------------+
 370 | test_create_with_invalid_qos          | 2 & 3         | Tests the creation of a volume type with an invalid QoS   |
 371 |                                       |               | Spec with the function cinder_utils#create_volume_type()  |
 372 +---------------------------------------+---------------+-----------------------------------------------------------+
 373 | test_create_with_qos_and_encryption   | 2 & 3         | Tests the creation of a volume type with a QoS Spec and   |
 374 |                                       |               | encryption with the function                              |
 375 |                                       |               | cinder_utils#create_volume_type()                         |
 376 +---------------------------------------+---------------+-----------------------------------------------------------+
 377
 378 cinder_utils_tests.py - CinderUtilsVolumeTests
 379 ----------------------------------------------
 380
 381 +---------------------------------------+---------------+-----------------------------------------------------------+
 382 | Test Name                             |  Cinder API   | Description                                               |
 383 +=======================================+===============+===========================================================+
 384 | test_create_simple_volume             | 2 & 3         | Tests the creation of a simple volume with the function   |
 385 |                                       |               | cinder_utils#create_volume()                              |
 386 +---------------------------------------+---------------+-----------------------------------------------------------+
 387 | test_create_delete_volume             | 2 & 3         | Tests the creation of a volume with the function          |
 388 |                                       |               | cinder_utils#create_volume() then deletion with the       |
 389 |                                       |               | function cinder_utils#delete_volume()                     |
 390 +---------------------------------------+---------------+-----------------------------------------------------------+
 391
 392 nova_utils_tests.py - NovaUtilsKeypairTests
 393 -------------------------------------------
 394
 395 +---------------------------------------+---------------+-----------------------------------------------------------+
 396 | Test Name                             | Nova API      | Description                                               |
 397 +=======================================+===============+===========================================================+
 398 | test_create_keypair                   | 2             | Ensures that a keypair can be properly created via        |
 399 |                                       |               | nova_utils.upload_keypair() with a public_key object      |
 400 +---------------------------------------+---------------+-----------------------------------------------------------+
 401 | test_create_delete_keypair            | 2             | Ensures that a keypair can be properly deleted via        |
 402 |                                       |               | nova_utils.delete_keypair()                               |
 403 +---------------------------------------+---------------+-----------------------------------------------------------+
 404 | test_create_key_from_file             | 2             | Ensures that a keypair can be properly created via        |
 405 |                                       |               | nova_utils.upload_keypair_file()                          |
 406 +---------------------------------------+---------------+-----------------------------------------------------------+
 407
 408 nova_utils_tests.py - NovaUtilsFlavorTests
 409 ------------------------------------------
 410
 411 +---------------------------------------+---------------+-----------------------------------------------------------+
 412 | Test Name                             | Nova API      | Description                                               |
 413 +=======================================+===============+===========================================================+
 414 | test_create_flavor                    | 2             | Ensures that a flavor can be properly created via         |
 415 |                                       |               | nova_utils.create_flavor()                                |
 416 +---------------------------------------+---------------+-----------------------------------------------------------+
 417 | test_create_delete_flavor             | 2             | Ensures that a flavor can be properly deleted via         |
 418 |                                       |               | nova_utils.delete_flavor()                                |
 419 +---------------------------------------+---------------+-----------------------------------------------------------+
 420
 421 nova_utils_tests.py - NovaUtilsInstanceTests
 422 --------------------------------------------
 423
 424 +---------------------------------------+---------------+-----------------------------------------------------------+
 425 | Test Name                             | Nova API      | Description                                               |
 426 +=======================================+===============+===========================================================+
 427 | test_create_instance                  | 2             | Ensures that a VM instance can be properly created via    |
 428 |                                       |               | nova_utils.create_server()                                |
 429 +---------------------------------------+---------------+-----------------------------------------------------------+
 430
 431 nova_utils_tests.py - NovaUtilsInstanceVolumeTests
 432 --------------------------------------------------
 433
 434 +---------------------------------------+---------------+-----------------------------------------------------------+
 435 | Test Name                             | Nova API      | Description                                               |
 436 +=======================================+===============+===========================================================+
 437 | test_add_remove_volume                | 2             | Ensures that a VM instance can properly attach and detach |
 438 |                                       |               | a volume using the nova interface                         |
 439 +---------------------------------------+---------------+-----------------------------------------------------------+
 440
 441 create_flavor_tests.py - CreateFlavorTests
 442 ------------------------------------------
 443
 444 +---------------------------------------+---------------+-----------------------------------------------------------+
 445 | Test Name                             | Nova API      | Description                                               |
 446 +=======================================+===============+===========================================================+
 447 | test_create_flavor                    | 2             | Ensures that the OpenStackFlavor class's create() method  |
 448 |                                       |               | creates an OpenStack flavor object                        |
 449 +---------------------------------------+---------------+-----------------------------------------------------------+
 450 | test_create_flavor_existing           | 2             | Ensures that the OpenStackFlavor class's create() will not|
 451 |                                       |               | create a flavor with the same name more than once         |
 452 +---------------------------------------+---------------+-----------------------------------------------------------+
 453 | test_create_clean_flavor              | 2             | Ensures that the OpenStackFlavor class's clean() method   |
 454 |                                       |               | will delete the flavor object                             |
 455 +---------------------------------------+---------------+-----------------------------------------------------------+
 456 | test_create_delete_flavor             | 2             | Ensures that the OpenStackFlavor class's clean() method   |
 457 |                                       |               | will not raise an exception when called and the object no |
 458 |                                       |               | longer exists                                             |
 459 +---------------------------------------+---------------+-----------------------------------------------------------+
 460 | test_create_delete_flavor_all_settings| 2             | Ensures that the OpenStackFlavor class will create a      |
 461 |                                       |               | a flavor properly with all supported settings             |
 462 +---------------------------------------+---------------+-----------------------------------------------------------+
 463
 464 heat_utils_tests.py - HeatUtilsCreateSimpleStackTests
 465 -----------------------------------------------------
 466
 467 +---------------------------------------+---------------+-----------------------------------------------------------+
 468 | Test Name                             | Heat API      | Description                                               |
 469 +=======================================+===============+===========================================================+
 470 | test_create_stack                     | 1-3           | Tests the heat_utils.create_stack() with a test template  |
 471 +---------------------------------------+---------------+-----------------------------------------------------------+
 472 | test_create_stack_x2                  | 1-3           | Tests the heat_utils.create_stack() with a test template  |
 473 |                                       |               | and attempts to deploy a second time w/o actually         |
 474 |                                       |               | deploying any objects                                     |
 475 +---------------------------------------+---------------+-----------------------------------------------------------+
 476
 477 heat_utils_tests.py - HeatUtilsCreateComplexStackTests
 478 ------------------------------------------------------
 479
 480 +---------------------------------------+---------------+-----------------------------------------------------------+
 481 | Test Name                             | Heat API      | Description                                               |
 482 +=======================================+===============+===========================================================+
 483 | test_get_settings_from_stack          | 1-3           | Tests the heat_utils functions that are responsible for   |
 484 |                                       |               | reverse engineering settings objects of the types deployed|
 485 |                                       |               | by Heat                                                   |
 486 +---------------------------------------+---------------+-----------------------------------------------------------+
 487
 488 heat_utils_tests.py - HeatUtilsRouterTests
 489 ------------------------------------------
 490
 491 +---------------------------------------+---------------+-----------------------------------------------------------+
 492 | Test Name                             | Heat API      | Description                                               |
 493 +=======================================+===============+===========================================================+
 494 | test_create_router_with_stack         | 1-3           | Tests ability of the function                             |
 495 |                                       |               | heat_utils.get_stack_routers() to return the correct      |
 496 |                                       |               | OpenStackRouter instance                                  |
 497 +---------------------------------------+---------------+-----------------------------------------------------------+
 498
 499 heat_utils_tests.py - HeatUtilsVolumeTests
 500 ------------------------------------------
 501
 502 +---------------------------------------+---------------+-----------------------------------------------------------+
 503 | Test Name                             | Heat API      | Description                                               |
 504 +=======================================+===============+===========================================================+
 505 | test_create_vol_with_stack            | 1-3           | Tests ability of the function                             |
 506 |                                       |               | heat_utils.create_stack() to return the correct           |
 507 |                                       |               | Volume domain objects deployed with Heat                  |
 508 +---------------------------------------+---------------+-----------------------------------------------------------+
 509 | test_create_vol_types_with_stack      | 1-3           | Tests ability of the function                             |
 510 |                                       |               | heat_utils.get_stack_volumes_types() to return the correct|
 511 |                                       |               | VolumeType domain objects deployed with Heat              |
 512 +---------------------------------------+---------------+-----------------------------------------------------------+
 513
 514 heat_utils_tests.py - HeatUtilsKeypairTests
 515 -------------------------------------------
 516
 517 +---------------------------------------+---------------+-----------------------------------------------------------+
 518 | Test Name                             | Heat API      | Description                                               |
 519 +=======================================+===============+===========================================================+
 520 | test_create_keypair_with_stack        | 1-3           | Tests ability of the function                             |
 521 |                                       |               | heat_utils.get_stack_keypairs() to return the correct     |
 522 |                                       |               | Keypair domain objects deployed with Heat                 |
 523 +---------------------------------------+---------------+-----------------------------------------------------------+
 524
 525 heat_utils_tests.py - HeatUtilsSecurityGroupTests
 526 -------------------------------------------------
 527
 528 +---------------------------------------+---------------+-----------------------------------------------------------+
 529 | Test Name                             | Heat API      | Description                                               |
 530 +=======================================+===============+===========================================================+
 531 | test_create_security_group_with_stack | 1-3           | Tests ability of the function                             |
 532 |                                       |               | heat_utils.get_stack_security_groups() to return the      |
 533 |                                       |               | correct SecurityGroup domain objects deployed with Heat   |
 534 +---------------------------------------+---------------+-----------------------------------------------------------+
 535
 536 heat_utils_tests.py - HeatUtilsFlavorTests
 537 ------------------------------------------
 538
 539 +---------------------------------------+---------------+-----------------------------------------------------------+
 540 | Test Name                             | Heat API      | Description                                               |
 541 +=======================================+===============+===========================================================+
 542 | test_create_flavor_with_stack         | 1-3           | Tests ability of the function                             |
 543 |                                       |               | heat_utils.get_stack_flavors() to return the correct      |
 544 |                                       |               | Flavor domain objects deployed with Heat                  |
 545 +---------------------------------------+---------------+-----------------------------------------------------------+
 546
 547 magnum_utils_tests.py - MagnumUtilsTests
 548 ----------------------------------------
 549
 550 +---------------------------------------+---------------+-----------------------------------------------------------+
 551 | Test Name                             | Magnum API    | Description                                               |
 552 +=======================================+===============+===========================================================+
 553 | test_create_cluster_template_simple   | 1             | Tests ability of the function                             |
 554 |                                       |               | magnum_utils.create_cluster_template() to create a simple |
 555 |                                       |               | cluster template OpenStack object with minimal config     |
 556 +---------------------------------------+---------------+-----------------------------------------------------------+
 557 | test_create_cluster_template_all      | 1             | Tests ability of the function                             |
 558 |                                       |               | magnum_utils.create_cluster_template() to create a        |
 559 |                                       |               | cluster template OpenStack object with maximum config     |
 560 +---------------------------------------+---------------+-----------------------------------------------------------+
 561 | test_create_cluster_template_bad_image| 1             | Ensures the function                                      |
 562 |                                       |               | magnum_utils.create_cluster_template() will raise a       |
 563 |                                       |               | BadRequest exception when the image does not exist        |
 564 +---------------------------------------+---------------+-----------------------------------------------------------+
 565 | test_create_cluster_template_bad_ext  | 1             | Ensures the function                                      |
 566 | _net                                  |               | magnum_utils.create_cluster_template() will raise a       |
 567 |                                       |               | BadRequest exception when the external network does not   |
 568 |                                       |               | exist                                                     |
 569 +---------------------------------------+---------------+-----------------------------------------------------------+
 570 | test_create_cluster_template_bad      | 1             | Ensures the function                                      |
 571 | _flavor                               |               | magnum_utils.create_cluster_template() will raise a       |
 572 |                                       |               | BadRequest exception when the flavor does not exist       |
 573 +---------------------------------------+---------------+-----------------------------------------------------------+
 574 | test_create_cluster_template_bad      | 1             | Ensures the function                                      |
 575 | _master_flavor                        |               | magnum_utils.create_cluster_template() will raise a       |
 576 |                                       |               | BadRequest exception when the master flavor does not exist|
 577 +---------------------------------------+---------------+-----------------------------------------------------------+
 578 | test_create_cluster_template_bad      | 1             | Ensures the function                                      |
 579 | _network_driver                       |               | magnum_utils.create_cluster_template() will raise a       |
 580 |                                       |               | BadRequest exception when the network driver is invalid   |
 581 +---------------------------------------+---------------+-----------------------------------------------------------+
 582 | test_create_cluster_template_bad      | 1             | Ensures the function                                      |
 583 | _volume_driver                        |               | magnum_utils.create_cluster_template() will raise a       |
 584 |                                       |               | BadRequest exception when the volume driver is invalid    |
 585 +---------------------------------------+---------------+-----------------------------------------------------------+
 586
 587 settings_utils_tests.py - SettingsUtilsNetworkingTests
 588 ------------------------------------------------------
 589
 590 +---------------------------------------+---------------+-----------------------------------------------------------+
 591 | Test Name                             | API           | Description                                               |
 592 +=======================================+===============+===========================================================+
 593 | test_derive_net_settings_no_subnet    | Neutron 2     | Tests to ensure that derived NetworkConfig from an        |
 594 |                                       |               | OpenStack network are correct without a subnet            |
 595 +---------------------------------------+---------------+-----------------------------------------------------------+
 596 | test_derive_net_settings_two_subnets  | Neutron 2     | Tests to ensure that derived NetworkConfig from an        |
 597 |                                       |               | OpenStack network are correct with two subnets            |
 598 +---------------------------------------+---------------+-----------------------------------------------------------+
 599
 600
 601 settings_utils_tests.py - SettingsUtilsVmInstTests
 602 --------------------------------------------------
 603 +---------------------------------------+---------------+-----------------------------------------------------------+
 604 | Test Name                             | API           | Description                                               |
 605 +=======================================+===============+===========================================================+
 606 | test_derive_vm_inst_config            | Neutron 2     | Tests to ensure that derived VmInstanceSettings from an   |
 607 |                                       |               | OpenStack VM instance is correct                          |
 608 +---------------------------------------+---------------+-----------------------------------------------------------+
 609 | test_derive_image_settings            | Neutron 2     | Tests to ensure that derived ImageConfig from an        |
 610 |                                       |               | OpenStack VM instance is correct                          |
 611 +---------------------------------------+---------------+-----------------------------------------------------------+