1 SNAPS OpenStack Integration Testing
2 ===================================
4 These tests are ones designed to be run within their own dynamically created project along with a newly generated user
5 account and generally require other OpenStack object creators.
10 create_security_group_tests.py - CreateSecurityGroupTests
11 ---------------------------------------------------------
13 +---------------------------------------+---------------+-----------------------------------------------------------+
14 | Test Name | API Versions | Description |
15 +=======================================+===============+===========================================================+
16 | test_create_group_without_rules | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class can create a |
17 | | Neutron 2 | security group without any rules |
18 +---------------------------------------+---------------+-----------------------------------------------------------+
19 | test_create_group_admin_user_to_new | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class can be created |
20 | _project | Neutron 2 | by the admin user and associated with a new project |
21 +---------------------------------------+---------------+-----------------------------------------------------------+
22 | test_create_group_new_user_to_admin | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class can be created |
23 | _project | Neutron 2 | by the new user and associated with the admin project |
24 +---------------------------------------+---------------+-----------------------------------------------------------+
25 | test_create_delete_group | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class clean() method |
26 | | Neutron 2 | will not raise an exception should the group be deleted by|
27 | | | some other process |
28 +---------------------------------------+---------------+-----------------------------------------------------------+
29 | test_create_group_with_one_simple_rule| Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class can create a |
30 | | Neutron 2 | security group with a single simple rule |
31 +---------------------------------------+---------------+-----------------------------------------------------------+
32 | test_create_group_with_one_complex | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class can create a |
33 | _rule | Neutron 2 | security group with a single complex rule |
34 +---------------------------------------+---------------+-----------------------------------------------------------+
35 | test_create_group_with_several_rules | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup class can create a |
36 | | Neutron 2 | security group with several rules |
37 +---------------------------------------+---------------+-----------------------------------------------------------+
38 | test_add_rule | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup#add_rule() method |
39 | | Neutron 2 | properly creates and associates the new rule |
40 +---------------------------------------+---------------+-----------------------------------------------------------+
41 | test_remove_rule_by_id | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup#remove_rule() method |
42 | | Neutron 2 | properly deletes and disassociates the old rule via its ID|
43 +---------------------------------------+---------------+-----------------------------------------------------------+
44 | test_remove_rule_by_setting | Keysone 2 & 3 | Ensures the OpenStackSecurityGroup#remove_rule() method |
45 | | Neutron 2 | properly deletes and disassociates the old rule via its |
46 | | | setting object |
47 +---------------------------------------+---------------+-----------------------------------------------------------+
49 create_image_tests.py - CreateImageSuccessTests
50 -----------------------------------------------
52 +---------------------------------------+---------------+-----------------------------------------------------------+
53 | Test Name | Glance API | Description |
54 +=======================================+===============+===========================================================+
55 | test_create_image_clean_url | 1 & 2 | Ensures the OpenStackImage class can create an image from |
56 | | | a download URL location |
57 +---------------------------------------+---------------+-----------------------------------------------------------+
58 | test_create_image_clean_url_properties| 1 & 2 | Ensures the OpenStackImage class can create an image from |
59 | | | a download URL location with custom properties |
60 +---------------------------------------+---------------+-----------------------------------------------------------+
61 | test_create_image_clean_file | 1 & 2 | Ensures the OpenStackImage class can create an image from |
62 | | | a locally sourced image file |
63 +---------------------------------------+---------------+-----------------------------------------------------------+
64 | test_create_delete_image | 1 & 2 | Ensures the OpenStackImage.clean() method deletes an image|
65 | | | and does not raise an exception on subsequent calls to the|
66 | | | clean() method |
67 +---------------------------------------+---------------+-----------------------------------------------------------+
68 | test_create_same_image | 1 & 2 | Ensures the OpenStackImage.create() method does not create|
69 | | | another image when one already exists with the same name |
70 +---------------------------------------+---------------+-----------------------------------------------------------+
71 | test_create_same_image_new_settings | 1 & 2 | Tests the creation of an OpenStack image when the image |
72 | | | already exists and the configuration only contains the |
74 +---------------------------------------+---------------+-----------------------------------------------------------+
76 create_image_tests.py - CreateImageNegativeTests
77 ------------------------------------------------
79 +---------------------------------------+---------------+-----------------------------------------------------------+
80 | Test Name | Glance API | Description |
81 +=======================================+===============+===========================================================+
82 | test_bad_image_name | 1 & 2 | Ensures OpenStackImage.create() results in an Exception |
83 | | | being raised when the ImageSettings.name attribute has |
85 +---------------------------------------+---------------+-----------------------------------------------------------+
86 | test_bad_image_url | 1 & 2 | Ensures OpenStackImage.create() results in an Exception |
87 | | | being raised when the download URL is invalid |
88 +---------------------------------------+---------------+-----------------------------------------------------------+
89 | test_bad_image_type | 1 & 2 | Ensures OpenStackImage.create() results in an Exception |
90 | | | being raised when the image format is 'foo' |
91 +---------------------------------------+---------------+-----------------------------------------------------------+
92 | test_bad_image_file | 1 & 2 | Ensures OpenStackImage.create() results in an Exception |
93 | | | being raised when the image file does not exist |
94 +---------------------------------------+---------------+-----------------------------------------------------------+
96 create_image_tests.py - CreateMultiPartImageTests
97 -------------------------------------------------
99 +----------------------------------------+---------------+-----------------------------------------------------------+
100 | Test Name | Glance API | Description |
101 +========================================+===============+===========================================================+
102 | test_create_three_part_image_from_url | 1 & 2 | Ensures that a 3-part image can be created when each part |
103 | | | is being sourced from URLs |
104 +----------------------------------------+---------------+-----------------------------------------------------------+
105 | test_create_three_part_image_from_file | 1 & 2 | Ensures that a 3-part image can be created when each part |
106 | _3_creators | | is being sourced from local files and 3 creators are used |
107 +----------------------------------------+---------------+-----------------------------------------------------------+
108 | test_create_three_part_image_from_url | 1 & 2 | Ensures that a 3-part image can be created when each part |
109 | _3_creators | | is being sourced from a URL and 3 creators are used |
110 +----------------------------------------+---------------+-----------------------------------------------------------+
112 create_keypairs_tests.py - CreateKeypairsTests
113 ----------------------------------------------
115 +---------------------------------------+---------------+-----------------------------------------------------------+
116 | Test Name | Nova API | Description |
117 +=======================================+===============+===========================================================+
118 | test_create_keypair_only | 2 | Ensures that a keypair object can be created simply by |
119 | | | only configuring a name |
120 +---------------------------------------+---------------+-----------------------------------------------------------+
121 | test_create_keypair_large_key | 2 | Ensures that a keypair object can be created with a large |
122 | | | key of 10000 bytes |
123 +---------------------------------------+---------------+-----------------------------------------------------------+
124 | test_create_delete_keypair | 2 | Ensures that a keypair object is deleted via |
125 | | | OpenStackKeypair.clean() and subsequent calls do not |
126 | | | result in exceptions |
127 +---------------------------------------+---------------+-----------------------------------------------------------+
128 | test_create_keypair_save_pub_only | 2 | Ensures that a keypair object can be created when the only|
129 | | | the public key is cached to disk |
130 +---------------------------------------+---------------+-----------------------------------------------------------+
131 | test_create_keypair_save_both | 2 | Ensures that a keypair object can be created when both the|
132 | | | public and private keys are cached to disk |
133 +---------------------------------------+---------------+-----------------------------------------------------------+
134 | test_create_keypair_from_file | 2 | Ensures that a keypair object can be created with an |
135 | | | existing public key file |
136 +---------------------------------------+---------------+-----------------------------------------------------------+
138 create_keypairs_tests.py - CreateKeypairsCleanupTests
139 -----------------------------------------------------
141 +---------------------------------------+---------------+-----------------------------------------------------------+
142 | Test Name | Nova API | Description |
143 +=======================================+===============+===========================================================+
144 | test_create_keypair_gen_files_delete_1| 2 | Ensures that new keypair files are deleted by default |
145 | | | by OpenStackKeypair#clean() |
146 +---------------------------------------+---------------+-----------------------------------------------------------+
147 | test_create_keypair_gen_files_delete_2| 2 | Ensures that new keypair files are deleted by |
148 | | | OpenStackKeypair#clean() when the settings delete_on_clean|
149 | | | attribute is set to True |
150 +---------------------------------------+---------------+-----------------------------------------------------------+
151 | test_create_keypair_gen_files_keep | 2 | Ensures that new keypair files are not deleted by |
152 | | | OpenStackKeypair#clean() |
153 +---------------------------------------+---------------+-----------------------------------------------------------+
154 | test_create_keypair_exist_files_keep | 2 | Ensures that existing keypair files are not deleted by |
155 | | | OpenStackKeypair#clean() |
156 +---------------------------------------+---------------+-----------------------------------------------------------+
157 | test_create_keypair_exist_files_delete| 2 | Ensures that existing keypair files are deleted by |
158 | | | OpenStackKeypair#clean() |
159 +---------------------------------------+---------------+-----------------------------------------------------------+
161 create_network_tests.py - CreateNetworkSuccessTests
162 ---------------------------------------------------
164 +---------------------------------------+---------------+-----------------------------------------------------------+
165 | Test Name | Neutron API | Description |
166 +=======================================+===============+===========================================================+
167 | test_create_network_without_router | 2 | Ensures that a network can be created via the |
168 | | | OpenStackNetwork class without any routers |
169 +---------------------------------------+---------------+-----------------------------------------------------------+
170 | test_create_delete_network | 2 | Ensures that a router can be deleted via the |
171 | | | OpenStackNetwork.clean() method |
172 +---------------------------------------+---------------+-----------------------------------------------------------+
173 | test_create_network_with_router | 2 | Ensures that a network can be created via the |
174 | | | OpenStackNetwork class with a router |
175 +---------------------------------------+---------------+-----------------------------------------------------------+
176 | test_create_networks_same_name | 2 | Ensures that the OpenStackNetwork.create() method will not|
177 | | | create a network with the same name |
178 +---------------------------------------+---------------+-----------------------------------------------------------+
179 | test_create_networks_router_admin_user| 2 | Ensures that the networks, subnets, and routers can be |
180 | _to_new_project | | create created by an admin user and assigned to a new |
182 +---------------------------------------+---------------+-----------------------------------------------------------+
183 | test_create_networks_router_new_user | 2 | Ensures that the networks, subnets, and routers can be |
184 | _to_admin_project | | create created by a new admin user and assigned to the |
185 | | | 'admin' project ID |
186 +---------------------------------------+---------------+-----------------------------------------------------------+
188 create_router_tests.py - CreateRouterSuccessTests
189 -------------------------------------------------
191 +---------------------------------------+---------------+-----------------------------------------------------------+
192 | Test Name | Neutron API | Description |
193 +=======================================+===============+===========================================================+
194 | test_create_router_vanilla | 2 | Ensures that a router can be created via the |
195 | | | OpenStackRouter class with minimal settings |
196 +---------------------------------------+---------------+-----------------------------------------------------------+
197 | test_create_router_admin_user_to_new | 2 | Ensures that a router can be created by an admin user and |
198 | _project | | assigned to a new project |
199 +---------------------------------------+---------------+-----------------------------------------------------------+
200 | test_create_router_new_user_to_admin | 2 | Ensures that a router can be created by a new user and |
201 | _project | | assigned to the admin project |
202 +---------------------------------------+---------------+-----------------------------------------------------------+
203 | test_create_delete_router | 2 | Ensures that a router can be deleted via the |
204 | | | OpenStackRouter.clean() method |
205 +---------------------------------------+---------------+-----------------------------------------------------------+
206 | test_create_router_admin_state_false | 2 | Ensures that a router can created with |
207 | | | admin_state_up = False |
208 +---------------------------------------+---------------+-----------------------------------------------------------+
209 | test_create_router_admin_state_True | 2 | Ensures that a router can created with |
210 | | | admin_state_up = True |
211 +---------------------------------------+---------------+-----------------------------------------------------------+
212 | test_create_router_private_network | 2 | Ensures that a router port can be created against a |
213 | | | private network |
214 +---------------------------------------+---------------+-----------------------------------------------------------+
215 | test_create_router_external_network | 2 | Ensures that a router can be created that is connected to |
216 | | | both external and private internal networks |
217 +---------------------------------------+---------------+-----------------------------------------------------------+
219 create_router_tests.py - CreateRouterNegativeTests
220 --------------------------------------------------
222 +----------------------------------------+---------------+-----------------------------------------------------------+
223 | Test Name | Neutron API | Description |
224 +========================================+===============+===========================================================+
225 | test_create_router_noname | 2 | Ensures that an exception is raised when attempting to |
226 | | | create a router without a name |
227 +----------------------------------------+---------------+-----------------------------------------------------------+
228 | test_create_router_invalid_gateway_name| 2 | Ensures that an exception is raised when attempting to |
229 | | | create a router to an external network that does not exist|
230 +----------------------------------------+---------------+-----------------------------------------------------------+
232 create_stack_tests.py - CreateStackSuccessTests
233 -----------------------------------------------
235 +---------------------------------------+---------------+-----------------------------------------------------------+
236 | Test Name | Neutron API | Description |
237 +=======================================+===============+===========================================================+
238 | test_create_stack_template_file | 2 | Ensures that a Heat stack can be created with a file-based|
239 | | | Heat template file |
240 +---------------------------------------+---------------+-----------------------------------------------------------+
241 | test_create_stack_template_dict | 2 | Ensures that a Heat stack can be created with a dictionary|
242 | | | Heat template |
243 +---------------------------------------+---------------+-----------------------------------------------------------+
244 | test_create_delete_stack | 2 | Ensures that a Heat stack can be created and deleted |
245 | | | while having clean() called 2x without an exception |
246 +---------------------------------------+---------------+-----------------------------------------------------------+
247 | test_create_same_stack | 2 | Ensures that a Heat stack with the same name cannot be |
249 +---------------------------------------+---------------+-----------------------------------------------------------+
250 | test_retrieve_network_creators | 2 | Ensures that an OpenStackHeatStack instance can return an |
251 | | | OpenStackNetwork instance configured as deployed |
252 +---------------------------------------+---------------+-----------------------------------------------------------+
253 | test_retrieve_vm_inst_creators | 2 | Ensures that an OpenStackHeatStack instance can return an |
254 | | | OpenStackVmInstance instance configured as deployed |
255 +---------------------------------------+---------------+-----------------------------------------------------------+
257 create_stack_tests.py - CreateComplexStackTests
258 -----------------------------------------------
260 +---------------------------------------+---------------+-----------------------------------------------------------+
261 | Test Name | Neutron API | Description |
262 +=======================================+===============+===========================================================+
263 | test_connect_via_ssh_heat_vm | 2 | Ensures that two OpenStackHeatStack instances can return |
264 | | | OpenStackVmInstance instances one configured with a |
265 | | | floating IP and keypair and can be access via SSH |
266 +---------------------------------------+---------------+-----------------------------------------------------------+
268 create_stack_tests.py - CreateStackNegativeTests
269 ------------------------------------------------
271 +----------------------------------------+---------------+-----------------------------------------------------------+
272 | Test Name | Neutron API | Description |
273 +========================================+===============+===========================================================+
274 | test_missing_dependencies | 2 | Ensures that a Heat template fails to deploy when expected|
275 | | | dependencies are missing |
276 +----------------------------------------+---------------+-----------------------------------------------------------+
277 | test_bad_stack_file | 2 | Ensures that a Heat template fails to deploy when the Heat|
278 | | | template file does not exist |
279 +----------------------------------------+---------------+-----------------------------------------------------------+
281 create_instance_tests.py - CreateInstanceSimpleTests
282 ----------------------------------------------------
284 +---------------------------------------+---------------+-----------------------------------------------------------+
285 | Test Name | API Versions | Description |
286 +=======================================+===============+===========================================================+
287 | test_create_delete_instance | Nova 2 | Ensures that the OpenStackVmInstance.clean() method |
288 | | Neutron 2 | deletes the instance |
289 +---------------------------------------+---------------+-----------------------------------------------------------+
291 create_instance_tests.py - SimpleHealthCheck
292 --------------------------------------------
294 +---------------------------------------+---------------+-----------------------------------------------------------+
295 | Test Name | API Versions | Description |
296 +=======================================+===============+===========================================================+
297 | test_check_vm_ip_dhcp | Nova 2 | Tests the creation of an OpenStack instance with a single |
298 | | Neutron 2 | port and it's assigned IP address |
299 +---------------------------------------+---------------+-----------------------------------------------------------+
301 create_instance_tests.py - CreateInstanceTwoNetTests
302 ----------------------------------------------------
304 +---------------------------------------+---------------+-----------------------------------------------------------+
305 | Test Name | API Versions | Description |
306 +=======================================+===============+===========================================================+
307 | test_ping_via_router | Nova 2 | Tests the ability of two VMs on different private overlay |
308 | | Neutron 2 | networks tied together with a router to ping each other |
309 +---------------------------------------+---------------+-----------------------------------------------------------+
311 create_instance_tests.py - CreateInstanceSingleNetworkTests
312 -----------------------------------------------------------
314 +---------------------------------------+---------------+-----------------------------------------------------------+
315 | Test Name | API Versions | Description |
316 +=======================================+===============+===========================================================+
317 | test_single_port_static | Nova 2 | Ensures that an instance with a single port/NIC with a |
318 | | Neutron 2 | static IP can be created |
319 +---------------------------------------+---------------+-----------------------------------------------------------+
320 | test_ssh_client_fip_before_active | Nova 2 | Ensures that an instance can be reached over SSH when the |
321 | | Neutron 2 | floating IP is assigned prior to the VM becoming ACTIVE |
322 +---------------------------------------+---------------+-----------------------------------------------------------+
323 | test_ssh_client_fip_after_active | Nova 2 | Ensures that an instance can be reached over SSH when the |
324 | | Neutron 2 | floating IP is assigned after to the VM becoming ACTIVE |
325 +---------------------------------------+---------------+-----------------------------------------------------------+
326 | test_ssh_client_fip_second_creator | Nova 2 | Ensures that an instance can be reached over SSH via a |
327 | | Neutron 2 | second identical creator object |
328 +---------------------------------------+---------------+-----------------------------------------------------------+
330 create_instance_tests.py - CreateInstancePortManipulationTests
331 --------------------------------------------------------------
333 +---------------------------------------+---------------+-----------------------------------------------------------+
334 | Test Name | API Versions | Description |
335 +=======================================+===============+===========================================================+
336 | test_set_custom_valid_ip_one_subnet | Nova 2 | Ensures that an instance's can have a valid static IP is |
337 | | Neutron 2 | properly assigned |
338 +---------------------------------------+---------------+-----------------------------------------------------------+
339 | test_set_custom_invalid_ip_one_subnet | Nova 2 | Ensures that an instance's port with an invalid static IP |
340 | | Neutron 2 | raises an exception |
341 +---------------------------------------+---------------+-----------------------------------------------------------+
342 | test_set_custom_valid_mac | Nova 2 | Ensures that an instance's port can have a valid MAC |
343 | | Neutron 2 | address properly assigned |
344 +---------------------------------------+---------------+-----------------------------------------------------------+
345 | test_set_custom_invalid_mac | Nova 2 | Ensures that an instance's port with an invalid MAC |
346 | | Neutron 2 | address raises and exception |
347 +---------------------------------------+---------------+-----------------------------------------------------------+
348 | test_set_custom_mac_and_ip | Nova 2 | Ensures that an instance's port with a valid static IP and|
349 | | Neutron 2 | MAC are properly assigned |
350 +---------------------------------------+---------------+-----------------------------------------------------------+
351 | test_set_allowed_address_pairs | Nova 2 | Ensures the configured allowed_address_pairs is properly |
352 | | Neutron 2 | set on a VMs port |
353 +---------------------------------------+---------------+-----------------------------------------------------------+
354 | test_set_allowed_address_pairs_bad_mac| Nova 2 | Ensures the port cannot be created when a bad MAC address |
355 | | Neutron 2 | format is used in the allowed_address_pairs port attribute|
356 +---------------------------------------+---------------+-----------------------------------------------------------+
357 | test_set_allowed_address_pairs_bad_ip | Nova 2 | Ensures the port cannot be created when a bad IP address |
358 | | Neutron 2 | format is used in the allowed_address_pairs port attribute|
359 +---------------------------------------+---------------+-----------------------------------------------------------+
361 create_instance_tests.py - CreateInstanceOnComputeHost
362 ------------------------------------------------------
364 +---------------------------------------+---------------+-----------------------------------------------------------+
365 | Test Name | API Versions | Description |
366 +=======================================+===============+===========================================================+
367 | test_deploy_vm_to_each_compute_node | Nova 2 | Tests to ensure that one can fire up an instance on each |
368 | | Neutron 2 | active compute node |
369 +---------------------------------------+---------------+-----------------------------------------------------------+
371 create_instance_tests.py - CreateInstanceFromThreePartImage
372 -----------------------------------------------------------
374 +-----------------------------------------------------+---------------+-----------------------------------------------------------+
375 | Test Name | API Versions | Description |
376 +=====================================================+===============+===========================================================+
377 | test_create_delete_instance_from_three_part_image | Nova 2 | Tests to ensure that one can fire up an instance then |
378 | | Neutron 2 | delete it when using a 3-part image |
379 +-----------------------------------------------------+---------------+-----------------------------------------------------------+
381 create_instance_tests.py - CreateInstancePubPrivNetTests
382 --------------------------------------------------------
384 +---------------------------------------+---------------+-----------------------------------------------------------+
385 | Test Name | API Versions | Description |
386 +=======================================+===============+===========================================================+
387 | test_dual_ports_dhcp | Nova 2 | Ensures that a VM with two ports/NICs can have its second |
388 | | Neutron 2 | NIC configured via SSH/Ansible after startup |
389 +---------------------------------------+---------------+-----------------------------------------------------------+
391 create_instance_tests.py - InstanceSecurityGroupTests
392 -----------------------------------------------------
394 +---------------------------------------+---------------+-----------------------------------------------------------+
395 | Test Name | API Versions | Description |
396 +=======================================+===============+===========================================================+
397 | test_add_security_group | Nova 2 | Ensures that a VM instance can have security group added |
398 | | Neutron 2 | to it while its running |
399 +---------------------------------------+---------------+-----------------------------------------------------------+
400 | test_add_invalid_security_group | Nova 2 | Ensures that a VM instance does not accept the addition of|
401 | | Neutron 2 | a security group that no longer exists |
402 +---------------------------------------+---------------+-----------------------------------------------------------+
403 | test_remove_security_group | Nova 2 | Ensures that a VM instance accepts the removal of a |
404 | | Neutron 2 | security group |
405 +---------------------------------------+---------------+-----------------------------------------------------------+
406 | test_remove_security_group_never_added| Nova 2 | Ensures that a VM instance does not accept the removal of |
407 | | Neutron 2 | a security group that was never added in the first place |
408 +---------------------------------------+---------------+-----------------------------------------------------------+
409 | test_add_same_security_group | Nova 2 | Ensures that a VM instance does not add a security group |
410 | | Neutron 2 | that has already been added to the instance |
411 +---------------------------------------+---------------+-----------------------------------------------------------+
413 ansible_utils_tests.py - AnsibleProvisioningTests
414 -------------------------------------------------
416 +---------------------------------------+---------------+-----------------------------------------------------------+
417 | Test Name | API Versions | Description |
418 +=======================================+===============+===========================================================+
419 | test_apply_simple_playbook | Nova 2 | Ensures that an instance assigned with a floating IP will |
420 | | Neutron 2 | apply a simple Ansible playbook |
421 +---------------------------------------+---------------+-----------------------------------------------------------+
422 | test_apply_template_playbook | Nova 2 | Ensures that an instance assigned with a floating IP will |
423 | | Neutron 2 | apply a Ansible playbook containing Jinga2 substitution |
425 +---------------------------------------+---------------+-----------------------------------------------------------+