5 ci_loop: '(daily)|(weekly)'
7 First tier to be executed to verify the basic
12 criteria: 'status == "PASS"'
15 This test case verifies the basic OpenStack services like
16 Keystone, Glance, Cinder, Neutron and Nova.
20 scenario: '^((?!lxd).)*$'
22 name: snaps_health_check
23 criteria: 'status == "PASS"'
26 This test case creates executes the SimpleHealthCheck
27 Python test class which creates an, image, flavor, network,
28 and Cirros VM instance and observes the console output to
29 validate the single port obtains the correct IP address.
33 scenario: '^((?!lxd).)*$'
35 module: 'functest.opnfv_tests.openstack.snaps.health_check'
38 name: connection_check
39 criteria: 'status == "PASS"'
42 This test case verifies the retrieval of OpenStack clients:
43 Keystone, Glance, Neutron and Nova and may perform some
44 simple queries. When the config value of
45 snaps.use_keystone is True, functest must have access to
46 the cloud's private network.
49 installer: '^((?!netvirt).)*$'
52 module: 'functest.opnfv_tests.openstack.snaps.connection_check'
53 class: 'ConnectionCheck'
57 criteria: 'status == "PASS"'
60 This test case verifies the retrieval of OpenStack clients:
61 Keystone, Glance, Neutron and Nova and may perform some
62 simple queries. When the config value of
63 snaps.use_keystone is True, functest must have access to
64 the cloud's private network.
67 installer: '^((?!netvirt).)*$'
70 module: 'functest.opnfv_tests.openstack.snaps.api_check'
75 ci_loop: '(daily)|(weekly)'
77 Set of basic Functional tests to validate the OPNFV scenarios.
81 criteria: 'status == "PASS"'
84 This test case verifies: 1) SSH to an instance using floating
85 IPs over the public network. 2) Connectivity between 2 instances
86 over a private network.
89 scenario: '^((?!bgpvpn|odl_l3).)*$'
91 module: 'functest.opnfv_tests.openstack.vping.vping_ssh'
96 criteria: 'status == "PASS"'
99 This test case verifies: 1) Boot a VM with given userdata.
100 2) Connectivity between 2 instances over a private network.
103 scenario: '^((?!lxd).)*$'
105 module: 'functest.opnfv_tests.openstack.vping.vping_userdata'
106 class: 'VPingUserdata'
109 name: tempest_smoke_serial
110 criteria: 'success_rate == 100%'
113 This test case runs the smoke subset of the OpenStack
114 Tempest suite. The list of test cases is generated by
115 Tempest automatically and depends on the parameters of
116 the OpenStack deplopyment.
118 installer: '^((?!netvirt).)*$'
121 module: 'functest.opnfv_tests.openstack.tempest.tempest'
122 class: 'TempestSmokeSerial'
126 criteria: 'success_rate == 100%'
129 This test case runs a sub group of tests of the OpenStack
130 Rally suite in smoke mode.
133 scenario: '^((?!bgpvpn).)*$'
135 module: 'functest.opnfv_tests.openstack.rally.rally'
140 criteria: 'success_rate == 100%'
143 Test Suite for the OpenDaylight SDN Controller. It
144 integrates some test suites from upstream using
145 Robot as the test framework.
150 module: 'functest.opnfv_tests.sdn.odl.odl'
154 - /home/opnfv/repos/odl_test/csit/suites/integration/basic
155 - /home/opnfv/repos/odl_test/csit/suites/openstack/neutron
159 criteria: 'success_rate == 100%'
162 Test Suite for the OpenDaylight SDN Controller when
163 the NetVirt features are installed. It integrates
164 some test suites from upstream using Robot as the
170 module: 'functest.opnfv_tests.sdn.odl.odl'
174 - /home/opnfv/repos/odl_test/csit/suites/integration/basic
175 - /home/opnfv/repos/odl_test/csit/suites/openstack/neutron
176 - /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity
180 criteria: 'status == "PASS"'
183 Test Suite for the ONOS SDN Controller. It integrates
184 some test suites from upstream using TestON as the test
193 criteria: 'status == "PASS"'
196 This test case contains tests that setup and destroy
197 environments with VMs with and without Floating IPs
198 with a newly created user and project. Set the config
199 value snaps.use_floating_ips (True|False) to toggle
200 this functionality. When the config value of
201 snaps.use_keystone is True, functest must have access to
202 the cloud's private network.
205 installer: '^((?!netvirt).)*$'
208 module: 'functest.opnfv_tests.openstack.snaps.smoke'
214 ci_loop: '(daily)|(weekly)'
216 Test suites from feature projects
217 integrated in functest
221 criteria: 'success_rate == 100%'
224 Test suite from Promise project.
226 installer: '(fuel)|(joid)'
229 module: 'functest.opnfv_tests.features.promise'
234 criteria: 'status == "PASS"'
237 Test suite from Doctor project.
239 installer: '(apex)|(fuel)|(joid)'
240 scenario: '^((?!fdio).)*$'
242 module: 'functest.opnfv_tests.features.doctor'
247 criteria: 'status == "PASS"'
250 Test suite from SDNVPN project.
252 installer: '(fuel)|(apex)|(netvirt)'
255 module: 'functest.opnfv_tests.features.sdnvpn'
260 criteria: 'status == "PASS"'
266 scenario: '^((?!fdio).)*$'
268 module: 'functest.opnfv_tests.features.security_scan'
269 class: 'SecurityScan'
272 # criteria: 'status == "PASS"'
275 # Test suite for policy management based on OpenStack Congress
277 # installer: '(apex)|(joid)'
278 # scenario: '^((?!fdio|lxd).)*$'
280 # module: 'functest.opnfv_tests.features.copper'
284 criteria: 'success_rate == 100%'
287 Test suite from kingbird
289 installer: '(fuel)|(compass)'
290 scenario: 'multisite'
292 module: 'functest.opnfv_tests.openstack.tempest.tempest'
293 class: 'TempestMultisite'
296 criteria: 'status == "PASS"'
299 Test suite for odl-sfc to test two chains and two SFs
301 installer: '(apex)|(fuel)'
302 scenario: 'odl_l2-sfc'
304 module: 'functest.opnfv_tests.features.odl_sfc'
305 class: 'OpenDaylightSFC'
308 criteria: 'status == "PASS"'
311 Test Suite for onos-sfc to test sfc function.
320 Test suite from Parser project.
323 scenario: '^((?!bgpvpn|noha).)*$'
325 module: 'functest.opnfv_tests.vnf.rnc.parser'
332 Test OpenBaton (Orchestra) stack
337 module: 'functest.opnfv_tests.features.orchestrator.orchestra'
338 class: 'OpenbatonOrchestrator'
341 criteria: 'status == "PASS"'
344 Test suite from Netready project.
349 module: 'functest.opnfv_tests.features.netready'
353 criteria: 'status == "PASS"'
356 Test suite for the Barometer project. Separate tests verify the
357 proper configuration and functionality of the following
358 collectd plugins Ceilometer, Hugepages, Memory RAS (mcelog),
362 scenario: 'kvm_ovs_dpdk_bar'
364 module: 'functest.opnfv_tests.features.barometer'
365 class: 'BarometerCollectd'
371 Extensive testing of OpenStack API.
374 # name: tempest_full_parallel
375 # criteria: 'success_rate >= 80%'
378 # The list of test cases is generated by
379 # Tempest automatically and depends on the parameters of
380 # the OpenStack deplopyment.
382 # installer: '^((?!netvirt).)*$'
385 # module: 'functest.opnfv_tests.openstack.tempest.tempest'
386 # class: 'TempestFullParallel'
388 name: tempest_defcore
389 criteria: 'success_rate == 100%'
392 This is the set of Tempest test cases created by OpenStack
393 Interop Working Group for certification purposes.
396 scenario: 'nosdn-nofeature-ha'
398 module: 'functest.opnfv_tests.openstack.tempest.tempest'
399 class: 'TempestDefcore'
402 # criteria: 'success_rate >= 90%'
405 # This test case runs the full suite of scenarios of the OpenStack
406 # Rally suite using several threads and iterations.
408 # installer: '^((?!netvirt).)*$'
411 # module: 'functest.opnfv_tests.openstack.rally.rally'
419 Collection of VNF test cases.
423 criteria: 'status == "PASS"'
426 This test case deploys an OpenSource vIMS solution from Clearwater
427 using the Cloudify orchestrator. It also runs some signaling traffic.
430 scenario: '(ocl)|(nosdn)|^(os-odl)((?!bgpvpn).)*$'
432 module: 'functest.opnfv_tests.vnf.ims.cloudify_ims'
439 Test suite from Parser project.
444 module: 'functest.opnfv_tests.vnf.aaa.aaa'
452 Test suite from OAI project, vEPC deployed with Juju.
457 module: 'functest.opnfv_tests.vnf.epc.epc'
465 VNF deployment with OpenBaton (Orchestra)
470 module: 'functest.opnfv_tests.vnf.ims.orchestra_ims'
483 module: 'functest.opnfv_tests.vnf.ims.opera_ims'