5 ci_loop: '(daily)|(weekly)'
7 First tier to be executed to verify the basic
11 name: snaps_health_check
12 criteria: 'status == "PASS"'
15 This test case creates executes the SimpleHealthCheck
16 Python test class which creates an, image, flavor, network,
17 and Cirros VM instance and observes the console output to
18 validate the single port obtains the correct IP address.
21 scenario: '^((?!lxd).)*$'
23 module: 'functest.opnfv_tests.openstack.snaps.health_check'
26 name: connection_check
27 criteria: 'status == "PASS"'
30 This test case verifies the retrieval of OpenStack clients:
31 Keystone, Glance, Neutron and Nova and may perform some
32 simple queries. When the config value of
33 snaps.use_keystone is True, functest must have access to
34 the cloud's private network.
37 installer: '^((?!netvirt).)*$'
40 module: 'functest.opnfv_tests.openstack.snaps.connection_check'
41 class: 'ConnectionCheck'
45 criteria: 'status == "PASS"'
48 This test case verifies the retrieval of OpenStack clients:
49 Keystone, Glance, Neutron and Nova and may perform some
50 simple queries. When the config value of
51 snaps.use_keystone is True, functest must have access to
52 the cloud's private network.
55 installer: '^((?!netvirt).)*$'
58 module: 'functest.opnfv_tests.openstack.snaps.api_check'
63 ci_loop: '(daily)|(weekly)'
65 Set of basic Functional tests to validate the OPNFV scenarios.
69 criteria: 'status == "PASS"'
72 This test case verifies: 1) SSH to an instance using floating
73 IPs over the public network. 2) Connectivity between 2 instances
74 over a private network.
77 scenario: '^((?!odl_l3).)*$'
79 module: 'functest.opnfv_tests.openstack.vping.vping_ssh'
84 criteria: 'status == "PASS"'
87 This test case verifies: 1) Boot a VM with given userdata.
88 2) Connectivity between 2 instances over a private network.
91 scenario: '^((?!lxd).)*$'
93 module: 'functest.opnfv_tests.openstack.vping.vping_userdata'
94 class: 'VPingUserdata'
97 name: tempest_smoke_serial
98 criteria: 'success_rate == 100%'
101 This test case runs the smoke subset of the OpenStack
102 Tempest suite. The list of test cases is generated by
103 Tempest automatically and depends on the parameters of
104 the OpenStack deplopyment.
106 installer: '^((?!netvirt).)*$'
109 module: 'functest.opnfv_tests.openstack.tempest.tempest'
110 class: 'TempestSmokeSerial'
114 criteria: 'success_rate == 100%'
117 This test case runs a sub group of tests of the OpenStack
118 Rally suite in smoke mode.
123 module: 'functest.opnfv_tests.openstack.rally.rally'
128 criteria: 'success_rate == 100%'
131 Test Suite for the OpenDaylight SDN Controller. It
132 integrates some test suites from upstream using
133 Robot as the test framework.
138 module: 'functest.opnfv_tests.sdn.odl.odl'
142 - /home/opnfv/repos/odl_test/csit/suites/integration/basic
143 - /home/opnfv/repos/odl_test/csit/suites/openstack/neutron
147 criteria: 'success_rate == 100%'
150 Test Suite for the OpenDaylight SDN Controller when
151 the NetVirt features are installed. It integrates
152 some test suites from upstream using Robot as the
158 module: 'functest.opnfv_tests.sdn.odl.odl'
162 - /home/opnfv/repos/odl_test/csit/suites/integration/basic
163 - /home/opnfv/repos/odl_test/csit/suites/openstack/neutron
164 - /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity
168 criteria: 'status == "PASS"'
171 Test Suite for the ONOS SDN Controller. It integrates
172 some test suites from upstream using TestON as the test
178 module: 'functest.opnfv_tests.sdn.onos.onos'
183 criteria: 'status == "PASS"'
186 This test case contains tests that setup and destroy
187 environments with VMs with and without Floating IPs
188 with a newly created user and project. Set the config
189 value snaps.use_floating_ips (True|False) to toggle
190 this functionality. When the config value of
191 snaps.use_keystone is True, functest must have access to
192 the cloud's private network.
195 installer: '^((?!netvirt).)*$'
198 module: 'functest.opnfv_tests.openstack.snaps.smoke'
204 ci_loop: '(daily)|(weekly)'
206 Test suites from feature projects
207 integrated in functest
211 criteria: 'success_rate == 100%'
214 Test suite from Promise project.
216 installer: '(fuel)|(joid)'
219 module: 'functest.opnfv_tests.features.promise'
224 criteria: 'status == "PASS"'
227 Test suite from Doctor project.
229 installer: '(apex)|(fuel)|(joid)'
230 scenario: '^((?!fdio).)*$'
232 module: 'functest.opnfv_tests.features.doctor'
237 criteria: 'status == "PASS"'
240 Test suite from SDNVPN project.
242 installer: '(fuel)|(apex)|(netvirt)'
245 module: 'functest.opnfv_tests.features.sdnvpn'
250 criteria: 'status == "PASS"'
256 scenario: '^((?!fdio).)*$'
258 module: 'functest.opnfv_tests.features.security_scan'
259 class: 'SecurityScan'
262 # criteria: 'status == "PASS"'
265 # Test suite for policy management based on OpenStack Congress
267 # installer: '(apex)|(joid)'
268 # scenario: '^((?!fdio|lxd).)*$'
270 # module: 'functest.opnfv_tests.features.copper'
274 criteria: 'success_rate == 100%'
277 Test suite from kingbird
279 installer: '(fuel)|(compass)'
280 scenario: 'multisite'
282 module: 'functest.opnfv_tests.openstack.tempest.tempest'
283 class: 'TempestMultisite'
286 criteria: 'status == "PASS"'
289 Test suite for odl-sfc to test two chains and two SFs
291 installer: '(apex)|(fuel)'
292 scenario: 'odl_l2-sfc'
294 module: 'functest.opnfv_tests.features.odl_sfc'
295 class: 'OpenDaylightSFC'
298 criteria: 'status == "PASS"'
301 Test Suite for onos-sfc to test sfc function.
306 module: 'functest.opnfv_tests.sdn.onos.onos'
313 Test suite from Parser project.
316 scenario: '^((?!bgpvpn|noha).)*$'
318 module: 'functest.opnfv_tests.vnf.rnc.parser'
322 criteria: 'status == "PASS"'
325 Test suite from Domino project.
330 module: 'functest.opnfv_tests.features.domino'
337 Test OpenBaton (Orchestra) stack
342 module: 'functest.opnfv_tests.features.orchestrator.orchestra'
343 class: 'OpenbatonOrchestrator'
346 criteria: 'status == "PASS"'
349 Test suite from Netready project.
354 module: 'functest.opnfv_tests.features.netready'
358 criteria: 'status == "PASS"'
361 Test suite for the Barometer project. Separate tests verify the
362 proper configuration and functionality of the following
363 collectd plugins Ceilometer, Hugepages, Memory RAS (mcelog),
367 scenario: 'kvm_ovs_dpdk_bar'
369 module: 'functest.opnfv_tests.features.barometer'
370 class: 'BarometerCollectd'
376 Extensive testing of OpenStack API.
379 # name: tempest_full_parallel
380 # criteria: 'success_rate >= 80%'
383 # The list of test cases is generated by
384 # Tempest automatically and depends on the parameters of
385 # the OpenStack deplopyment.
387 # installer: '^((?!netvirt).)*$'
390 # module: 'functest.opnfv_tests.openstack.tempest.tempest'
391 # class: 'TempestFullParallel'
393 name: tempest_defcore
394 criteria: 'success_rate == 100%'
397 This is the set of Tempest test cases created by OpenStack
398 Interop Working Group for certification purposes.
401 scenario: 'nosdn-nofeature-ha'
403 module: 'functest.opnfv_tests.openstack.tempest.tempest'
404 class: 'TempestDefcore'
407 criteria: 'success_rate == 100%'
410 The test case allows running a customized list of tempest
411 test cases defined in a file under
412 <dir_functest_repo>/functest/opnfv_tests/openstack/
413 /tempest/custom_tests/test_list.txt
414 The file is empty and can be customized with the desired tests.
419 module: 'functest.opnfv_tests.openstack.tempest.tempest'
420 class: 'TempestCustom'
423 # criteria: 'success_rate >= 90%'
426 # This test case runs the full suite of scenarios of the OpenStack
427 # Rally suite using several threads and iterations.
429 # installer: '^((?!netvirt).)*$'
432 # module: 'functest.opnfv_tests.openstack.rally.rally'
440 Collection of VNF test cases.
444 criteria: 'status == "PASS"'
447 This test case deploys an OpenSource vIMS solution from Clearwater
448 using the Cloudify orchestrator. It also runs some signaling traffic.
451 scenario: '(ocl)|(nosdn)|^(os-odl)((?!bgpvpn).)*$'
453 module: 'functest.opnfv_tests.vnf.ims.cloudify_ims'
460 Test suite from Parser project.
465 module: 'functest.opnfv_tests.vnf.aaa.aaa'
473 Test suite from OAI project, vEPC deployed with Juju.
478 module: 'functest.opnfv_tests.vnf.epc.epc'
486 VNF deployment with OpenBaton (Orchestra)
491 module: 'functest.opnfv_tests.vnf.ims.orchestra_ims'
504 module: 'functest.opnfv_tests.vnf.ims.opera_ims'
509 criteria: 'status == "PASS"'
512 This test case is vRouter testing.
515 scenario: 'nosdn-nofeature'
517 module: 'functest.opnfv_tests.vnf.router.vyos_vrouter'