5 ci_loop: '(daily)|(weekly)'
7 First tier to be executed to verify the basic
11 case_name: connection_check
12 project_name: functest
13 criteria: 'status == "PASS"'
17 This test case verifies the retrieval of OpenStack clients:
18 Keystone, Glance, Neutron and Nova and may perform some
19 simple queries. When the config value of
20 snaps.use_keystone is True, functest must have access to
21 the cloud's private network.
24 installer: '^((?!netvirt).)*$'
27 module: 'functest.opnfv_tests.openstack.snaps.connection_check'
28 class: 'ConnectionCheck'
32 project_name: functest
33 criteria: 'status == "PASS"'
37 This test case verifies the retrieval of OpenStack clients:
38 Keystone, Glance, Neutron and Nova and may perform some
39 simple queries. When the config value of
40 snaps.use_keystone is True, functest must have access to
41 the cloud's private network.
44 installer: '^((?!netvirt).)*$'
47 module: 'functest.opnfv_tests.openstack.snaps.api_check'
50 case_name: snaps_health_check
51 project_name: functest
52 criteria: 'status == "PASS"'
56 This test case creates executes the SimpleHealthCheck
57 Python test class which creates an, image, flavor, network,
58 and Cirros VM instance and observes the console output to
59 validate the single port obtains the correct IP address.
62 scenario: '^((?!lxd).)*$'
64 module: 'functest.opnfv_tests.openstack.snaps.health_check'
69 ci_loop: '(daily)|(weekly)'
71 Set of basic Functional tests to validate the OPNFV scenarios.
75 project_name: functest
76 criteria: 'status == "PASS"'
80 This test case verifies: 1) SSH to an instance using floating
81 IPs over the public network. 2) Connectivity between 2 instances
82 over a private network.
85 scenario: '^((?!odl_l3|odl-bgpvpn|gluon).)*$'
87 module: 'functest.opnfv_tests.openstack.vping.vping_ssh'
91 case_name: vping_userdata
92 project_name: functest
93 criteria: 'status == "PASS"'
97 This test case verifies: 1) Boot a VM with given userdata.
98 2) Connectivity between 2 instances over a private network.
101 scenario: '^((?!lxd).)*$'
103 module: 'functest.opnfv_tests.openstack.vping.vping_userdata'
104 class: 'VPingUserdata'
107 case_name: tempest_smoke_serial
108 project_name: functest
109 criteria: 'success_rate == 100%'
113 This test case runs the smoke subset of the OpenStack
114 Tempest suite. The list of test cases is generated by
115 Tempest automatically and depends on the parameters of
116 the OpenStack deplopyment.
118 installer: '^((?!netvirt).)*$'
121 module: 'functest.opnfv_tests.openstack.tempest.tempest'
122 class: 'TempestSmokeSerial'
125 case_name: rally_sanity
126 project_name: functest
127 criteria: 'success_rate == 100%'
131 This test case runs a sub group of tests of the OpenStack
132 Rally suite in smoke mode.
137 module: 'functest.opnfv_tests.openstack.rally.rally'
141 case_name: refstack_defcore
142 project_name: functest
143 criteria: 'success_rate == 100%'
147 This test case runs a sub group of tests of the OpenStack
148 Defcore testcases by using refstack client.
153 module: 'functest.opnfv_tests.openstack.refstack_client.refstack_client'
154 class: 'RefstackClient'
158 project_name: functest
159 criteria: 'success_rate == 100%'
163 Test Suite for the OpenDaylight SDN Controller. It
164 integrates some test suites from upstream using
165 Robot as the test framework.
170 module: 'functest.opnfv_tests.sdn.odl.odl'
174 - /home/opnfv/repos/odl_test/csit/suites/integration/basic
175 - /home/opnfv/repos/odl_test/csit/suites/openstack/neutron
178 case_name: odl_netvirt
179 project_name: functest
180 criteria: 'success_rate == 100%'
184 Test Suite for the OpenDaylight SDN Controller when
185 the NetVirt features are installed. It integrates
186 some test suites from upstream using Robot as the
190 scenario: 'os-odl_l3-nofeature'
192 module: 'functest.opnfv_tests.sdn.odl.odl'
196 - /home/opnfv/repos/odl_test/csit/suites/integration/basic
197 - /home/opnfv/repos/odl_test/csit/suites/openstack/neutron
198 - /home/opnfv/repos/odl_test/csit/suites/openstack/connectivity
202 project_name: functest
203 criteria: 'success_rate == 100%'
207 Test Suite for the OpenDaylight SDN Controller when GBP features are
208 installed. It integrates some test suites from upstream using
209 Robot as the test framework.
212 scenario: 'odl_l2-fdio'
214 module: 'functest.opnfv_tests.sdn.odl.odl'
218 - /home/opnfv/repos/fds/testing/robot
222 project_name: functest
223 criteria: 'status == "PASS"'
227 Test Suite for the ONOS SDN Controller. It integrates
228 some test suites from upstream using TestON as the test
234 module: 'functest.opnfv_tests.sdn.onos.onos'
238 case_name: snaps_smoke
239 project_name: functest
240 criteria: 'status == "PASS"'
244 This test case contains tests that setup and destroy
245 environments with VMs with and without Floating IPs
246 with a newly created user and project. Set the config
247 value snaps.use_floating_ips (True|False) to toggle
248 this functionality. When the config value of
249 snaps.use_keystone is True, functest must have access to
250 the cloud's private network.
253 installer: '^((?!netvirt).)*$'
254 scenario: '^((?!lxd).)*$'
256 module: 'functest.opnfv_tests.openstack.snaps.smoke'
262 ci_loop: '(daily)|(weekly)'
264 Test suites from feature projects
265 integrated in functest
269 project_name: promise
270 criteria: 'success_rate == 100%'
274 Test suite from Promise project.
276 installer: '(fuel)|(joid)'
279 module: 'functest.core.feature'
282 cmd: 'cd /home/opnfv/repos/promise/promise/test/functest && python ./run_tests.py'
285 case_name: doctor-notification
287 criteria: 'status == "PASS"'
291 Test suite from Doctor project.
293 installer: '(apex)|(fuel)'
294 scenario: '^((?!fdio).)*$'
296 module: 'functest.core.feature'
299 cmd: 'cd /home/opnfv/repos/doctor/tests && ./run.sh'
304 criteria: 'status == "PASS"'
308 Test suite from SDNVPN project.
310 installer: '(fuel)|(apex)|(netvirt)'
313 module: 'functest.core.feature'
316 cmd: 'cd /home/opnfv/repos/sdnvpn/sdnvpn/test/functest && python ./run_tests.py'
319 case_name: security_scan
320 project_name: securityscanning
321 criteria: 'status == "PASS"'
328 scenario: '^((?!fdio).)*$'
330 module: 'functest.core.feature'
333 cmd: '. /home/opnfv/functest/conf/stackrc && cd /home/opnfv/repos/securityscanning && python security_scan.py --config config.ini && cd -'
337 project_name: multisite
338 criteria: 'success_rate == 100%'
342 Test suite from kingbird
344 installer: '(fuel)|(compass)'
345 scenario: 'multisite'
347 module: 'functest.opnfv_tests.openstack.tempest.tempest'
348 class: 'TempestMultisite'
350 case_name: functest-odl-sfc
352 criteria: 'status == "PASS"'
356 Test suite for odl-sfc to test two chains and two SFs
358 installer: '(apex)|(fuel)'
359 scenario: 'odl_l2-sfc'
361 module: 'functest.core.feature'
364 cmd: 'cd /home/opnfv/repos/sfc/sfc/tests/functest && python ./run_tests.py'
367 project_name: functest
368 criteria: 'status == "PASS"'
372 Test Suite for onos-sfc to test sfc function.
377 module: 'functest.opnfv_tests.sdn.onos.onos'
380 case_name: parser-basics
386 Test suite from Parser project.
389 scenario: '^((?!bgpvpn|noha).)*$'
391 module: 'functest.core.feature'
394 cmd: 'cd /home/opnfv/repos/parser/tests && ./functest_run.sh'
396 case_name: domino-multinode
398 criteria: 'status == "PASS"'
402 Test suite from Domino project.
407 module: 'functest.core.feature'
410 cmd: 'cd /home/opnfv/repos/domino && ./tests/run_multinode.sh'
412 case_name: gluon_vping
413 project_name: netready
414 criteria: 'status == "PASS"'
418 Test suite from Netready project.
423 module: 'functest.core.feature'
426 cmd: 'cd /home/opnfv/repos/netready/test/functest && python ./gluon-test-suite.py'
428 case_name: barometercollectd
429 project_name: barometer
430 criteria: 'status == "PASS"'
434 Test suite for the Barometer project. Separate tests verify the
435 proper configuration and functionality of the following
436 collectd plugins Ceilometer, Hugepages, Memory RAS (mcelog),
440 scenario: 'kvm_ovs_dpdk_bar'
442 module: 'functest.opnfv_tests.features.barometer'
443 class: 'BarometerCollectd'
449 Extensive testing of OpenStack API.
452 case_name: tempest_full_parallel
453 project_name: functest
454 criteria: 'success_rate >= 80%'
458 The list of test cases is generated by
459 Tempest automatically and depends on the parameters of
460 the OpenStack deplopyment.
462 installer: '^((?!netvirt).)*$'
465 module: 'functest.opnfv_tests.openstack.tempest.tempest'
466 class: 'TempestFullParallel'
468 case_name: tempest_custom
469 project_name: functest
470 criteria: 'success_rate == 100%'
474 The test case allows running a customized list of tempest
475 test cases defined in a file under
476 <dir_functest_repo>/functest/opnfv_tests/openstack/
477 /tempest/custom_tests/test_list.txt
478 The file is empty and can be customized with the desired tests.
483 module: 'functest.opnfv_tests.openstack.tempest.tempest'
484 class: 'TempestCustom'
486 case_name: rally_full
487 project_name: functest
488 criteria: 'success_rate >= 90%'
492 This test case runs the full suite of scenarios of the OpenStack
493 Rally suite using several threads and iterations.
495 installer: '^((?!netvirt).)*$'
498 module: 'functest.opnfv_tests.openstack.rally.rally'
506 Collection of VNF test cases.
509 case_name: cloudify_ims
510 project_name: functest
511 criteria: 'status == "PASS"'
515 This test case deploys an OpenSource vIMS solution from Clearwater
516 using the Cloudify orchestrator. It also runs some signaling traffic.
519 scenario: '(ocl)|(nosdn)|^(os-odl)((?!bgpvpn).)*$'
521 module: 'functest.opnfv_tests.vnf.ims.cloudify_ims'
525 # project_name: functest
526 # criteria: 'ret == 0'
530 # Test suite from Parser project.
535 # module: 'functest.opnfv_tests.vnf.aaa.aaa'
538 case_name: orchestra_ims
539 project_name: functest
544 VNF deployment with OpenBaton (Orchestra)
549 module: 'functest.opnfv_tests.vnf.ims.orchestra_ims'
553 case_name: opera-vims
555 criteria: 'status == "PASS"'
559 VNF deployment with OPEN-O
564 module: 'functest.opnfv_tests.vnf.ims.opera_ims'
568 case_name: vyos_vrouter
569 project_name: functest
570 criteria: 'status == "PASS"'
574 This test case is vRouter testing.
577 scenario: 'nosdn-nofeature'
579 module: 'functest.opnfv_tests.vnf.router.vyos_vrouter'