5 ci_loop: '(daily)|(weekly)'
7 First tier to be executed to verify the basic
12 criteria: 'status == "PASS"'
15 This test case verifies the basic OpenStack services like
16 Keystone, Glance, Cinder, Neutron and Nova.
20 scenario: '^((?!lxd).)*$'
25 ci_loop: '(daily)|(weekly)'
27 Set of basic Functional tests to validate the OPNFV scenarios.
31 criteria: 'status == "PASS"'
34 This test case verifies: 1) SSH to an instance using floating
35 IPs over the public network. 2) Connectivity between 2 instances
36 over a private network.
39 scenario: '^((?!bgpvpn|odl_l3).)*$'
41 module: 'functest.opnfv_tests.openstack.vping.vping_ssh'
46 criteria: 'status == "PASS"'
49 This test case verifies: 1) Boot a VM with given userdata.
50 2) Connectivity between 2 instances over a private network.
53 scenario: '^((?!lxd).)*$'
55 module: 'functest.opnfv_tests.openstack.vping.vping_userdata'
56 class: 'VPingUserdata'
59 name: tempest_smoke_serial
60 criteria: 'success_rate == 100%'
63 This test case runs the smoke subset of the OpenStack
64 Tempest suite. The list of test cases is generated by
65 Tempest automatically and depends on the parameters of
66 the OpenStack deplopyment.
68 installer: '^((?!netvirt).)*$'
71 module: 'functest.opnfv_tests.openstack.tempest.tempest'
72 class: 'TempestSmokeSerial'
76 criteria: 'success_rate == 100%'
79 This test case runs a sub group of tests of the OpenStack
80 Rally suite in smoke mode.
83 scenario: '^((?!bgpvpn).)*$'
85 module: 'functest.opnfv_tests.openstack.rally.rally'
90 criteria: 'success_rate == 100%'
93 Test Suite for the OpenDaylight SDN Controller. It integrates
94 some test suites from upstream using Robot as the test
100 module: 'functest.opnfv_tests.sdn.odl.odl'
105 criteria: 'status == "PASS"'
108 Test Suite for the ONOS SDN Controller. It integrates
109 some test suites from upstream using TestON as the test
116 name: connection_check
117 criteria: 'status == "PASS"'
120 This test case verifies the retrieval of OpenStack clients:
121 Keystone, Glance, Neutron and Nova and may perform some
122 simple queries. When the config value of
123 snaps.use_keystone is True, functest must have access to
124 the cloud's private network.
127 installer: '^((?!netvirt).)*$'
130 module: 'functest.opnfv_tests.openstack.snaps.connection_check'
131 class: 'ConnectionCheck'
135 criteria: 'status == "PASS"'
138 This test case verifies the retrieval of OpenStack clients:
139 Keystone, Glance, Neutron and Nova and may perform some
140 simple queries. When the config value of
141 snaps.use_keystone is True, functest must have access to
142 the cloud's private network.
145 installer: '^((?!netvirt).)*$'
148 module: 'functest.opnfv_tests.openstack.snaps.api_check'
153 criteria: 'status == "PASS"'
156 This test case contains tests that setup and destroy
157 environments with VMs with and without Floating IPs
158 with a newly created user and project. Set the config
159 value snaps.use_floating_ips (True|False) to toggle
160 this functionality. When the config value of
161 snaps.use_keystone is True, functest must have access to
162 the cloud's private network.
165 installer: '^((?!netvirt).)*$'
168 module: 'functest.opnfv_tests.openstack.snaps.smoke'
174 ci_loop: '(daily)|(weekly)'
176 Test suites from feature projects
177 integrated in functest
181 criteria: 'success_rate == 100%'
184 Test suite from Promise project.
186 installer: '(fuel)|(joid)'
191 criteria: 'status == "PASS"'
194 Test suite from Doctor project.
196 installer: '(apex)|(fuel)|(joid)'
197 scenario: '^((?!fdio).)*$'
199 module: 'functest.opnfv_tests.features.doctor'
204 criteria: 'status == "PASS"'
207 Test suite from SDNVPN project.
209 installer: '(fuel)|(apex)|(netvirt)'
212 module: 'functest.opnfv_tests.features.sdnvpn'
217 criteria: 'status == "PASS"'
223 scenario: '^((?!fdio).)*$'
226 criteria: 'status == "PASS"'
229 Test suite for policy management based on OpenStack Congress
231 installer: '(apex)|(joid)'
232 scenario: '^((?!fdio|lxd).)*$'
234 module: 'functest.opnfv_tests.features.copper'
238 criteria: 'status == "PASS"'
241 Security management system for OPNFV
244 scenario: '(odl)*(moon)'
247 criteria: 'success_rate == 100%'
250 Test suite from kingbird
252 installer: '(fuel)|(compass)'
253 scenario: 'multisite'
255 module: 'functest.opnfv_tests.openstack.tempest.tempest'
256 class: 'TempestMultisite'
259 criteria: 'status == "PASS"'
262 Test suite for odl-sfc to test two chains and two SFs
264 installer: '(apex)|(fuel)'
265 scenario: 'odl_l2-sfc'
267 module: 'functest.opnfv_tests.features.odl_sfc'
268 class: 'OpenDaylightSFC'
271 criteria: 'status == "PASS"'
274 Test Suite for onos-sfc to test sfc function.
283 Test suite from Parser project.
286 scenario: '^((?!bgpvpn|noha).)*$'
288 module: 'functest.opnfv_tests.vnf.rnc.parser'
295 Test OpenBaton (Orchestra) stack
300 module: 'functest.opnfv_tests.features.orchestrator.orchestra'
301 class: 'OpenbatonOrchestrator'
307 Extensive testing of OpenStack API.
310 name: tempest_full_parallel
311 criteria: 'success_rate >= 80%'
314 The list of test cases is generated by
315 Tempest automatically and depends on the parameters of
316 the OpenStack deplopyment.
318 installer: '^((?!netvirt).)*$'
321 module: 'functest.opnfv_tests.openstack.tempest.tempest'
322 class: 'TempestFullParallel'
326 criteria: 'success_rate >= 90%'
329 This test case runs the full suite of scenarios of the OpenStack
330 Rally suite using several threads and iterations.
332 installer: '^((?!netvirt).)*$'
335 module: 'functest.opnfv_tests.openstack.rally.rally'
343 Collection of VNF test cases.
347 criteria: 'status == "PASS"'
350 This test case deploys an OpenSource vIMS solution from Clearwater
351 using the Cloudify orchestrator. It also runs some signaling traffic.
354 scenario: '(ocl)|(nosdn)|^(os-odl)((?!bgpvpn).)*$'
356 module: 'functest.opnfv_tests.vnf.ims.cloudify_ims'
363 Test suite from Parser project.
368 module: 'functest.opnfv_tests.vnf.aaa.aaa'
376 Test suite from OAI project, vEPC deployed with Juju.
381 module: 'functest.opnfv_tests.vnf.epc.epc'
389 VNF deployment with OpenBaton (Orchestra)
394 module: 'functest.opnfv_tests.vnf.ims.orchestra_ims'
407 module: 'functest.opnfv_tests.vnf.ims.opera_ims'