5 ci_loop: '(daily)|(weekly)'
7 First tier to be executed to verify the basic
12 criteria: 'status == "PASS"'
15 This test case verifies the basic OpenStack services like
16 Keystone, Glance, Cinder, Neutron and Nova.
20 scenario: '^((?!lxd).)*$'
25 ci_loop: '(daily)|(weekly)'
27 Set of basic Functional tests to validate the OpenStack deployment.
31 criteria: 'status == "PASS"'
34 This test case verifies: 1) SSH to an instance using floating
35 IPs over the public network. 2) Connectivity between 2 instances
36 over a private network.
39 scenario: '^((?!bgpvpn|odl_l3).)*$'
43 criteria: 'status == "PASS"'
46 This test case verifies: 1) Boot a VM with given userdata.
47 2) Connectivity between 2 instances over a private network.
50 scenario: '^((?!lxd).)*$'
53 name: tempest_smoke_serial
54 criteria: 'success_rate == 100%'
57 This test case runs the smoke subset of the OpenStack
58 Tempest suite. The list of test cases is generated by
59 Tempest automatically and depends on the parameters of
60 the OpenStack deplopyment.
67 criteria: 'success_rate == 100%'
70 This test case runs a sub group of tests of the OpenStack
71 Rally suite in smoke mode.
79 ci_loop: '(daily)|(weekly)'
81 Test suites corresponding to the different
82 SDN Controllers existing in OPNFV.
86 criteria: 'success_rate == 100%'
89 Test Suite for the OpenDaylight SDN Controller. It integrates
90 some test suites from upstream using Robot as the test
98 criteria: 'status == "PASS"'
101 Test Suite for the ONOS SDN Controller. It integrates
102 some test suites from upstream using TestON as the test
111 ci_loop: '(daily)|(weekly)'
113 Test suites from feature projects
114 integrated in functest
118 criteria: 'success_rate == 100%'
121 Test suite from Promise project.
123 installer: '(fuel)|(joid)'
128 criteria: 'status == "PASS"'
131 Test suite from Doctor project.
133 installer: '(apex)|(fuel)'
138 criteria: 'status == "PASS"'
141 Test suite from SDNVPN project.
143 installer: '(fuel)|(apex)'
148 criteria: 'status == "PASS"'
158 criteria: 'status == "PASS"'
161 Test suite for policy management based on OpenStack Congress
163 installer: '(apex)|(joid)'
167 criteria: 'status == "PASS"'
170 Security management system for OPNFV
173 scenario: '(odl)*(moon)'
176 criteria: 'success_rate == 100%'
179 Test suite from kingbird
181 installer: '(fuel)|(compass)'
182 scenario: 'multisite'
185 criteria: 'status == "PASS"'
188 Test suite for template distribution based on Domino
194 criteria: 'status == "PASS"'
197 Test suite for odl-sfc to test two chains and two SFs
200 scenario: 'odl_l2-sfc'
203 criteria: 'status == "PASS"'
206 Test Suite for onos-sfc to test sfc function.
215 Test suite from Parser project.
218 scenario: '^((?!noha).)*$'
224 Extensive testing of OpenStack API.
227 name: tempest_full_parallel
228 criteria: 'success_rate >= 80%'
231 The list of test cases is generated by
232 Tempest automatically and depends on the parameters of
233 the OpenStack deplopyment.
240 criteria: 'success_rate >= 90%'
243 This test case runs the full suite of scenarios of the OpenStack
244 Rally suite using several threads and iterations.
254 Collection of VNF test cases.
258 criteria: 'status == "PASS"'
261 This test case deploys an OpenSource vIMS solution from Clearwater
262 using the Cloudify orchestrator. It also runs some signaling traffic.
265 scenario: '(ocl)|(nosdn)|^(os-odl)((?!bgpvpn).)*$'