Healthcheck tests
^^^^^^^^^^^^^^^^^
- In Danube, healthcheck tests have been refactored and rely on SNAPS, an
+ Since Danube, healthcheck tests have been refactored and rely on SNAPS, an
OPNFV middleware project.
SNAPS stands for "SDN/NFV Application development Platform and Stack".
* neutron
* nova
* quotas
+ * ceilometer
A basic SLA (stop test on errors) has been implemented.
cases. Test case 'rally_full' executes the full defined set of Rally tests.
- Refstack-client to run Defcore testcases
- -----------------------------------------
+ Refstack-client to run OpenStack interop testcases
+ --------------------------------------------------
Refstack-client `[8]`_ is a command line utility that allows you to
execute Tempest test runs based on configurations you specify.
- It is the official tool to run Defcore `[9]`_ testcases,
- which focuses on testing interoperability between OpenStack clouds.
+ It is the official tool to run Openstack Interop (previously known as Defcore)
+ testcases `[9]`_, which focus on testing interoperability between OpenStack
+ clouds.
Refstack-client is integrated in Functest, consumed by Dovetail, which
intends to define and provide a set of OPNFV related validation criteria
that will provide input for the evaluation of the use of OPNFV trademarks.
This progress is under the guideline of Compliance Verification Program(CVP).
- Defcore testcases
- ^^^^^^^^^^^^^^^^^^
-
- *Danube Release*
-
- Set of DefCore tempest test cases not flagged and required.
- According to `[10]`_, some tests are still flagged due to outstanding bugs
- in the Tempest library, particularly tests that require SSH. Refstack developers
- are working on correcting these bugs upstream. Please note that although some tests
- are flagged because of bugs, there is still an expectation that the capabilities
- covered by the tests are available. It only contains Openstack core compute
- (no object storage). The approved guidelines (2016.08) are valid for Kilo,
- Liberty, Mitaka and Newton releases of OpenStack.
- The list can be generated using the Rest API from RefStack project:
- https://refstack.openstack.org/api/v1/guidelines/2016.08/tests?target=compute&type=required&alias=true&flag=false
-
Running methods
^^^^^^^^^^^^^^^
This test case contains tests that setup and destroy environments with VMs with
and without Floating IPs with a newly created user and project. Set the config
- value snaps.use_floating_ips (True|False) to toggle this functionality. When
- the config value of snaps.use_keystone is True, Functest must have access
+ value snaps.use_floating_ips (True|False) to toggle this functionality.
+ Please note that When the configuration value of snaps.use_keystone is True, Functest must have access
the cloud's private network.
This suite consists in 38 tests (test duration < 10 minutes)
SDN Controllers
---------------
- There are currently 3 available controllers:
-
- * OpenDaylight (ODL)
- * ONOS
- * OpenContrail (OCL)
-
OpenDaylight
^^^^^^^^^^^^
+-----------------+---------+----------+--------+-----------+
| fds | | | X | X |
+-----------------+---------+----------+--------+-----------+
- | moon | | X | | X |
+ | moon | | X | | |
+-----------------+---------+----------+--------+-----------+
| multisite | | X | X | |
+-----------------+---------+----------+--------+-----------+
+-----------------+---------+----------+--------+-----------+
| orchestra | | | X | X |
+-----------------+---------+----------+--------+-----------+
- | parser | | | X | |
+ | parser | | | X | X |
+-----------------+---------+----------+--------+-----------+
| promise | X | X | X | X |
+-----------------+---------+----------+--------+-----------+
:align: center
:alt: vIMS architecture
+ cloudify_ims_perf
+ ^^^^^^^^^^^^
+ This testcase extends the cloudify_ims test case.
+ The first part is similar but the testing part is different.
+ The testing part consists in automating a realistic signaling load on the vIMS
+ using an Ixia loader (proprietary tools)
+ - You need to have access to an Ixia licence server
+ defined in the configuration file.
+
+ To start this test you need to have access to an Ixia licence server and have ixia image locally
+ -
+ case_name: cloudify_ims_perf
+ project_name: functest
+ criteria: 100
+ blocking: false
+ description: ''
+ dependencies:
+ installer: ''
+ scenario: 'o'
+ run:
+ module: 'functest.opnfv_tests.vnf.ims.cloudify_ims_perf'
+ class: 'CloudifyImsPerf'
+
orchestra_openims
^^^^^^^^^^^^^^^^^
Orchestra test case deals with the deployment of OpenIMS with OpenBaton
parser
^^^^^^
- See parser user guide for details: `[12]`_
+ See parser user guide for details.
vyos-vrouter
The vyos-vrouter architecture is described in `[14]`_
+ cloudify_ims_perf
+ ^^^^^^^^^^^^^^^^^
+
+ This test case is available but not declared in testcases.yaml. If you want to
+ run it you need to get the Ixia loader images and have access to an Ixia license
+ server.
+
+ The declaration of the testcase is simple, connect to your functest-vnf docker,
+ add the following section in /usr/lib/python2.7/site-packacges/functest/ci/testcases.yaml::
+
+ case_name: cloudify_ims_perf
+ project_name: functest
+ criteria: 80
+ blocking: false
+ description: >-
+ Stress tests based on Cloudify. Ixia loader images and access to Ixia
+ server license.
+ dependencies:
+ installer: ''
+ scenario: 'os-nosdn-nofeature-ha'
+ run:
+ module: 'functest.opnfv_tests.vnf.ims.cloudify_ims_perf'
+ class: 'CloudifyImsPerf'
+
+
.. _`[2]`: http://docs.openstack.org/developer/tempest/overview.html
.. _`[3]`: https://rally.readthedocs.org/en/latest/index.html
.. _`[5]`: https://github.com/Orange-OpenSource/opnfv-cloudify-clearwater/blob/master/openstack-blueprint.yaml
.. _`[8]`: https://github.com/openstack/refstack-client
.. _`[10]`: https://github.com/openstack/interop/blob/master/2016.08/procedure.rst
.. _`[11]`: http://robotframework.org/
- .. _`[12]`: http://artifacts.opnfv.org/parser/colorado/docs/userguide/index.html
+ .. _`[12]`: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/userguide/index.html
.. _`[13]`: https://wiki.opnfv.org/display/PROJ/SNAPS-OO
.. _`[14]`: https://github.com/oolorg/opnfv-functest-vrouter
.. _`[15]`: https://aptira.com/testing-openstack-tempest-part-1/
Code Review / functest-xtesting.git / commitdiff