The internal test cases are:
* connection_check
- * api_check
- * snaps_health_check
+ * tenantnetwork1
+ * tenantnetwork2
+ * vmready1
+ * vmready2
+ * singlevm1
+ * singlevm2
* vping_ssh
* vping_userdata
- * tempest_smoke_serial
+ * cinder_test
+ * tempest_smoke
+ * tempest_horizon
+ * odl
+ * tempest_neutron
+ * tempest_cinder
+ * tempest_keystone
+ * tempest_heat
+ * tempest_telemetry
* rally_sanity
- * refstack_defcore
+ * refstack_compute
+ * refstack_object
+ * refstack_platform
+ * tempest_full
+ * tempest_scenario
+ * tempest_slow
* patrole
- * odl
- * snaps_smoke
- * neutron_trunk
- * tempest_full_parallel
+ * barbican
+ * octavia
* rally_full
+ * rally_jobs
+ * vmtp
+ * shaker
+ * cloudify
* cloudify_ims
+ * heat_ims
* vyos_vrouter
* juju_epc
-The OPNFV projects integrated into Functest framework for automation are:
-
- * doctor
- * bgpvpn
- * odl-sfc
- * barometer
- * fds
- * parser
-
Kubernetes
----------
The internal test cases are:
* k8s_smoke
+ * xrally_kubernetes
* k8s_conformance
-The OPNFV projects integrated into Functest framework for automation are:
-
- * stor4nfv
- * clover
-
Release Data
============
* https://hub.docker.com/r/opnfv/functest-healthcheck
* https://hub.docker.com/r/opnfv/functest-smoke
- * https://hub.docker.com/r/opnfv/functest-features
- * https://hub.docker.com/r/opnfv/functest-components
+ * https://hub.docker.com/r/opnfv/functest-benchmarking
* https://hub.docker.com/r/opnfv/functest-vnf
- * https://hub.docker.com/r/opnfv/functest-parser
+ * https://hub.docker.com/r/opnfv/functest-smoke-cntt
+ * https://hub.docker.com/r/opnfv/functest-benchmarking-cntt
Functest Docker images (Kubernetes):
* https://hub.docker.com/r/opnfv/functest-kubernetes-healthcheck
* https://hub.docker.com/r/opnfv/functest-kubernetes-smoke
- * https://hub.docker.com/r/opnfv/functest-kubernetes-features
Docker tag for master: latest
Documents
---------
- * Config Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/configguide/index.html
- * User Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/userguide/index.html
- * Developer Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/developer/devguide/index.html
- * API Docs: http://functest.readthedocs.io/en/latest/
+ * Functest Guides: https://functest.readthedocs.io/en/latest/
+ * API Docs: https://functest-api.readthedocs.io/en/latest/
Version change
==============
-New test cases
---------------
-
- * neutron_trunk
- * patrole
- * juju_epc
- * k8s_smoke
- * k8s_conformance
- * stor4nfv
- * clover
-
Key changes
-----------
- * update test cases and containers to `OpenStack Pike`_
- * move the framework into a separate project: Xtesting_
- * ease running all containers thanks to default values
- * clean interfaces with OPNFV Installers and Features
- * rewrite all vnfs to allow multiple tests in parallel
- * fully support non-default region names and Keystone v3 domains
- * refactor all tempest-based test cases (e.g. refstack_defcore)
- * remove obsolete OpenStack and Functest utils
- * verify all changes via doc8 and yamllint too
- * generate reports for all tempest-based test cases
+ * update testcases and containers to `OpenStack master`_ and to
+ `Kubernetes master`_
-.. _`OpenStack Pike`: https://raw.githubusercontent.com/openstack/requirements/stable/pike/upper-constraints.txt
-.. _Xtesting: http://xtesting.readthedocs.io/en/latest/
+.. _`OpenStack master`: https://github.com/openstack/requirements/blob/master/upper-constraints.txt
+.. _`Kubernetes master`: https://github.com/kubernetes/kubernetes
Key benefits
------------
- * the enduser can run all tests by setting only one input (EXTERNAL_NETWORK)
- * the developer can only work on the test suites without diving into CI/CD
- integration
- * both OpenStack and Kubernetes deployments can be verified
- * Functest test cases are trustable as they meet the best coding rules (unit
- tests, coverage, linters, etc.)
- * Functest can be reused in other projects (e.g.
- `ONS: Re-using OPNFV framework tests for LFN projects`_)
+ * the enduser can easily deploy its own `Functest toolchains`_ in few commands
+ * everyone can pick stable Functest rolling releases (latest included)
+ * Functest can verify VIM in production even on `Raspberry PI`_
+ * all testcases can run in parallel (tested with 4 executors in our gates)
+ * no remaining resources detected in our gates after multiple runs
-.. _`ONS: Re-using OPNFV framework tests for LFN projects`: https://wiki.lfnetworking.org/display/LN/LFN+Developer+Forum+Schedule?preview=/328197/328329/ONS-OPNFV%20framework%20tests%20for%20LFN%20projects.pdf
+.. _`Functest toolchains`: https://wiki.opnfv.org/pages/viewpage.action?pageId=32015004
+.. _`Raspberry PI`: https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI
Code quality
------------
- * pylint: ~9.5/10
- * code coverage: ~70%
+ * pylint: 10.00/10
+ * code coverage: 70%
Useful links
============
- * wiki project page: https://wiki.opnfv.org/opnfv_functional_testing
- * Functest git repository: https://git.opnfv.org/cgit/functest
+ * wiki project page: https://wiki.opnfv.org/display/functest/Opnfv+Functional+Testing
+ * Functest git repository: https://github.com/opnfv/functest
* Functest CI dashboard: https://build.opnfv.org/ci/view/functest/
* JIRA dashboard: https://jira.opnfv.org/secure/Dashboard.jspa?selectPageId=10611
* Functest IRC channel: #opnfv-functest
Code Review / functest.git / blobdiff