docs/release/release-notes/functest-release.rst

   1 .. SPDX-License-Identifier: CC-BY-4.0
   2
   3 ======================================
   4 OPNFV master release note for Functest
   5 ======================================
   6
   7 Abstract
   8 ========
   9
  10 This document contains the release notes of the Functest project.
  11
  12 OPNFV master Release
  13 ====================
  14
  15 Functest deals with functional testing of the OPNFV solution.
  16 It includes test cases developed within the project, test cases developed in
  17 other OPNFV projects and it also integrates test cases from other upstream
  18 communities.
  19
  20 OpenStack
  21 ---------
  22
  23 The internal test cases are:
  24
  25  * connection_check
  26  * tenantnetwork1
  27  * tenantnetwork2
  28  * vmready1
  29  * vmready2
  30  * singlevm1
  31  * singlevm2
  32  * vping_ssh
  33  * vping_userdata
  34  * cinder_test
  35  * tempest_smoke
  36  * tempest_horizon
  37  * odl
  38  * tempest_neutron
  39  * tempest_cinder
  40  * tempest_keystone
  41  * tempest_heat
  42  * tempest_telemetry
  43  * rally_sanity
  44  * refstack_compute
  45  * refstack_object
  46  * refstack_platform
  47  * tempest_full
  48  * tempest_scenario
  49  * tempest_slow
  50  * patrole
  51  * barbican
  52  * octavia
  53  * rally_full
  54  * rally_jobs
  55  * vmtp
  56  * shaker
  57  * cloudify
  58  * cloudify_ims
  59  * heat_ims
  60  * vyos_vrouter
  61  * juju_epc
  62
  63 Kubernetes
  64 ----------
  65
  66 The internal test cases are:
  67
  68  * k8s_smoke
  69  * xrally_kubernetes
  70  * k8s_conformance
  71
  72 Release Data
  73 ============
  74
  75 +--------------------------------------+--------------------------------------+
  76 | **Project**                          | functest                             |
  77 +--------------------------------------+--------------------------------------+
  78 | **Repository branch**                | master                               |
  79 +--------------------------------------+--------------------------------------+
  80
  81 Deliverables
  82 ============
  83
  84 Software
  85 --------
  86
  87  Functest Docker images (OpenStack):
  88
  89  * https://hub.docker.com/r/opnfv/functest-healthcheck
  90  * https://hub.docker.com/r/opnfv/functest-smoke
  91  * https://hub.docker.com/r/opnfv/functest-benchmarking
  92  * https://hub.docker.com/r/opnfv/functest-vnf
  93  * https://hub.docker.com/r/opnfv/functest-smoke-cntt
  94  * https://hub.docker.com/r/opnfv/functest-benchmarking-cntt
  95
  96  Functest Docker images (Kubernetes):
  97
  98  * https://hub.docker.com/r/opnfv/functest-kubernetes-healthcheck
  99  * https://hub.docker.com/r/opnfv/functest-kubernetes-smoke
 100
 101 Docker tag for master: latest
 102
 103 Documents
 104 ---------
 105
 106  * Functest Guides: https://functest.readthedocs.io/en/latest/
 107  * API Docs: https://functest-api.readthedocs.io/en/latest/
 108
 109 Version change
 110 ==============
 111
 112 Key changes
 113 -----------
 114
 115  * update testcases and containers to `OpenStack master`_ and to
 116    `Kubernetes master`_
 117
 118 .. _`OpenStack master`: https://github.com/openstack/requirements/blob/master/upper-constraints.txt
 119 .. _`Kubernetes master`: https://github.com/kubernetes/kubernetes
 120
 121 Key benefits
 122 ------------
 123
 124  * the enduser can easily deploy its own `Functest toolchains`_ in few commands
 125  * everyone can pick stable Functest rolling releases (latest included)
 126  * Functest can verify VIM in production even on `Raspberry PI`_
 127  * all testcases can run in parallel (tested with 4 executors in our gates)
 128  * no remaining resources detected in our gates after multiple runs
 129
 130 .. _`Functest toolchains`: https://wiki.opnfv.org/pages/viewpage.action?pageId=32015004
 131 .. _`Raspberry PI`: https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI
 132
 133 Code quality
 134 ------------
 135
 136  * pylint: 10.00/10
 137  * code coverage: 70%
 138
 139 Useful links
 140 ============
 141
 142  * wiki project page: https://wiki.opnfv.org/display/functest/Opnfv+Functional+Testing
 143  * Functest git repository: https://github.com/opnfv/functest
 144  * Functest CI dashboard: https://build.opnfv.org/ci/view/functest/
 145  * JIRA dashboard: https://jira.opnfv.org/secure/Dashboard.jspa?selectPageId=10611
 146  * Functest IRC channel: #opnfv-functest
 147  * Reporting page: http://testresults.opnfv.org/reporting/master/functest/functest.html