Code Review / functest.git / commitdiff
? search:
summary | shortlog | log | commit | commitdiff | review | tree
raw | patch | inline | side by side (parent: 75dd21c)
Update all results in docs 48/71248/2
authorCédric Ollivier <cedric.ollivier@orange.com>
Sat, 10 Oct 2020 10:38:16 +0000 (12:38 +0200)
committerCédric Ollivier <cedric.ollivier@orange.com>
Sat, 10 Oct 2020 11:28:11 +0000 (13:28 +0200)
It also updates the release notes.

Change-Id: I7413c45c7bf5a85070970f159fb770284e772a6c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
docs/release/release-notes/functest-release.rst patch | blob | history
docs/spelling_wordlist.txt patch | blob | history
docs/testing/user/configguide/configguide.rst patch | blob | history
docs/testing/user/userguide/test_results.rst patch | blob | history

diff --git a/docs/release/release-notes/functest-release.rst b/docs/release/release-notes/functest-release.rst
index 00951b9..ab26348 100644 (file)
--- a/docs/release/release-notes/functest-release.rst
+++ b/docs/release/release-notes/functest-release.rst
@@ -1,7 +1,7 @@
 .. SPDX-License-Identifier: CC-BY-4.0
 
 ======================================
-OPNFV master release note for Functest
+OPNFV Leguer release note for Functest
 ======================================
 
 Abstract
@@ -86,7 +86,7 @@ Release Data
 +--------------------------------------+--------------------------------------+
 | **Project**                          | functest                             |
 +--------------------------------------+--------------------------------------+
-| **Repository branch**                | master                               |
+| **Repository branch**                | stable/leguer                        |
 +--------------------------------------+--------------------------------------+
 
 Deliverables
@@ -112,7 +112,7 @@ Software
  * https://hub.docker.com/r/opnfv/functest-kubernetes-benchmarking
  * https://hub.docker.com/r/opnfv/functest-kubernetes-cnf
 
-Docker tag for master: latest
+Docker tag for Leguer: leguer
 
 Documents
 ---------
diff --git a/docs/spelling_wordlist.txt b/docs/spelling_wordlist.txt
index f4dcea5..62bad2f 100644 (file)
--- a/docs/spelling_wordlist.txt
+++ b/docs/spelling_wordlist.txt
@@ -57,6 +57,8 @@ kube
 kubernetes
 Kubernetes
 kvm
+leguer
+Leguer
 linux
 login
 metadata
diff --git a/docs/testing/user/configguide/configguide.rst b/docs/testing/user/configguide/configguide.rst
index 9b75657..0f60d40 100644 (file)
--- a/docs/testing/user/configguide/configguide.rst
+++ b/docs/testing/user/configguide/configguide.rst
@@ -72,25 +72,25 @@ Run healthcheck suite::
   sudo docker run --env-file env \
       -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \
       -v $(pwd)/images:/home/opnfv/functest/images \
-      opnfv/functest-healthcheck
+      opnfv/functest-healthcheck:leguer
 
 Results shall be displayed as follows::
 
   +--------------------------+------------------+---------------------+------------------+----------------+
   |        TEST CASE         |     PROJECT      |         TIER        |     DURATION     |     RESULT     |
   +--------------------------+------------------+---------------------+------------------+----------------+
-  |     connection_check     |     functest     |     healthcheck     |      00:03       |      PASS      |
-  |      tenantnetwork1      |     functest     |     healthcheck     |      00:05       |      PASS      |
+  |     connection_check     |     functest     |     healthcheck     |      00:02       |      PASS      |
+  |      tenantnetwork1      |     functest     |     healthcheck     |      00:04       |      PASS      |
   |      tenantnetwork2      |     functest     |     healthcheck     |      00:06       |      PASS      |
-  |         vmready1         |     functest     |     healthcheck     |      00:06       |      PASS      |
-  |         vmready2         |     functest     |     healthcheck     |      00:08       |      PASS      |
-  |        singlevm1         |     functest     |     healthcheck     |      00:32       |      PASS      |
-  |        singlevm2         |     functest     |     healthcheck     |      00:37       |      PASS      |
-  |        vping_ssh         |     functest     |     healthcheck     |      00:46       |      PASS      |
-  |      vping_userdata      |     functest     |     healthcheck     |      00:39       |      PASS      |
-  |       cinder_test        |     functest     |     healthcheck     |      01:05       |      PASS      |
-  |      tempest_smoke       |     functest     |     healthcheck     |      05:39       |      PASS      |
-  |     tempest_horizon      |     functest     |     healthcheck     |      01:05       |      PASS      |
+  |         vmready1         |     functest     |     healthcheck     |      00:05       |      PASS      |
+  |         vmready2         |     functest     |     healthcheck     |      00:06       |      PASS      |
+  |        singlevm1         |     functest     |     healthcheck     |      00:31       |      PASS      |
+  |        singlevm2         |     functest     |     healthcheck     |      00:35       |      PASS      |
+  |        vping_ssh         |     functest     |     healthcheck     |      00:47       |      PASS      |
+  |      vping_userdata      |     functest     |     healthcheck     |      00:42       |      PASS      |
+  |       cinder_test        |     functest     |     healthcheck     |      01:09       |      PASS      |
+  |      tempest_smoke       |     functest     |     healthcheck     |      04:50       |      PASS      |
+  |     tempest_horizon      |     functest     |     healthcheck     |      01:00       |      PASS      |
   |           odl            |     functest     |     healthcheck     |      00:00       |      SKIP      |
   +--------------------------+------------------+---------------------+------------------+----------------+
 
@@ -104,28 +104,31 @@ Run smoke suite::
   sudo docker run --env-file env \
       -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \
       -v $(pwd)/images:/home/opnfv/functest/images \
-      opnfv/functest-smoke
+      opnfv/functest-smoke:leguer
 
 Results shall be displayed as follows::
 
   +---------------------------+------------------+---------------+------------------+----------------+
   |         TEST CASE         |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
   +---------------------------+------------------+---------------+------------------+----------------+
-  |      tempest_neutron      |     functest     |     smoke     |      15:30       |      PASS      |
-  |       tempest_cinder      |     functest     |     smoke     |      02:01       |      PASS      |
-  |      tempest_keystone     |     functest     |     smoke     |      01:17       |      PASS      |
-  |        tempest_heat       |     functest     |     smoke     |      22:14       |      PASS      |
-  |     tempest_telemetry     |     functest     |     smoke     |      00:00       |      SKIP      |
-  |        rally_sanity       |     functest     |     smoke     |      17:24       |      PASS      |
-  |      refstack_compute     |     functest     |     smoke     |      07:03       |      PASS      |
-  |      refstack_object      |     functest     |     smoke     |      02:09       |      PASS      |
-  |     refstack_platform     |     functest     |     smoke     |      07:31       |      PASS      |
-  |        tempest_full       |     functest     |     smoke     |      41:52       |      PASS      |
-  |      tempest_scenario     |     functest     |     smoke     |      08:42       |      PASS      |
-  |        tempest_slow       |     functest     |     smoke     |      43:42       |      PASS      |
-  |          patrole          |     functest     |     smoke     |      02:42       |      PASS      |
-  |      tempest_barbican     |     functest     |     smoke     |      02:30       |      PASS      |
+  |      tempest_neutron      |     functest     |     smoke     |      11:58       |      PASS      |
+  |       tempest_cinder      |     functest     |     smoke     |      02:13       |      PASS      |
+  |      tempest_keystone     |     functest     |     smoke     |      01:18       |      PASS      |
+  |        tempest_heat       |     functest     |     smoke     |      23:24       |      PASS      |
+  |     tempest_telemetry     |     functest     |     smoke     |      01:54       |      PASS      |
+  |        rally_sanity       |     functest     |     smoke     |      20:29       |      PASS      |
+  |      refstack_compute     |     functest     |     smoke     |      05:16       |      PASS      |
+  |      refstack_object      |     functest     |     smoke     |      01:59       |      PASS      |
+  |     refstack_platform     |     functest     |     smoke     |      06:42       |      PASS      |
+  |        tempest_full       |     functest     |     smoke     |      31:30       |      PASS      |
+  |      tempest_scenario     |     functest     |     smoke     |      09:57       |      PASS      |
+  |        tempest_slow       |     functest     |     smoke     |      57:15       |      PASS      |
+  |       patrole_admin       |     functest     |     smoke     |      22:15       |      PASS      |
+  |       patrole_member      |     functest     |     smoke     |      23:58       |      PASS      |
+  |       patrole_reader      |     functest     |     smoke     |      22:15       |      PASS      |
+  |      tempest_barbican     |     functest     |     smoke     |      03:37       |      PASS      |
   |      tempest_octavia      |     functest     |     smoke     |      00:00       |      SKIP      |
+  |       tempest_cyborg      |     functest     |     smoke     |      00:00       |      SKIP      |
   +---------------------------+------------------+---------------+------------------+----------------+
 
 Note: if the scenario does not support some tests, they are indicated as SKIP.
@@ -139,21 +142,21 @@ Run smoke-cntt suite::
   sudo docker run --env-file env \
       -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \
       -v $(pwd)/images:/home/opnfv/functest/images \
-      opnfv/functest-smoke-cntt
+      opnfv/functest-smoke-cntt:leguer
 
 Results shall be displayed as follows::
 
   +-------------------------------+------------------+---------------+------------------+----------------+
   |           TEST CASE           |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
   +-------------------------------+------------------+---------------+------------------+----------------+
-  |      tempest_neutron_cntt     |     functest     |     smoke     |      11:35       |      PASS      |
-  |      tempest_cinder_cntt      |     functest     |     smoke     |      01:58       |      PASS      |
-  |     tempest_keystone_cntt     |     functest     |     smoke     |      01:13       |      PASS      |
-  |       tempest_heat_cntt       |     functest     |     smoke     |      22:32       |      PASS      |
-  |       rally_sanity_cntt       |     functest     |     smoke     |      17:16       |      PASS      |
-  |       tempest_full_cntt       |     functest     |     smoke     |      41:13       |      PASS      |
-  |     tempest_scenario_cntt     |     functest     |     smoke     |      08:57       |      PASS      |
-  |       tempest_slow_cntt       |     functest     |     smoke     |      35:58       |      PASS      |
+  |      tempest_neutron_cntt     |     functest     |     smoke     |      10:03       |      PASS      |
+  |      tempest_cinder_cntt      |     functest     |     smoke     |      02:10       |      PASS      |
+  |     tempest_keystone_cntt     |     functest     |     smoke     |      01:17       |      PASS      |
+  |       tempest_heat_cntt       |     functest     |     smoke     |      22:44       |      PASS      |
+  |       rally_sanity_cntt       |     functest     |     smoke     |      17:37       |      PASS      |
+  |       tempest_full_cntt       |     functest     |     smoke     |      29:48       |      PASS      |
+  |     tempest_scenario_cntt     |     functest     |     smoke     |      09:59       |      PASS      |
+  |       tempest_slow_cntt       |     functest     |     smoke     |      41:57       |      PASS      |
   +-------------------------------+------------------+---------------+------------------+----------------+
 
 Testing benchmarking suite
@@ -164,17 +167,17 @@ Run benchmarking suite::
   sudo docker run --env-file env \
       -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \
       -v $(pwd)/images:/home/opnfv/functest/images \
-      opnfv/functest-benchmarking
+      opnfv/functest-benchmarking:leguer
 
 Results shall be displayed as follows::
 
   +--------------------+------------------+----------------------+------------------+----------------+
   |     TEST CASE      |     PROJECT      |         TIER         |     DURATION     |     RESULT     |
   +--------------------+------------------+----------------------+------------------+----------------+
-  |     rally_full     |     functest     |     benchmarking     |      93:03       |      PASS      |
-  |     rally_jobs     |     functest     |     benchmarking     |      27:05       |      PASS      |
-  |        vmtp        |     functest     |     benchmarking     |      17:56       |      PASS      |
-  |       shaker       |     functest     |     benchmarking     |      24:02       |      PASS      |
+  |     rally_full     |     functest     |     benchmarking     |      104:28      |      PASS      |
+  |     rally_jobs     |     functest     |     benchmarking     |      30:00       |      PASS      |
+  |        vmtp        |     functest     |     benchmarking     |      23:43       |      PASS      |
+  |       shaker       |     functest     |     benchmarking     |      28:49       |      PASS      |
   +--------------------+------------------+----------------------+------------------+----------------+
 
 Note: if the scenario does not support some tests, they are indicated as SKIP.
@@ -188,17 +191,17 @@ Run benchmarking-cntt suite::
   sudo docker run --env-file env \
       -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \
       -v $(pwd)/images:/home/opnfv/functest/images \
-      opnfv/functest-benchmarking-cntt
+      opnfv/functest-benchmarking-cntt:leguer
 
 Results shall be displayed as follows::
 
   +-------------------------+------------------+----------------------+------------------+----------------+
   |        TEST CASE        |     PROJECT      |         TIER         |     DURATION     |     RESULT     |
   +-------------------------+------------------+----------------------+------------------+----------------+
-  |     rally_full_cntt     |     functest     |     benchmarking     |      89:52       |      PASS      |
-  |     rally_jobs_cntt     |     functest     |     benchmarking     |      19:39       |      PASS      |
-  |           vmtp          |     functest     |     benchmarking     |      16:59       |      PASS      |
-  |          shaker         |     functest     |     benchmarking     |      23:43       |      PASS      |
+  |     rally_full_cntt     |     functest     |     benchmarking     |      90:27       |      PASS      |
+  |     rally_jobs_cntt     |     functest     |     benchmarking     |      22:58       |      PASS      |
+  |           vmtp          |     functest     |     benchmarking     |      23:43       |      PASS      |
+  |          shaker         |     functest     |     benchmarking     |      28:49       |      PASS      |
   +-------------------------+------------------+----------------------+------------------+----------------+
 
 Testing vnf suite
@@ -209,18 +212,18 @@ Run vnf suite::
   sudo docker run --env-file env \
       -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \
       -v $(pwd)/images:/home/opnfv/functest/images \
-      opnfv/functest-vnf
+      opnfv/functest-vnf:leguer
 
 Results shall be displayed as follows::
 
   +----------------------+------------------+--------------+------------------+----------------+
   |      TEST CASE       |     PROJECT      |     TIER     |     DURATION     |     RESULT     |
   +----------------------+------------------+--------------+------------------+----------------+
-  |       cloudify       |     functest     |     vnf      |      05:08       |      PASS      |
-  |     cloudify_ims     |     functest     |     vnf      |      24:46       |      PASS      |
-  |       heat_ims       |     functest     |     vnf      |      33:12       |      PASS      |
-  |     vyos_vrouter     |     functest     |     vnf      |      15:53       |      PASS      |
-  |       juju_epc       |     functest     |     vnf      |      27:52       |      PASS      |
+  |       cloudify       |     functest     |     vnf      |      04:23       |      PASS      |
+  |     cloudify_ims     |     functest     |     vnf      |      24:42       |      PASS      |
+  |       heat_ims       |     functest     |     vnf      |      30:33       |      PASS      |
+  |     vyos_vrouter     |     functest     |     vnf      |      17:31       |      PASS      |
+  |       juju_epc       |     functest     |     vnf      |      37:21       |      PASS      |
   +----------------------+------------------+--------------+------------------+----------------+
 
 Functest Dockers for Kubernetes deployment
@@ -247,7 +250,7 @@ Run healthcheck suite::
 
   sudo docker run -it --env-file env \
       -v $(pwd)/config:/root/.kube/config \
-      opnfv/functest-kubernetes-healthcheck
+      opnfv/functest-kubernetes-healthcheck:leguer
 
 A config file in the current dir 'config' is also required, which should be
 volume mapped to ~/.kube/config inside kubernetes container.
@@ -257,8 +260,8 @@ Results shall be displayed as follows::
   +-------------------+------------------+---------------------+------------------+----------------+
   |     TEST CASE     |     PROJECT      |         TIER        |     DURATION     |     RESULT     |
   +-------------------+------------------+---------------------+------------------+----------------+
-  |     k8s_quick     |     functest     |     healthcheck     |      00:18       |      PASS      |
-  |     k8s_smoke     |     functest     |     healthcheck     |      01:14       |      PASS      |
+  |     k8s_quick     |     functest     |     healthcheck     |      00:13       |      PASS      |
+  |     k8s_smoke     |     functest     |     healthcheck     |      00:26       |      PASS      |
   +-------------------+------------------+---------------------+------------------+----------------+
 
 Testing smoke suite
@@ -268,15 +271,15 @@ Run smoke suite::
 
   sudo docker run -it --env-file env \
       -v $(pwd)/config:/root/.kube/config \
-      opnfv/functest-kubernetes-smoke
+      opnfv/functest-kubernetes-smoke:leguer
 
 Results shall be displayed as follows::
 
   +---------------------------+------------------+---------------+------------------+----------------+
   |         TEST CASE         |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
   +---------------------------+------------------+---------------+------------------+----------------+
-  |      k8s_conformance      |     functest     |     smoke     |      94:26       |      PASS      |
-  |     xrally_kubernetes     |     functest     |     smoke     |      13:05       |      PASS      |
+  |      k8s_conformance      |     functest     |     smoke     |      103:05      |      PASS      |
+  |     xrally_kubernetes     |     functest     |     smoke     |      14:17       |      PASS      |
   +---------------------------+------------------+---------------+------------------+----------------+
 
 Testing security suite
@@ -286,16 +289,16 @@ Run smoke suite::
 
   sudo docker run -it --env-file env \
       -v $(pwd)/config:/root/.kube/config \
-      opnfv/functest-kubernetes-security
+      opnfv/functest-kubernetes-security:leguer
 
 Results shall be displayed as follows::
 
   +---------------------------+------------------+------------------+------------------+----------------+
   |         TEST CASE         |     PROJECT      |       TIER       |     DURATION     |     RESULT     |
   +---------------------------+------------------+------------------+------------------+----------------+
-  |        kube_hunter        |     functest     |     security     |      00:19       |      PASS      |
-  |     kube_bench_master     |     functest     |     security     |      00:02       |      PASS      |
-  |      kube_bench_node      |     functest     |     security     |      00:01       |      PASS      |
+  |        kube_hunter        |     functest     |     security     |      00:18       |      PASS      |
+  |     kube_bench_master     |     functest     |     security     |      00:07       |      PASS      |
+  |      kube_bench_node      |     functest     |     security     |      00:06       |      PASS      |
   +---------------------------+------------------+------------------+------------------+----------------+
 
 Testing benchmarking suite
@@ -305,14 +308,14 @@ Run benchmarking suite::
 
   sudo docker run -it --env-file env \
       -v $(pwd)/config:/root/.kube/config \
-      opnfv/functest-kubernetes-benchmarking
+      opnfv/functest-kubernetes-benchmarking:leguer
 
 Results shall be displayed as follows::
 
   +--------------------------------+------------------+----------------------+------------------+----------------+
   |           TEST CASE            |     PROJECT      |         TIER         |     DURATION     |     RESULT     |
   +--------------------------------+------------------+----------------------+------------------+----------------+
-  |     xrally_kubernetes_full     |     functest     |     benchmarking     |      34:16       |      PASS      |
+  |     xrally_kubernetes_full     |     functest     |     benchmarking     |      39:15       |      PASS      |
   +--------------------------------+------------------+----------------------+------------------+----------------+
 
 Testing cnf suite
@@ -322,16 +325,16 @@ Run cnf suite::
 
   sudo docker run -it --env-file env \
       -v $(pwd)/config:/root/.kube/config \
-      opnfv/functest-kubernetes-cnf
+      opnfv/functest-kubernetes-cnf:leguer
 
 Results shall be displayed as follows::
 
   +-------------------------+------------------+--------------+------------------+----------------+
   |        TEST CASE        |     PROJECT      |     TIER     |     DURATION     |     RESULT     |
   +-------------------------+------------------+--------------+------------------+----------------+
-  |         k8s_vims        |     functest     |     cnf      |      09:06       |      PASS      |
-  |        helm_vims        |     functest     |     cnf      |      08:54       |      PASS      |
-  |     cnf_conformance     |     functest     |     cnf      |      02:00       |      PASS      |
+  |         k8s_vims        |     functest     |     cnf      |      09:27       |      PASS      |
+  |        helm_vims        |     functest     |     cnf      |      09:12       |      PASS      |
+  |     cnf_conformance     |     functest     |     cnf      |      02:55       |      PASS      |
   +-------------------------+------------------+--------------+------------------+----------------+
 
 Environment variables
diff --git a/docs/testing/user/userguide/test_results.rst b/docs/testing/user/userguide/test_results.rst
index 2ac86f2..7e13ef2 100644 (file)
--- a/docs/testing/user/userguide/test_results.rst
+++ b/docs/testing/user/userguide/test_results.rst
@@ -24,18 +24,18 @@ Healthcheck suite::
   +--------------------------+------------------+---------------------+------------------+----------------+
   |        TEST CASE         |     PROJECT      |         TIER        |     DURATION     |     RESULT     |
   +--------------------------+------------------+---------------------+------------------+----------------+
-  |     connection_check     |     functest     |     healthcheck     |      00:03       |      PASS      |
-  |      tenantnetwork1      |     functest     |     healthcheck     |      00:05       |      PASS      |
+  |     connection_check     |     functest     |     healthcheck     |      00:02       |      PASS      |
+  |      tenantnetwork1      |     functest     |     healthcheck     |      00:04       |      PASS      |
   |      tenantnetwork2      |     functest     |     healthcheck     |      00:06       |      PASS      |
-  |         vmready1         |     functest     |     healthcheck     |      00:06       |      PASS      |
-  |         vmready2         |     functest     |     healthcheck     |      00:08       |      PASS      |
-  |        singlevm1         |     functest     |     healthcheck     |      00:32       |      PASS      |
-  |        singlevm2         |     functest     |     healthcheck     |      00:37       |      PASS      |
-  |        vping_ssh         |     functest     |     healthcheck     |      00:46       |      PASS      |
-  |      vping_userdata      |     functest     |     healthcheck     |      00:39       |      PASS      |
-  |       cinder_test        |     functest     |     healthcheck     |      01:05       |      PASS      |
-  |      tempest_smoke       |     functest     |     healthcheck     |      05:39       |      PASS      |
-  |     tempest_horizon      |     functest     |     healthcheck     |      01:05       |      PASS      |
+  |         vmready1         |     functest     |     healthcheck     |      00:05       |      PASS      |
+  |         vmready2         |     functest     |     healthcheck     |      00:06       |      PASS      |
+  |        singlevm1         |     functest     |     healthcheck     |      00:31       |      PASS      |
+  |        singlevm2         |     functest     |     healthcheck     |      00:35       |      PASS      |
+  |        vping_ssh         |     functest     |     healthcheck     |      00:47       |      PASS      |
+  |      vping_userdata      |     functest     |     healthcheck     |      00:42       |      PASS      |
+  |       cinder_test        |     functest     |     healthcheck     |      01:09       |      PASS      |
+  |      tempest_smoke       |     functest     |     healthcheck     |      04:50       |      PASS      |
+  |     tempest_horizon      |     functest     |     healthcheck     |      01:00       |      PASS      |
   |           odl            |     functest     |     healthcheck     |      00:00       |      SKIP      |
   +--------------------------+------------------+---------------------+------------------+----------------+
 
@@ -44,21 +44,24 @@ Smoke suite::
   +---------------------------+------------------+---------------+------------------+----------------+
   |         TEST CASE         |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
   +---------------------------+------------------+---------------+------------------+----------------+
-  |      tempest_neutron      |     functest     |     smoke     |      15:30       |      PASS      |
-  |       tempest_cinder      |     functest     |     smoke     |      02:01       |      PASS      |
-  |      tempest_keystone     |     functest     |     smoke     |      01:17       |      PASS      |
-  |        tempest_heat       |     functest     |     smoke     |      22:14       |      PASS      |
-  |     tempest_telemetry     |     functest     |     smoke     |      00:00       |      SKIP      |
-  |        rally_sanity       |     functest     |     smoke     |      17:24       |      PASS      |
-  |      refstack_compute     |     functest     |     smoke     |      07:03       |      PASS      |
-  |      refstack_object      |     functest     |     smoke     |      02:09       |      PASS      |
-  |     refstack_platform     |     functest     |     smoke     |      07:31       |      PASS      |
-  |        tempest_full       |     functest     |     smoke     |      41:52       |      PASS      |
-  |      tempest_scenario     |     functest     |     smoke     |      08:42       |      PASS      |
-  |        tempest_slow       |     functest     |     smoke     |      43:42       |      PASS      |
-  |          patrole          |     functest     |     smoke     |      02:42       |      PASS      |
-  |      tempest_barbican     |     functest     |     smoke     |      02:30       |      PASS      |
+  |      tempest_neutron      |     functest     |     smoke     |      11:58       |      PASS      |
+  |       tempest_cinder      |     functest     |     smoke     |      02:13       |      PASS      |
+  |      tempest_keystone     |     functest     |     smoke     |      01:18       |      PASS      |
+  |        tempest_heat       |     functest     |     smoke     |      23:24       |      PASS      |
+  |     tempest_telemetry     |     functest     |     smoke     |      01:54       |      PASS      |
+  |        rally_sanity       |     functest     |     smoke     |      20:29       |      PASS      |
+  |      refstack_compute     |     functest     |     smoke     |      05:16       |      PASS      |
+  |      refstack_object      |     functest     |     smoke     |      01:59       |      PASS      |
+  |     refstack_platform     |     functest     |     smoke     |      06:42       |      PASS      |
+  |        tempest_full       |     functest     |     smoke     |      31:30       |      PASS      |
+  |      tempest_scenario     |     functest     |     smoke     |      09:57       |      PASS      |
+  |        tempest_slow       |     functest     |     smoke     |      57:15       |      PASS      |
+  |       patrole_admin       |     functest     |     smoke     |      22:15       |      PASS      |
+  |       patrole_member      |     functest     |     smoke     |      23:58       |      PASS      |
+  |       patrole_reader      |     functest     |     smoke     |      22:15       |      PASS      |
+  |      tempest_barbican     |     functest     |     smoke     |      03:37       |      PASS      |
   |      tempest_octavia      |     functest     |     smoke     |      00:00       |      SKIP      |
+  |       tempest_cyborg      |     functest     |     smoke     |      00:00       |      SKIP      |
   +---------------------------+------------------+---------------+------------------+----------------+
 
 Smoke CNTT suite::
@@ -66,14 +69,14 @@ Smoke CNTT suite::
   +-------------------------------+------------------+---------------+------------------+----------------+
   |           TEST CASE           |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
   +-------------------------------+------------------+---------------+------------------+----------------+
-  |      tempest_neutron_cntt     |     functest     |     smoke     |      11:35       |      PASS      |
-  |      tempest_cinder_cntt      |     functest     |     smoke     |      01:58       |      PASS      |
-  |     tempest_keystone_cntt     |     functest     |     smoke     |      01:13       |      PASS      |
-  |       tempest_heat_cntt       |     functest     |     smoke     |      22:32       |      PASS      |
-  |       rally_sanity_cntt       |     functest     |     smoke     |      17:16       |      PASS      |
-  |       tempest_full_cntt       |     functest     |     smoke     |      41:13       |      PASS      |
-  |     tempest_scenario_cntt     |     functest     |     smoke     |      08:57       |      PASS      |
-  |       tempest_slow_cntt       |     functest     |     smoke     |      35:58       |      PASS      |
+  |      tempest_neutron_cntt     |     functest     |     smoke     |      10:03       |      PASS      |
+  |      tempest_cinder_cntt      |     functest     |     smoke     |      02:10       |      PASS      |
+  |     tempest_keystone_cntt     |     functest     |     smoke     |      01:17       |      PASS      |
+  |       tempest_heat_cntt       |     functest     |     smoke     |      22:44       |      PASS      |
+  |       rally_sanity_cntt       |     functest     |     smoke     |      17:37       |      PASS      |
+  |       tempest_full_cntt       |     functest     |     smoke     |      29:48       |      PASS      |
+  |     tempest_scenario_cntt     |     functest     |     smoke     |      09:59       |      PASS      |
+  |       tempest_slow_cntt       |     functest     |     smoke     |      41:57       |      PASS      |
   +-------------------------------+------------------+---------------+------------------+----------------+
 
 Benchmarking suite::
@@ -81,10 +84,10 @@ Benchmarking suite::
   +--------------------+------------------+----------------------+------------------+----------------+
   |     TEST CASE      |     PROJECT      |         TIER         |     DURATION     |     RESULT     |
   +--------------------+------------------+----------------------+------------------+----------------+
-  |     rally_full     |     functest     |     benchmarking     |      93:03       |      PASS      |
-  |     rally_jobs     |     functest     |     benchmarking     |      27:05       |      PASS      |
-  |        vmtp        |     functest     |     benchmarking     |      17:56       |      PASS      |
-  |       shaker       |     functest     |     benchmarking     |      24:02       |      PASS      |
+  |     rally_full     |     functest     |     benchmarking     |      104:28      |      PASS      |
+  |     rally_jobs     |     functest     |     benchmarking     |      30:00       |      PASS      |
+  |        vmtp        |     functest     |     benchmarking     |      23:43       |      PASS      |
+  |       shaker       |     functest     |     benchmarking     |      28:49       |      PASS      |
   +--------------------+------------------+----------------------+------------------+----------------+
 
 Benchmarking CNTT suite::
@@ -92,10 +95,10 @@ Benchmarking CNTT suite::
   +-------------------------+------------------+----------------------+------------------+----------------+
   |        TEST CASE        |     PROJECT      |         TIER         |     DURATION     |     RESULT     |
   +-------------------------+------------------+----------------------+------------------+----------------+
-  |     rally_full_cntt     |     functest     |     benchmarking     |      89:52       |      PASS      |
-  |     rally_jobs_cntt     |     functest     |     benchmarking     |      19:39       |      PASS      |
-  |           vmtp          |     functest     |     benchmarking     |      16:59       |      PASS      |
-  |          shaker         |     functest     |     benchmarking     |      23:43       |      PASS      |
+  |     rally_full_cntt     |     functest     |     benchmarking     |      90:27       |      PASS      |
+  |     rally_jobs_cntt     |     functest     |     benchmarking     |      22:58       |      PASS      |
+  |           vmtp          |     functest     |     benchmarking     |      23:43       |      PASS      |
+  |          shaker         |     functest     |     benchmarking     |      28:49       |      PASS      |
   +-------------------------+------------------+----------------------+------------------+----------------+
 
 Vnf suite::
@@ -103,11 +106,11 @@ Vnf suite::
   +----------------------+------------------+--------------+------------------+----------------+
   |      TEST CASE       |     PROJECT      |     TIER     |     DURATION     |     RESULT     |
   +----------------------+------------------+--------------+------------------+----------------+
-  |       cloudify       |     functest     |     vnf      |      05:08       |      PASS      |
-  |     cloudify_ims     |     functest     |     vnf      |      24:46       |      PASS      |
-  |       heat_ims       |     functest     |     vnf      |      33:12       |      PASS      |
-  |     vyos_vrouter     |     functest     |     vnf      |      15:53       |      PASS      |
-  |       juju_epc       |     functest     |     vnf      |      27:52       |      PASS      |
+  |       cloudify       |     functest     |     vnf      |      04:23       |      PASS      |
+  |     cloudify_ims     |     functest     |     vnf      |      24:42       |      PASS      |
+  |       heat_ims       |     functest     |     vnf      |      30:33       |      PASS      |
+  |     vyos_vrouter     |     functest     |     vnf      |      17:31       |      PASS      |
+  |       juju_epc       |     functest     |     vnf      |      37:21       |      PASS      |
   +----------------------+------------------+--------------+------------------+----------------+
 
 Kubernetes healthcheck suite::
@@ -115,8 +118,8 @@ Kubernetes healthcheck suite::
   +-------------------+------------------+---------------------+------------------+----------------+
   |     TEST CASE     |     PROJECT      |         TIER        |     DURATION     |     RESULT     |
   +-------------------+------------------+---------------------+------------------+----------------+
-  |     k8s_quick     |     functest     |     healthcheck     |      00:18       |      PASS      |
-  |     k8s_smoke     |     functest     |     healthcheck     |      01:14       |      PASS      |
+  |     k8s_quick     |     functest     |     healthcheck     |      00:13       |      PASS      |
+  |     k8s_smoke     |     functest     |     healthcheck     |      00:26       |      PASS      |
   +-------------------+------------------+---------------------+------------------+----------------+
 
 Kubernetes smoke suite::
@@ -124,8 +127,8 @@ Kubernetes smoke suite::
   +---------------------------+------------------+---------------+------------------+----------------+
   |         TEST CASE         |     PROJECT      |      TIER     |     DURATION     |     RESULT     |
   +---------------------------+------------------+---------------+------------------+----------------+
-  |      k8s_conformance      |     functest     |     smoke     |      94:26       |      PASS      |
-  |     xrally_kubernetes     |     functest     |     smoke     |      13:05       |      PASS      |
+  |      k8s_conformance      |     functest     |     smoke     |      103:05      |      PASS      |
+  |     xrally_kubernetes     |     functest     |     smoke     |      14:17       |      PASS      |
   +---------------------------+------------------+---------------+------------------+----------------+
 
 Kubernetes security suite::
@@ -133,9 +136,9 @@ Kubernetes security suite::
   +---------------------------+------------------+------------------+------------------+----------------+
   |         TEST CASE         |     PROJECT      |       TIER       |     DURATION     |     RESULT     |
   +---------------------------+------------------+------------------+------------------+----------------+
-  |        kube_hunter        |     functest     |     security     |      00:19       |      PASS      |
-  |     kube_bench_master     |     functest     |     security     |      00:02       |      PASS      |
-  |      kube_bench_node      |     functest     |     security     |      00:01       |      PASS      |
+  |        kube_hunter        |     functest     |     security     |      00:18       |      PASS      |
+  |     kube_bench_master     |     functest     |     security     |      00:07       |      PASS      |
+  |      kube_bench_node      |     functest     |     security     |      00:06       |      PASS      |
   +---------------------------+------------------+------------------+------------------+----------------+
 
 Kubernetes benchmarking suite::
@@ -143,7 +146,7 @@ Kubernetes benchmarking suite::
   +--------------------------------+------------------+----------------------+------------------+----------------+
   |           TEST CASE            |     PROJECT      |         TIER         |     DURATION     |     RESULT     |
   +--------------------------------+------------------+----------------------+------------------+----------------+
-  |     xrally_kubernetes_full     |     functest     |     benchmarking     |      34:16       |      PASS      |
+  |     xrally_kubernetes_full     |     functest     |     benchmarking     |      39:15       |      PASS      |
   +--------------------------------+------------------+----------------------+------------------+----------------+
 
 Kubernetes cnf suite::
@@ -151,9 +154,9 @@ Kubernetes cnf suite::
   +-------------------------+------------------+--------------+------------------+----------------+
   |        TEST CASE        |     PROJECT      |     TIER     |     DURATION     |     RESULT     |
   +-------------------------+------------------+--------------+------------------+----------------+
-  |         k8s_vims        |     functest     |     cnf      |      09:06       |      PASS      |
-  |        helm_vims        |     functest     |     cnf      |      08:54       |      PASS      |
-  |     cnf_conformance     |     functest     |     cnf      |      02:00       |      PASS      |
+  |         k8s_vims        |     functest     |     cnf      |      09:27       |      PASS      |
+  |        helm_vims        |     functest     |     cnf      |      09:12       |      PASS      |
+  |     cnf_conformance     |     functest     |     cnf      |      02:55       |      PASS      |
   +-------------------------+------------------+--------------+------------------+----------------+
 
 Results are automatically pushed to the test results database, some additional
Test suites and cases to verify OPNFV Platform functionality