X-Git-Url: https://gerrit.opnfv.org/gerrit/gitweb?a=blobdiff_plain;f=docs%2Frelease%2Frelease-notes%2Ffunctest-release.rst;h=d984a558b7cc874cf58cea3534c863aced16155b;hb=4470868c2d4486e8dbfab925c22eb364974b2c40;hp=fe49657b388fe91be67e45377cfdfddbc103a128;hpb=78d54dcc2d1131b791c0a111595844ef4506823d;p=functest.git diff --git a/docs/release/release-notes/functest-release.rst b/docs/release/release-notes/functest-release.rst index fe49657b3..d984a558b 100644 --- a/docs/release/release-notes/functest-release.rst +++ b/docs/release/release-notes/functest-release.rst @@ -5,48 +5,28 @@ License ======= -OPNFV Danube release note for Functest Docs -(c) by Jose Lausuch (Ericsson) - -OPNFV Danube release note for Functest Docs +OPNFV Euphrates release note for Functest Docs are licensed under a Creative Commons Attribution 4.0 International License. You should have received a copy of the license along with this. If not, see . -=========================================== -OPNFV Danube2.0 release note for Functest -=========================================== +============================================= +OPNFV Euphrates 5.1 release note for Functest +============================================= Abstract ======== -This document describes the release note of Functest project. - - -Version history -=============== - -+------------+----------+------------------+------------------------+ -| **Date** | **Ver.** | **Author** | **Comment** | -| | | | | -+------------+----------+------------------+------------------------+ -| 2016-08-17 | 1.0.0 | Morgan Richomme | Functest for Colorado | -| | | (Orange) | release | -+------------+----------+------------------+------------------------+ -| 2017-03-29 | 4.0.0 | Jose Lausuch | Functest for Danube | -| | | (Ericsson) | release | -+------------+----------+------------------+------------------------+ -| 2017-05-04 | 5.0.0 | Jose Lausuch | Functest for Danube.2.0| -| | | (Ericsson) | release | -+------------+----------+------------------+------------------------+ +This document contains the release notes of the Functest project. -OPNFV Danube Release +OPNFV Euphrates Release ====================== Functest deals with functional testing of the OPNFV solution. -It includes test cases developed within the project and test cases developed in -other OPNFV projects and other upstream communities. +It includes test cases developed within the project, test cases developed in +other OPNFV projects and it also intgrates test cases from other upstream +communities. The internal test cases are: @@ -63,6 +43,7 @@ The internal test cases are: * tempest_full_parallel * rally_full * cloudify_ims + * vyos_vrouter The OPNFV projects integrated into Functest framework for automation are: @@ -71,23 +52,13 @@ The OPNFV projects integrated into Functest framework for automation are: * doctor * domino * fds - * multisite - * netready - * onos * odl-sfc * odl-netvirt * parser * promise - * security scan - * orchestra_ims - * vyos_vrouter + * orchestra_openims + * orchestra_clearwaterims -The validation of a scenario requires a subset of these tests depending -on the installer and the scenario. - -The test cases from vnf (cloudify_ims, orchestra_ims, vyos_vrouter) and -component categories (tempest full parallel, Rally full) are not considered for -scenario validation. Release Data ============ @@ -96,16 +67,16 @@ Release Data | **Project** | functest | | | | +--------------------------------------+--------------------------------------+ -| **Repo/tag** | danube.2.0 | +| **Repo/tag** | opnfv-5.1.0 | | | | +--------------------------------------+--------------------------------------+ -| **Release designation** | Danube service release | +| **Release designation** | Euphrates 5.1 release | | | | +--------------------------------------+--------------------------------------+ -| **Release date** | May 4st 2017 | +| **Release date** | December 15th 2017 | | | | +--------------------------------------+--------------------------------------+ -| **Purpose of the delivery** | Danube second release | +| **Purpose of the delivery** | Euphrates second release | | | | +--------------------------------------+--------------------------------------+ @@ -115,369 +86,131 @@ Deliverables Software -------- - - The Functest Docker image: https://hub.docker.com/r/opnfv/functest (tag: danube.2.0) + Functest Docker images: + + * https://hub.docker.com/r/opnfv/functest-healthcheck + * https://hub.docker.com/r/opnfv/functest-smoke + * https://hub.docker.com/r/opnfv/functest-features + * https://hub.docker.com/r/opnfv/functest-components + * https://hub.docker.com/r/opnfv/functest-vnf + * https://hub.docker.com/r/opnfv/functest-parser + * https://hub.docker.com/r/opnfv/functest-restapi - - The TestAPI Docker image: https://hub.docker.com/r/opnfv/testapi (tag:danube.2.0) + TestAPI Docker image: + * https://hub.docker.com/r/opnfv/testapi + +Docker tag to be pulled: + * amd64: amd64-opnfv-5.1.0 + * arm64: arm64-opnfv-5.1.0 Documents --------- - - Installation/configuration guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/configguide/index.html - - - User Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/userguide/index.html + - Installation/configuration guide: http://docs.opnfv.org/en/stable-euphrates/submodules/functest/docs/testing/user/configguide/index.html - - Developer Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/developer/devguide/index.html + - User Guide: http://docs.opnfv.org/en/stable-euphrates/submodules/functest/docs/testing/user/userguide/index.html + - Developer Guide: http://docs.opnfv.org/en/stable-euphrates/submodules/functest/docs/testing/developer/devguide/index.html -Version change -============== + - API Docs: http://artifacts.opnfv.org/functest/docs/index.html -Feature evolution ------------------ + - Functest Framework presentation: http://testresults.opnfv.org/functest/framework/index.html -- Adoption of SNAPS as middleware in 4 new test cases (connection_check, api_check, - snaps_health_check and snaps_smoke) -- Introduction of refstack suite +Version change +============== -- Support new odl suites (odl-netvirt, fds) +Functest now delivers light-weigth Docker images based on Alpine 3.6. The test cases are grouped into several categories +or tiers and must be run from the corresponding container. For example, to run the test case healthcheck, the image +opnfv/functest-healthcheck shall be used. The tiers and the tests within them are explained in detail in the User Guide. -- Introduction of VNF onboarding capabilities +The former Ubuntu image is not longer maintained. -- Support of new feature projects (fds, netready, barometer, orchestra, vyos_vrouter) +The Parser test case has its own dedicated Docker image since it requires libraries released for OpenStack Pike and +Euphrates is based on Ocata. +The Docker images do not contain OS images (Cirros, Ubuntu, Centos, ..) anymore. A script has been created under the +ci directory (download_images.sh) which contains all the needed images for all the tests. This file can be modified by +the user since not all the images might be used. It must be executed before starting Functest and attach the needed +images as a Docker volume. See Configuration Guide for more information. +The requirements have been split into 3 files: + * requirements.txt : lists all abstract dependencies of the OPNFV packages + * test-requirements.txt : lists all abstract dependencies required by Functest Unit Tests + * upper-constraints.txt : lists all concrete upstream dependencies required by Functest Docker container -Framework ---------- +OPNFV (test-)requirements.txt have been updated according to stable/ocata global-requirements.txt. +Functest uses (and completes) stable/ocata upper-constraints.txt in Dockerfiles and tox configuration. +The project relies on pbr, which injects requirements into the install_requires, tests_require and/or dependency_links +arguments to setup. It also supports conditional dependencies which can be added to the requirements (e.g. dnspython>=1.14.0;python_version=='2.7') - - Harmonization of the naming, better adoption of OpenStack coding conventions +The way to manage logging has been centralized to a configuration file (logging.ini) which might be modified by the user. +By default, the output of executing the test cases is redirected to log files and is not displayed on the console, only result +messages and summary tables are displayed. - - Enhanced code to be more Object Oriented, removed bash scripts +The framework has been refactored and all the test cases inherit from a core class TestCase. For Feature projects who develop +test cases, 2 sub-classes have been created: + - Feature: it implements all the needed functions and the developer must only overwrite the method "execute" (e.g. Barometer) + - BashFeature: it is used if the third party test case is a shell script. This way, the execution command must be specified in + testcases.yaml as the argument (e.g. Domino, Doctor) - - Introduction of abstraction classes to ease and harmonize the integration of - test cases (internal or from feature projects) +An internal REST API has been introduced in Euphrates. The goal is to trigger Functest operations through an API in addition of the CLI. +This could be considered as a first step towards a pseudo micro services approach where the different test projects could expose and +consume APIs to the other test projects. - - New management of logger, env variables and configuration files +Euphrates 5.1 improvements +========================== - - Creation of unit tests on the whole framework to ensure stability +* Alpine images are now supported for ARM (arm64). +* Added Vyos_router test case. +* Updated of Rally 0.9.1 and fixed some bugs in cinder scenarios. +* Patch to allow building containers from a gerrit change. +* Selection of a subset of SNAPS test cases. +* Reorder VNF test cases and adjust timeouts in VNFs. - - Creation or ARM Functest docker -Test API ---------- +Euphrates 5.1 known restrictions/issues +======================================= ++--------------+-----------+----------------------------------------------+ +| Installer | Scenario | Issue | ++==============+===========+==============================================+ +| fuel@aarch64 | any | VNF tier not supported yet. | ++--------------+-----------+----------------------------------------------+ +| | | The test cases belonging to the VNF tier | +| any | any | have been only tested on os-nosdn-nofeature | +| | | scenarios and baremetal deployments. | ++--------------+-----------+----------------------------------------------+ +| Joid | k8 | Functest does not offer test suites for | +| Compass | | Kubernetes scenarios yet. | ++--------------+-----------+----------------------------------------------+ -- Automatic documentation (html & pdf) - -- Full dockerization and automation of the deployment on testresults.opnfv.org - -- Automation of test database backup on artifact - - -New internal tests cases ------------------------- - -- connection_check - -- api_check - -- snaps_health_check (replacing shell script healtcheck) - -- refstack_defcore - -- snaps_smoke - -- vyos_vrouter - - -Scenario Matrix -=============== - -For Danube 2.0, Functest was tested on the following HA scenarios (new -dabube scenarios in bold): - -+---------------------+---------+---------+---------+---------+ -| Scenario | Apex | Compass | Fuel | Joid | -+=====================+=========+=========+=========+=========+ -| nosdn | X | X | X | X | -+---------------------+---------+---------+---------+---------+ -| **fdio** | X | | | | -+---------------------+---------+---------+---------+---------+ -| kvm | X | | X | | -+---------------------+---------+---------+---------+---------+ -| **kvm_ovs_dpdk** | | | X | | -+---------------------+---------+---------+---------+---------+ -| **kvm_ovs_dpdk-bar**| | | X | | -+---------------------+---------+---------+---------+---------+ -| lxd | | | | X | -+---------------------+---------+---------+---------+---------+ -| **ovs** | | | X | | -+---------------------+---------+---------+---------+---------+ -| **openo** | | X | | | -+---------------------+---------+---------+---------+---------+ -| odl_l2 | | X | X | X | -+---------------------+---------+---------+---------+---------+ -| odl-bgpvpn | X | | | | -+---------------------+---------+---------+---------+---------+ -| odl_l2-bgpvpn | | | X | | -+---------------------+---------+---------+---------+---------+ -| **odl_l2-fdio** | X | | | | -+---------------------+---------+---------+---------+---------+ -| odl_l2-sfc | | | X | | -+---------------------+---------+---------+---------+---------+ -| odl_l3 | X | X | X | | -+---------------------+---------+---------+---------+---------+ -| **ocl** | | X | | | -+---------------------+---------+---------+---------+---------+ -| onos | | X | | | -+---------------------+---------+---------+---------+---------+ -| multisite | | | X | | -+---------------------+---------+---------+---------+---------+ - -Non HA scenarios: - -+---------------------+---------+---------+---------+---------+ -| Scenario | Apex | Compass | Fuel | Joid | -+=====================+=========+=========+=========+=========+ -| nosdn | | | X | X | -+---------------------+---------+---------+---------+---------+ -| kvm | | | X | | -+---------------------+---------+---------+---------+---------+ -| **kvm_ovs_dpdk** | | | X | | -+---------------------+---------+---------+---------+---------+ -| **kvm_ovs_dpdk-bar**| | | X | | -+---------------------+---------+---------+---------+---------+ -| lxd | | | | X | -+---------------------+---------+---------+---------+---------+ -| ovs | | | X | | -+---------------------+---------+---------+---------+---------+ -| odl_l2 | | | X | | -+---------------------+---------+---------+---------+---------+ -| odl_l2-bgpvpn | | | X | | -+---------------------+---------+---------+---------+---------+ -| odl_l2-fdio | X | | | | -+---------------------+---------+---------+---------+---------+ -| **odl_l3-fdio** | X | | | | -+---------------------+---------+---------+---------+---------+ -| odl_l2-sfc | | | X | | -+---------------------+---------+---------+---------+---------+ -| odl_l3 | | | X | | -+---------------------+---------+---------+---------+---------+ -| **odl_gluon** | X | | | | -+---------------------+---------+---------+---------+---------+ - -Colorado deprecated scenarios: - - * odl_l2-moon - * onos-sfc - * onos-noha - * onos-sfc-noha - -For the scenario validation, we consider only the healthcheck, smoke and -features categories. These tests are run systematically in the CI daily loops. - -Success criterias have been defined for these test cases, they can be -PASS/FAIL or a success rate may be declared (100%, > 90%). -All the criteria, as well as the test dependencies are declared in the -testcases.yaml file located in the ci directory of the repository. - -The scoring for the Danube release per installer can be described as -follows. - -The scoring is an indicator showing how many feature project test suites -have been integrated in the scenario. - -The scoring equals the number of tests * successful iteration of each -test [0-3]. The scoring method is described in https://wiki.opnfv.org/pages/viewpage.action?pageId=6828617 - - e.g. - apex/odl_l2-nofeature-ha - tests = vping_ssh+vping_userdata+tempest+rally+odl+doctor+copper - Scoring = 21/21 = 7 * 3 - -By default, if not specified, the scenarios are HA. -HA means OpenStack High Availability (main services). Note that not -all VIM (e.g. OpenStack) services are deployed in HA mode, as that -depends upon support of the specific service for HA deployment. -For example, in the Danube release, the Congress service -is deployed in non-HA mode even for HA OPNFV scenarios, as explicit -support for HA operation has not yet been verified. -See the release notes of the installers for more details. - - -Apex ----- - -+------------------+---------+---------+-----------------+ -| Scenario | Scoring | Success | Results | -| | | rate | | -+==================+=========+=========+=================+ -| nosdn | 30/33 | 91% | `apex-res-1`_ | -+------------------+---------+---------+-----------------+ -| odl_l3 | 23/33 | 70% | `apex-res-2`_ | -+------------------+---------+---------+-----------------+ -| odl-bgpvpn | 16/36 | 44% | `apex-res-3`_ | -+------------------+---------+---------+-----------------+ -| odl-gluon | 18/36 | 50% | `apex-res-4`_ | -+------------------+---------+---------+-----------------+ -| kvm | 30/33 | 91% | `apex-res-5`_ | -+------------------+---------+---------+-----------------+ -| odl_l2-fdio | 30/36 | 83% | `apex-res-6`_ | -+------------------+---------+---------+-----------------+ -| odl_l2-fdio-noha | 29/36 | 81% | `apex-res-7`_ | -+------------------+---------+---------+-----------------+ -| odl_l3-fdio-noha | 23/30 | 77% | `apex-res-8`_ | -+------------------+---------+---------+-----------------+ -| fdio | 6/30 | 20% | `apex-res-9`_ | -+------------------+---------+---------+-----------------+ - -Compass -------- - -+------------------+---------+---------+------------------+ -| Scenario | Scoring | Success | Results | -| | | rate | | -+==================+=========+=========+==================+ -| nosdn | 29/30 | 97% | `compass-res-1`_ | -+------------------+---------+---------+------------------+ -| odl_l2 | 29/33 | 88% | `compass-res-2`_ | -+------------------+---------+---------+------------------+ -| odl_l3 | 25/30 | 83% | `compass-res-3`_ | -+------------------+---------+---------+------------------+ -| onos | 28/33 | 84% | `compass-res-4`_ | -+------------------+---------+---------+------------------+ -| openo | 29/30 | 97% | `compass-res-5`_ | -+------------------+---------+---------+------------------+ -| ocl | 3/30 | 10% | `compass-res-6`_ | -+------------------+---------+---------+------------------+ - -Note: all the Compass tests for Danube have been executed on virtual -environment. Bare metal resources were used for Master branch. - - -Fuel ----- - -+----------------------+---------+---------+----------------+ -| Scenario | Scoring | Success | Results | -| | | rate | | -+======================+=========+=========+================+ -| nosdn | 38/39 | 97% | `fuel-res-1`_ | -+----------------------+---------+---------+----------------+ -| nosdn-noha | 36/36 | 100% | `fuel-res-2`_ | -+----------------------+---------+---------+----------------+ -| nosdn-kvm | 39/39 | 100% | `fuel-res-3`_ | -+----------------------+---------+---------+----------------+ -| nosdn-kvm-noha | 36/36 | 100% | `fuel-res-4`_ | -+----------------------+---------+---------+----------------+ -| nosdn-ovs | 39/39 | 100% | `fuel-res-5`_ | -+----------------------+---------+---------+----------------+ -| nosdn-ovs-noha | 36/36 | 100% | `fuel-res-6`_ | -+----------------------+---------+---------+----------------+ -| odl_l2 | 40/42 | 95% | `fuel-res-7`_ | -+----------------------+---------+---------+----------------+ -| odl_l2-noha | 37/39 | 95% | `fuel-res-8`_ | -+----------------------+---------+---------+----------------+ -| odl_l2-sfc | 45/45 | 100% | `fuel-res-9`_ | -+----------------------+---------+---------+----------------+ -| odl_l2-sfc-noha | 36/42 | 86% | `fuel-res-10`_ | -+----------------------+---------+---------+----------------+ -| odl_l3 | 38/39 | 97% | `fuel-res-11`_ | -+----------------------+---------+---------+----------------+ -| odl_l3-noha | 36/36 | 100% | `fuel-res-12`_ | -+----------------------+---------+---------+----------------+ -| kvm_ovs_dpdk | 6/39 | 15% | `fuel-res-13`_ | -+----------------------+---------+---------+----------------+ -| kvm_ovs_dpdk_noha | 36/36 | 100% | `fuel-res-14`_ | -+----------------------+---------+---------+----------------+ -| kvm_ovs_dpdk_bar | 6/42 | 14% | `fuel-res-15`_ | -+----------------------+---------+---------+----------------+ -| kvm_ovs_dpdk_bar_noha| 38/39 | 97% | `fuel-res-16`_ | -+----------------------+---------+---------+----------------+ - - - - -Joid ----- - -+---------------------+---------+---------+---------------+ -| Scenario | Scoring | Success | Results | -| | | rate | | -+=====================+=========+=========+===============+ -| nosdn | 29/33 | 97% | `joid-res-1`_ | -+---------------------+---------+---------+---------------+ -| nosdn-noha | 33/33 | 100% | `joid-res-2`_ | -+---------------------+---------+---------+---------------+ -| nosdn-lxd | 18/24 | 75% | `joid-res-3`_ | -+---------------------+---------+---------+---------------+ -| nosdn-lxd-noha | 18/24 | 71% | `joid-res-4`_ | -+---------------------+---------+---------+---------------+ -| odl_l2 | 9/36 | 25% | `joid-res-5`_ | -+---------------------+---------+---------+---------------+ - -It is highly recommended to install a json viewer in your browser -(e.g. https://addons.mozilla.org/fr/firefox/addon/jsonview/) - -You can get additional details through test logs on http://artifacts.opnfv.org/. -As no search engine is available on the OPNFV artifact web site you must -retrieve the pod identifier on which the tests have been executed (see -field pod in any of the results) then click on the selected POD and look -for the date of the test you are interested in. - -The reporting pages can be found at: - - * apex: http://testresults.opnfv.org/reporting/functest/release/danube/index-status-apex.html - * compass: http://testresults.opnfv.org/reporting/functest/release/danube/index-status-compass.html - * fuel: http://testresults.opnfv.org/reporting/functest/release/danube/index-status-fuel.html - * joid: http://testresults.opnfv.org/reporting/functest/release/danube/index-status-joid.html - -Danube known restrictions/issues -================================== - -************* TODO ***************************************** - -+-----------+-----------+----------------------------------------------+ -| Installer | Scenario | Issue | -+===========+===========+==============================================+ -| fuel | odl_-* | Tempest test case "TestServerBasicOps" | -| | | disabled due to bug `tempest-bug`_ | -+-----------+-----------+----------------------------------------------+ -| apex/fuel | *-bgpvpn | Due to some instabilities in the bgpvpn | -| | | test case, the scenario has been postponed | -| | | to Danube 2.0 | -+-----------+-----------+----------------------------------------------+ -| apex | *-gluon | vPing_ssh disabled due to floating ips | -| | | not working 100% of the times. | -| | | Tempest test "test_reboot_server_hard" | -| | | disabled due to bug `gluon-bug`_ | -+-----------+-----------+----------------------------------------------+ -| joid | any | Tempest cases related to object storage | -| | | excluded | -+-----------+-----------+----------------------------------------------+ -| any | any | The VNF tier has not been fully tested | -| | | since it has not been run in daily loops | -| | | in CI. Weekly jobs have been activated | -| | | a bit late in the process and have not been | -| | | used to validate the scenarios. | -+-----------+-----------+----------------------------------------------+ Test and installer/scenario dependencies ======================================== It is not always possible to run all the test cases on all the scenarios. -The following table details the dependencies of the test cases per -scenario. The scenario dependencies (installer or scenario) are detailed -in https://git.opnfv.org/cgit/functest/tree/ci/testcases.yaml +The scenario dependencies (installer or scenario) are detailed +in the different testcases.yaml for each tier: + + * https://git.opnfv.org/functest/tree/docker/healthcheck/testcases.yaml?h=stable/euphrates + * https://git.opnfv.org/functest/tree/docker/smoke/testcases.yaml?h=stable/euphrates + * https://git.opnfv.org/functest/tree/docker/features/testcases.yaml?h=stable/euphrates + * https://git.opnfv.org/functest/tree/docker/components/testcases.yaml?h=stable/euphrates + * https://git.opnfv.org/functest/tree/docker/vnf/testcases.yaml?h=stable/euphrates + * https://git.opnfv.org/functest/tree/docker/parser/testcases.yaml?h=stable/euphrates + Test results ============ -Test results are available in: +The Functest scenario status on December 15, 2017 can be seen on +http://testresults.opnfv.org/functest/euphrates/ - - test results document: http://artifacts.opnfv.org/functest +Test logs are available in: + + - test results logs from CI: http://artifacts.opnfv.org (within different directories 'logs_functest_X') - jenkins logs on CI: https://build.opnfv.org/ci/view/functest/ @@ -498,16 +231,13 @@ Open JIRA tickets All the tickets that are not blocking have been fixed or postponed the next release. -Functest Danube 2.0 is released without known bugs. - - Useful links ============ - wiki project page: https://wiki.opnfv.org/opnfv_functional_testing - - wiki Functest Danube page: https://wiki.opnfv.org/display/functest/Functest+Danube + - wiki Functest Euphrates page: https://wiki.opnfv.org/display/functest/5.+Euphrates - Functest repo: https://git.opnfv.org/cgit/functest @@ -517,83 +247,4 @@ Useful links - Functest IRC chan: #opnfv-functest - - Reporting page: http://testresults.opnfv.org/reporting/danube.html - - - Functest test configuration: https://git.opnfv.org/cgit/functest/tree/functest/ci/testcases.yaml - -.. _`tempest-bug`: https://bugs.launchpad.net/tempest/+bug/1577632 - -.. _`gluon-bug`: https://bugs.opendaylight.org/show_bug.cgi?id=5586 - -.. _`apex-res-1`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-222 - -.. _`apex-res-2`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-211 - -.. _`apex-res-3`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-224 - -.. _`apex-res-4`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-225 - -.. _`apex-res-5`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-216 - -.. _`apex-res-6`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-215 - -.. _`apex-res-7`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-214 - -.. _`apex-res-8`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-217 - -.. _`apex-res-9`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-apex-apex-daily-danube-daily-danube-218 - -.. _`compass-res-1`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-compass-virtual-daily-danube-216 - -.. _`compass-res-2`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-compass-virtual-daily-danube-221 - -.. _`compass-res-3`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-compass-baremetal-daily-danube-214 - -.. _`compass-res-4`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-compass-virtual-daily-danube-213 - -.. _`compass-res-5`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-compass-baremetal-daily-danube-212 - -.. _`compass-res-6`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-compass-baremetal-daily-danube-222 - -.. _`fuel-res-1`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-54 - -.. _`fuel-res-2`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-357 - -.. _`fuel-res-3`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-53 - -.. _`fuel-res-4`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-355 - -.. _`fuel-res-5`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-335 - -.. _`fuel-res-6`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-356 - -.. _`fuel-res-7`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-zte-pod1-daily-danube-337 - -.. _`fuel-res-8`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-358 - -.. _`fuel-res-9`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-340 - -.. _`fuel-res-10`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-353 - -.. _`fuel-res-11`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-338 - -.. _`fuel-res-12`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-360 - -.. _`fuel-res-13`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-341 - -.. _`fuel-res-14`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-359 - -.. _`fuel-res-15`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-baremetal-daily-danube-339 - -.. _`fuel-res-16`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-fuel-virtual-daily-danube-361 - - -.. _`joid-res-1`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-joid-baremetal-daily-danube-164 - -.. _`joid-res-2`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-joid-baremetal-daily-danube-150 - -.. _`joid-res-3`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-joid-baremetal-daily-danube-162 - -.. _`joid-res-4`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-joid-baremetal-daily-danube-167 - -.. _`joid-res-5`: http://testresults.opnfv.org/test/api/v1/results?build_tag=jenkins-functest-joid-baremetal-daily-danube-165 + - Reporting page: http://testresults.opnfv.org/reporting/euphrates.html