docs/results/results.rst

   1 .. This work is licensed under a Creative Commons Attribution 4.0 International
   2 .. License.
   3 .. http://creativecommons.org/licenses/by/4.0
   4
   5 Results listed by scenario
   6 ==========================
   7
   8 The following sections describe the yardstick results as evaluated for the
   9 Colorado release scenario validation runs. Each section describes the
  10 determined state of the specific scenario as deployed in the Colorado
  11 release process.
  12
  13 Scenario Results
  14 ================
  15
  16 .. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main
  17 .. _Jenkins: https://build.opnfv.org/ci/view/yardstick/
  18
  19 The following documents contain results of Yardstick test cases executed on
  20 OPNFV labs, triggered by OPNFV CI pipeline, documented per scenario.
  21
  22
  23 Ready scenarios
  24 ---------------
  25
  26 The following scenarios have been successfully tested at least four consecutive
  27 times:
  28
  29 .. toctree::
  30    :maxdepth: 1
  31
  32    fuel-os-odl_l2-nofeature-ha.rst
  33    fuel-os-odl_l3-nofeature-noha.rst
  34    fuel-os-nosdn-kvm-ha.rst
  35    fuel-os-nosdn-kvm-noha.rst
  36    fuel-os-odl_l2-bgpvpn-ha.rst
  37    fuel-os-odl_l2-bgpvpn-noha.rst
  38    compass-os-nosdn-nofeature-ha.rst
  39    compass-os-odl_l2-moon-ha.rst
  40    compass-os-onos-sfc-ha.rst
  41    compass-onos-nofeature-ha.rst
  42    joid-os-nosdn-nofeature-ha.rst
  43    joid-os-nosdn-nofeature-noha.rst
  44    joid-odl_l2-nofeature-ha.rst
  45    joid-os-onos-nofeature-ha.rst
  46    joid-os-onos-sfc-ha.rst
  47    apex-os-nosdn-nofeature-ha.rst
  48    apex-os-odl_l2-bgpvpn-ha.rst
  49
  50 Limitations
  51 -----------
  52
  53 For the following scenarios, Yardstick generic test cases suite was executed at
  54 least one time however less than four consecutive times, measurements
  55 collected:
  56
  57
  58    * fuel-os-odl_l3-nofeature-ha
  59
  60
  61 For the following scenario, Yardstick generic test cases suite was executed
  62 four consecutive times, measurements collected; no feature test cases were
  63 executed, therefore the feature is not verified by Yardstick:
  64
  65
  66
  67 For the following scenario, Yardstick generic test cases suite was executed
  68 three consecutive times, measurements collected; no feature test cases
  69 were executed, therefore the feature is not verified by Yardstick:
  70
  71     * fuel-os-odl_l2-sfc-ha
  72
  73
  74 Test results of executed tests are avilable in Dashboard_ and logs in Jenkins_.
  75
  76
  77 Feature Test Results
  78 ====================
  79
  80 The following features were verified by Yardstick test cases:
  81
  82    * IPv6
  83
  84    * HA (see :doc:`yardstick-opnfv-ha`)
  85
  86    * KVM
  87
  88    * Parser
  89
  90    * Virtual Traffic Classifier (see :doc:`yardstick-opnfv-vtc`)
  91
  92    * StorPerf
  93
  94 .. note:: The test cases for IPv6 and Parser Projects are included in the
  95   compass scenario.
  96