docs/results/results.rst

   1 .. This work is licensed under a Creative Commons Attribution 4.0 International
   2 .. License.
   3 .. http://creativecommons.org/licenses/by/4.0
   4
   5
   6 ======================
   7 Yardstick Test Results
   8 ======================
   9
  10 .. toctree::
  11    :maxdepth: 2
  12
  13
  14 Scenario Results
  15 ================
  16
  17 .. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main
  18 .. _Jenkins: https://build.opnfv.org/ci/view/yardstick/
  19
  20 The following documents contain results of Yardstick test cases executed on
  21 OPNFV labs, triggered by OPNFV CI pipeline, documented per scenario.
  22
  23
  24 Ready scenarios
  25 ---------------
  26
  27 The following scenarios run at least four consecutive times Yardstick test
  28 cases suite:
  29
  30 .. toctree::
  31    :maxdepth: 1
  32
  33    apex-os-odl_l2-nofeature-ha.rst
  34    compass-os-nosdn-nofeature-ha.rst
  35    compass-os-odl_l2-nofeature-ha.rst
  36    compass-os-onos-nofeature-ha.rst
  37    fuel-os-nosdn-nofeature-ha.rst
  38    fuel-os-odl_l2-nofeature-ha.rst
  39    fuel-os-onos-nofeature-ha.rst
  40    fuel-os-nosdn-kvm-ha
  41    joid-os-odl_l2-nofeature-ha.rst
  42
  43
  44 Limitations
  45 -----------
  46
  47 For the following scenarios, Yardstick generic test cases suite was executed at
  48 least one time however less than four consecutive times, measurements
  49 collected:
  50
  51
  52    * fuel-os-odl_l2-bgpvpn-ha
  53
  54    * fuel-os-odl_l3-nofeature-ha
  55
  56    * joid-os-nosdn-nofeature-ha
  57
  58    * joid-os-onos-nofeature-ha
  59
  60
  61 For the following scenario, Yardstick generic test cases suite was executed
  62 four consecutive times, measurements collected; no feature test cases were
  63 executed, therefore the feature is not verified by Yardstick:
  64
  65     * apex-os-odl_l2-bgpvpn-ha
  66
  67
  68 For the following scenario, Yardstick generic test cases suite was executed
  69 three consecutive times, measurements collected; no feature test cases
  70 were executed, therefore the feature is not verified by Yardstick:
  71
  72     * fuel-os-odl_l2-sfc-ha
  73
  74
  75 Test results of executed tests are avilable in Dashboard_ and logs in Jenkins_.
  76
  77
  78
  79 Feature Test Results
  80 ====================
  81
  82 The following features were verified by Yardstick test cases:
  83
  84    * IPv6
  85
  86    * HA (see :doc:`yardstick-opnfv-ha`)
  87
  88    * KVM
  89
  90    * Parser
  91
  92    * Virtual Traffic Classifier (see :doc:`yardstick-opnfv-vtc`)
  93
  94 .. note:: The test cases for IPv6 and Parser Projects are included in the
  95   compass scenario.