docs/testing/user/userguide/02-methodology.rst

   1 .. This work is licensed under a Creative Commons Attribution 4.0 International
   2 .. License.
   3 .. http://creativecommons.org/licenses/by/4.0
   4 .. (c) OPNFV, Intel Corporation and others.
   5
   6 ===========
   7 Methodology
   8 ===========
   9
  10 Abstract
  11 ========
  12
  13 This chapter describes the methodology/overview of SampleVNF project from
  14 the perspective of a :term:`VNF` and verifying the :term:`NFVI`
  15
  16 Overview
  17 ========
  18 This project provides a placeholder for various sample VNF (Virtual Network Function (:term:`VNF`))
  19 development which includes example reference architecture and optimization methods
  20 related to VNF/Network service for high performance VNFs.
  21
  22 The sample VNFs are Open Source approximations* of Telco grade :term:`VNF`
  23 using optimized VNF + NFVi Infrastructure libraries, with Performance Characterization of Sample† Traffic Flows.
  24 • * Not a commercial product. Encourage the community to contribute and close the feature gaps.
  25 • † No Vendor/Proprietary Workloads
  26
  27 ETSI-NFV
  28 ========
  29
  30 .. _NFV-TST001: http://www.etsi.org/deliver/etsi_gs/NFV-TST/001_099/001/01.01.01_60/gs_NFV-TST001v010101p.pdf
  31 .. _SampleVNFtst: https://wiki.opnfv.org/display/SAM/Technical+Briefs+of+VNFs
  32 .. _Yardstick_NSB: http://artifacts.opnfv.org/yardstick/docs/testing_user_userguide/index.html#document-13-nsb-overview
  33
  34 SampleVNF Test Infrastructure (NSB (Yardstick_NSB_))in yardstick helps to facilitate
  35 consistent/repeatable methodologies for characterizing & validating the
  36 sample VNFs (:term:`VNF`) through OPEN SOURCE VNF approximations.
  37
  38 Network Service Benchmarking in yardstick framework follows ETSI GS NFV-TST001_
  39 to verify/characterize both :term:`NFVI` & :term:`VNF`
  40
  41 The document ETSI GS NFV-TST001_, "Pre-deployment Testing; Report on Validation
  42 of NFV Environments and Services", recommends methods for pre-deployment
  43 testing of the functional components of an NFV environment.
  44
  45 The SampleVNF project implements the methodology described in chapter 13 of Yardstick_NSB_,
  46 "Pre-deployment validation of NFV infrastructure".
  47
  48 The methodology consists in decomposing the typical :term:`VNF` work-load
  49 performance metrics into a number of characteristics/performance vectors, which
  50 each can be represented by distinct test-cases.
  51
  52 .. seealso:: SampleVNFtst_ for material on alignment ETSI TST001 and SampleVNF.
  53
  54 Metrics
  55 =======
  56
  57 The metrics, as defined by ETSI GS NFV-TST001, are shown in
  58 :ref:`Table1 <table2_1>`.
  59
  60 .. _table2_1:
  61
  62 **Table 1 - Performance/Speed Metrics**
  63
  64 +---------+-------------------------------------------------------------------+
  65 | Category| Performance/Speed                                                 |
  66 |         |                                                                   |
  67 +---------+-------------------------------------------------------------------+
  68 | Network | * Throughput per NFVI node (frames/byte per second)               |
  69 |         | * Throughput provided to a VM (frames/byte per second)            |
  70 |         | * Latency per traffic flow                                        |
  71 |         | * Latency between VMs                                             |
  72 |         | * Latency between NFVI nodes                                      |
  73 |         | * Packet delay variation (jitter) between VMs                     |
  74 |         | * Packet delay variation (jitter) between NFVI nodes              |
  75 |         | * RFC 3511 benchmark                                              |
  76 |         |                                                                   |
  77 +---------+-------------------------------------------------------------------+
  78
  79 .. note:: The description in this OPNFV document is intended as a reference for
  80   users to understand the scope of the SampleVNF Project and the
  81   deliverables of the SampleVNF framework. For complete description of
  82   the methodology, please refer to the ETSI document.
  83
  84 .. rubric:: Footnotes
  85 .. [1] To be included in future deliveries.
  86