docs: update test summary list.

Update test summary list to include:
 * LTD.Scalability.VNF.RFC2544.PacketLossProfile
 * LTD.Scalability.VNF.RFC2544.PacketLossRatio
 * LTD.Stress.RFC2544.0PacketLoss

JIRA: VSPERF-238

Change-Id: I62ff23c00243cadc8c818d09079dcd38a587a922
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

IETF Draft: Address last BMWG meeting Comments

Final version submitted as -02
On branch IETF-95draft_1b
Changes to be committed:
new file:   docs/requirements/ietf_draft/draft-vsperf-bmwg-vswitch-opnfv-02.xml
new file:   docs/requirements/ietf_draft/draft-vsperf-bmwg-vswitch-opnf-02.txt

JIRA: VSPERF-246

Change-Id: I69262f3392cc9865be46ddff0f12ba85091d947d
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

systems: Fix top level build_base_machine script to use ID

Modified top level build_base_machine.sh script to use ID
instead of Name from os-release file. Renamed folders to
adapt to this change.

* Modified ID variable assignment from echo to straight assignment.

JIRA: VSPERF-257

Change-Id: I22a7d5a1f191418cbc8fc9fd7d85b013e51b49bc
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

LTD: Add Rationale for 10^-7 % Loss Ratio

This expanded item in the Throughput RFC description
explains a choice we made in Release A.
modified:   docs/requirements/vswitchperf_ltd.rst

JIRA: VSPERF-2??  (having trouble with JIRA on 3/26)

Change-Id: Icf5132f55c8b00f99c41439ca644655dfcdf017d
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

IETF Draft: Address IETF-94 BMWG meeting Comments

Several Comments from the IETF-94 meeting, many are captured in the meeting notes.
Section 6 of the meeting notes gives the comments:
https://www.ietf.org/proceedings/94/minutes/minutes-94-bmwg

JIRA: VSPERF-246

Change-Id: Ibe77b67789024ac48cce00147ce94cf2270d8106
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

bugfix: Fix errors related to removal of kernel modules

Internal module manager is responsible for removal of all vsperf
specific kernel modules. Order of modules has been changed
to respect possible dependencies among modules. Manager has been
improved to detect modules automatically loaded by modprobe
to solve dependecies. These modules are automatically removed.
Code of module manager has been refactored.

Change-Id: I4484f3bea7d9900db688f96edd5c3c6d4a304742
JIRA: VSPERF-259
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

integration: Support of integration testcases

Generic support for integration testcases with first
set of tests for vswitch testing.
New test option "TestSteps" has been introduced
to define test step by step directly in configuration
file.
In case that this concept will be accepted, there
are plenty of possibilities for future improvements.
For example:
* use it also for performance tests without explicit
call of validation methods
* introduce step macros for repetitive scenarios,
so new tests can be easily written
* further generalization, which would go beyond
usage of controllers and will operate directly
with vswitch, vnf and trafficgen objects

Change-Id: Ifad166c8ef9cfbda6694682fe6b3421e0e97bbf2
JIRA: VSPERF-212
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

tunneling: Vanilla OVS decapsulation tests

Add Vanilla OVS VXLAN/GRE/GENEVE decapsulation tests
Recent changes:
* Line wrap
* Fix GENEVE IP settings
* Add GRE and GENEVE steps to integration.rst
* Add DUT_NIC1_MAC and DUT_NIC2_MAC
* Remove unnecessary call to vswitch.set_tunnel_arp
* Move optional VXLAN/GRE/GENEVE decap settings to a different section
* Add tunnel type to report files md and rst
* Fix typo error: l4 to L4 in conf/integration/03_traffic.conf

Change-Id: I8a43521668d5870ec893aed1df49467f0a84a07d
JIRA: VSPERF-180
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Install: Adding RedHat 7.2 Installation bash scripts

Adding in prepare_python_env.sh and build_base_machine.sh
scripts to appropriate systems folder for installation on
Red Hat 7.2. Modified installation.rst to reflect these
changes.

* Fixed Header to add Red Hat
* Added myself as contributor

JIRA: VSPERF-214

Change-Id: I23a10316e77c3cec67b7f25176e8707de683af09
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

bugfix: Eliminate error and warning messages

Several issues have been fixed to decrease a number of warning
and error messages written to the standard output. Error and
warning messages causes false build failure report by Jenkins,
in case that internal parsing of job output is enabled.
Fixed issues:
* qemu makefile updated
* shared directories between host and guests are forcibly deleted
before vsperf execution
* nonstop_tsc cpu flag is exported from host to the guest
* vloop-vnf help has been updated and changelog added
* TCL scripts updated to print info instead of warning
* vloop-vnf image updated to avoid snmpd related warnings

Change-Id: Id9ca014bae8fa34772b67d1ebab3431682682931
JIRA: VSPERF-206
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

bugfix: Cleanup of traffic gen api and default traffic values

Both documentation and traffic generator API are updated
to match current code logic. Additional default values
are added into TRAFFIC_DEFAULTS dictionary. Constructor
of TestCase class uses default values from TRAFFIC_DEFAULTS
instead of magic numbers.

Change-Id: Id2f4983945e4b123adddbc9a2a832f4a735b27f6
JIRA: VSPERF-253
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

dpdk: enable vfio_pci support

Enable vfio_pci support for DPDK in the case where the end user
doesn't want to use igb_uio.
Changes:
* Use generic functions to strip the path and .ko extension from the
  module to be inserted/removed.
* Removed debug line in Modules_Manager.
* Removed commented code.
* Fixed all pylint issues.
JIRA: VSPERF-249

Change-Id: I69c9077735879bcbf7ce5c970c1ec53c219e9f90
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

bugfix: Fix link to the artifactory

Test report PDF publishes the link to the logs collected
during CI build. Link has been fixed to point to the right
file.

Change-Id: I3d482d3934874af69f9630b95c7813736ae94afe
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

docs: add Scalability Tests for VMs in Series

Add LTD.Scalability.VNF.RFC2544.PacketLossProfile and
LTD.Scalability.VNF.RFC2544.PacketLossRatio to LTD.

JIRA: VSPERF-238

Change-Id: I26e2b9e06d7bdaf4cc5ab8de7d6ecf261e0a03d4
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

docs: update LTD.CPU.RFC2544.0PacketLoss

Rename and update LTD.CPU.RFC2544.0PacketLoss to
LTD.Stress.RFC2544.0PacketLoss and adding the memory
stressing app also.

JIRA: VSPERF-252

Change-Id: Ib79249f5cfeb304e03ce7f21b5c97a8030edade3
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

Altering the heading levels to fit into the composite docs user guide.

Is required or it leaves the context of the document segment in the userguide.

Change-Id: Idb476b7926ba0fce11ed3be54eaa6837e34bff66
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>

Results: Report percentage frameloss from Dummy

This patch adds the frameloss % result reporting to the dummy traffic
gen and fixes incorrect calculations in the past for mbps that don't
convert packet sizes to bits.
JIRA: VSPERF-201

Change-Id: Ic4fc64a981ecbed0ab956f1cb94c7d76e7868def
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

bugfix: Parameter duration does not work

Vswitchperf help describes two different options, which will
set lenght of the test or duration of its iteration. It can be set
either by parameter --duration or by --test-params CLI option
duration. However only the second option is implemented. It is
enough to support only one option and thus --duration parameter
has been removed.

Change-Id: Icfa40ec25f50bd090229b0761fa968567d8d3553
JIRA: VSPERF-196
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

systems: Dependency package additions for Fedora 22

Added in sysstat and glib2-devel to Fedora build_base_machine.sh for
proper build and execution of VSPerf. QEMU make would fail because of
missing dependencies and VSPerf would error on pidstat execution. Installing
these two packages resolves those issues when building VSPerf on a fresh
install of Fedora 22.

JIRA: VSPerf-221

Change-Id: Icf2f96ce9e2305928cbb1f3811171ed0821d6f2d
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

CI: Generate test report and push logs and report to the artifactory

Script for CI job execution automatically generates final test
report, collects log files and pushes these results into artifactory.
Support for branch specific configuration file has been added.

Change-Id: Ifdf13b1c4c389f8d20dbc8e0ed99f43273e0820b
JIRA: VSPERF-181
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

trafficgen: pause trafficgenerator

Add a mode to pause the traffic generator before transmission to bypass
manual setup if required.

Change-Id: Iad62a5e7cb83a311e2814d8a9ee2bc9b2d2ed4de
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: Fixing typo in testusage.rst for port name example.

JIRA: VSPERF-222

Signed-off-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

pktgen: docstring fix

Fixed docstring to correctly reflect python output from using
merge_spec function.

JIRA: VSPERF-210

Change-Id: Ie3bf2a3d148aa9823bafafe8c61c4c94f00ccc87
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

docs: results explain the dashboard results

Add some more details on the test names used by the dashboard as well as
the test metrics plotted in the graphs.

Change-Id: I6c780a292937622e03fd8af4b9396add82e89bf8
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

VSPERF: Report percentage frameloss from IXIA/IXNET

The patch introduces frame_loss_percent result value.
The implementation is done for Ixia and IxNet
traffic generators. The value is visible in list
of result values at the end of the test, in csv,
rst and md files.

JIRA: VSPERF-201

Change-Id: I9b6795d427b199cb62ed66b7a137e412e36dc757
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>

docs: add release information

Add the release information to NEWS.rst.

Change-Id: I12baf8098c7ea1c45075a99fdaf031f1bd63f905
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christopher Price <christopher.price@ericsson.com>

src: update make install for DPDK

Update make install for DPDK to install to the appropriate DESTDIR.

Change-Id: I6e4f0707038c05eeb2e2849ce34300149d8c5410
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Ian Stokes <ian.stokes@intel.com>
Reviewed-by: Antonio Fischetti<antonio.fischetti@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com

docs: results documentation

Add a results directory and relevant rst files for vsperf brahmaputra
results.

Change-Id: I99ea7b4246b801054d2582933f7d25b7f36abe5d
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christopher Price <christopher.price@ericsson.com>

Altering the filename for autogeneration

Updated the heading and moved to a new filename for composite docs.
Added a link to the vsp  userguide at the end of the doc.

Change-Id: I416228be9347275bcd4c90e394678e4eb93198d4
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>

bugfix: Blank lines are required to join RST templates

Blank lines are required to correctly join multiple RST templates.
Otherwise their text will be merged into one paragraph and formatting
tags will be ignored.

Change-Id: I6885019f7af2fd2201b9f30496d78200a0432e8e
JIRA: VSPERF-181
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

docs: adding license to rest of rst files

Add Creative Commons Creative Commons license to missed documentation
in vsperf. One of these files is not on the stable Brahmaputra branch.
JIRA: VSPERF-239

Change-Id: If1420c3b84ba5ba9e1b4c1f9d75347f1b6e6117f
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

docs: fix link to the page with test results

Test report publishes link to the page with test results. Link
has been fixed to point to the correct page.

Change-Id: I12f2959dffdc081dda9ef15333f9ea937b56eb35
JIRA: VSPERF-181
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

gitignore: include src dirs that can be ignored

Change-Id: I571c09fbe2b8c83b4012bcff92377ef32253770b
JIRA: VSPERF-240
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

docs: adding license to all rst files.

Add Creative Commons Creative Commons license to all documentation in
vsperf.
JIRA: VSPERF-239

Change-Id: I88721205a36078f6e0d4a4c5dd842907729d2b6b
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

fuel-plugin: Remove use of plugin-defined role

The use of a fuel plugin-defined role not working since rebase
to Fuel8 so work around this by removing dependecy on this feature
for imminent Rel/B.

Change-Id: Icd1ee1c8f05a1c26e8da7f80d2d7206374099a93
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Michal Skalski <mskalski@mirantis.com>
Reviewed-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Mark D. Gray <mark.d.gray@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

pkt_gen: Add support for generating GENEVE frames

Add option to generate GENEVE frames for decapsulation
tests.
IxNet 7.3X does not have a native support of GENEVE protocol. The
template, GeneveIxNetTemplate.xml_ClearText.xml, should be imported
into IxNET for this testcase to work.

Recent changes:
* Updated dependency
* Updated userguide
* Move inner frame variables & srcport/dstport to L4

Change-Id: I90f5fb256b51ae44bc1bc7983c599c9dbbffea08
JIRA: VSPERF-192
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Mark D. Gray <mark.d.gray@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

pkt_gen: Add IxNet support for GRE frames

Add option to generate GRE frames for testing GRE decapsulation
tests.

Recent changes:
* Fix merge conflict
* Updated userguides
* Complete set of fields and working decap
* Move GRE ixnet calls to if statement to reuse inner frame settings

Change-Id: I0cf9243953a72a464ae4701a858e76aecbdb8528
JIRA: VSPERF-191
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Add simple VxLAN decapsulation performance test

Measure OVS DPDK VXLAN decapsulation performance.
The DUT is configured as a VTEP (VXLAN Tunnel Endpoint)
which performs decapsulation of frames and sends traffic to
the 2nd traffic generator port.

This test is unidirectional.

Recent changes:
* Userguide update
* Move src/dstport from L2 to L4 (conf, TCL)
* Fix 'TestCase' object has no attribute '_tunnel_operation' error when
  running non overlay tests
* Fix merge conflict
* Move doc to docs/userguide/integration.rst
* Add setting of DUT_NIC1_MAC and setting of other
  variables to docs/userguide/integration.rst

Change-Id: Ia44f8888ef727831543c80f5c98c866686c5c92c
JIRA: VSPERF-190
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com>
Signed-off-by: Timo Puha <timox.puha@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com

Add OVS tunnel encapsulation performance test

Measure OVS DPDK and native VXLAN/GRE/GENEVE encapsulation performance.
This patch creates a new deployment scenario, Overlay_P2P.
The DUT is configured as a TEP (Tunnel Endpoint)
which performs encapsulation of frames and sends traffic to
the 2nd traffic generator port. The traffic generator in this
case receives an encapsulated frame. No decapsulation is performed
in this testcase.

Introduce a vsperf param, --run-integration, to filter tests to
integration tests. When running integration tests, variables defined
in the directory conf/integration/*conf as well as the conf/*.conf
are available.

This test case requires DPDK 2.1.0 and OVS master - 6bb4a18 or newer.

Change-Id: Ide2f418909d647119388df9b30d0d0a3656b4e53
JIRA: VSPERF-180
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: Add a note on pidstat and unknown results.

Add a Note on why %CPU and %USER > 100%, as well as a note regarding the
"unkown" results.

Change-Id: I7e173c91a549932301645c9344648c9b73da4a70
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

docs: Final report conclusions and recommendations

Remove TODO sections from the Release B report.

Change-Id: I4520c23ad9cbb980c9f1c1ee14cc7e91060933a4
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

bugfix: do not report DPDK version for vanilla OVS vswitch

DPDK version check has been removed in case that OVS
does not use DPDK.

Change-Id: I78560a72e4fde3d7113165d88eb81d80f6399af8
JIRA: VSPERF-209
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

docs: traffic generator integration guide

Simple guide with description of integration
of new traffic generator into the VSPERF.

Change-Id: Iab84d1356dbf3ef3405817606c094ffe31355b9f
JIRA: VSPERF-174
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

src: dpdk and ovs version update.

Update vsperf to use DPDK 2.2 and the OVS patch that enables DPDK 2.2
support.

Change-Id: Ibe9702b2934bc87fbcd91b941ae31a7295a65f4f
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Ian Stokes <ian.stokes@intel.com>
Reviewed-by: Antonio Fischetti<antonio.fischetti@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>

results: update test dashboard url

Update test dashboard url to http://testresults.opnfv.org/testapi.

JIRA: VSPERF-112

Change-Id: I2402aaff846229c78fa1f4d3d9e409d931886b4f
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Morgan Richomme <morgan.richomme@orange.com

docs: updates and final fixes

Migrate the installation guide for vsperf to a configguide directory,
update the links to the installation guide. Re-add top level index.rst
and remove the all directory. Update release documentation with vsperf
Rel B support.

Change-Id: Ib643b9d3581d8109b85c377027c8cc6be4b797fc
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

VSPERF docs: Patches for Design Document

Routing Table Figure has an odd description
for the table#1 description.
Connectivity to the DUT is assumed, could provide
example directions. Suggest a new section.

JIRA: VSPERF-178
JIRA: VSPERF-179

Change-Id: I38e48034a9029d4a8969affdddef5b281dc8eba3
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

report: create test report for all executed TCs

Every testcase generates report with its results into separate file.
It is required to merge all partial reports into final overall
report for whole set of TCs executed by VSPERF.
Hugepages are mounted also for TestPMD packet forwarder.

Change-Id: Iaa1ab4e08d1637106da804e06b7f30100d609cd6
JIRA: VSPERF-181
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

VSPERF docs: Review userguide docs for Brahmaputra

Since 'make' builds all three OVS variants,
WITH_LINUX and VHOST_USER are not used anymore on cli.
The fix removes them from quickstart.rst

JIRA: VSPERF-177

Change-Id: I7efe49f638f1234da0d84c5eb62624f543134efc
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
>

docs: update links in LTD and doc versioning

JIRA: VSPERF-60
Change-Id: I2c04faa13a2182e3e28619d23ec68ac52c7a7be9
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>

docs: fix links in the quickstart guide.

Fix installation and Traffic gen guide links in
http://artifacts.opnfv.org/vswitchperf/docs/userguides/quickstart.html
to
http://artifacts.opnfv.org/vswitchperf/docs/userguides/installation.html
and
http://artifacts.opnfv.org/vswitchperf/docs/userguides/trafficgen.html.
Also added where vloop_vnf can be downloaded from.

JIRA: VSPERF-186
Change-Id: I585367b1c717fdbb0b56b7f0312fe9c70f51594f
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>

bugfix: set default framerate/iload to 100%

Continuous testcases should be executed with 100% of frame rate
by default. Thus iLoad parameter of all continuous testcases
was updated to the value of 100.

Change-Id: Ia1c5a49c274d96a25ab7d9b8378ae7be6dc0b10c
JIRA: VSPERF-189
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

report: add rst template for results reporting

Add a template that can be used for reporting vsperf release B results.
This patch also fixes the line length issues in the markdown template.

Change-Id: Id03f5c7eb84536697deca73d3fb397629b647a85
JIRA: VSPERF-181
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

pkt_gen: support of standalone execution of traffic generator

Support for multiple modes of VSPERF operation has been added.
These modes can be used for standalone execution of traffic
generator or for manual testing or for execution of unsupported
traffic generator. Supported modes are: "normal" - execute vSwitch,
VNF and traffic generator; "trafficgen" - execute only traffic
generator; "trafficgen-off" - execute vSwitch and VNF.
Normal mode is selected by default.
In case that trafficgen mode is selected, then various
--test-params could be specified to affect traffic generator
configuration. These parameters include traffic type, frame rate,
bidirectional and scalability settings. Selection of transport
protocol is not supported by IxNet yet (UDP is enforced), thus
modification of transport protocol from command line is not
supported too.
Fixes of testpmd and qemu warning patches are inclduded.

Change-Id: Idac10fe03e724075268a01ec3eb0817fba830aec
JIRA: VSPERF-173
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: installation guide update

Installation guide should be OS agnostic.

Change-Id: Idba63925a27fd204c6542ca886381a56c0415dab
JIRA: VSPERF-150
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

bugfix: mount hugepages for PVP and PVVP scenarios

Hugepages are used by both DPDK and Qemu. However they were mounted
only in case, that OVS with DPDK support was detected. Thus code
has been modified to mount hugepages in case that either DPDK usage
or QEMU usage is detected.

Change-Id: I662a6f0918b7b8d4fc38c2ce3d0d82bba0b8b2b0
JIRA: VSPERF-170
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

bugfix: remove QEMU warning during mount of shared directory

Qemu 2.3.0 requires image type to be explicitly set to 'raw'
for shared directories with FAT. Required option "type=raw"
is compatible with older QEMU versions, so it can be passed
to QEMU by default.

Change-Id: Icca5e4249cc2c05c0b9609d7bd34368b4b86f492
JIRA: VSPERF-187
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Add testpmd as vswitch class

The purpose of using testpmd instead of OVS is to get the baseline
of the DUT when performing hardware offloading operations.
There are supported different checksum calculation
and txq flags settings.

Change-Id: I93c9b45dcb31eaa1f610b7e061f3dd5936b0e6ec
JIRA: VSPERF-193
Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

testcase: scalability - configurable installation of flows to the vswitch

Stream specific flows can be pre-installed into the vswitch
based on the value of testcase specific configuration option
"Pre-installed Flows". In case, it is set to 'Yes', then
specific flow for each stream will be inserted into the switch.
Otherwise only generic flows will be installed. Default value
of "Pre-installed Flows" is set to 'No'. Its value can be
overridden by CLI parameter pre-installed_flows.
This configuration parameter is an enhancement of "MultiSream"
feature and it is ignored if "MultiStream" is disabled.
Python module 'netaddr' is required by this implementation
and it has been added to requirements.txt file.

Change-Id: I8a17577a702bf2be2753134eb203b936a87fc2e5
JIRA: VSPERF-83
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

fuel-plugin: Initial version targeting Fuel8

Change-Id: I21b24527da480c713899bffdaec8381752354e53
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>

reporting: add vswitch, vnf and trafficgen version into the report

Final test report MD file should contain information about version
of vswitch, vnf, VM loopback forwarding application and traffic
generator used during the test. In case that component is cloned
from GIT repository, then hash of its recent commit should be
part of the report too.

Change-Id: I4eb398bc95bc5030d0852d08bcf9febbf17640d4
JIRA: VSPERF-172
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

ci: show TC results inside Jenkins job console output

It is required to show detailed result figures together
with OK/FAILED status. CI script has been modified
to show formatted results from test report MD files.

Change-Id: I9e3724c5aac517dc493f0cf57fc8292434c0bfe8
JIRA: VSPERF-184
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: LTD: RFC.WorstN-BestN test

 - Test ID: LTD.Throughput.RFC2544.WorstN-BestN

JIRA: VSPERF-123

Change-Id: Ief04d8c415a77f4a9b77ba0d2a52653376b37ff1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

test_spec: LTD: Updates

 - document updates

JIRA: VSPERF-123

Change-Id: Ic156bb43dbb04e8895ac3e194c0f485517af93ef
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

vswitches: Remove datapath after stopping OVS

Remove the datapath that OVS creates, ovs-system, (can be viewed by ip link)
after running OVS vanilla tests.

Change-Id: I087c7b3f5afa546258227939ffcb38f0192f0d98
JIRA: VSPERF-175
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

CI: terminate hanging vsperf before its execution

In case that vsperf terminates unexpectedly, then vsperf itself
or any of executed applications might remain active. It is essential
to terminate any hanging instance of vsperf, ovs, qemu, etc.
before re-execution of vsperf itself. Otherwise vsperf will fail
again.

Change-Id: Idd65288a5171d19fcbfb907a156347eb4b645a88
JIRA: VSPERF-155
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

update docs build dir names in .gitignore

Change-Id: Ie153c504b390dc68911a8f1d9a82c7a2e1901ec4
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>

src: fix ovs and qemu version

Qemu 2.2 doesn't compile on Fedora 22 and ovs was set to track the head
of master. We need to fix this for OPNFV builds.
Change-Id: I05823f96b9347ac322831a0dd3f3d63dcf726beb

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

CI: bugfix of build-vsperf.sh script

Vanilla version of OVS was enforced also for set of test, which should
be executed with DPDK version of OVS. Value of --vswitch parameter
was fixed.

Change-Id: I3c486454ff5093436ddc64847e29e55e23764a92
JIRA: VSPERF-155
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

conf: modify core mask format

The pmd-cpu-core mask flag does not accept a hexmask with a
leading '0x'. Remove these characters from the VSWITCH_PMD_CPU_MASK
variable.

JIRA: VSPERF-139

Signed-off-by: Ciara Loftus <ciara.loftus@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

system: add build support for Fedora 20

The most recent version of virtualenv available through installer tools
on Fedora 20 is 3.3; existing build scripts for Fedora 21 and 22
reference version 3.4. Add relevant scripts to enable installation and
build on F20.

Change-Id: I87324fe55df0af687b616fd2e3f6419046a23e46
Signed-off-by: Mark Kavanagh <mark.b.kavanagh@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

docs: fix all/ index.rst links.

JIRA: VSPERF-160
Change-Id: I5722fd8340e009cb1885981e6e40468df4d9216c
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: update release docs after reviewing

Review and update release documentation for Release B.
JIRA: VSPERF-160

Change-Id: I43c85639ed010f950dc3c85eecfe2ff47b65214d
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Code checker

Initial implementation of code checker script. It uses pylint
with vsperf specific pylintrc file to check code syntax, design, etc.
Check can be performed for all files, specified directories or for
modified files only. It will skip files defined by EXCLUDE_MODULES
in conf/00_common.conf file. Details about script usage can be
obtained by ./check -h.

Change-Id: I7d894a2c4db92b7b9d4d4312e6f56bc48c8d5dbf
JIRA: VSPERF-114
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

CI: update build-vsperf.sh script

Script for execution of "daily" vswitchperf job has been updated.
It is prepared also for execution of "verify" and "merge" jobs
after their content will be defined.

Change-Id: I64aa4a2aa23c93f1847cc4528fbdee6f71a62290
JIRA: VSPERF-155
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

bugfix: Vanilla OVS kernel module broken dependencies

Vsperf doesn't install OVS kernel module into standard directory,
to keep host OS untouched. Thus kernel module must be inserted
by insmod and module dependencies solved manually. List of kernel
modules was updated to load all dependencies for recent OVS version.

Change-Id: Id147615ca95cfbde26d1dc8d6c9801f7bb3b5d36
JIRA: VSPERF-161
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vnf: support of vloop_vnf VM

Additional modifications are required to support vloop_vnf
as a master VM image for PVP and PVVP deployments.
Firewall is disabled directly by call of iptables to avoid
dependency on distribution specific firewall handling.
Default configuration values in 04_vnf.conf were set according
to vloop_vnf to make its usage easy. Values are generic
enough to work well also with other images.
Parameters VANILLA_NICx_NAME and vanilla_nicx_name were renamed
to GUEST_NICx_NAME and guest_nicx_name respectively, because
they are used for all vswitch versions. Functionality
of CLI options was fixed. Default values of GUEST_NICx_NAME
were changed to work with vloop_vnf image.
Bug with modification of TRAFFIC_DEFAULTS values has been fixed.
Deep copy is used and l2 and l3 dictionaries are correctly
updated to avoid issues.
Qemu disc emulation has been set to SCSI again to avoid
error messages related to non-functional DMA in syslog. Appropriate
kernel modules were added into vloop_vnf to support scsi
disk emulation during boot.

Change-Id: I5901f454861f99d21cca03030d6d5468ab71a8af
JIRA: VSPERF-133
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

docs: update design docs after reviewing

Review and update design documentation for Release B.
JIRA: VSPERF-160

Change-Id: I2c2167b5ac9161e30aacd277060da22a559dd0c2
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

docs: update userguides after reviewing

Review and update userguides for Release B.
JIRA: VSPERF-160

Change-Id: I54c4dd37fa5951cab9d0e17bb2f3a4d273741cb0
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

docs: updates and move traffic gens to separate doc

Move the traffic gen instructions to a separate user guide and add
information on usage of the Dummy traffic generator. Update docs
to fix PDF build failure and do general clean-up. Removed the numbering
from the LTD and added the numbered directive to automate numbering for
sections and headers. Add comment anchors that reflect the section
numbers.

Change-Id: I984ca38456a891c439697ebc1da041bc1d828a15
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Back2Back: update default params

Update the default duration of a back to back test to be 2 seconds which
is the minimum recommended by RFC2544, and update the Trials to be 50,
which is also the default value specified by the RFC. This patch also
fixes the tcl script to allow for the minimum framesize to be sent from
the traffic gen.

JIRA:

Change-Id: I801196c1998ec2bffbeab69a3a290d6ef6feb1c3
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>

CI: Create simple Hello world build-vsperf.sh

Create a ci directory and create a simple
"echo Hello world" in a shell script called
build-vsperf.sh.
The file will be used as a placeholder for OPNFV Jenkins
vsperf-daily-master job.

JIRA: VSPERF-157

Change-Id: Ibe5ca31f8776fcf4ba6b1e353383a03566617350
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

INFO: remove inactive committers

Remove inactive committers who cannot be contacted or who have stepped
down from the committer role.

Change-Id: Ied02443b571d0dc70135329aed65af2acb9fe426
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Results: Integrate with opnfv_test_dashboard

The feature is enabled by --opnfvpod parameter on vsperf command line.
The value of the parameter sets POD name:
example:
--opnfvpod <pod_name>   or   --opnfvpod=<pod_name>
You need to specify installer name. It can be set in conf-file
default value:
OPNFV_INSTALLER = "Fuel"
Additionally, there are two parameters with default values:
OPNFV_URL = "http://213.77.62.197"
Defines address of opnfv releng database server
PACKAGE_LIST = "src/package-list.mk"
OVS and DPDK tags are read from this file and values are used
for creation of 'version' filed.
The patch requires 'requests' module. The requirements.txt is updated.

JIRA: VSPERF-112

Change-Id: I49f6f5058b1bce8a257669efa8229ff31879481d
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

bugfix: Fix failure caused by unset locale

In case, that VSPERF detects missing locale settings, it will
set language and encodding settings to default values specified
by configuration parameter DEFAULT_LOCALE.
Localized external commands with output parsed by VSPERF
are executed with modified locale to ensure correct VSPERF
function. Locale settings for such commands is specified
by configuration parameter DEFAULT_CMD_LOCALE.

Change-Id: If5c15115b778ce90046e390f10438b780f82695b
JIRA: VSPERF-132
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

bugfix: Support paths with user's home shortcut

VSPERF will explicitly expand any '~' to the absolute path to the user's
home directory before call of subsystem.Popen method. Only calls,
which process configuration values are modified.

Change-Id: Ibd9399ae84bf4698c86bf8eff97ca6ce785fb3fb
JIRA: VSPERF-45
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>

Fix: OS name detection error by build scripts

There is a problem detecting OS specific scripts dir if NAME variable in
/etc/os-release contains a multi-word string (e.g NAME="CentOS Linux").
To fix this we get first part of the NAME string (i.e "CentOS") for
simplicity and look for version specific scripts dir within that.

Change-Id: Ic840788875e9b486b20608a9b9e523cbd4530e31
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <Brian.Castelli@spirent.com>

test_spec: LTD: new topology

 - Physical port → VNF → vSwitch → VNF → physical port

updated topology with pNIC-VF
this provides us ability to fill up the box with multiple VNFs

JIRA: VSPERF-123

Change-Id: Iea991b2cd2973c07ecbc300bb6d413a182cae992
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

updates to use new doc toolchain

Change-Id: I5009a996b2e581638f159ed37a1c56ac53c0c71f
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>

testcase: scalability testcase enhancements

Streams used by scalability testcases can be simulated
at different network layers by modification of destination
MAC address (L2), destination IP address (L3) or destination
UDP port (L4). It is possible to define number and type
of the streams by testcase definition by options "MultiStream"
and "Stream Type" or by CLI parameters "multistream" and
"stream_type". CLI options override testcase definition.
Number of streams, their types, used transport protocol
and indication of pre-installed flows are written to both
result CSV file and MD file with test report.
Default transport protocol was changed to UDP because
IxNetwork configuration script doesn't support TCP yet.

Change-Id: I1ff9ab7756d38f65b1a7730397507c5a5ff5a3d1
JIRA: VSPERF-81
JIRA: VSPERF-82
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

pkt_gen: rename throughput_tx_* to tx_rate_*

Change throughput_tx_* references to tx_rate_* so the results won't be
confusing as part of the opnfv test dashboard when they become
publicly available.

Change-Id: Ie8cfae99a75497f15eb09d097c72c8a35df3b5f9
JIRA: VSPERF-135

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Ian Stokes <ian.stokes@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Results: Integrate with opnfv_test_dashboard

All the test projects generate results in different format.
The goal of a testing dashboard is to provide a consistent
view of the different tests from the different projects.
We need to enable the data collection for VSPERF, in other words
VSPERF pushes data using a REST API.
The feature is enabled by --opnfvpod parameter on vsperf command line.
The value of the parameter sets POD name.
Example:
--opnfvpod <pod_name>   or   --opnfvpod=<pod_name>
You need to specify installer name. It can be set in conf-file
default value:
OPNFV_INSTALLER = "Fuel"

JIRA: VSPERF-112

Change-Id: I37255414eebcc2ff0c12109c508dcd984663a830
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Add some error checking to F21 install

Make the install fail fast and obviously on error rather than
continuing on. This can be used as a template for adding error
checking on the other systems.

JIRA: VSPERF-141

Change-Id: I1892db661a56ab2012e26c6720e0851fabbb51d9

Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vnfs: configurable loopback application support inside VM

For PVP and PVVP deployments, traffic inside virtual machines must be
forwarded between its interfaces. There are several forwarding options
supported by VSPERF, including DPDK testpmd, Huawei l2fwd kernel module
and linux bridge. Another option is, that VM image has built in forwarding
functionality and vsperf doesn't configure it itself.
User can select VM loopback application by configuration option
GUEST_LOOPBACK (per VM) or by SCALAR cli option guest_loopback (global
settings).
Selected guest loopback application(s) will be written into test results
CSV file and test report MD file.
Default wildcarded guest login prompt was added. Guest startup guarding
timer can be configured. Path to OVS kernel module has been fixed.

Change-Id: If738da1ea09112f9cf2267afcbc99a6797f3a03a
JIRA: VSPERF-130
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

pkt_gen: add duration to all send functions

Allow a configurable duration for all send functions.
JIRA: VSPERF-125

Change-Id: I7c6f5d136a7d7100e3990f7fdc00121b07081a80
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>

docs: update installation guide and gsg.

Update installation guide and gsg to include latest updates to vsperf
build and installation.
JIRA: VSPERF-127
Change-Id: I773ea240eb90e191f4f53ed977651056817413f1

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

Adding install scripts for Ubuntu14.04

System build scripts for Ubuntu14.04 are added. DPDK mkdir hugepage
fails to create /dev/hugepages with permission error. Workaround for
that is added so that /dev/hugepages dir is created when OS specific
scripts is run with sudo privilege. Also adding missing packages
kernel-modules-extra, pixman-devel and openssl-devel for Fedora systems.

JIRA: VSPERF-128

Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Change-Id: Ie805c094df4a3f9446b09ea2d7e4dfb2f5324544
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

doc: update template and conf files

JIRA: RELENG-16

Change-Id: I0aaac15c1d1a1031cbc113db594a342c60b7eb1d
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>

Adding system build scripts for Fedora 21 and Fedora 22

Scripts are added for Fedora 21 and 22 to install system requirements
and python packages on these systems. Also modified root
build_base_machine.sh so that it can handle directory structures for
version specific scripts if available.

JIRA: VSPERF-93

Change-Id: If6a311bc7bb1116979faabff5e9097e39f2f5495
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

pkt_gen: update testcenter implementation

Update testcenter implementation to move settings to
generic settings file and change windows line endings.
JIRA: VSPERF-126
Change-Id: I156005f261bc0df6c3d8009db72ba2d5991c6166

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>