report: Update paths after doc reorganization

Directory with report files was moved to different
location. Thus CI build script must be updated too.

Change-Id: Id5b4c8b2740c01c821c25f8bfdaeb25352410e76
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "build: Rename cloned repositories and remove cuse"

build: Rename cloned repositories and remove cuse

VSPERF expects folders to be named a certain way, but this may not be
the case if another repository is specified via the package-list.mk
file. One example of this is the DPDK stable repo which gets cloned to
the "dpdk-stable" directory unless otherwise specified. Thus Makefiles
were updated to enforce expected folder names.

Unused configuration related to vHostCuse support was removed.

Change-Id: Ifa48898d51e96c72e7d740f43cb635d729b2a796
Signed-off-by: Cian Ferriter <cian.ferriter@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

gitignore: Ignore non vsperf files

.gitignore was updated to ignore following files:
* VPP project directory
* l2fwd binary files
* tags

JIRA: VSPERF-529

Change-Id: Idc10eae7b14c72a863f3473e02cbdc7c47d31b41
Signed-off-by: Cian Ferriter <cian.ferriter@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "opnfvresultdb: Update data reported to result DB"

opnfvresultdb: Update data reported to result DB

Data reported to result DB were updated to comply
with recent API version and requirements.

JIRA: VSPERF-488

Change-Id: I6ab02ea54d99099e88b0d5ab6e9745ee8297f544
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Mars Toktonaliev <mars.toktonaliev@nokia.com>
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Moved devguide for consitency with docs dir structure for all testing projects
Updated RFC description based on IETF approval of Internet Draft

Change-Id: Ifd37da946866f350b8968bbbe8c5a3f5ce762cfa
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "driverctl: Add driverctl binding tool"

driverctl: Add driverctl binding tool

Adds driverctl as a binding tool option for dpdk devices. JIRA
ticket contains test results to verify it works when using
dpdk-devbind or driverctl.

JIRA: VSPERF-525

Change-Id: Ia7a6e43a4b6fb3ba21f5d87d601f4ea4b95b7dab
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Merge "xena2544_verify_fix: Fix Xena verify options"

Merge "tests: L3, L4 and VxLAN tests for OVS & VPP"

xena2544_verify_fix: Fix Xena verify options

Fixes issue when running multiple packets sizes and using the Xena
verify option. Original values are restored to settings for each
new packet size or test case.

Also fixes a minor issue where if the test failed, the verify would
run regardless.

JIRA: VSPERF-515

Change-Id: I6b6ce5160b66e7ed4a3847711c4f05529ae8ca54
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

tests: L3, L4 and VxLAN tests for OVS & VPP

A set of tests was introduced with focus on L3, L4 and VxLAN performance
of OVS and VPP. New testcases were created for phy2phy network scenario.
In case of PVP and PVVP, only OVS testcases are available.

Notes:
* two sets of OVS P2P testcases were created, one creates unique flow
  for each IP address involved in the test (performance sensitive);
  Second set inserts just one flow with large network mask (tests with
  _mask suffix).
* three different types of VPP P2P L3 testcases were created to
  demonstrate performance impact of multi ARP entries or IP routes.
* VPP multi ARP record based testcases use a set of "workarounds"
  to load a large number of ARP entries. It is not possible to use
  "set ip arp count" syntax, as it doesn't work well for large count
  values (e.g. 60K)
* OVS VxLAN testcases utilize existing OP2P deployment scenario and thus
  it can be used also with GRE and GENEVE tunnel types. Tunnel type
  to be used is defined by test configuration option "Tunnel Type".

JIRA: VSPERF-518

Change-Id: I65adad976f12d8625d918a1996eb42693c511ee1
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Ciara Loftus <ciara.loftus@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
Reviewed-by: Cian Ferriter <cian.ferriter@intel.com>

Merge "ci: Fix path to CI report"

dpdk: Support dpdk vhost-user client mode

Support of vhost-user client mode has been added for both
OVS and VPP. VSPERF configures vhost-user server mode
in vswitches by default for backward compatibility.
Support of vhost-user server mode is deprecated
in OVS and it can be removed in future releases. Once it will
happen, we have to change vsperf default behavior to
usage of vhost-user client ports at vswitch side.

This patch also fixes processing of boolean configuration
parameters passed via --test-params option. In the past
it was not possible to set boolean value to False through
--test-params option.

JIRA: VSPERF-517

Change-Id: I65e341f820edd6c720043a4acc74c5140b05db18
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

ci: Fix path to CI report

Index file of CI report was restored and paths to it updated
to reflect new documentation structure.

JIRA: VSPERF-514

Change-Id: Id92eb2003a9e6737652313f7ecd03d48a0bfd2ce
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

ci: Use log scale for B2B graphs

Graph configuration for B2B was modified to show correct y axis
tittle and to use log scale.

Change-Id: I7ac75ca803f93be28d89a4504e046b1119d341e1
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "ovs: Update OVS to use DPDK 17.02"

ovs: Update OVS to use DPDK 17.02

Versions of VSPERF tools were updated to use OVS
with DPDK 17.02 support by default. Currently used
VPP version uses DPDK 17.02 already.
VSPERF was updated to support new path to the dpdk
devbind tool.

JIRA: VSPERF-516

Change-Id: I004d0531553c974d604635d50f601cd4326f2f7d
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

cleanup: remove fuel plugin since fuel@opnfv uses mcp

Change-Id: Ibe2028b01c38fa545e72a00a7ef47103d1112b82
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

ci: Fix of SRIOV graphs generation

Wrong test name was used for SRIOV.

Change-Id: Ie07a3bcd162b228d9d6843205a9abf237026f428
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

ci: Fix of CI graphs generation

Parameters must be quoted, otherwise list of testcases is split
among many parameters.

Change-Id: I16ca4feb7e8d30bbbed60fd259e3bd3155f382b3
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

ci: Configure graphical output

Modify configuration of graphs generated from CI results.

Change-Id: Id1a30e0c61419ff131fb4f41138af2e62f822b9c
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

Merge "tests: Improvement of step driven testcases"

Merge "ci: Fix VPP back2back TCs"

ci: Plot graphs from CI results

CI scripts were enhanced to plot graphs from last
results and push them into artifactory. Graphs
will be updated by every CI run and can be included
e.g. in VSPERF results WIKI page.

Change-Id: Iada4acd7cc2c3dc73b9f30a429fe2b53020c4d3b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

ci: Fix VPP back2back TCs

There was a generic issue with restoration of original environment
after execution of testcase. Thus in case that multiple tests were
executed, their settings could be corrupted. This issue was detected
after VPP testcases were added into VSPERF DAILY CI job.

There were two issues:

* setttings.load_from_dict() method was used to restore original
  configuration values; However this method updates dict content
  with supplied values. If TC has introduced new dict item,
  then it was not removed from settings after TC execution
  and modified settings was applied also for next test(s).
* test configuration passed to testcase constructor is used
  for initialization of TC members, which are later updated;
  As python does shallow copy on dict members by default,
  modification of such testcase members led to corruption
  of configuration of other testcases. Thus deepcopy of testcase
  configuration was introduced into vsperf constructor to
  avoid TC configuration corruption.

JIRA: VSPERF-511

Change-Id: I45fb49d48743015353652de12db4692333043733
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

ixia: Fix IXIA in trafficgen mode

There are two IXIA wrappers in VSPERF - IxNET and Ixia. It has
been found that legacy Ixia implementation is no longer working
in trafficgen mode. This issues has been fixed.

JIRA: VSPERF-513

Change-Id: Ief1db71f688a19c5b41508617ccbc73024a02c48
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

tests: Improvement of step driven testcases

A set of improvements was introduced to enhance step driven
testcases capabilities.

Details:
* delay among test steps is configurable by TEST_STEP_DELAY
  parameter
* step driven tool function exec was renamed to exec_shell
* new step driven tool function exec_python was introduced to execute
  a python code
* new step driven object sleep was introduced to pause test execution
  for defined number of seconds.
* fixed bug in settings.validate_getValue() to correctly validate
  access of parameters modified by TEST_PARAMS
* new #PARAM() macro was introduced to allow references among
  configuration parameters
* multistream support has been added into ixnetrfc2544v2.tcl,
  which is used for tunneling protocols test (op2p deployment)
* fixed bug in op2p deployment to list interfaces and flows
  from both bridges involved in the test
* test report updated to state exact rfcxxxx type of traffic
  type, e.g. rfc2544_continuous
* test report of step driven testcases was updated to contain
  measured values from traffic generator in CSV report
* method for ovs flow comparison was modified to normalize
  IPv4 CIDR network addr (e.g. 10.0.0.5/8 => 10.0.0.0/8)

JIRA: VSPERF-512

Change-Id: Ib4f38dcdfbf3820dd766b25520da0ad0c81f3293
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
Reviewed-by: Ciara Loftus <ciara.loftus@intel.com>

Merge "Qemu: Mechanism to pass extra qemu cpu features and pin vCPU threads"

Qemu: Mechanism to pass extra qemu cpu features and pin vCPU threads

JIRA: VSPERF-510

This patch is used to implement the mechanism to pass extra qemu
cpu options required to achieve better results/performance. Also
used to implement a mechanism to pin the vCPU threads to another
pCPU core which helps in reducing the noise from housekeeping
thread and packet loss.

Change-Id: Ic40fd47d7c4f5556f7e240c6ca671a0535d06ece
Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>

xena_cont_bug_fix: Fix duration issue

Port duration is in microseconds. I broke this with a previous
commit.

Change-Id: Id2770149355f40107ab8ee0523482b5867e0e72a
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

vpp_doc_fix: Modify VPP documentation to be current

Update VPP installation documentation and add note for issue
seen with some installs.

Change-Id: Ib1a2bb5f7b6bb07ddff2ea5c7d2ca9f9100250dd
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Merge "xena_pairs: Add pairs topology for 2544 testing"

xena_pairs: Add pairs topology for 2544 testing

Add xena pairs topology and port removal options for JSON
files with RFC2544 testing.  Refactored JSON code for
better expansion later.

Resolved pathing issues related to previous patch allowing
for execution of VSPerf from any directory.

JIRA: VSPERF-502

Change-Id: Ida60c1223ae0f45f8879351770ab7fdce859b59b
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

ci: Update list of VPP TCs in daily job

JIRA: VSPERF-509

Change-Id: I03bfc5a2c8ff69e226464d307563e117b7f3318e
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

ci: Add VPP test execution into CI daily job

Basic set of VPP performance tests was added into
OPNFV CI daily job.

JIRA: VSPERF-509

Change-Id: I9cd6086a958d67dd0e395f962111e6d2b44bf86c
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

build: Automated VPP build

VSPERF makefiles were updated to automatically download and compile
VPP. VPP will not be installed into the OS, but it will be executed
from VSPERF's src subdirectory. Thus underlying OS is not affected
by VPP build required by VSPERF. It also allows quick switch among
different versions of various tools used by VSPERF.

As part of this patch, VERIFY and MERGE CI jobs were updated to
build VPP and test it with basic set of integration tests.

JIRA: VSPERF-493

Change-Id: I958b9031c4fefc87c4c63a471d2ba1a0db1eaaa4
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

pylint_error_report: Report errors generated from pylint failures

Change the output of the pylint check script to report the errors
generated from a non 10 pylint score.

JIRA: VSPerf-508

Change-Id: I6d764f4040a662385c83125322bec7e887942bc5
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

xena_duration_fix: Revert xena continuous to port time limits

Revert xena continuous traffic to port based time limits as
packet limits have an uppers bounds which could be reached
with small packet sizes and longer durations.

JIRA: VSPERF-507

Change-Id: I56986159643344f7872e311590f7d05ac02b038b
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Merge "ixia: Support of 1 NIC connection to trafficgen"

docs: Remove whitespaces from indexes

Whitespaces were removed from RST indexes to correctly
pass rst validation.

Change-Id: I5f277d5f8846653c6e7ea3fbb29881e2dd3f610b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "xena_verify: Add final verification option to Xena"

ixia: Support of 1 NIC connection to trafficgen

For some testcases it is useful to have only one connection between
traffic generator and DUT. Thus IxNet class was extended to support
such connection. Feature is enabled if both IXIA ports are set to
the same value.
New integration testcase ixnet_pvp_tput_1nic was created to demonstrate
this feature.
Unused code was removed from 3rd_party/ixia/ixnetrfc2544.tcl to simplify
introduction of new features and to speed up IXIA configuration.

JIRA: VSPERF-503

Change-Id: I92ab24fa58eeb1ccb7f00ac7f3530ffca7b99241
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

xena_verify: Add final verification option to Xena

Adds final verification option to Xena traffic generator
inside VSPerf. Works by running the Xena2544.exe again
after the initial run is complete with modified values
inside the json file. If the final verify fails it will
revert the settings and continue the in a pattern based
on if the smart search is enabled.

JIRA: VSPERF-506

Change-Id: Ic272628c489b88989f67549bd020af7354dc9b91
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Fix for multi-stream configuration

The multistream configuration is not passed to the remote host where the traffic generator (MoonGen) runs.

Change-Id: I3e9862553b5b064272f3bfffb788c06ebd3740ca
Signed-off-by: Marco Varlese <marco.varlese@suse.com>

Merge "ixia: VLAN support without l3/l4 headers"

Merge "jumbo_frame: Add jumbo frame support"

Changes index depth

Change-Id: I9f83b22eebb61de7ab98040bd67f7dd7f3caf129
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

ixia: VLAN support without l3/l4 headers

Remove dependency of VLAN headers on L3 and L4 protocols.

JIRA: VSPERF-499

Change-Id: Ic16dbbf2b503be7dd48a7bf55e45795bbb9f7e67
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

jumbo_frame: Add jumbo frame support

Add jumbo frame support for all packet forwarding applications
inside guest for pxp testing. Enable jumbo frame support for
OvsVanilla, OvsDpdkVhostUser, and Packet forwarding.

Add minor fix for missing method issue when running packet
forwarding tests. The get_version method was missing in
the packet_forwaring core module.

JIRA: VSPERF-501

Change-Id: Ia99975f47c64259ed2566bde3c85b2779c309e80
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

Removed white space

Change-Id: I4455ce38ca81ad1d5a028c626e3ac53d6d87db43
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Fixed indexes in user and developer documentation

Change-Id: Iad5c130936a815c41265b29053d2978808ff14bb
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "ixia: Make L3 and L4 headers optional"

Merge "ixia: Fix VLAN support by IxNet class"

Merge "vpp: Reporting update related to VPP"

ixia: Make L3 and L4 headers optional

During testing it is sometimes useful to generate pure L2 traffic
without L3 or L4 related headers. IxNetwork TCL script was updated
to support this option.
Generic TRAFFIC array was enhanced by on/off switch for L3 and L4
headers. Thus it can be implemented by other traffic generators
in the future, if this feature will prove itself useful.

JIRA: VSPERF-500

Change-Id: I723c703e5d6ef609fd5b7db366871278a4730203
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

ixia: Fix VLAN support by IxNet class

IxNet class, which controls IXIA via IxNetwork TCL
server, did not support VLAN configuration. Main TCL
script 3rd_party/ixia/ixnetrfc2544.tcl was updated
to support VLAN configuration.

JIRA: VSPERF-499

Change-Id: I89b33dfc653fd59c2983e78a6532812a4c29bddf
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

multistream: Support huge number of streams

Restriction of 64K streams was limited only to L4 stream
type. In case of L3 and L2 stream type, it is possible to
define unlimited number of streams to be simulated
by traffic generator.

JIRA: VSPERF-498

Change-Id: I4ce3253299473127d135c01543999a8593b9556f
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Removed reference to POD 3 since VSPERF POD was moved to POD 12

Change-Id: Ic278ba90c3174b9f83766861981aeb66320c8963
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Added index files for user and dev doc dirs

Change-Id: I0ac84324be97de91c8d4730cd3cb73e994cf28a7
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Updates release note numbering

Change-Id: Id0510b96375033540fa80fe22b301fb1d0d20e40
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

New doc structure changes for stable/danube

Change-Id: I2e9b432a74ee22690fdb366de619dc3a5d2ad725
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Updated doc locations for new structure

Change-Id: I8d948bad350ec90618edac5fc451167c06e8baa5
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "Revert "Moved doc files to testing document structure"

Revert "Moved doc files to testing document structure

This reverts commit 32a5263216d79ad34041dca55357278f092bb931.

Change-Id: I641b967badffd52ffd9e249b75e67bb7c82a8150
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Revert "Corrected doc dir errors"

This reverts commit 255f58a8c64fcb2875f7616dfcbbfeef2173efcb.

Change-Id: Iccaaf205da26a49744b06e019b000e824e4c45cd
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Corrected doc dir errors

Change-Id: Iab221ca0ea22156830c2a106695e305f965d5226
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Moved doc files to testing document structure testing/user ... testing/developer and modified doc index to match dir structure

Change-Id: I4b1a535808a48773505fa7874c61707cd349fced
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Renamed release notes file and added index file to release-notes dir

Change-Id: I448fd909a89103b2c11cb16f91b8c646fb5adee8
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

vpp: Reporting update related to VPP

VSPERF reports were updated to contain vSwitch name.
In case of VPP, it is not possible to read its version
if VPP is not running. Thus VSPERF was enhanced
to support tool version check during its runtime. This
mechanism can be enhanced to support e.g. VNF in the future.

JIRA: VSPERF-496

Change-Id: I74b47505e35340eead165d9b588e9cc15c058bbf
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "IXIA setup: Fix to create packets with the specified values."

Merge "vpp: Initial support of VPP vSwitch"

vpp: Initial support of VPP vSwitch

Support of VPP was implemented into VSPERF. Initial implementation
uses step driven testcases to configure P2P, PVP and PVVP network
scenarios. These testcases were prepared for three RFC2544 traffic
types, i.e. throughput, continuous stream and back to back.
VPP configuration is driven by new configuration option VSWITCH_VPP_ARGS.
It is possible to use three types of l2 port connection supported
by VPP, i.e. l2 xconnect (default), l2patch and l2 bridge features.
Configuration is driven by parameter VSWITCH_VPP_L2_CONNECT_MODE.

JIRA: VSPERF-495

Change-Id: Idebef9b10fb0d70796adb3405fec77302de00a7e
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Fix fuel plugin installation issue in latest ISO

Change-Id: I8383b469f5350f4457cf234de2a4ff8f79151afe
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>

Merge "install: opensuse - fix non-utf8 characters issue in /etc/services"

install: opensuse - fix non-utf8 characters issue in /etc/services

The scapy python script (data.py) parses the file /etc/services
using the default utf8 decoder. Unfortunately, there are some
characters in that file which are non-utf8 hence the script
stops prematurely. This patch addresses that issue.

Change-Id: Ib5bd41d4fc60b4ce1072fe71b14769b02da7b724
Signed-off-by: Marco Varlese <marco.varlese@suse.com>

Changed "NEWS" to "Release Notes" and added openSUSE

Change-Id: I55d50656930f386b55924ee23948b2e321d2745b
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Renamed NEWS.rst to vsperf-release.rst and moved into release dir per new doc structure
Remove reference to NEWS.rst in index file ... release notes will be referenced in Release section

Change-Id: I8f32c7cd23b0b2cd33703950a71cbb626c0c35fc
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Add support for openSUSE Leap 42.2

This patch enables openSUSE Leap 42.2 systems to build and run VSPERF.

Change-Id: I182cec8a11ee5f0d70670f1ae18dd35fcc257616
Signed-off-by: Marco Varlese <marco.varlese@suse.com>

Merge "Updated project description and license header"

bugfix: Remove typo from requirements.txt

Wrong characters were inserted into requirements.txt during
modification of file license header. This bug caused issues
during installation of vsperf by installation scripts.
Problematic line was removed to avoid installation failures.

JIRA: VSPERF-489

Change-Id: I399eb8ecc7c42a9c42fb1e697dd6322fc9867951
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Marco Varlese <marco.varlese@suse.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Updated project description and license header

Change-Id: I122bdec1a7fa9a9e3da51acb31b30a231eff7890
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Xena_pylint_fix: Fix param call to changes made by pylint patch

Missed this small issue when calling continuous streams caused
by the param name change from the pylint patch in XenaDriver.py
ca9c9275ed6d5d852987c69a378e88a3502cb2ab.

Change-Id: Ic8ad86358f72e91edea34cb37207d7dc583128b4
Signed-off-by: Christian Trautman <ctrautma@redhat.com>

pkt_gen: STC parameter reordering bug.

This patch fixes a bug caused due to wrong parameter ordering.
stc_common_settings should come after rfc2544_common_settings.
It also gets rid of 'Import' error for module 'conf'

JIRA: VSPERF-491

Change-Id: I356294b4efdf9ebd0cea4492d3ed1cb8e04ec9b1
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>

license: Add license info to all project files

All files were updated with license header. In case
of binary files is license stored in LICENSE file stored
in the same directory. Packages.txt was removed, because
file has not been used.List of packages differs according
OS distribution, all of neccesary packages are include in
instalation scripts

JIRA: VSPERF-489

Change-Id: I6ecae21b8db2a0f22fa5a66f9525352080f1fcc0
Signed-off-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>

Merge "ci: Add SRIOV TC to CI daily job"

ci: Execute pylint checks by VERIFY and MERGE jobs

Pylint should be executed automatically for every patch
to assure, that new code meets vsperf coding standards.

JIRA: VSPERF-114

Change-Id: Icb1000e207b2d728497ff3d349fb3cb8334baac7
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>

ci: Add SRIOV TC to CI daily job

SRIOV functionality should be regularly tested to detect
any issues brought by new features. Testcase pvp_tput
will be executed by daily job for several packet sizes.
Testcase results will be reported and stored into artifactory,
but they won't be stored into result database.

JIRA: VSPERF-390

Change-Id: I9f6290b3be297a84c185681ce354bc7365b4036c
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

pylint: Fixing pylint errors and warnings

All python files must reach pylint score 10/10. This will be
regularly verified by Jenkins jobs to keep constant code quality.
VSPERF specific pylintrc file was updated according to the vsperf
coding standards. Distro version included in reports will be
slightly different, due to migration to new python package distro.
Previously used platform.distro() will be deprecated since python 3.7.

JIRA: VSPERF-487

Change-Id: I934120208b9624787a3567ccaa49e14d77d7a5bf
Signed-off-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>

docs: Remove hyperlinks to docs in artifacts

It is possible to use sphinx cross referencing
feature in case, that only one level of toctree
is used. Thus documentation was reorganized
to utilize just one top level index with toctree.
After that it was possible to use rst native syntax
to create a cross links among vsperf documentation
chapters. As a result only 2 hyperlinks to the
yardstick documentation are version specific.

JIRA: VSPERF-442

Change-Id: I15c2f53922e88765506448de61af4a299f5d53c5
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "pkt_gen: STC - RFC 2889 Address Learning and Caching Support"

pkt_gen: STC - RFC 2889 Address Learning and Caching Support

This patch adds RFC-2889 address-learning-rate test and
address-caching-capacity tests. The patch includes following changes

1. 01_testcases.conf: testcase definitions are added for new tests
2. results_constants.py: 3 new results constants are added, removed
   unsupported constants
3. testcenter-rfc2889-rest.py: Added support to these two new
   tests. Removed un-necessary synchronization of db-file. 5 new
   configuration parameters are added - which are explained in (4).
4. trafficgen.rst: Configuration description for rfc2889 tests are
   added. Stale information is removed.
5. testcenter.py: Support for two new tests are added. Separate
   functions for results analysis and parameter settings are added.
6. traffic_controller_rfc2889.py: Calls to functions in testcenter.py,
   based on the traffic_type, are added.

Removed trailing whitespaces from trafficgen.rst

JIRA: VSPERF-395

Change-Id: Ie6ca87519b7736e7410d7f0e60904579934af24a
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>

fedora_remove_old: Remove installation scripts for Fedora 20-22

VSPERF with DPDK 16.04 and 16.07 did not work on Fedora 20-22.
Installtion scripts for F20-F22 were deleted. VSPERF supports
F24 and F25.

JIRA: VSPERF-475

Change-Id: I3ce62b8883844cbcaab5b75fb9374068f9fced16
Signed-off-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>

Merge "fedora25_install: Provide installer script for Fedora 25"

IXIA setup: Fix to create packets with the specified values.

This patch fixes the setting of the packet fields generated by IXIA.
So that  packets will be created with the values we pass, eg UDP
source port, UDP dest port, MAC source address.

JIRA: VSPERF-477

Change-Id: I15371b9f4e5fe60f738fc0e836ec7abc4f2a3938
Signed-off-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik martinx.klozik@intel.com
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>

fedora25_install: Provide installer script for Fedora 25

Adds installer script for Fedora 25. Kernel version on Fedora 25
requires DPDK 16.11 and newer. VSPERF user must use DPDK and OVS
versions, which are compatible with installed kernel.

Adds new folder for current distribution with installation scripts.

JIRA: VSPERF-453

Change-Id: Icb86ea7655e95df57a8052e4a8523348a0c75dc0
Signed-off-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>

info: Updated key project facts

List of commiters was updated and name of IRC channel added.

Change-Id: Ib12cc5fd9991f5918be06e0bccf5ef09dcff5628
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>

Merge "fedora24_install: Provide installer script for Fedora 24"

fedora24_install: Provide installer script for Fedora 24

Adds installer script for Fedora 24. Kernel version on Fedora 24
requires DPDK 16.11 and newer. VSPERF user must ensure, that used DPDK
and OVS version which are compatible with installed kernel.

Adds new folder for current distribution with installation scripts.

JIRA: VSPERF-453

Change-Id: I08846d6e51faa578ea9305173174bfc49b77018a
Signed-off-by: Martin Goldammer <martinx.goldammer@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>