testcase: scalability testcase enhancements

Streams used by scalability testcases can be simulated
at different network layers by modification of destination
MAC address (L2), destination IP address (L3) or destination
UDP port (L4). It is possible to define number and type
of the streams by testcase definition by options "MultiStream"
and "Stream Type" or by CLI parameters "multistream" and
"stream_type". CLI options override testcase definition.
Number of streams, their types, used transport protocol
and indication of pre-installed flows are written to both
result CSV file and MD file with test report.
Default transport protocol was changed to UDP because
IxNetwork configuration script doesn't support TCP yet.

Change-Id: I1ff9ab7756d38f65b1a7730397507c5a5ff5a3d1
JIRA: VSPERF-81
JIRA: VSPERF-82
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

pkt_gen: rename throughput_tx_* to tx_rate_*

Change throughput_tx_* references to tx_rate_* so the results won't be
confusing as part of the opnfv test dashboard when they become
publicly available.

Change-Id: Ie8cfae99a75497f15eb09d097c72c8a35df3b5f9
JIRA: VSPERF-135

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Ian Stokes <ian.stokes@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Results: Integrate with opnfv_test_dashboard

All the test projects generate results in different format.
The goal of a testing dashboard is to provide a consistent
view of the different tests from the different projects.
We need to enable the data collection for VSPERF, in other words
VSPERF pushes data using a REST API.
The feature is enabled by --opnfvpod parameter on vsperf command line.
The value of the parameter sets POD name.
Example:
--opnfvpod <pod_name>   or   --opnfvpod=<pod_name>
You need to specify installer name. It can be set in conf-file
default value:
OPNFV_INSTALLER = "Fuel"

JIRA: VSPERF-112

Change-Id: I37255414eebcc2ff0c12109c508dcd984663a830
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Add some error checking to F21 install

Make the install fail fast and obviously on error rather than
continuing on. This can be used as a template for adding error
checking on the other systems.

JIRA: VSPERF-141

Change-Id: I1892db661a56ab2012e26c6720e0851fabbb51d9

Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vnfs: configurable loopback application support inside VM

For PVP and PVVP deployments, traffic inside virtual machines must be
forwarded between its interfaces. There are several forwarding options
supported by VSPERF, including DPDK testpmd, Huawei l2fwd kernel module
and linux bridge. Another option is, that VM image has built in forwarding
functionality and vsperf doesn't configure it itself.
User can select VM loopback application by configuration option
GUEST_LOOPBACK (per VM) or by SCALAR cli option guest_loopback (global
settings).
Selected guest loopback application(s) will be written into test results
CSV file and test report MD file.
Default wildcarded guest login prompt was added. Guest startup guarding
timer can be configured. Path to OVS kernel module has been fixed.

Change-Id: If738da1ea09112f9cf2267afcbc99a6797f3a03a
JIRA: VSPERF-130
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

pkt_gen: add duration to all send functions

Allow a configurable duration for all send functions.
JIRA: VSPERF-125

Change-Id: I7c6f5d136a7d7100e3990f7fdc00121b07081a80
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>

docs: update installation guide and gsg.

Update installation guide and gsg to include latest updates to vsperf
build and installation.
JIRA: VSPERF-127
Change-Id: I773ea240eb90e191f4f53ed977651056817413f1

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

Adding install scripts for Ubuntu14.04

System build scripts for Ubuntu14.04 are added. DPDK mkdir hugepage
fails to create /dev/hugepages with permission error. Workaround for
that is added so that /dev/hugepages dir is created when OS specific
scripts is run with sudo privilege. Also adding missing packages
kernel-modules-extra, pixman-devel and openssl-devel for Fedora systems.

JIRA: VSPERF-128

Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Change-Id: Ie805c094df4a3f9446b09ea2d7e4dfb2f5324544
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

doc: update template and conf files

JIRA: RELENG-16

Change-Id: I0aaac15c1d1a1031cbc113db594a342c60b7eb1d
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>

Adding system build scripts for Fedora 21 and Fedora 22

Scripts are added for Fedora 21 and 22 to install system requirements
and python packages on these systems. Also modified root
build_base_machine.sh so that it can handle directory structures for
version specific scripts if available.

JIRA: VSPERF-93

Change-Id: If6a311bc7bb1116979faabff5e9097e39f2f5495
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

pkt_gen: update testcenter implementation

Update testcenter implementation to move settings to
generic settings file and change windows line endings.
JIRA: VSPERF-126
Change-Id: I156005f261bc0df6c3d8009db72ba2d5991c6166

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

Enable OVS master and DPDK 2.1

VSPERF used old version of OVS, which has supported DPDK 2.0.
With switch to DPDK 2.1, VSPERF can use recent OVS code again.

JIRA: VSPERF-124
Change-Id: I81f6b8887d795df08a2eb8959606f2a9a277f9e6
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

conf: change default RTE_TARGET

Change RTE_TARGET to build native instead of ivshmem.

Change-Id: I3707d1f4bf545c4a2a35e85816f26dbd214a72de
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: reorganize docs for the sphinx build

Reorganize docs into the appropriate folders for the new sphinx build.
JIRA: VSPERF-80

Change-Id: I9dcd74e092ce52546a0986b92a1ebb2b5b7419bf
Signed-off-by: Ramprasad Velavarthipati <ram.v@freescale.com>
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Trinath Somanchi <trinath.somanchi@gmail.com>

bugfix of Vanilla OVS testing scenarios

Automatic selection of OVS and DPDK directories must be performed
before initialization of modules is called. Otherwise modules will
use wrong values with unpredictable results.
Default directory values have been changed to point to sources build
by make.
Clean&sweep of directory usage was performed.
Configuration file for pylint has been renamed to follow pylint
naming convention.

Change-Id: I42c89f8890c021f0062b478a856ae0113f1245fb
JIRA: VSPERF-121
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

First phase of Spirent Traffic Gen integration

Change-Id: Ib852c81fc8e09593411984bfb6f9bc5d5629f0c4

docs: fixup documentation errors and locations

Fixup the location of all rst documentation and any errors in the ltd.

JIRA:VSPERF-60

Change-Id: I1472d540b1b4eca4ab038d079bfb0ef2f0c5ebcd
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Fix Make, Make clean and when the src directories are cloned

Update the rules for Make clean and distclean.
Update make not to clone the repositories if they are already
cloned, simply pull, checkout the tags and build.
Changes in this patch:
1. QEMU is built just once in .../src directory.
.../src_vanilla and .../src_cuse don't contain qemu anymore
2. 'make clean' deletes all built *.o files
3. 'make distclean' deletes all built and generated files
(distclean is used instead of cleanse now)
4. 'make' calls 'git pull' when repository is cloned already

JIRA: VSPERF-94

Change-Id: I80f9a135580b450fb4606cf947661049ff509548
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

Stop OVS from generating misleading add-br errors

Create bridge and set datapath_type in 1 transaction to prevent OVS from
generating misleading error messages which jenkins considers as
build errors.

Update vswitch interface to include optional parameters.

Change-Id: I668f474ea909b284f3726807aab42d52ae2fb504
JIRA: VSPERF-122
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>

systems directory scripts for Centos7

Installation scripts for Centos7 have been updated with new packages.
Script will install also python3 packages and create python virtual
environment. As a last step DPDK, OVS and QEMU will be compiled. So
after script execution VSPERF should be ready for use.
It is recommended to execute installation script from user account
with password less sudo access. Otherwise python environment
must be copied over from root home directory.
After VSPERF generic Makefile will be created by VSPERF-114, it can
be enhanced to call build script too.

Change-Id: I6ff5d2660af29cf8be134a4cae3b1d7b559892fa
JIRA: VSPERF-93
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Simple performance Test for the PVP and PVVP

Two sample contionous stream testcaes were introduced for PVP and PVVP
scenarios. Required frame rate percentage can be specified either by
tetcase configuration option "iLoad" or by command line option "iload".
Command line option take precendece to testcase option. By default 100%
linerate is used if not specified otherwise.

Change-Id: I95f7ae6081377a4c99ce70fc7504b6b542f9260b
JIRA: VSPERF-95
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>

Add Pylint to VSPERF commit gate

Initial pylint config file has been created to follow current
code structure and design. A few issues have been fixed, so currently
56 of 67 files have rating 10/10. There are still issues to be fixed,
mainly TODOs/FIXMEs and missing impelentation of abstract class members.

Change-Id: Icf5b12c2150258f8ac657f8d50b47a697d1660a0
JIRA: VSPERF-91
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Flow Classification extension

Flow definition can be changed by testcase setup. By default
only ingress ports are used to route traffic, but flow can be
extended by src and dst IP addresses used by the traffic
generator.

Change-Id: I694714537ad2d818192a39f3235d8e6bf0f59a49
JIRA: VSPERF-90
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

exclude files from the search in the Loader

New configuration parameter EXCLUDE_MODULES defines module names,
which won't be automatically loaded by LoaderServant. It can be used
to exclude obsolete or abstract modules.

Change-Id: If98b50b1505465bcedcf28fe63421c73a4fe160a
JIRA: VSPERF-118
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Implement support of 'insmod' and 'modprobe' commands into ModuleManager

Module manager has been enhanced to support both 'insmod' and 'modprobe'
commands for kernel module insertion. In case, that .ko suffix is detected
then insmod will be used otherwise modprobe will be called. This allows
user to specify full path to each module. For example vanilla ovs module
can be defined as "OVS_DIR_VANILLA + 'datapath/linux/openvswitch.ko'"
to load kernel module matching OVS vanilla source tree version.

Change-Id: Ib8d16eca84449ad34d6b307ab836f58d2f0d341b
JIRA: VSPERF-116
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

test_spec: Need deployment scenario in RFC2889 Forwarding Rate test

The RFC 2889 Forwarding Rate test requires a Deployment Scenario
Section - was missing.

JIRA: VSPERF-102

Change-Id: Iaf661a6bbb9ad52f23147f9444f23d96a82ceb2d
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

test_spec: LTD: Add Caution for Scaleability Address Time-out.

LTD.Scalability.RFC2544.0PacketLoss needs to add the caution that
all flows must be learned before running Throughput testing,
and no flows can be allowed to time-out during the test.

JIRA: VSPERF-108

Change-Id: I95ae20a978b7af660b358450e67ce60939b0b7c1
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

test_spec: IETF Draft: Update to reflect dev since July and IETF-93 comments

Among the Updates needed are:
- Several New tests created since July, add to Matrix section.
- Re-named tests: fix in Matrix section.
- Link to Summaries on Wiki.
- Link to Test Setup Figures on Wiki.
- Add some general points on New Test Equipment Challenges/Metrics.
- Mention future test specs, and IFA003 as one source.

JIRA: VSPERF-120

Change-Id: I981b0b6301a208d20220f67784b4591aa3f51338
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

test_spec: LTD: Some "Throughput" Tests belong in another category

In the LTD, some of the tests with "Throughput" in the title are not actually
testing throughput in the data path.
Since the test names are used by TOIT/VSPERF to group similar tests for batch
execution, it's important that the names accurately represent the test methods
and metrics measured.

JIRA: VSPERF-98

Change-Id: I620ddc0779232f2dd325379005faba8692fea18c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

test_spec: LTD: Missing Pre-requisites in some of the "new" tests.

A few of the tests should call out a prerequisite.
LTD.MemoryBandwidth.RFC2544.0PacketLoss.Scalability
and
LTD.Scalability.RFC2544.0PacketLoss
are examples.

JIRA: VSPERF-107

Change-Id: I1ca653ac765f9494b48759764103dfc9d42a42f1
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

Default config picks up OVS variants

Running a test with vanilla-ovs, vhost-user-ovs,
vhost-cuse-ovs,... does not require any building
or configuration changes - the vswitch needs only
to specified on the command line.
The config file contains new variables for particular
ovs build.
OvsVanilla:
OVS_DIR_VANILLA, QEMU_DIR_VANILLA
VhostCuse:
RTE_SDK_CUSE, OVS_DIR_CUSE, QEMU_DIR_CUSE
VhostUser:
RTE_SDK_USER, OVS_DIR_USER, QEMU_DIR_USER
The vspef chooses right paths according to command line
switches '--vswitch' (or 'VSWITCH') and '--vnf' (or 'VNF')

JIRA: VSPERF-86

Change-Id: I22e3a7f9e21d6ceb13830e444716b4274314560c
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: LTD:Throughput.RFC2544.Profile Metric Clarifications

LTD.Throughput.RFC2544.Profile refers to the metric "maximum forwarding rate"
but implies that this is the zero% loss rate, which would be the Throughput
level (MFR is usually higher than Throughput, because MFR allows losses).
It may be that MFR and Throughput are just interchanged in the last two
paragraphs of the description.

JIRA: VSPERF-110

Change-Id: I4f36fd4ce66f2f4ebee4f60a11ad03adfb2b3b7c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

test_spec: LTD: Memory BW Test - probable issue caused by md to rst conversion

The following text in the Description needs to be formatted as a list in .RST:
Furthermore: - the ratio of reads to writes should be recorded.

JIRA: VSPERF-109

Change-Id: I3b6c819d1ac07cc466c747d3552cbcc4de5f34bf
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

test_spec: Expand deployment scenario in RFC2889 Broadcast Rate test

In the RFC 2889 Broadcast rate testing, four test ports are required.
One of the ports is connected to the test device, so it can send
broadcast frames and listen for miss-routed frames.

JIRA: VSPERF-103

Change-Id: I5ee3d20c71d7debf6c7b09fc094f72b2d4c10684
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>

Enable PVP and PVVP deployments for Vanilla OVS

Support for PVP and PVVP scenerios using Vanilla OVS was added.
VMs are configured to forward traffic between virtual interfaces
by standard linux capabilities. Traffic generator script was updated
to accept MAC and IP address configuration to allow VM forwarding
configuration.

VSPERF-66, VSPERF-70

Change-Id: Ia70ab6be547b39928a1eae319faba779d4e29284
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

docs: Add overview of the structure of vsperf code

Text & sequence diagrams as both source and png.

JIRA: VSPERF-106

Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Change-Id: I33f57fba85710ab4cfc72d0a5d06db6f653545d6

test_spec: Note need for 3 test ports in RFC2889 address/cache

The RFC 2889 Address Learning and Cache Capacity tests require
a listening port to check for flooded frames.

JIRA: VSPERF-74

Change-Id: I7b4d2461e819d01d642c9c4d95b938dfbe056f2c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

src: add appropriate build flags for OVS dpdk

Technical Debt - Add appropriate build flags to the OVS makefiles to
build OVS for performance.
JIRA:VSPERF-92

Change-Id: I63d45ebe8ba41799158f97db892a94e16c7b3df5
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

Enable PVVP deployment for DPDK Vhost User and Vhost Cuse

Generic PVVP deployment support has been added. Two
new testcase scenarios for throughput and back2back
tests with PVVP deployment were added. Original
implementation of PVP has been refactored
Following files were affected:
modified:   conf/01_testcases.conf
modified:   conf/02_vswitch.conf
modified:   conf/04_vnf.conf
modified:   core/__init__.py
modified:   core/component_factory.py
modified:   core/loader/loader_servant.py
modified:   core/vnf_controller.py
deleted:    core/vnf_controller_p2p.py
deleted:    core/vnf_controller_pvp.py
modified:   core/vswitch_controller_p2p.py
modified:   core/vswitch_controller_pvp.py
new file:   core/vswitch_controller_pvvp.py
modified:   docs/to-be-reorganized/NEWS.rst
modified:   docs/to-be-reorganized/quickstart.rst
modified:   src/dpdk/dpdk.py
modified:   src/ovs/ofctl.py
modified:   testcases/testcase.py
modified:   tools/tasks.py
new file:   vnfs/qemu/qemu.py
new file:   vnfs/qemu/qemu_dpdk.py
modified:   vnfs/qemu/qemu_dpdk_vhost_cuse.py
modified:   vnfs/qemu/qemu_dpdk_vhost_user.py
modified:   vnfs/vnf/vnf.py
modified:   vswitches/ovs_dpdk_vhost.py

Change-Id: Ib6869a29337a184cb58c57fd96bba1183aba00ab
JIRA: VSPERF-68, VSPERF-69
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

The 'make' creates all required variants of vSwitch

Currently the VSPERF makefiles make just one variant
of vSwitch - OVS with DPDK-vhost-user. To make the other
variants the makefile has to be edited. And the make re-run.
The fix builds all required versions:
DPDK-vhost-user OVS (in src/)
Vanilla OVS (in src_vanilla/)
DPDK-vhost-cuse OVS (in src_cuse/)
HowTo:
- git clone vsperf
- cd .../src
- make

JIRA: VSPERF-85

Change-Id: I469baf8432f0b127cde785f35a6c57a2c778f23f
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>

pkt_gen: change duration to int for Dummy pkt_gen

In case there is specified concrete value for "duration" in the
configuration there is raised TypeError exception
in the send_rfc2544_throughput function of dummy traffic generator.
Conversion to integer solved this issue.

Change-Id: Ib37ecabc1000369d807a997c88d7a3d7aca425d5
Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Add Traffic Profiles (IMIX) maintained by Functest

The Current list of fixed frame sizes need to be augmented with
IMIX Traffic Profiles in the test framework.

JIRA: VSPERF-100

Change-Id: I97425c09c1d692bae56f2518d479b83a282eb7d1
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Fix WIDE Fig and Note need for full-mesh ports in RFC2889 tests

The RFC 2889 tests require Full Mesh on multiple ports.
Modify the bunny-ears fig to show this (and address -99 in the process)

JIRA: VSPERF-99
JIRA: VSPERF-101

Change-Id: Id67cb5ef6748c83858a90033534f960874614c06
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

Remove reported derived performance figures

Since vsperf (ixnet trafficgen) started using AggResults.csv
to pull out traffic results after bi-dir support was added.
Some of the derived results are wrong (derived meaning
these are figures vsperf calculates from the info available
in the raw ixnet results).

JIRA: VSPERF-88

Change-Id: I79d88bfc7718bda675d2ba7e5148053405a94211
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

Sysmetrics implementation update

New sysmetrics implementation is based on pidstat command line tool
from sysstat package. Old non-functional implementation was removed.
Reporting was refactored to generate report after each TC from values
already available in memory.
Following files were affected:
modified:   conf/01_testcases.conf
modified:   conf/02_vswitch.conf
modified:   conf/05_collector.conf
deleted:    core/collector_controller.py
modified:   core/component_factory.py
modified:   docs/NEWS.rst
modified:   packages.txt
modified:   requirements.txt
modified:   testcases/testcase.py
modified:   tools/collectors/collector/collector.py
modified:   tools/collectors/sysmetrics/__init__.py
deleted:    tools/collectors/sysmetrics/linuxmetrics.py
new file:   tools/collectors/sysmetrics/pidstat.py
modified:   tools/report/report.jinja
modified:   tools/report/report.py
modified:   tools/systeminfo.py
modified:   vsperf

JIRA: VSPERF-67
Change-Id: I25a79f2afef405b9ac46ae85c18044af167a62a4
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Frame Modification: support remaining frame modification types.

Only works for P2P. Other deployment scenarios will need to implement
the same kind of multi-table flow as P2P to enable frame modification.

Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Madarang <dino.simeonx.madarang@intel.com>
Change-Id: I2fa35972b90b165c00f0d0a7515fa275d0f17aa4

Move documentation to new sphinx build

TODO: Reorganize documentation into properly named subfolders
TODO: Add logos to documentation (see index.rst for example)
Note you can see the results of this change via a link in the gerrit
comments below
NOTE: The merge job for your project has not been enabled, this code
will not go to the artifacts page upon a merge. you can merge it and
work on it in your own time, please contact me to enable the merge
(the merge job will make this documentation avaliable to the public on
artifacts.opnfv.org)
JIRA:RELENG-15

Change-Id: I3f3d8c9d7fceae90e0ed824b66bdaf7a8ea66328
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>

Add DNAT/SNAT support

JIRA: VSPERF-72

This change adds optional IPv4 DNAT support to l2fwd module for level two
forwarding. With this change the l2fwd module can be used for testing
complex IP configuration routing with virtual switches.

Other L2 forwarding modules provide only Level 2 pass through. These can be
used for complex IP chain processing but rely on port forwarding in the switch.
With this module each packet which is forwarded optionally gets a new
destination IP and source masquerade. So a test packet can be routed to eth1
and forwarded on eth2 with a different target IP and source address.

To use this module compile it for your kernel and use the 'insmod' command
to insert it.

With no arguments this will forward eth1 to eth2 without modification.

With 'net1=ethX net2=ethX' Level 2 forwarding can be done between arbitrary
ports.

With 'netX=ethX,XX.XX.XX.XX,xx:xx:xx:xx:xx:xx' the packets which are forwarded
on the target port will be given the new destination IP and mac address. One
or both ports may enable DNAT.

Change-Id: If24281a6841930a7a85e4536da96b980ed48df1b
Signed-off-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>

Improvement: Expand background details on PDV in the LTD

Expand description of Packet Delay Variation to capture
the additional details which will be important to measurement
design. Measurmeent devices may be implementing the RFC 5481
PDV metric for the firt time, so som general details will
be useful to include in the LTD. Addresses MT's comments.

JIRA: VSPERF-73

Change-Id: I60524969f72bb00519e8070ae51e219d857c554e
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

bug_fix: Remove extra call to VNF start

Remove call to VNF start since it is already called in __enter__
of VnfControllerPVP.

VSPERF-66

Change-Id: I9c9174ffe7d03efacb6853c059b43c8a5ca66704
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

bugfix: Allow exact test names

The current --tests option can make it hard to specify a single test to run.
This patch allows specification of tests using exact names.

JIRA: VSPERF-58

Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Change-Id: Ib820bdae96d6257d785f4e310a3b3d1fbfa1b575

vswitches: Fix error in loading eventfd module

Load eventfd only when vhost-cuse is specified as
the guest access method.

This commit also includes quickstart update for executing PVP tests.

JIRA: VSPERF-59

Change-Id: I41f116ab1c42f704026567a269922c07994b15a5
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>

src/dpdk: Rebind DPDK ports to the original driver

Bind DPDK ports back to the original driver they were bound to. This
will be useful when switching between the types of vswitches we are
testing.

Change-Id: I6818d3f8e3c2a5d3a5f083cf9e37e0819e0b39d1
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>

bug_fix: process pkt_size/duration from cli

Refactor rfc25444_duration to duration and update the --test-params help
to show the type of parameters that can be set from the cli. Also
configure pkt_sizes so that it can be modified from the CLI. Also fixes
the tcl script to configure framesize properly (to the value selected
and not the default 64b).

JIRA: VSPERF-27

Change-Id: I76dcd824977a5f940cf7476090d2d2a3acca8160
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Dino Madarang <dino.simeonx.madarang@intel.com>

Merge "Support of configurable background load and implementation of LTD.CPU.RFC2544.0PacketLoss and LTD.Memory.RFC2544.0PacketLoss"

Support of configurable background load and implementation of LTD.CPU.RFC2544.0PacketLoss and LTD.Memory.RFC2544.0PacketLoss

Every testcase can be configured to run background load
on the DUT. Load is generated by chosen command line tool,
which must be installed according to the installation.md.
Currently 'stress' and 'stress-ng' tools are supported,
but support for new tool can be easily added.
Load can be configured by testcase configuration option 'load'.
Details about supported load generator options can be found
in conf/01_testcases.conf.

JIRA: VSPERF-23
JIRA: VSPERF-24
Change-Id: I3e1aebc0d41357f5a2764015c41ffc7e50fdbf8b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Merge "vswitches: Affinitize vswitch threads for OVS-DPDK"

vswitches: Affinitize vswitch threads for OVS-DPDK

JIRA: VSPERF-64

Change-Id: I7cefd05479da6fe17357da4da558f466175dd6fc
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vnfs: Enable PVP using vhost-cuse

Enable PVP testing using vhost-cuse as guest access method

Recent changes:
* Move NEWS.md changes to NEWS.rst
* Update comment to vhost-cuse
* Restore config back to checkout state after make
* Merge OPNFV 1092 updates

* Add PVP-vhost-cuse to NEWS.md
* Add comment/example to GUEST_CORE_BINDING
* Move hardcoded values to conf/04_vnfs.conf
* Set default VNF to QemuDpdkVhostCuse
* Compile eventfd_link if VHOST_USER=n
* Use MAC and PCI address from conf
* Use vhost method in conf to properly set interface type

JIRA: VSPERF-59

Change-Id: Ib1159e216f3e25b9971c0935969680582683916b
Signed-off-by: Madarang, Dino Simeon <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

docs: Add Gotchas to quickstart guide.

JIRA: VSPERF-60
Change-Id: I63695f8fa8a86cf1e64fd959658e11f3d827a3c4
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: Migrate Docs to RST format and new dir docs/

Migrate all existing VSPERF documentation to a new directory called
docs/ and convert to ReStructuredText format. It's recommended that any
doc changes in the future are tested with: http://rst.ninjs.org/.

Change-Id: I18aa574b1259986502bde4ceef1fae7c6a5c1f33
JIRA: VSPERF-60

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com

vsperf: update package dependencies for QEMU

Update packages.txt with the required packages to build QEMU v2.2.1.

JIRA: VSPERF-56

Change-Id: Ifdf802de3c195b0dc5c48dcb8f098c31a1561012
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Madarang, Dino SimeonX <dino.simeonx.madarang@intel.com>

Initial reporting implemenation

Reporting from TOIT was merged and improved. Default template was modified
to support any testcase and to show more details about system environment.
Affected files:
* docs/NEWS.md
* testcases/testcase.py
* tools/report/__init__.py
* tools/report/report.jinja
* tools/report/report.py
* tools/systeminfo.py
* vsperf

JIRA: VSPERF-71
Change-Id: I4dc84ca69e5c292eae1f8dede1411c06ae3ef8af
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>

vnfs: Enable PVP using vhost-user

Enable booting of a VM with DPDK and run testpmd for
PVP testing.
* Added throughput and back2back tests with pvp deployment scenario in
  01_testcases.conf
* PVP requires DPDK 2.0 with VHOST_USER enabled and QEMU 2.2.0
* Tested on CentOS7 and Fedora 20
* Fix conflict with change 1078

Recent Changes:
* Fix merge conflict (testcase.py and testcases.conf)
* Remove QEMU_DIR. User must set QEMU_BIN
* Set bidir traffic to True
* Add flow for bi-directional traffic
* Use working OVS_TAG ad2e649834be20dd01b1632799fe778106a96a2d
* Merge change 1096 (src: Add QEMU makefile)
* Set virtio-net-pci csum=off and other variables to off
* Move hardcoded values to conf/*

JIRA: VSPERF-56

Change-Id: I4ad184531064855493483d9833a7722c9f7d3576
Signed-off-by: Madarang, Dino Simeon <dino.simeonx.madarang@intel.com>
Signed-off-by: Meghan Halton <meghan.halton@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

TestSpec: LTD.Scalability.RFC2544.0PacketLoss

Clarify that the test intends to test the fastpath and thus the flows
need to be installed on the vSwitch before passing traffic

Change-Id: I7d72ca66d7b854463c3b809c16fd8c8088353b99
JIRA: VSPERF-19
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Address IETF-93 comments with 2889 Soak tests

This patch makes it clear that the Soak tests use a
method consistent with RFC 2889 to simplify test system
interactions.

JIRA: VSPERF-49

Change-Id: I82ca1e6ae6e066f72b343ece72ba98fab2aab97a
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

Add new testcase for LTD.Scalability.RFC2544.0PacketLoss

This test adds a multistream config item,
taking the required number of flows to setup in the traffic,
to the existing testcase and then running the standard
2544 Throughput test. The config is plumbed through
from the 01_testcase.conf via ITraffic to the IxNet.
01_testcase.conf contains new parameter MultiStream
for 2544 Throughput test.

JIRA: VSPERF-19

Change-Id: I12e0e76a5f54dc13b854f3a65f3a4a0fe90ff885
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

TestSpec: Add actions to flow Classification

Clarify that a flow has an associated action and isn't simply packets
with matching header fields.

Change-Id: Iffa7ae121049d8ec798f937082a733ef520e9d05
JIRA: VSPERF-49
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add compiler details to test report info

Change-Id: I19d574607c29cbb8401047ab7d1255ba7282ef63
JIRA: VSPERF-47
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com

test_spec: Clarify LTD.CPU.RFC2544.0PacketLoss

Make changes based on comments from review at VSPERF weekly call 2015-08-05.

JIRA: VSPERF-2

Change-Id: I141c2b35c5469270ba8e3ecfdf88b93ec8e3d35a
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Merge "src: Add QEMU makefile"

test_spec: Add LTD.CPDPCouplingFlowAddition

JIRA: VSPERF-2

Change-Id: Iab66730606d9137e0f2cac195f7c98bec71fa072
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Vanilla OVS support implementation

JIRA: VSPERF-57

This patch implements Vanilla OVS support.It contains:
* New IVswitch implementation: OvsVanilla,
* New configuration contants,
* New mandatory configuration variable: VSWITCH_VANILLA_PHY_PORT_NAMES
for Vanilla OVS has been added,
* Virtual ports are not yet implemented,
* Some kernel modules wrapping methods has been moved from dpdk.py to
tools.
* Fixed bug where ovsdb hasn't been killed at the end of test case run on
some platforms.

Change-Id: I21a0d84dbc4004aae564d5547387a2563f2d1e5b
Signed-off-by: Michal Weglicki <michalx.weglicki@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Clarify LTD.PacketLatency.InitialPacketProcessingLatency

Make changes based on comments from review at VSPERF weekly call 2015-22-27.

JIRA: VSPERF-2

Change-Id: Ic11a021fee58876d0a402a07195c0f1746fc1705
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

src/ovs: Add support for building vanilla OVS with kernel module

DPDK build remains the default.

JIRA: VSPERF-27
Change-Id: I7282e32d2246eaf75e399c5af87ef0ea53981895
Signed-off-by: Timo Puha <timox.puha@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

src/dpdk: Enable building of vhost-user in src/dpdk.

Allow vhost-user compilation by specifying make VHOST_USER=y
in src/Makefile. This commit also fixes a dpdk linking issue
by modifying config/common_linuxapp instead of passing args.

JIRA: VSPERF-56
Change-Id: I0437bf92b37f8f5a1939690c308cd54dfbe017f0
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Clarify LTD.Throughput.RFC2889.BroadcastFrameForwarding

Make changes based on comments from review at VSPERF weekly call 2015-07-15.

JIRA: VSPERF-2

Change-Id: I3742518edaea09c9a32a71c9cccc3c4c09fd4598
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

src: Add QEMU makefile

QEMU v2.2.0+ is recommended for vhost-user. We are adding QEMU 2.2.1
to the makefile because the EPEL repo for CentOS7 only supports QEMU 2.0.0.

JIRA: VSPERF-56

Change-Id: I1c65ad6030888802586659d044f069f7fe57c0ea
Signed-off-by: Timo Puha <timox.puha@intel.com>
Signed-off-by: Madarang, Dino Simeon <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Support vswitch selection from the command line.

New command line argument '--vswitch' was introduced to override
vswitch implementation selected in configuration file.
Modified file:
* vsperf

JIRA: VSPERF-27
Change-Id: Ia0070ea9f998349dcca697a0fe9519a009479477
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Maryam Tahhan <maryamtahhan@intel.com>

Add a simple performance test that sends a continuous stream

Implement a simple performance test that sends a continuous
stream of traffic to the vSwitch at line rate for 30 seconds
and measures the throughput
Note: there is issue with calculating of the Tx Fps and Mbps
based on the results from the IxNetwork traffic generator.
This issue will be fixed in a later patch.

JIRA: VSPERF-27

Change-Id: Ic72225888735d33398a602462af159e901fb5957
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Adding vm2vm on separate hosts use case

The deployment scenario covers the use case of
traffic passing between two physical machines where VMs are hosted on
each physical machine.
JIRA: VSPERF-44

Change-Id: I74a507537587fea4eaa887a8d9fd27a40a8ce0e7
Signed-off-by: T V Rao <tv.rao@freescale.com>

test_spec: Add LTD.PacketDelayVariation.RFC3393.Soak

JIRA: VSPERF-2

Change-Id: I2aa2e929d67a0674c07c975c4d91cdcff50f2c40
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Add LTD.MemoryBandwidth.RFC2544.0PacketLoss.Scalability

* Also fixing typo on RFC2885 -> RFC2285

JIRA: VSPERF-22

Change-Id: I99c97b6850c0340db0f68e10e21436d6898842dd
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

testcase: Add frame modification config

* Added a new standard set of flow table that defaults to routing phy1 to phy2
  and vice-versa and allows frame modification and tuple matches to be added
  independently of routing.
* Add a FrameMod testcase attribute - implement this for value 'vlan'
* With FrameMod == 'vlan' the reported tx_fps and rx_fps figures do not match
  even for RFC2544 throughtput 0% packet loss - this is a pre-existing bug
  and a fix will be done as a separate patch. The rx_fps figure is the
  reliable figure.

JIRA: VSPERF-27

Change-Id: Idd137b7a101305e7aebb6fabdfb6a7a4dcf8661b
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

BUILD: Fix Build to allow us to verify patches

Fix build so as we no longer use the HEAD of OVS master, but a specific
commit and modify the DPDK build to edit the configuration file.

Change-Id: I0067b53e5c5295d87b9daf49a9d1ff9e4081558e
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Fix stability issues at the end of testcase run.

Cleanup procedure is performed at the end of each testcase run.
Procedure consists of termination of vswitch processes,
removal of unneeded kernel drivers, unmount of hugepages, etc.
There must be enough time for vswitch processes to terminate
properly before OS resources are freed. Otherwise OS stability
issues can be observed (e.g. server reboot).
Process termination is implemented by sending signal SIGTERM
to the process instead of previously used signal SIGINT.

Change-Id: I7e8c7a86ae2a75f2a18db0d9340726fb649a685b
JIRA: VSPERF-27
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Add new biDirectional parameter for particular testcase

This change introduces new parameter which sets the communication
between ports either uni-directional or bi-directional.

JIRA: VSPERF-27
Change-Id: I4eb06f5c91ef42147878cb68cbad24e69eb002c1
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Meghan Halton <meghan.halton@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>

test_spec: Clarify LTD.Throughput.RFC2544.SoakFrameModification

Based on comments from weekly VSPERF call 2015-06-24.
JIRA: VSPERF-2

Change-Id: I204ea21b5ecb634e0bec249ed826ff2402d67d9e
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>

test_spec: Clarify LTD.Throughput.RFC2889.ErrorFramesFiltering

Make changes based on comments from review at VSPERF weekly call 2015-07-15.

JIRA: VSPERF-2

Change-Id: I96e9a0c518e7d857d6e58d7bcc96e4691957aac0
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Support of windows drive letter in path to result dir.

Parsing of path with IxNetwork test results has been fixed
to accept also windows drive letter. Change affects parsing
of TRAFFICGEN_IXNET_TESTER_RESULT_DIR configuration parameter.
Modified file:
* tools/pkt_gen/ixnet/ixnet.py

JIRA: VSPERF-27
Change-Id: I3dd6123e051952e6fd3f83cd9691341472d2960e
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Add new test definition LTD.Throughput.RFC2544.Profile

This test was proposed at VSPERF weekly call 2015-06-17.

JIRA: VSPERF-2

Change-Id: I1ca0749637473ab2df68b9cd6725eaae78cafa46
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

TestSpec: Add flow Classification section

Add a section that specifies the fields we should match on as part of a
flow.

JIRA: VSPERF-49

Change-Id: Ice5496076ac77bceca8ddadd13bea396177f2901
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

IETF Summary: Editorial changes prior to submission

Final and Submitted version 00 of IETF Summary

Change-Id: Ibfdb2d2edcd29107d887e67887f15935c7d3ffd7
JIRA: VSPERF-43
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

TestSpec: Add test report information details

Add a section that specifies the test parameters that should be recorded
to minimize the variation in test results for test runs.

JIRA: VSPERF-47

Change-Id: Ifce7ca1174ef83a999c6ddfe1ddd026309ef214b
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

TestSpec: Add a section on system validation

Add an LTD section on system validation and isolation.

JIRA: VSPERF-48

Change-Id: Ib686d22753d364da1197290886ec37a12724df32
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vsperf: Add --xunit support

Generate xmlrunner output for use by Jenkins, but without actually
using xmlrunner to discover & run tests.

JIRA: VSPERF-27

Change-Id: I000099c841f3755043104f251837e3d4c214c6bb
Signed-off-by: Billy O'mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Clarify RFC2889.MaxForwardingRate

Changes based on review from VSPERF weekly call 2015-07-01.

* Change name from ForwardingRate to MaxForwardingRate
* Add section number to reference to RFC2889.

JIRA: VSPERF-33

Change-Id: Ic4ff9be5cf6a3d61fb5aa7c3216d3ff7c348677b
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Port RFC2544.BackToBackFrames test to vsperf

Add RFC2544.BackToBackFrames test and fix pylint errors.
Remove irrelevant values of back to back test results.

JIRA: VSPERF-46
Change-Id: I7a0dfd9494b509c3be7bffc0678228838d3059a1
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Meghan Halton <meghan.halton@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Martin Klozik<martinx.klozik@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

IETFSummary: Expand IETF summary of LTD Sec 3

Added a section on new concfiguration parameters and a another section
on flow classification/matching. Fixed diagrams to match starting
offset.
JIRA: VSPERF-43

Change-Id: Iad8742810c37ffe33de4005e3b2150593fe2defe
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Signed-off-by: Al Morton <acmorton@att.com>

src: update DPDK and OVS build to DPDK2.0.0

Update DPDK to build DPDK v2.0.0 and update OVS to link to that version
of DPDK.

Change-Id: Icc8f9fbcc7a4804a3648f0027b4ea2140888d5d1
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com>
Reviewed-by: TV Rao <tv.rao@freescale.com>