Merge "vswitches: Affinitize vswitch threads for OVS-DPDK"

vswitches: Affinitize vswitch threads for OVS-DPDK

JIRA: VSPERF-64

Change-Id: I7cefd05479da6fe17357da4da558f466175dd6fc
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vnfs: Enable PVP using vhost-cuse

Enable PVP testing using vhost-cuse as guest access method

Recent changes:
* Move NEWS.md changes to NEWS.rst
* Update comment to vhost-cuse
* Restore config back to checkout state after make
* Merge OPNFV 1092 updates

* Add PVP-vhost-cuse to NEWS.md
* Add comment/example to GUEST_CORE_BINDING
* Move hardcoded values to conf/04_vnfs.conf
* Set default VNF to QemuDpdkVhostCuse
* Compile eventfd_link if VHOST_USER=n
* Use MAC and PCI address from conf
* Use vhost method in conf to properly set interface type

JIRA: VSPERF-59

Change-Id: Ib1159e216f3e25b9971c0935969680582683916b
Signed-off-by: Madarang, Dino Simeon <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

docs: Add Gotchas to quickstart guide.

JIRA: VSPERF-60
Change-Id: I63695f8fa8a86cf1e64fd959658e11f3d827a3c4
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: Migrate Docs to RST format and new dir docs/

Migrate all existing VSPERF documentation to a new directory called
docs/ and convert to ReStructuredText format. It's recommended that any
doc changes in the future are tested with: http://rst.ninjs.org/.

Change-Id: I18aa574b1259986502bde4ceef1fae7c6a5c1f33
JIRA: VSPERF-60

Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com

vsperf: update package dependencies for QEMU

Update packages.txt with the required packages to build QEMU v2.2.1.

JIRA: VSPERF-56

Change-Id: Ifdf802de3c195b0dc5c48dcb8f098c31a1561012
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Madarang, Dino SimeonX <dino.simeonx.madarang@intel.com>

Initial reporting implemenation

Reporting from TOIT was merged and improved. Default template was modified
to support any testcase and to show more details about system environment.
Affected files:
* docs/NEWS.md
* testcases/testcase.py
* tools/report/__init__.py
* tools/report/report.jinja
* tools/report/report.py
* tools/systeminfo.py
* vsperf

JIRA: VSPERF-71
Change-Id: I4dc84ca69e5c292eae1f8dede1411c06ae3ef8af
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>

vnfs: Enable PVP using vhost-user

Enable booting of a VM with DPDK and run testpmd for
PVP testing.
* Added throughput and back2back tests with pvp deployment scenario in
  01_testcases.conf
* PVP requires DPDK 2.0 with VHOST_USER enabled and QEMU 2.2.0
* Tested on CentOS7 and Fedora 20
* Fix conflict with change 1078

Recent Changes:
* Fix merge conflict (testcase.py and testcases.conf)
* Remove QEMU_DIR. User must set QEMU_BIN
* Set bidir traffic to True
* Add flow for bi-directional traffic
* Use working OVS_TAG ad2e649834be20dd01b1632799fe778106a96a2d
* Merge change 1096 (src: Add QEMU makefile)
* Set virtio-net-pci csum=off and other variables to off
* Move hardcoded values to conf/*

JIRA: VSPERF-56

Change-Id: I4ad184531064855493483d9833a7722c9f7d3576
Signed-off-by: Madarang, Dino Simeon <dino.simeonx.madarang@intel.com>
Signed-off-by: Meghan Halton <meghan.halton@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>

TestSpec: LTD.Scalability.RFC2544.0PacketLoss

Clarify that the test intends to test the fastpath and thus the flows
need to be installed on the vSwitch before passing traffic

Change-Id: I7d72ca66d7b854463c3b809c16fd8c8088353b99
JIRA: VSPERF-19
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Address IETF-93 comments with 2889 Soak tests

This patch makes it clear that the Soak tests use a
method consistent with RFC 2889 to simplify test system
interactions.

JIRA: VSPERF-49

Change-Id: I82ca1e6ae6e066f72b343ece72ba98fab2aab97a
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

Add new testcase for LTD.Scalability.RFC2544.0PacketLoss

This test adds a multistream config item,
taking the required number of flows to setup in the traffic,
to the existing testcase and then running the standard
2544 Throughput test. The config is plumbed through
from the 01_testcase.conf via ITraffic to the IxNet.
01_testcase.conf contains new parameter MultiStream
for 2544 Throughput test.

JIRA: VSPERF-19

Change-Id: I12e0e76a5f54dc13b854f3a65f3a4a0fe90ff885
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

TestSpec: Add actions to flow Classification

Clarify that a flow has an associated action and isn't simply packets
with matching header fields.

Change-Id: Iffa7ae121049d8ec798f937082a733ef520e9d05
JIRA: VSPERF-49
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add compiler details to test report info

Change-Id: I19d574607c29cbb8401047ab7d1255ba7282ef63
JIRA: VSPERF-47
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com

test_spec: Clarify LTD.CPU.RFC2544.0PacketLoss

Make changes based on comments from review at VSPERF weekly call 2015-08-05.

JIRA: VSPERF-2

Change-Id: I141c2b35c5469270ba8e3ecfdf88b93ec8e3d35a
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Merge "src: Add QEMU makefile"

test_spec: Add LTD.CPDPCouplingFlowAddition

JIRA: VSPERF-2

Change-Id: Iab66730606d9137e0f2cac195f7c98bec71fa072
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Vanilla OVS support implementation

JIRA: VSPERF-57

This patch implements Vanilla OVS support.It contains:
* New IVswitch implementation: OvsVanilla,
* New configuration contants,
* New mandatory configuration variable: VSWITCH_VANILLA_PHY_PORT_NAMES
for Vanilla OVS has been added,
* Virtual ports are not yet implemented,
* Some kernel modules wrapping methods has been moved from dpdk.py to
tools.
* Fixed bug where ovsdb hasn't been killed at the end of test case run on
some platforms.

Change-Id: I21a0d84dbc4004aae564d5547387a2563f2d1e5b
Signed-off-by: Michal Weglicki <michalx.weglicki@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Clarify LTD.PacketLatency.InitialPacketProcessingLatency

Make changes based on comments from review at VSPERF weekly call 2015-22-27.

JIRA: VSPERF-2

Change-Id: Ic11a021fee58876d0a402a07195c0f1746fc1705
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

src/ovs: Add support for building vanilla OVS with kernel module

DPDK build remains the default.

JIRA: VSPERF-27
Change-Id: I7282e32d2246eaf75e399c5af87ef0ea53981895
Signed-off-by: Timo Puha <timox.puha@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

src/dpdk: Enable building of vhost-user in src/dpdk.

Allow vhost-user compilation by specifying make VHOST_USER=y
in src/Makefile. This commit also fixes a dpdk linking issue
by modifying config/common_linuxapp instead of passing args.

JIRA: VSPERF-56
Change-Id: I0437bf92b37f8f5a1939690c308cd54dfbe017f0
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Clarify LTD.Throughput.RFC2889.BroadcastFrameForwarding

Make changes based on comments from review at VSPERF weekly call 2015-07-15.

JIRA: VSPERF-2

Change-Id: I3742518edaea09c9a32a71c9cccc3c4c09fd4598
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

src: Add QEMU makefile

QEMU v2.2.0+ is recommended for vhost-user. We are adding QEMU 2.2.1
to the makefile because the EPEL repo for CentOS7 only supports QEMU 2.0.0.

JIRA: VSPERF-56

Change-Id: I1c65ad6030888802586659d044f069f7fe57c0ea
Signed-off-by: Timo Puha <timox.puha@intel.com>
Signed-off-by: Madarang, Dino Simeon <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Support vswitch selection from the command line.

New command line argument '--vswitch' was introduced to override
vswitch implementation selected in configuration file.
Modified file:
* vsperf

JIRA: VSPERF-27
Change-Id: Ia0070ea9f998349dcca697a0fe9519a009479477
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Maryam Tahhan <maryamtahhan@intel.com>

Add a simple performance test that sends a continuous stream

Implement a simple performance test that sends a continuous
stream of traffic to the vSwitch at line rate for 30 seconds
and measures the throughput
Note: there is issue with calculating of the Tx Fps and Mbps
based on the results from the IxNetwork traffic generator.
This issue will be fixed in a later patch.

JIRA: VSPERF-27

Change-Id: Ic72225888735d33398a602462af159e901fb5957
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Adding vm2vm on separate hosts use case

The deployment scenario covers the use case of
traffic passing between two physical machines where VMs are hosted on
each physical machine.
JIRA: VSPERF-44

Change-Id: I74a507537587fea4eaa887a8d9fd27a40a8ce0e7
Signed-off-by: T V Rao <tv.rao@freescale.com>

test_spec: Add LTD.PacketDelayVariation.RFC3393.Soak

JIRA: VSPERF-2

Change-Id: I2aa2e929d67a0674c07c975c4d91cdcff50f2c40
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Add LTD.MemoryBandwidth.RFC2544.0PacketLoss.Scalability

* Also fixing typo on RFC2885 -> RFC2285

JIRA: VSPERF-22

Change-Id: I99c97b6850c0340db0f68e10e21436d6898842dd
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

testcase: Add frame modification config

* Added a new standard set of flow table that defaults to routing phy1 to phy2
  and vice-versa and allows frame modification and tuple matches to be added
  independently of routing.
* Add a FrameMod testcase attribute - implement this for value 'vlan'
* With FrameMod == 'vlan' the reported tx_fps and rx_fps figures do not match
  even for RFC2544 throughtput 0% packet loss - this is a pre-existing bug
  and a fix will be done as a separate patch. The rx_fps figure is the
  reliable figure.

JIRA: VSPERF-27

Change-Id: Idd137b7a101305e7aebb6fabdfb6a7a4dcf8661b
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

BUILD: Fix Build to allow us to verify patches

Fix build so as we no longer use the HEAD of OVS master, but a specific
commit and modify the DPDK build to edit the configuration file.

Change-Id: I0067b53e5c5295d87b9daf49a9d1ff9e4081558e
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

Fix stability issues at the end of testcase run.

Cleanup procedure is performed at the end of each testcase run.
Procedure consists of termination of vswitch processes,
removal of unneeded kernel drivers, unmount of hugepages, etc.
There must be enough time for vswitch processes to terminate
properly before OS resources are freed. Otherwise OS stability
issues can be observed (e.g. server reboot).
Process termination is implemented by sending signal SIGTERM
to the process instead of previously used signal SIGINT.

Change-Id: I7e8c7a86ae2a75f2a18db0d9340726fb649a685b
JIRA: VSPERF-27
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Add new biDirectional parameter for particular testcase

This change introduces new parameter which sets the communication
between ports either uni-directional or bi-directional.

JIRA: VSPERF-27
Change-Id: I4eb06f5c91ef42147878cb68cbad24e69eb002c1
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Meghan Halton <meghan.halton@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>

test_spec: Clarify LTD.Throughput.RFC2544.SoakFrameModification

Based on comments from weekly VSPERF call 2015-06-24.
JIRA: VSPERF-2

Change-Id: I204ea21b5ecb634e0bec249ed826ff2402d67d9e
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>

test_spec: Clarify LTD.Throughput.RFC2889.ErrorFramesFiltering

Make changes based on comments from review at VSPERF weekly call 2015-07-15.

JIRA: VSPERF-2

Change-Id: I96e9a0c518e7d857d6e58d7bcc96e4691957aac0
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Support of windows drive letter in path to result dir.

Parsing of path with IxNetwork test results has been fixed
to accept also windows drive letter. Change affects parsing
of TRAFFICGEN_IXNET_TESTER_RESULT_DIR configuration parameter.
Modified file:
* tools/pkt_gen/ixnet/ixnet.py

JIRA: VSPERF-27
Change-Id: I3dd6123e051952e6fd3f83cd9691341472d2960e
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Add new test definition LTD.Throughput.RFC2544.Profile

This test was proposed at VSPERF weekly call 2015-06-17.

JIRA: VSPERF-2

Change-Id: I1ca0749637473ab2df68b9cd6725eaae78cafa46
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

TestSpec: Add flow Classification section

Add a section that specifies the fields we should match on as part of a
flow.

JIRA: VSPERF-49

Change-Id: Ice5496076ac77bceca8ddadd13bea396177f2901
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>

IETF Summary: Editorial changes prior to submission

Final and Submitted version 00 of IETF Summary

Change-Id: Ibfdb2d2edcd29107d887e67887f15935c7d3ffd7
JIRA: VSPERF-43
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

TestSpec: Add test report information details

Add a section that specifies the test parameters that should be recorded
to minimize the variation in test results for test runs.

JIRA: VSPERF-47

Change-Id: Ifce7ca1174ef83a999c6ddfe1ddd026309ef214b
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

TestSpec: Add a section on system validation

Add an LTD section on system validation and isolation.

JIRA: VSPERF-48

Change-Id: Ib686d22753d364da1197290886ec37a12724df32
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

vsperf: Add --xunit support

Generate xmlrunner output for use by Jenkins, but without actually
using xmlrunner to discover & run tests.

JIRA: VSPERF-27

Change-Id: I000099c841f3755043104f251837e3d4c214c6bb
Signed-off-by: Billy O'mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

test_spec: Clarify RFC2889.MaxForwardingRate

Changes based on review from VSPERF weekly call 2015-07-01.

* Change name from ForwardingRate to MaxForwardingRate
* Add section number to reference to RFC2889.

JIRA: VSPERF-33

Change-Id: Ic4ff9be5cf6a3d61fb5aa7c3216d3ff7c348677b
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

Port RFC2544.BackToBackFrames test to vsperf

Add RFC2544.BackToBackFrames test and fix pylint errors.
Remove irrelevant values of back to back test results.

JIRA: VSPERF-46
Change-Id: I7a0dfd9494b509c3be7bffc0678228838d3059a1
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Meghan Halton <meghan.halton@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Martin Klozik<martinx.klozik@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>

IETFSummary: Expand IETF summary of LTD Sec 3

Added a section on new concfiguration parameters and a another section
on flow classification/matching. Fixed diagrams to match starting
offset.
JIRA: VSPERF-43

Change-Id: Iad8742810c37ffe33de4005e3b2150593fe2defe
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Signed-off-by: Al Morton <acmorton@att.com>

src: update DPDK and OVS build to DPDK2.0.0

Update DPDK to build DPDK v2.0.0 and update OVS to link to that version
of DPDK.

Change-Id: Icc8f9fbcc7a4804a3648f0027b4ea2140888d5d1
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com>
Reviewed-by: TV Rao <tv.rao@freescale.com>

doc: add IXIA client setup information

Add information on how to install the IXIA client software that works
with vsperf.

Change-Id: Ia9923617e713c56ba5ecedd0d3cdf0388221dcac
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com>
Reviewed-by: TV Rao <tv.rao@freescale.com>

docs: update quickstart.md with src build info

Update quickstart.md to add information on how one can clone and build
OVS and DPDK.

Change-Id: I02365c4cdbdde6426008672a7ed7c6402be3c046
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com>
Reviewed-by: TV Rao <tv.rao@freescale.com>

Merge "doc: quickstart.md fixup"

doc: quickstart.md fixup

Fix line wrapping in quickstart.md so lines aren't deliberately cut
off at particular points.

Change-Id: Ie166c679b7036c850412be645fcc1fee65400b1b
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: TV Rao <tv.rao@freescale.com>

TestSpec: Add Test Summary List

Add a summary list of the tests defined so far.

Change-Id: I60011bf79515d7b95563b6f3132d01a32ae5e394
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

docs: fix-up typos in installation.md

Fix-up a typo and line ending in installation.md.

Change-Id: Ie0a682f20ca63df853600a585d65d2ee844bacc4
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

test_spec: update spec with MAC learning tests

Update LTD.Throughput.RFC2889.AddressCachingCapacity and
LTD.Throughput.RFC2889.AddressLearningRate to indicate they are only
applicable to vswitches that are capable of MAC learning.
JIRA: VSPERF-35

Change-Id: I7b0f5c98347ba7d8f0a774982bd574a7d306b540
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Merge "test_spec: Clarify LTD.Throughput.RFC2544.PacketLossRatioFrameModification"

Merge "TestSpec: Add LTD.Scalability.RFC2544.0PacketLoss"

Merge "test_spec: Clarify LTD.Throughput.RFC2544.Soak"

test_spec: Clarify LTD.Throughput.RFC2544.Soak

Based on comments from weekly VSPERF call 2015-05-20.
JIRA: VSPERF-2

Change-Id: Ic36b6c1260168a7bb0b003585b3abe64a2841820
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Clarify RFC6201.ResetTime

Make changes based on comments from review at VSPERF weekly call 2015-05-27.

JIRA: VSPERF-2

Change-Id: I7e4f0e1137d9dd96953f5b96c5179b40906c23b9
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

TestSpec: Add LTD.Scalability.RFC2544.0PacketLoss

JIRA: VSPERF-19
Change-Id: I4b85ed0291d785b46222ab1a965bc377c05130ed
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Merge "Update targets for l2fwd build"

IETFSummary: Add initial IETF summary of LTD

JIRA: VSPERF-43

Change-Id: I1020b2845a644d3002c08ede3a6dfa8fc068781a
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Signed-off-by: Al Morton <acmorton@att.com>

TestSpec: Modify soak tests to measure PDV

Add PDV as defined by RFC 5841 as one of the metrics collected by the
defined soak tests.

JIRA: VSPERF-14
Change-Id: Ida110347ec3a60e0d8fba03ab20407e11e40b96a
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Merge "test_spec: Clarify LTD.Throughput.RFC2544.SystemRecoveryTime"

Update targets for l2fwd build

Added cleanse, clobber and force_make targets for top level Makefile
compliance

Change-Id: I510ed174e3ae01b35e9df975e5aaa1c989b34ce9
Signed-off-by: Eugene Snider <eugene.snider@huawei.com>

TestSpec: Add LTD.Latency.Slowpath

Add a definition for Slowpath packet delay test.

JIRA: VSPERF-40
Change-Id: I43727ad966c706bd3d4fad3a463798af3ccd72f8
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Aihua Li <aihua.li@huawei.com>

TestSpec: Modify LTD access permissions

Modify the LTD access permissions so it's not executable.

Change-Id: I234f84da5901934cb3f55830225a326ba03c1193
JIRA: VSPERF-2
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Aihua Li <aihua.li@huawei.com>

Merge "framework: Add reworked framework to repo"

framework: Add reworked framework to repo

This commit adds the vSwitch Integration Test Framework whose
design, based off TOIT, is outlined in the HLD previously made
availiable to the community for review.

The design of this framework allows developers to add different
implementations of components, specifically vSwitches, Traffic
Generators, Metrics Collectors and VNFs, easily.

The goal of this design is that all testcases should run regardless of
what is "under the hood".

This commit adds support for running the framework for a phy to phy
RFC2544 testcase only. More testcases will be added by the community.

vSwitches supported at this time:
* Intel DPDK (r) accelerated OpenvSwitch

Traffic Generators supported at this time:
* IxNet - IxNetwork Implementation
* Ixia - IxExplorer Implementation
* Dummy - Manual Implementation

Metrics Collectors supported at this time:
* Linux Metrics

No VNFs are supported at this time but the framework outlines how they
should be integrated and provides APIs for them to adhere to.

JIRA: VSPERF-27
Change-Id: I312e1a1199487ffee8f824be06cd97d4f793eee0
Signed-off-by: Stephen Finucane <Stephen.Finucane@intel.com>
Signed-off-by: Meghan Halton <Meghan.Halton@intel.com>
Signed-off-by: Christopher Nolan <Christopher.Nolan@intel.com>
Signed-off-by: Maryam Tahhan <Maryam.Tahhan@intel.com>
Signed-off-by: Ciara Loftus <Ciara.Loftus@intel.com>
Signed-off-by: Mark Kavanagh <Mark.B.Kavanagh@intel.com>
Signed-off-by: Cian Ferriter <Cian.Ferriter@intel.com>
Signed-off-by: Timo Puha <TimoX.Puha@intel.com>
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>
Signed-off-by: Michal Weglicki <MichalX.Weglicki@intel.com>
Signed-off-by: Rory Sexton <Rory.Sexton@intel.com>
Signed-off-by: Ian Stokes <Ian.Stokes@intel.com>
Signed-off-by: Kevin Traynor <Kevin.Traynor@intel.com>
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Aihua Li <aihua.li@huawei.com>

test_spec: Clarify LTD.Throughput.RFC2544.SystemRecoveryTime

Make changes based on review from VSPERF weekly call 2015-05-27.

JIRA: VSPERF-2

Change-Id: I4e2caec3f0ad52a7ef3773372aee4f06791631de
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

test_spec: Clarify LTD.Throughput.RFC2544.PacketLossRatioFrameModification

Based on comments from weekly VSPERF call 2015-05-20.
JIRA: VSPERF-2

Change-Id: I7707ca62a870509baaff557715da31bb7a254b70
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>

Update license to Apache 2.0

Change-Id: I87027ac8ac34340ee3629a536bf3467241f8abd9
JIRA: VSPERF-15
Signed-off-by: Aihua Li <aihua.li@huawei.com>
Reviewed-by: Eugene Snider <eugene.snider@huawei.com>

testspec: cleanup + update tests with new metrics

Cleanup and update the test specification with CPU and memory
utilization metrics that can be collected in conjunction with the other
metrics for the test.

JIRA: VSPERF-2
Change-Id: Ia70d83a9cba724e2d6f503984a8db537d4a1f395
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

Add l2 fwd kernel module

This commit adds a simple kernel module for l2 forwarding or termination

This module provides only level 2 forwarding between two ports, it does not
do any NAT or Masquerade.

Arguments are:

net1=ethXXXX # set forwarding port 1
net2=ethXXX  # set forwarding port 2
terminate=1  # terminate the connection and free the skb

Changed to GPL licensing to avoid compilation issues
Added sanity build target
Fix whitespace issues

JIRA: VSPERF-39

Change-Id: I0fa3e0135af06b7cba665a357dccfb9459edb9f6
Signed-off-by: Eugene Snider <eugene.snider@huawei.com>

Merge "TestSpec: Add LTD.Throughput.RFC2889.BroadcastFrameForwarding"

Merge "TestSpec: Add LTD.Throughput.RFC2889.ErrorFramesFiltering"

Merge "TestSpec: Add LTD.Throughput.RFC2889.AddressLearningRate"

Merge "TestSpec: Add LTD.Throughput.RFC2889.AddressCachingCapacity"

Merge "TestSpec: Add LTD.Throughput.RFC2889.ForwardPressure"

Merge "TestSpec: LTD.Throughput.RFC2889.ForwardingRate"

Merge "Adding Onboarding file"

TestSpec: Add LTD.Throughput.RFC2889.BroadcastFrameForwarding

Add a definition for RFC2889 Broadcast Frame Forwarding Test.

JIRA: VSPERF-37
Change-Id: I7d6e11d5c911fe372c5dcc0475d6a7f2c48ecd71
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC2889.ErrorFramesFiltering

Add a definition for RFC2889 Error Frames Filtering Test.

JIRA: VSPERF-36
Change-Id: I366108424a1188256e5977952e9a7fbbf09377ba
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC2889.AddressLearningRate

Add a definition for RFC2889 Address Learning Rate Test

JIRA: VSPERF-35
Change-Id: I646383d09cf0cfb14712879f11217319cf2ce715
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC2889.AddressCachingCapacity

Add a definition for RFC2889 Address Caching Capacity Test.

JIRA: VSPERF-34
Change-Id: I6557d3bf865f38c3eb02cfe2133749b135501685
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC2889.ForwardPressure

Add a definition for RFC2889 Forward Pressure Test

JIRA: VSPERF-33
Change-Id: Ia036c9b52aba49ca68d0a2712d606fc14f5cb22a
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: LTD.Throughput.RFC2889.ForwardingRate

Add a definition for RFC2889 Forwarding Rate Test.

JIRA: VSPERF-32
Change-Id: If756ff84ad4b42ed5aa8ded2b7c7df12b76eaca1
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC6201.ResetTime

Add a definition for RFC 6201 Reset Time Test

Change-Id: I31cd5befb1e662697fe4d8ff81caa229ae6bfb64
JIRA: VSPERF-13
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC2544.SoakFrameModification

Add a definition for RFC 2544 X% packet loss Throughput Soak Test with
packet modification.

Change-Id: I60f8f8726d0b01f73990566a1ce286917c3be940
JIRA: VSPERF-16
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

TestSpec: Add LTD.Throughput.RFC2544.Soak

Add a definition for RFC 2544 X% packet loss Throughput Soak Test

Change-Id: I6cd457106548d01c3edd911b46f33e17aecd533b
JIRA: VSPERF-14
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Al Morton <acmorton@att.com>

Merge "complete build_base_machine for CentOS distro"

Merge "src: added mechanism to pull upstream packages and provided single top-level make"

Adding Onboarding file

Change-Id: If01b5eecc74f9e52c77cdc6baa1b1ac41c3527b9
JIRA: OCTO-13
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>

Merge "TestSpec: Add LTD.Throughput.RFC2544.BackToBackFrames"

src: added mechanism to pull upstream packages and provided single top-level make

updated DPDK and OVS tags to build the latest

Change-Id: Id1bb65a7a72d5098826d6b09bf3f73dd6d8c845f
JIRA: VSPERF-25
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Aihua Li <aihua.li@huawei.com>
Reviewed-by: Aric Gardner <agardner@linuxfoundation.org>

complete build_base_machine for CentOS distro

Change-Id: I597693c5993818e15666457dbf08c480c7417f6d
Reviewed-by: Al Morton <acmoton@att.com>
JIRA: VSPERF-15
Signed-off-by: Aihua Li <aihua.li@huawei.com>

Merge "INFO: Adding a Al Morton as a committer"

TestSpec: Add LTD.Throughput.RFC2544.BackToBackFrames

Add a definition for RFC 2544 Back To Back Frames Test.

Change-Id: I15499eb6874227e189fa9828b8488f9c06c0b1a1
JIRA: VSPERF-12
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Al Morton <acmorton@att.com>

INFO: Adding a Al Morton as a committer

Adding Al Morton to the project committer list.

Change-Id: I10fa854b587683f418ef6baee5d550b19e021658
JIRA: VSPERF-30
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Aihua Li <aihua.li@huawei.com>

TestSpec: Add LTD.Throughput.RFC2544.SystemRecoveryTime

Add a definition for RFC 2544 System Recovery Time Test.

Change-Id: I2fa10e749616bdc1118f17a6024d30bedb1ede07
JIRA: VSPERF-11
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>

JIRA: VSPERF-29 - Add build elements for Jenkins

This adds 'sanity' and 'test' stub functions to the build infrastructure

Get rid of trailing spaces.

Change-Id: I9d4f6f97bec4877dfeef9e5c68d491a928697ed1
Signed-off-by: Gene Snider <eugene.snider@huawei.com>

Merge "added mechanism to pull upstream packages and provided single top-level make"

added mechanism to pull upstream packages and provided single top-level make

Change-Id: I13bcce3104377cac84a736cfd9a3d9df208e91f0
JIRA: VSPERF-25
Signed-off-by: Aihua Li <aihua.li@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Stephen Finucane <stephen.finucane@intel.com>