Radek Zetik [Mon, 25 Jan 2016 12:22:46 +0000 (12:22 +0000)]
VSPERF docs: Patches for Design Document
Routing Table Figure has an odd description
for the table#1 description.
Connectivity to the DUT is assumed, could provide
example directions. Suggest a new section.
JIRA: VSPERF-178
JIRA: VSPERF-179
Change-Id: I38e48034a9029d4a8969affdddef5b281dc8eba3
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Martin Klozik [Mon, 25 Jan 2016 10:34:27 +0000 (10:34 +0000)]
report: create test report for all executed TCs
Every testcase generates report with its results into separate file.
It is required to merge all partial reports into final overall
report for whole set of TCs executed by VSPERF.
Hugepages are mounted also for TestPMD packet forwarder.
Change-Id: Iaa1ab4e08d1637106da804e06b7f30100d609cd6
JIRA: VSPERF-181
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Radek Zetik [Thu, 21 Jan 2016 12:26:53 +0000 (12:26 +0000)]
VSPERF docs: Review userguide docs for Brahmaputra
Since 'make' builds all three OVS variants,
WITH_LINUX and VHOST_USER are not used anymore on cli.
The fix removes them from quickstart.rst
JIRA: VSPERF-177
Change-Id: I7efe49f638f1234da0d84c5eb62624f543134efc
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
>
Maryam Tahhan [Tue, 19 Jan 2016 17:02:27 +0000 (17:02 +0000)]
docs: update links in LTD and doc versioning
JIRA: VSPERF-60
Change-Id: I2c04faa13a2182e3e28619d23ec68ac52c7a7be9
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Maryam Tahhan [Tue, 19 Jan 2016 17:11:25 +0000 (17:11 +0000)]
docs: fix links in the quickstart guide.
Fix installation and Traffic gen guide links in
http://artifacts.opnfv.org/vswitchperf/docs/userguides/quickstart.html
to
http://artifacts.opnfv.org/vswitchperf/docs/userguides/installation.html
and
http://artifacts.opnfv.org/vswitchperf/docs/userguides/trafficgen.html.
Also added where vloop_vnf can be downloaded from.
JIRA: VSPERF-186
Change-Id: I585367b1c717fdbb0b56b7f0312fe9c70f51594f
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Martin Klozik [Mon, 18 Jan 2016 10:30:21 +0000 (10:30 +0000)]
bugfix: set default framerate/iload to 100%
Continuous testcases should be executed with 100% of frame rate
by default. Thus iLoad parameter of all continuous testcases
was updated to the value of 100.
Change-Id: Ia1c5a49c274d96a25ab7d9b8378ae7be6dc0b10c
JIRA: VSPERF-189
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Martin Klozik [Thu, 21 Jan 2016 09:33:30 +0000 (09:33 +0000)]
report: add rst template for results reporting
Add a template that can be used for reporting vsperf release B results.
This patch also fixes the line length issues in the markdown template.
Change-Id: Id03f5c7eb84536697deca73d3fb397629b647a85
JIRA: VSPERF-181
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Martin Klozik [Wed, 13 Jan 2016 14:57:07 +0000 (14:57 +0000)]
pkt_gen: support of standalone execution of traffic generator
Support for multiple modes of VSPERF operation has been added.
These modes can be used for standalone execution of traffic
generator or for manual testing or for execution of unsupported
traffic generator. Supported modes are: "normal" - execute vSwitch,
VNF and traffic generator; "trafficgen" - execute only traffic
generator; "trafficgen-off" - execute vSwitch and VNF.
Normal mode is selected by default.
In case that trafficgen mode is selected, then various
--test-params could be specified to affect traffic generator
configuration. These parameters include traffic type, frame rate,
bidirectional and scalability settings. Selection of transport
protocol is not supported by IxNet yet (UDP is enforced), thus
modification of transport protocol from command line is not
supported too.
Fixes of testpmd and qemu warning patches are inclduded.
Change-Id: Idac10fe03e724075268a01ec3eb0817fba830aec
JIRA: VSPERF-173
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Martin Klozik [Tue, 19 Jan 2016 14:17:05 +0000 (14:17 +0000)]
docs: installation guide update
Installation guide should be OS agnostic.
Change-Id: Idba63925a27fd204c6542ca886381a56c0415dab
JIRA: VSPERF-150
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Martin Klozik [Fri, 15 Jan 2016 08:06:20 +0000 (08:06 +0000)]
bugfix: mount hugepages for PVP and PVVP scenarios
Hugepages are used by both DPDK and Qemu. However they were mounted
only in case, that OVS with DPDK support was detected. Thus code
has been modified to mount hugepages in case that either DPDK usage
or QEMU usage is detected.
Change-Id: I662a6f0918b7b8d4fc38c2ce3d0d82bba0b8b2b0
JIRA: VSPERF-170
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Fri, 15 Jan 2016 10:50:57 +0000 (10:50 +0000)]
bugfix: remove QEMU warning during mount of shared directory
Qemu 2.3.0 requires image type to be explicitly set to 'raw'
for shared directories with FAT. Required option "type=raw"
is compatible with older QEMU versions, so it can be passed
to QEMU by default.
Change-Id: Icca5e4249cc2c05c0b9609d7bd34368b4b86f492
JIRA: VSPERF-187
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Robert Wojciechowicz [Wed, 9 Dec 2015 10:07:38 +0000 (10:07 +0000)]
Add testpmd as vswitch class
The purpose of using testpmd instead of OVS is to get the baseline
of the DUT when performing hardware offloading operations.
There are supported different checksum calculation
and txq flags settings.
Change-Id: I93c9b45dcb31eaa1f610b7e061f3dd5936b0e6ec
JIRA: VSPERF-193
Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Fri, 11 Dec 2015 14:29:18 +0000 (14:29 +0000)]
testcase: scalability - configurable installation of flows to the vswitch
Stream specific flows can be pre-installed into the vswitch
based on the value of testcase specific configuration option
"Pre-installed Flows". In case, it is set to 'Yes', then
specific flow for each stream will be inserted into the switch.
Otherwise only generic flows will be installed. Default value
of "Pre-installed Flows" is set to 'No'. Its value can be
overridden by CLI parameter pre-installed_flows.
This configuration parameter is an enhancement of "MultiSream"
feature and it is ignored if "MultiStream" is disabled.
Python module 'netaddr' is required by this implementation
and it has been added to requirements.txt file.
Change-Id: I8a17577a702bf2be2753134eb203b936a87fc2e5
JIRA: VSPERF-83
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Billy O'Mahony [Tue, 19 Jan 2016 12:05:46 +0000 (12:05 +0000)]
fuel-plugin: Initial version targeting Fuel8
Change-Id: I21b24527da480c713899bffdaec8381752354e53
Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com>
Martin Klozik [Mon, 11 Jan 2016 16:56:45 +0000 (17:56 +0100)]
reporting: add vswitch, vnf and trafficgen version into the report
Final test report MD file should contain information about version
of vswitch, vnf, VM loopback forwarding application and traffic
generator used during the test. In case that component is cloned
from GIT repository, then hash of its recent commit should be
part of the report too.
Change-Id: I4eb398bc95bc5030d0852d08bcf9febbf17640d4
JIRA: VSPERF-172
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Martin Klozik [Tue, 19 Jan 2016 11:27:22 +0000 (11:27 +0000)]
ci: show TC results inside Jenkins job console output
It is required to show detailed result figures together
with OK/FAILED status. CI script has been modified
to show formatted results from test report MD files.
Change-Id: I9e3724c5aac517dc493f0cf57fc8292434c0bfe8
JIRA: VSPERF-184
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Miroslav Miklus [Tue, 10 Nov 2015 19:50:39 +0000 (20:50 +0100)]
test_spec: LTD: RFC.WorstN-BestN test
- Test ID: LTD.Throughput.RFC2544.WorstN-BestN
JIRA: VSPERF-123
Change-Id: Ief04d8c415a77f4a9b77ba0d2a52653376b37ff1
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Miroslav Miklus [Tue, 10 Nov 2015 19:35:36 +0000 (20:35 +0100)]
test_spec: LTD: Updates
- document updates
JIRA: VSPERF-123
Change-Id: Ic156bb43dbb04e8895ac3e194c0f485517af93ef
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Dino Simeon Madarang [Fri, 8 Jan 2016 15:31:36 +0000 (15:31 +0000)]
vswitches: Remove datapath after stopping OVS
Remove the datapath that OVS creates, ovs-system, (can be viewed by ip link)
after running OVS vanilla tests.
Change-Id: I087c7b3f5afa546258227939ffcb38f0192f0d98
JIRA: VSPERF-175
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Mon, 11 Jan 2016 12:58:28 +0000 (12:58 +0000)]
CI: terminate hanging vsperf before its execution
In case that vsperf terminates unexpectedly, then vsperf itself
or any of executed applications might remain active. It is essential
to terminate any hanging instance of vsperf, ovs, qemu, etc.
before re-execution of vsperf itself. Otherwise vsperf will fail
again.
Change-Id: Idd65288a5171d19fcbfb907a156347eb4b645a88
JIRA: VSPERF-155
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Ryota MIBU [Fri, 8 Jan 2016 02:43:15 +0000 (11:43 +0900)]
update docs build dir names in .gitignore
Change-Id: Ie153c504b390dc68911a8f1d9a82c7a2e1901ec4
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
Maryam Tahhan [Fri, 27 Nov 2015 11:16:59 +0000 (11:16 +0000)]
src: fix ovs and qemu version
Qemu 2.2 doesn't compile on Fedora 22 and ovs was set to track the head
of master. We need to fix this for OPNFV builds.
Change-Id: I05823f96b9347ac322831a0dd3f3d63dcf726beb
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Martin Klozik [Wed, 6 Jan 2016 06:31:51 +0000 (06:31 +0000)]
CI: bugfix of build-vsperf.sh script
Vanilla version of OVS was enforced also for set of test, which should
be executed with DPDK version of OVS. Value of --vswitch parameter
was fixed.
Change-Id: I3c486454ff5093436ddc64847e29e55e23764a92
JIRA: VSPERF-155
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Ciara Loftus [Fri, 20 Nov 2015 14:10:18 +0000 (14:10 +0000)]
conf: modify core mask format
The pmd-cpu-core mask flag does not accept a hexmask with a
leading '0x'. Remove these characters from the VSWITCH_PMD_CPU_MASK
variable.
JIRA: VSPERF-139
Signed-off-by: Ciara Loftus <ciara.loftus@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Mark Kavanagh [Tue, 17 Nov 2015 14:15:38 +0000 (14:15 +0000)]
system: add build support for Fedora 20
The most recent version of virtualenv available through installer tools
on Fedora 20 is 3.3; existing build scripts for Fedora 21 and 22
reference version 3.4. Add relevant scripts to enable installation and
build on F20.
Change-Id: I87324fe55df0af687b616fd2e3f6419046a23e46
Signed-off-by: Mark Kavanagh <mark.b.kavanagh@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Mon, 4 Jan 2016 10:09:35 +0000 (10:09 +0000)]
docs: fix all/ index.rst links.
JIRA: VSPERF-160
Change-Id: I5722fd8340e009cb1885981e6e40468df4d9216c
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Maryam Tahhan [Wed, 16 Dec 2015 14:18:01 +0000 (14:18 +0000)]
docs: update release docs after reviewing
Review and update release documentation for Release B.
JIRA: VSPERF-160
Change-Id: I43c85639ed010f950dc3c85eecfe2ff47b65214d
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Martin Klozik [Thu, 15 Oct 2015 06:44:08 +0000 (07:44 +0100)]
Code checker
Initial implementation of code checker script. It uses pylint
with vsperf specific pylintrc file to check code syntax, design, etc.
Check can be performed for all files, specified directories or for
modified files only. It will skip files defined by EXCLUDE_MODULES
in conf/00_common.conf file. Details about script usage can be
obtained by ./check -h.
Change-Id: I7d894a2c4db92b7b9d4d4312e6f56bc48c8d5dbf
JIRA: VSPERF-114
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Martin Klozik [Fri, 18 Dec 2015 13:16:48 +0000 (13:16 +0000)]
CI: update build-vsperf.sh script
Script for execution of "daily" vswitchperf job has been updated.
It is prepared also for execution of "verify" and "merge" jobs
after their content will be defined.
Change-Id: I64aa4a2aa23c93f1847cc4528fbdee6f71a62290
JIRA: VSPERF-155
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Martin Klozik [Mon, 21 Dec 2015 11:58:15 +0000 (11:58 +0000)]
bugfix: Vanilla OVS kernel module broken dependencies
Vsperf doesn't install OVS kernel module into standard directory,
to keep host OS untouched. Thus kernel module must be inserted
by insmod and module dependencies solved manually. List of kernel
modules was updated to load all dependencies for recent OVS version.
Change-Id: Id147615ca95cfbde26d1dc8d6c9801f7bb3b5d36
JIRA: VSPERF-161
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Martin Klozik [Wed, 16 Dec 2015 12:36:04 +0000 (12:36 +0000)]
vnf: support of vloop_vnf VM
Additional modifications are required to support vloop_vnf
as a master VM image for PVP and PVVP deployments.
Firewall is disabled directly by call of iptables to avoid
dependency on distribution specific firewall handling.
Default configuration values in 04_vnf.conf were set according
to vloop_vnf to make its usage easy. Values are generic
enough to work well also with other images.
Parameters VANILLA_NICx_NAME and vanilla_nicx_name were renamed
to GUEST_NICx_NAME and guest_nicx_name respectively, because
they are used for all vswitch versions. Functionality
of CLI options was fixed. Default values of GUEST_NICx_NAME
were changed to work with vloop_vnf image.
Bug with modification of TRAFFIC_DEFAULTS values has been fixed.
Deep copy is used and l2 and l3 dictionaries are correctly
updated to avoid issues.
Qemu disc emulation has been set to SCSI again to avoid
error messages related to non-functional DMA in syslog. Appropriate
kernel modules were added into vloop_vnf to support scsi
disk emulation during boot.
Change-Id: I5901f454861f99d21cca03030d6d5468ab71a8af
JIRA: VSPERF-133
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Maryam Tahhan [Wed, 16 Dec 2015 13:58:18 +0000 (13:58 +0000)]
docs: update design docs after reviewing
Review and update design documentation for Release B.
JIRA: VSPERF-160
Change-Id: I2c2167b5ac9161e30aacd277060da22a559dd0c2
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Wed, 16 Dec 2015 13:43:37 +0000 (13:43 +0000)]
docs: update userguides after reviewing
Review and update userguides for Release B.
JIRA: VSPERF-160
Change-Id: I54c4dd37fa5951cab9d0e17bb2f3a4d273741cb0
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Wed, 2 Dec 2015 13:42:50 +0000 (13:42 +0000)]
docs: updates and move traffic gens to separate doc
Move the traffic gen instructions to a separate user guide and add
information on usage of the Dummy traffic generator. Update docs
to fix PDF build failure and do general clean-up. Removed the numbering
from the LTD and added the numbered directive to automate numbering for
sections and headers. Add comment anchors that reflect the section
numbers.
Change-Id: I984ca38456a891c439697ebc1da041bc1d828a15
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Tue, 24 Nov 2015 16:55:54 +0000 (16:55 +0000)]
Back2Back: update default params
Update the default duration of a back to back test to be 2 seconds which
is the minimum recommended by RFC2544, and update the Trials to be 50,
which is also the default value specified by the RFC. This patch also
fixes the tcl script to allow for the minimum framesize to be sent from
the traffic gen.
JIRA:
Change-Id: I801196c1998ec2bffbeab69a3a290d6ef6feb1c3
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Radek Zetik [Mon, 14 Dec 2015 09:06:26 +0000 (09:06 +0000)]
CI: Create simple Hello world build-vsperf.sh
Create a ci directory and create a simple
"echo Hello world" in a shell script called
build-vsperf.sh.
The file will be used as a placeholder for OPNFV Jenkins
vsperf-daily-master job.
JIRA: VSPERF-157
Change-Id: Ibe5ca31f8776fcf4ba6b1e353383a03566617350
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Maryam Tahhan [Wed, 9 Dec 2015 10:28:18 +0000 (10:28 +0000)]
INFO: remove inactive committers
Remove inactive committers who cannot be contacted or who have stepped
down from the committer role.
Change-Id: Ied02443b571d0dc70135329aed65af2acb9fe426
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Radek Zetik [Wed, 9 Dec 2015 12:59:36 +0000 (12:59 +0000)]
Results: Integrate with opnfv_test_dashboard
The feature is enabled by --opnfvpod parameter on vsperf command line.
The value of the parameter sets POD name:
example:
--opnfvpod <pod_name> or --opnfvpod=<pod_name>
You need to specify installer name. It can be set in conf-file
default value:
OPNFV_INSTALLER = "Fuel"
Additionally, there are two parameters with default values:
OPNFV_URL = "http://213.77.62.197"
Defines address of opnfv releng database server
PACKAGE_LIST = "src/package-list.mk"
OVS and DPDK tags are read from this file and values are used
for creation of 'version' filed.
The patch requires 'requests' module. The requirements.txt is updated.
JIRA: VSPERF-112
Change-Id: I49f6f5058b1bce8a257669efa8229ff31879481d
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Wed, 9 Dec 2015 12:53:43 +0000 (12:53 +0000)]
bugfix: Fix failure caused by unset locale
In case, that VSPERF detects missing locale settings, it will
set language and encodding settings to default values specified
by configuration parameter DEFAULT_LOCALE.
Localized external commands with output parsed by VSPERF
are executed with modified locale to ensure correct VSPERF
function. Locale settings for such commands is specified
by configuration parameter DEFAULT_CMD_LOCALE.
Change-Id: If5c15115b778ce90046e390f10438b780f82695b
JIRA: VSPERF-132
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Martin Klozik [Wed, 9 Dec 2015 14:32:06 +0000 (14:32 +0000)]
bugfix: Support paths with user's home shortcut
VSPERF will explicitly expand any '~' to the absolute path to the user's
home directory before call of subsystem.Popen method. Only calls,
which process configuration values are modified.
Change-Id: Ibd9399ae84bf4698c86bf8eff97ca6ce785fb3fb
JIRA: VSPERF-45
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Abdul Halim [Fri, 11 Dec 2015 11:54:13 +0000 (11:54 +0000)]
Fix: OS name detection error by build scripts
There is a problem detecting OS specific scripts dir if NAME variable in
/etc/os-release contains a multi-word string (e.g NAME="CentOS Linux").
To fix this we get first part of the NAME string (i.e "CentOS") for
simplicity and look for version specific scripts dir within that.
Change-Id: Ic840788875e9b486b20608a9b9e523cbd4530e31
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <Brian.Castelli@spirent.com>
Miroslav Miklus [Tue, 10 Nov 2015 19:43:52 +0000 (20:43 +0100)]
test_spec: LTD: new topology
- Physical port → VNF → vSwitch → VNF → physical port
updated topology with pNIC-VF
this provides us ability to fill up the box with multiple VNFs
JIRA: VSPERF-123
Change-Id: Iea991b2cd2973c07ecbc300bb6d413a182cae992
Signed-off-by: Miroslav Miklus <mmiklus@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Ryota MIBU [Fri, 11 Dec 2015 06:30:46 +0000 (15:30 +0900)]
updates to use new doc toolchain
Change-Id: I5009a996b2e581638f159ed37a1c56ac53c0c71f
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
Martin Klozik [Thu, 3 Dec 2015 12:58:03 +0000 (12:58 +0000)]
testcase: scalability testcase enhancements
Streams used by scalability testcases can be simulated
at different network layers by modification of destination
MAC address (L2), destination IP address (L3) or destination
UDP port (L4). It is possible to define number and type
of the streams by testcase definition by options "MultiStream"
and "Stream Type" or by CLI parameters "multistream" and
"stream_type". CLI options override testcase definition.
Number of streams, their types, used transport protocol
and indication of pre-installed flows are written to both
result CSV file and MD file with test report.
Default transport protocol was changed to UDP because
IxNetwork configuration script doesn't support TCP yet.
Change-Id: I1ff9ab7756d38f65b1a7730397507c5a5ff5a3d1
JIRA: VSPERF-81
JIRA: VSPERF-82
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Thu, 26 Nov 2015 11:08:09 +0000 (11:08 +0000)]
pkt_gen: rename throughput_tx_* to tx_rate_*
Change throughput_tx_* references to tx_rate_* so the results won't be
confusing as part of the opnfv test dashboard when they become
publicly available.
Change-Id: Ie8cfae99a75497f15eb09d097c72c8a35df3b5f9
JIRA: VSPERF-135
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Ian Stokes <ian.stokes@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Radek Zetik [Thu, 12 Nov 2015 20:07:40 +0000 (20:07 +0000)]
Results: Integrate with opnfv_test_dashboard
All the test projects generate results in different format.
The goal of a testing dashboard is to provide a consistent
view of the different tests from the different projects.
We need to enable the data collection for VSPERF, in other words
VSPERF pushes data using a REST API.
The feature is enabled by --opnfvpod parameter on vsperf command line.
The value of the parameter sets POD name.
Example:
--opnfvpod <pod_name> or --opnfvpod=<pod_name>
You need to specify installer name. It can be set in conf-file
default value:
OPNFV_INSTALLER = "Fuel"
JIRA: VSPERF-112
Change-Id: I37255414eebcc2ff0c12109c508dcd984663a830
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Billy O'Mahony [Mon, 23 Nov 2015 15:26:28 +0000 (15:26 +0000)]
Add some error checking to F21 install
Make the install fail fast and obviously on error rather than
continuing on. This can be used as a template for adding error
checking on the other systems.
JIRA: VSPERF-141
Change-Id: I1892db661a56ab2012e26c6720e0851fabbb51d9
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Martin Klozik [Wed, 2 Dec 2015 10:04:19 +0000 (10:04 +0000)]
vnfs: configurable loopback application support inside VM
For PVP and PVVP deployments, traffic inside virtual machines must be
forwarded between its interfaces. There are several forwarding options
supported by VSPERF, including DPDK testpmd, Huawei l2fwd kernel module
and linux bridge. Another option is, that VM image has built in forwarding
functionality and vsperf doesn't configure it itself.
User can select VM loopback application by configuration option
GUEST_LOOPBACK (per VM) or by SCALAR cli option guest_loopback (global
settings).
Selected guest loopback application(s) will be written into test results
CSV file and test report MD file.
Default wildcarded guest login prompt was added. Guest startup guarding
timer can be configured. Path to OVS kernel module has been fixed.
Change-Id: If738da1ea09112f9cf2267afcbc99a6797f3a03a
JIRA: VSPERF-130
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Sun, 8 Nov 2015 22:35:50 +0000 (17:35 -0500)]
pkt_gen: add duration to all send functions
Allow a configurable duration for all send functions.
JIRA: VSPERF-125
Change-Id: I7c6f5d136a7d7100e3990f7fdc00121b07081a80
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Maryam Tahhan [Sun, 8 Nov 2015 11:50:48 +0000 (11:50 +0000)]
docs: update installation guide and gsg.
Update installation guide and gsg to include latest updates to vsperf
build and installation.
JIRA: VSPERF-127
Change-Id: I773ea240eb90e191f4f53ed977651056817413f1
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Abdul Halim [Mon, 16 Nov 2015 17:39:26 +0000 (17:39 +0000)]
Adding install scripts for Ubuntu14.04
System build scripts for Ubuntu14.04 are added. DPDK mkdir hugepage
fails to create /dev/hugepages with permission error. Workaround for
that is added so that /dev/hugepages dir is created when OS specific
scripts is run with sudo privilege. Also adding missing packages
kernel-modules-extra, pixman-devel and openssl-devel for Fedora systems.
JIRA: VSPERF-128
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Change-Id: Ie805c094df4a3f9446b09ea2d7e4dfb2f5324544
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Ryota MIBU [Thu, 26 Nov 2015 11:36:01 +0000 (20:36 +0900)]
doc: update template and conf files
JIRA: RELENG-16
Change-Id: I0aaac15c1d1a1031cbc113db594a342c60b7eb1d
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
Abdul Halim [Tue, 27 Oct 2015 16:51:04 +0000 (16:51 +0000)]
Adding system build scripts for Fedora 21 and Fedora 22
Scripts are added for Fedora 21 and 22 to install system requirements
and python packages on these systems. Also modified root
build_base_machine.sh so that it can handle directory structures for
version specific scripts if available.
JIRA: VSPERF-93
Change-Id: If6a311bc7bb1116979faabff5e9097e39f2f5495
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Maryam Tahhan [Mon, 9 Nov 2015 02:47:09 +0000 (02:47 +0000)]
pkt_gen: update testcenter implementation
Update testcenter implementation to move settings to
generic settings file and change windows line endings.
JIRA: VSPERF-126
Change-Id: I156005f261bc0df6c3d8009db72ba2d5991c6166
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Martin Klozik [Thu, 5 Nov 2015 10:08:45 +0000 (10:08 +0000)]
Enable OVS master and DPDK 2.1
VSPERF used old version of OVS, which has supported DPDK 2.0.
With switch to DPDK 2.1, VSPERF can use recent OVS code again.
JIRA: VSPERF-124
Change-Id: I81f6b8887d795df08a2eb8959606f2a9a277f9e6
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Maryam Tahhan [Sun, 8 Nov 2015 22:07:21 +0000 (17:07 -0500)]
conf: change default RTE_TARGET
Change RTE_TARGET to build native instead of ivshmem.
Change-Id: I3707d1f4bf545c4a2a35e85816f26dbd214a72de
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Ramprasad Velavarthipati [Fri, 23 Oct 2015 08:52:31 +0000 (14:22 +0530)]
docs: reorganize docs for the sphinx build
Reorganize docs into the appropriate folders for the new sphinx build.
JIRA: VSPERF-80
Change-Id: I9dcd74e092ce52546a0986b92a1ebb2b5b7419bf
Signed-off-by: Ramprasad Velavarthipati <ram.v@freescale.com>
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Trinath Somanchi <trinath.somanchi@gmail.com>
Martin Klozik [Mon, 19 Oct 2015 16:38:52 +0000 (17:38 +0100)]
bugfix of Vanilla OVS testing scenarios
Automatic selection of OVS and DPDK directories must be performed
before initialization of modules is called. Otherwise modules will
use wrong values with unpredictable results.
Default directory values have been changed to point to sources build
by make.
Clean&sweep of directory usage was performed.
Configuration file for pylint has been renamed to follow pylint
naming convention.
Change-Id: I42c89f8890c021f0062b478a856ae0113f1245fb
JIRA: VSPERF-121
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
spirentbrian [Tue, 27 Oct 2015 18:46:33 +0000 (14:46 -0400)]
First phase of Spirent Traffic Gen integration
Change-Id: Ib852c81fc8e09593411984bfb6f9bc5d5629f0c4
Maryam Tahhan [Wed, 28 Oct 2015 10:47:49 +0000 (10:47 +0000)]
docs: fixup documentation errors and locations
Fixup the location of all rst documentation and any errors in the ltd.
JIRA:VSPERF-60
Change-Id: I1472d540b1b4eca4ab038d079bfb0ef2f0c5ebcd
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Radek Zetik [Wed, 21 Oct 2015 05:45:20 +0000 (06:45 +0100)]
Fix Make, Make clean and when the src directories are cloned
Update the rules for Make clean and distclean.
Update make not to clone the repositories if they are already
cloned, simply pull, checkout the tags and build.
Changes in this patch:
1. QEMU is built just once in .../src directory.
.../src_vanilla and .../src_cuse don't contain qemu anymore
2. 'make clean' deletes all built *.o files
3. 'make distclean' deletes all built and generated files
(distclean is used instead of cleanse now)
4. 'make' calls 'git pull' when repository is cloned already
JIRA: VSPERF-94
Change-Id: I80f9a135580b450fb4606cf947661049ff509548
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Dino Simeon Madarang [Thu, 15 Oct 2015 15:01:14 +0000 (16:01 +0100)]
Stop OVS from generating misleading add-br errors
Create bridge and set datapath_type in 1 transaction to prevent OVS from
generating misleading error messages which jenkins considers as
build errors.
Update vswitch interface to include optional parameters.
Change-Id: I668f474ea909b284f3726807aab42d52ae2fb504
JIRA: VSPERF-122
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Martin Klozik [Wed, 21 Oct 2015 12:56:38 +0000 (13:56 +0100)]
systems directory scripts for Centos7
Installation scripts for Centos7 have been updated with new packages.
Script will install also python3 packages and create python virtual
environment. As a last step DPDK, OVS and QEMU will be compiled. So
after script execution VSPERF should be ready for use.
It is recommended to execute installation script from user account
with password less sudo access. Otherwise python environment
must be copied over from root home directory.
After VSPERF generic Makefile will be created by VSPERF-114, it can
be enhanced to call build script too.
Change-Id: I6ff5d2660af29cf8be134a4cae3b1d7b559892fa
JIRA: VSPERF-93
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Abdul Halim <abdul.halim@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Thu, 15 Oct 2015 00:28:55 +0000 (01:28 +0100)]
Simple performance Test for the PVP and PVVP
Two sample contionous stream testcaes were introduced for PVP and PVVP
scenarios. Required frame rate percentage can be specified either by
tetcase configuration option "iLoad" or by command line option "iload".
Command line option take precendece to testcase option. By default 100%
linerate is used if not specified otherwise.
Change-Id: I95f7ae6081377a4c99ce70fc7504b6b542f9260b
JIRA: VSPERF-95
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Martin Klozik [Mon, 12 Oct 2015 06:15:54 +0000 (07:15 +0100)]
Add Pylint to VSPERF commit gate
Initial pylint config file has been created to follow current
code structure and design. A few issues have been fixed, so currently
56 of 67 files have rating 10/10. There are still issues to be fixed,
mainly TODOs/FIXMEs and missing impelentation of abstract class members.
Change-Id: Icf5b12c2150258f8ac657f8d50b47a697d1660a0
JIRA: VSPERF-91
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Tue, 13 Oct 2015 05:35:33 +0000 (06:35 +0100)]
Flow Classification extension
Flow definition can be changed by testcase setup. By default
only ingress ports are used to route traffic, but flow can be
extended by src and dst IP addresses used by the traffic
generator.
Change-Id: I694714537ad2d818192a39f3235d8e6bf0f59a49
JIRA: VSPERF-90
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Mon, 19 Oct 2015 03:36:45 +0000 (04:36 +0100)]
exclude files from the search in the Loader
New configuration parameter EXCLUDE_MODULES defines module names,
which won't be automatically loaded by LoaderServant. It can be used
to exclude obsolete or abstract modules.
Change-Id: If98b50b1505465bcedcf28fe63421c73a4fe160a
JIRA: VSPERF-118
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Fri, 16 Oct 2015 05:29:30 +0000 (06:29 +0100)]
Implement support of 'insmod' and 'modprobe' commands into ModuleManager
Module manager has been enhanced to support both 'insmod' and 'modprobe'
commands for kernel module insertion. In case, that .ko suffix is detected
then insmod will be used otherwise modprobe will be called. This allows
user to specify full path to each module. For example vanilla ovs module
can be defined as "OVS_DIR_VANILLA + 'datapath/linux/openvswitch.ko'"
to load kernel module matching OVS vanilla source tree version.
Change-Id: Ib8d16eca84449ad34d6b307ab836f58d2f0d341b
JIRA: VSPERF-116
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Al Morton [Sun, 6 Sep 2015 23:44:50 +0000 (00:44 +0100)]
test_spec: Need deployment scenario in RFC2889 Forwarding Rate test
The RFC 2889 Forwarding Rate test requires a Deployment Scenario
Section - was missing.
JIRA: VSPERF-102
Change-Id: Iaf661a6bbb9ad52f23147f9444f23d96a82ceb2d
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Al Morton [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
test_spec: LTD: Add Caution for Scaleability Address Time-out.
LTD.Scalability.RFC2544.0PacketLoss needs to add the caution that
all flows must be learned before running Throughput testing,
and no flows can be allowed to time-out during the test.
JIRA: VSPERF-108
Change-Id: I95ae20a978b7af660b358450e67ce60939b0b7c1
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Al Morton [Thu, 15 Oct 2015 00:49:08 +0000 (20:49 -0400)]
test_spec: IETF Draft: Update to reflect dev since July and IETF-93 comments
Among the Updates needed are:
- Several New tests created since July, add to Matrix section.
- Re-named tests: fix in Matrix section.
- Link to Summaries on Wiki.
- Link to Test Setup Figures on Wiki.
- Add some general points on New Test Equipment Challenges/Metrics.
- Mention future test specs, and IFA003 as one source.
JIRA: VSPERF-120
Change-Id: I981b0b6301a208d20220f67784b4591aa3f51338
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Al Morton [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
test_spec: LTD: Some "Throughput" Tests belong in another category
In the LTD, some of the tests with "Throughput" in the title are not actually
testing throughput in the data path.
Since the test names are used by TOIT/VSPERF to group similar tests for batch
execution, it's important that the names accurately represent the test methods
and metrics measured.
JIRA: VSPERF-98
Change-Id: I620ddc0779232f2dd325379005faba8692fea18c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Al Morton [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
test_spec: LTD: Missing Pre-requisites in some of the "new" tests.
A few of the tests should call out a prerequisite.
LTD.MemoryBandwidth.RFC2544.0PacketLoss.Scalability
and
LTD.Scalability.RFC2544.0PacketLoss
are examples.
JIRA: VSPERF-107
Change-Id: I1ca653ac765f9494b48759764103dfc9d42a42f1
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Radek Zetik [Fri, 2 Oct 2015 13:10:30 +0000 (14:10 +0100)]
Default config picks up OVS variants
Running a test with vanilla-ovs, vhost-user-ovs,
vhost-cuse-ovs,... does not require any building
or configuration changes - the vswitch needs only
to specified on the command line.
The config file contains new variables for particular
ovs build.
OvsVanilla:
OVS_DIR_VANILLA, QEMU_DIR_VANILLA
VhostCuse:
RTE_SDK_CUSE, OVS_DIR_CUSE, QEMU_DIR_CUSE
VhostUser:
RTE_SDK_USER, OVS_DIR_USER, QEMU_DIR_USER
The vspef chooses right paths according to command line
switches '--vswitch' (or 'VSWITCH') and '--vnf' (or 'VNF')
JIRA: VSPERF-86
Change-Id: I22e3a7f9e21d6ceb13830e444716b4274314560c
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Al Morton [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
test_spec: LTD:Throughput.RFC2544.Profile Metric Clarifications
LTD.Throughput.RFC2544.Profile refers to the metric "maximum forwarding rate"
but implies that this is the zero% loss rate, which would be the Throughput
level (MFR is usually higher than Throughput, because MFR allows losses).
It may be that MFR and Throughput are just interchanged in the last two
paragraphs of the description.
JIRA: VSPERF-110
Change-Id: I4f36fd4ce66f2f4ebee4f60a11ad03adfb2b3b7c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Al Morton [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
test_spec: LTD: Memory BW Test - probable issue caused by md to rst conversion
The following text in the Description needs to be formatted as a list in .RST:
Furthermore: - the ratio of reads to writes should be recorded.
JIRA: VSPERF-109
Change-Id: I3b6c819d1ac07cc466c747d3552cbcc4de5f34bf
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Al Morton [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
test_spec: Expand deployment scenario in RFC2889 Broadcast Rate test
In the RFC 2889 Broadcast rate testing, four test ports are required.
One of the ports is connected to the test device, so it can send
broadcast frames and listen for miss-routed frames.
JIRA: VSPERF-103
Change-Id: I5ee3d20c71d7debf6c7b09fc094f72b2d4c10684
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Martin Klozik [Fri, 2 Oct 2015 01:18:09 +0000 (02:18 +0100)]
Enable PVP and PVVP deployments for Vanilla OVS
Support for PVP and PVVP scenerios using Vanilla OVS was added.
VMs are configured to forward traffic between virtual interfaces
by standard linux capabilities. Traffic generator script was updated
to accept MAC and IP address configuration to allow VM forwarding
configuration.
VSPERF-66, VSPERF-70
Change-Id: Ia70ab6be547b39928a1eae319faba779d4e29284
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Billy O'Mahony [Thu, 8 Oct 2015 10:47:03 +0000 (11:47 +0100)]
docs: Add overview of the structure of vsperf code
Text & sequence diagrams as both source and png.
JIRA: VSPERF-106
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Change-Id: I33f57fba85710ab4cfc72d0a5d06db6f653545d6
Al Morton [Sun, 6 Sep 2015 23:44:50 +0000 (00:44 +0100)]
test_spec: Note need for 3 test ports in RFC2889 address/cache
The RFC 2889 Address Learning and Cache Capacity tests require
a listening port to check for flooded frames.
JIRA: VSPERF-74
Change-Id: I7b4d2461e819d01d642c9c4d95b938dfbe056f2c
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Maryam Tahhan [Mon, 5 Oct 2015 16:44:17 +0000 (17:44 +0100)]
src: add appropriate build flags for OVS dpdk
Technical Debt - Add appropriate build flags to the OVS makefiles to
build OVS for performance.
JIRA:VSPERF-92
Change-Id: I63d45ebe8ba41799158f97db892a94e16c7b3df5
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Martin Klozik [Fri, 25 Sep 2015 17:00:17 +0000 (18:00 +0100)]
Enable PVVP deployment for DPDK Vhost User and Vhost Cuse
Generic PVVP deployment support has been added. Two
new testcase scenarios for throughput and back2back
tests with PVVP deployment were added. Original
implementation of PVP has been refactored
Following files were affected:
modified: conf/01_testcases.conf
modified: conf/02_vswitch.conf
modified: conf/04_vnf.conf
modified: core/__init__.py
modified: core/component_factory.py
modified: core/loader/loader_servant.py
modified: core/vnf_controller.py
deleted: core/vnf_controller_p2p.py
deleted: core/vnf_controller_pvp.py
modified: core/vswitch_controller_p2p.py
modified: core/vswitch_controller_pvp.py
new file: core/vswitch_controller_pvvp.py
modified: docs/to-be-reorganized/NEWS.rst
modified: docs/to-be-reorganized/quickstart.rst
modified: src/dpdk/dpdk.py
modified: src/ovs/ofctl.py
modified: testcases/testcase.py
modified: tools/tasks.py
new file: vnfs/qemu/qemu.py
new file: vnfs/qemu/qemu_dpdk.py
modified: vnfs/qemu/qemu_dpdk_vhost_cuse.py
modified: vnfs/qemu/qemu_dpdk_vhost_user.py
modified: vnfs/vnf/vnf.py
modified: vswitches/ovs_dpdk_vhost.py
Change-Id: Ib6869a29337a184cb58c57fd96bba1183aba00ab
JIRA: VSPERF-68, VSPERF-69
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Radek Zetik [Thu, 1 Oct 2015 17:13:18 +0000 (18:13 +0100)]
The 'make' creates all required variants of vSwitch
Currently the VSPERF makefiles make just one variant
of vSwitch - OVS with DPDK-vhost-user. To make the other
variants the makefile has to be edited. And the make re-run.
The fix builds all required versions:
DPDK-vhost-user OVS (in src/)
Vanilla OVS (in src_vanilla/)
DPDK-vhost-cuse OVS (in src_cuse/)
HowTo:
- git clone vsperf
- cd .../src
- make
JIRA: VSPERF-85
Change-Id: I469baf8432f0b127cde785f35a6c57a2c778f23f
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Robert Wojciechowicz [Tue, 29 Sep 2015 12:21:22 +0000 (08:21 -0400)]
pkt_gen: change duration to int for Dummy pkt_gen
In case there is specified concrete value for "duration" in the
configuration there is raised TypeError exception
in the send_rfc2544_throughput function of dummy traffic generator.
Conversion to integer solved this issue.
Change-Id: Ib37ecabc1000369d807a997c88d7a3d7aca425d5
Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Al Morton [Sun, 6 Sep 2015 23:44:50 +0000 (00:44 +0100)]
test_spec: Add Traffic Profiles (IMIX) maintained by Functest
The Current list of fixed frame sizes need to be augmented with
IMIX Traffic Profiles in the test framework.
JIRA: VSPERF-100
Change-Id: I97425c09c1d692bae56f2518d479b83a282eb7d1
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Al Morton [Sun, 6 Sep 2015 23:44:50 +0000 (00:44 +0100)]
test_spec: Fix WIDE Fig and Note need for full-mesh ports in RFC2889 tests
The RFC 2889 tests require Full Mesh on multiple ports.
Modify the bunny-ears fig to show this (and address -99 in the process)
JIRA: VSPERF-99
JIRA: VSPERF-101
Change-Id: Id67cb5ef6748c83858a90033534f960874614c06
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Radek Zetik [Tue, 22 Sep 2015 04:12:48 +0000 (05:12 +0100)]
Remove reported derived performance figures
Since vsperf (ixnet trafficgen) started using AggResults.csv
to pull out traffic results after bi-dir support was added.
Some of the derived results are wrong (derived meaning
these are figures vsperf calculates from the info available
in the raw ixnet results).
JIRA: VSPERF-88
Change-Id: I79d88bfc7718bda675d2ba7e5148053405a94211
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Martin Klozik [Sun, 6 Sep 2015 23:44:50 +0000 (00:44 +0100)]
Sysmetrics implementation update
New sysmetrics implementation is based on pidstat command line tool
from sysstat package. Old non-functional implementation was removed.
Reporting was refactored to generate report after each TC from values
already available in memory.
Following files were affected:
modified: conf/01_testcases.conf
modified: conf/02_vswitch.conf
modified: conf/05_collector.conf
deleted: core/collector_controller.py
modified: core/component_factory.py
modified: docs/NEWS.rst
modified: packages.txt
modified: requirements.txt
modified: testcases/testcase.py
modified: tools/collectors/collector/collector.py
modified: tools/collectors/sysmetrics/__init__.py
deleted: tools/collectors/sysmetrics/linuxmetrics.py
new file: tools/collectors/sysmetrics/pidstat.py
modified: tools/report/report.jinja
modified: tools/report/report.py
modified: tools/systeminfo.py
modified: vsperf
JIRA: VSPERF-67
Change-Id: I25a79f2afef405b9ac46ae85c18044af167a62a4
Signed-off-by: Martin Klozik (martinx.klozik@intel.com)
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Billy O'Mahony [Tue, 25 Aug 2015 10:35:28 +0000 (11:35 +0100)]
Frame Modification: support remaining frame modification types.
Only works for P2P. Other deployment scenarios will need to implement
the same kind of multi-table flow as P2P to enable frame modification.
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Madarang <dino.simeonx.madarang@intel.com>
Change-Id: I2fa35972b90b165c00f0d0a7515fa275d0f17aa4
Aric Gardner [Fri, 11 Sep 2015 19:45:39 +0000 (15:45 -0400)]
Move documentation to new sphinx build
TODO: Reorganize documentation into properly named subfolders
TODO: Add logos to documentation (see index.rst for example)
Note you can see the results of this change via a link in the gerrit
comments below
NOTE: The merge job for your project has not been enabled, this code
will not go to the artifacts page upon a merge. you can merge it and
work on it in your own time, please contact me to enable the merge
(the merge job will make this documentation avaliable to the public on
artifacts.opnfv.org)
JIRA:RELENG-15
Change-Id: I3f3d8c9d7fceae90e0ed824b66bdaf7a8ea66328
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Gene Snider [Tue, 1 Sep 2015 23:56:21 +0000 (16:56 -0700)]
Add DNAT/SNAT support
JIRA: VSPERF-72
This change adds optional IPv4 DNAT support to l2fwd module for level two
forwarding. With this change the l2fwd module can be used for testing
complex IP configuration routing with virtual switches.
Other L2 forwarding modules provide only Level 2 pass through. These can be
used for complex IP chain processing but rely on port forwarding in the switch.
With this module each packet which is forwarded optionally gets a new
destination IP and source masquerade. So a test packet can be routed to eth1
and forwarded on eth2 with a different target IP and source address.
To use this module compile it for your kernel and use the 'insmod' command
to insert it.
With no arguments this will forward eth1 to eth2 without modification.
With 'net1=ethX net2=ethX' Level 2 forwarding can be done between arbitrary
ports.
With 'netX=ethX,XX.XX.XX.XX,xx:xx:xx:xx:xx:xx' the packets which are forwarded
on the target port will be given the new destination IP and mac address. One
or both ports may enable DNAT.
Change-Id: If24281a6841930a7a85e4536da96b980ed48df1b
Signed-off-by: Gene Snider <eugene.snider@huawei.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Al Morton [Thu, 30 Jul 2015 12:44:36 +0000 (13:44 +0100)]
Improvement: Expand background details on PDV in the LTD
Expand description of Packet Delay Variation to capture
the additional details which will be important to measurement
design. Measurmeent devices may be implementing the RFC 5481
PDV metric for the firt time, so som general details will
be useful to include in the LTD. Addresses MT's comments.
JIRA: VSPERF-73
Change-Id: I60524969f72bb00519e8070ae51e219d857c554e
Signed-off-by: Al Morton <acmorton@att.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Dino Simeon Madarang [Tue, 1 Sep 2015 10:38:50 +0000 (11:38 +0100)]
bug_fix: Remove extra call to VNF start
Remove call to VNF start since it is already called in __enter__
of VnfControllerPVP.
VSPERF-66
Change-Id: I9c9174ffe7d03efacb6853c059b43c8a5ca66704
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Billy O'Mahony [Fri, 28 Aug 2015 15:09:07 +0000 (16:09 +0100)]
bugfix: Allow exact test names
The current --tests option can make it hard to specify a single test to run.
This patch allows specification of tests using exact names.
JIRA: VSPERF-58
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Dino Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Change-Id: Ib820bdae96d6257d785f4e310a3b3d1fbfa1b575
Dino Simeon Madarang [Wed, 26 Aug 2015 15:35:37 +0000 (16:35 +0100)]
vswitches: Fix error in loading eventfd module
Load eventfd only when vhost-cuse is specified as
the guest access method.
This commit also includes quickstart update for executing PVP tests.
JIRA: VSPERF-59
Change-Id: I41f116ab1c42f704026567a269922c07994b15a5
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
Maryam Tahhan [Thu, 30 Jul 2015 11:02:33 +0000 (12:02 +0100)]
src/dpdk: Rebind DPDK ports to the original driver
Bind DPDK ports back to the original driver they were bound to. This
will be useful when switching between the types of vswitches we are
testing.
Change-Id: I6818d3f8e3c2a5d3a5f083cf9e37e0819e0b39d1
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Maryam Tahhan [Thu, 30 Jul 2015 12:44:36 +0000 (13:44 +0100)]
bug_fix: process pkt_size/duration from cli
Refactor rfc25444_duration to duration and update the --test-params help
to show the type of parameters that can be set from the cli. Also
configure pkt_sizes so that it can be modified from the CLI. Also fixes
the tcl script to configure framesize properly (to the value selected
and not the default 64b).
JIRA: VSPERF-27
Change-Id: I76dcd824977a5f940cf7476090d2d2a3acca8160
Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com>
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Dino Madarang <dino.simeonx.madarang@intel.com>
Maryam Tahhan [Wed, 26 Aug 2015 08:16:03 +0000 (08:16 +0000)]
Merge "Support of configurable background load and implementation of LTD.CPU.RFC2544.0PacketLoss and LTD.Memory.RFC2544.0PacketLoss"
Martin Klozik [Tue, 18 Aug 2015 14:33:14 +0000 (15:33 +0100)]
Support of configurable background load and implementation of LTD.CPU.RFC2544.0PacketLoss and LTD.Memory.RFC2544.0PacketLoss
Every testcase can be configured to run background load
on the DUT. Load is generated by chosen command line tool,
which must be installed according to the installation.md.
Currently 'stress' and 'stress-ng' tools are supported,
but support for new tool can be easily added.
Load can be configured by testcase configuration option 'load'.
Details about supported load generator options can be found
in conf/01_testcases.conf.
JIRA: VSPERF-23
JIRA: VSPERF-24
Change-Id: I3e1aebc0d41357f5a2764015c41ffc7e50fdbf8b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Maryam Tahhan [Tue, 25 Aug 2015 14:17:31 +0000 (14:17 +0000)]
Merge "vswitches: Affinitize vswitch threads for OVS-DPDK"
Code Review / vswitchperf.git / log