yardstick.git
5 years agoAdd Grafana dashboards for RFC2544 31/67231/1
Myron Sosyak [Mon, 11 Mar 2019 12:46:16 +0000 (12:46 +0000)]
Add Grafana dashboards for RFC2544

Added two dashboards for RFC2544 and for RFC2544 multiframesize

YARDSTICK-1592

Change-Id: Ib474c3cd12e2771666f838ca58b0c2c2e46a17cb
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
5 years agoMerge "dovetail - no sla in bottlenecks ping test case would get exception"
Jing Lu [Mon, 11 Mar 2019 01:48:12 +0000 (01:48 +0000)]
Merge "dovetail - no sla in bottlenecks ping test case would get exception"

5 years agoMerge "Add Grafana Dashboard for vCMTS testcase"
Volodymyr Mytnyk [Thu, 7 Mar 2019 16:23:58 +0000 (16:23 +0000)]
Merge "Add Grafana Dashboard for vCMTS testcase"

5 years agoMerge "Support using existing private key when using external heat template file"
Volodymyr Mytnyk [Thu, 7 Mar 2019 16:20:51 +0000 (16:20 +0000)]
Merge "Support using existing private key when using external heat template file"

5 years agoMerge "Update grub in enable_iommu_on_boot when needed"
Volodymyr Mytnyk [Thu, 7 Mar 2019 16:05:42 +0000 (16:05 +0000)]
Merge "Update grub in enable_iommu_on_boot when needed"

5 years agoMerge "Fix failing if hugepages already configured"
Volodymyr Mytnyk [Thu, 7 Mar 2019 14:50:19 +0000 (14:50 +0000)]
Merge "Fix failing if hugepages already configured"

5 years agoMerge "Add Trex traffic generator to initate Traffic for VPP IPSEC"
Volodymyr Mytnyk [Thu, 7 Mar 2019 12:42:35 +0000 (12:42 +0000)]
Merge "Add Trex traffic generator to initate Traffic for VPP IPSEC"

5 years agoMerge "Add Grafana dashboard files for vIMS testcases"
Volodymyr Mytnyk [Thu, 7 Mar 2019 12:42:02 +0000 (12:42 +0000)]
Merge "Add Grafana dashboard files for vIMS testcases"

5 years agoFix RFC2544 Trex template 87/67187/1
Chornyi, TarasX [Wed, 6 Mar 2019 14:49:42 +0000 (16:49 +0200)]
Fix RFC2544 Trex template

Use template traffic profile instead of static one

JIRA: YARDSTICK-1592

Change-Id: I665896c4e533cd7b29f8b906c8c10f769f9268a7
Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
5 years agodovetail - no sla in bottlenecks ping test case would get exception 73/67173/1
rexlee8776 [Tue, 5 Mar 2019 01:25:28 +0000 (01:25 +0000)]
dovetail - no sla in bottlenecks ping test case would get exception

JIRA: YARDSTICK-1604

Change-Id: Ic48aae99478dff861c45da226b5fcfd2d4a7bc06
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoAdd description of NSB scenarios 56/67156/1
Serhiy Pshyk [Fri, 1 Mar 2019 14:30:13 +0000 (14:30 +0000)]
Add description of NSB scenarios

JIRA: YARDSTICK-1592

Change-Id: Ice5d288b1c95b71a5985fa58632f02bfab91e79d
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoAdd Grafana dashboard files for vIMS testcases 87/64287/2
treyad [Wed, 31 Oct 2018 02:00:12 +0000 (19:00 -0700)]
Add Grafana dashboard files for vIMS testcases

Adding json files for Grafana dashboard

JIRA:YARDSTICK-1495

Change-Id: I0a4ce9494ca90f17d2a7e68b1c5c9be7165a794e
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoSupport using existing private key when using external heat template file 53/62953/20
treyad [Tue, 25 Sep 2018 06:01:38 +0000 (23:01 -0700)]
Support using existing private key when using external heat template file

Currently, the private key is auto-generated from Yardstick.
This patch will allow user use their existing private key when
they use external heat template file.

JIRA: YARDSTICK-1447

Change-Id: I45a0ab4ac08e7ccedd770867ed43de92040b6a10
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Quick and ugly fix for "division by zero""
Volodymyr Mytnyk [Thu, 28 Feb 2019 14:51:51 +0000 (14:51 +0000)]
Merge "Quick and ugly fix for "division by zero""

5 years agoUpdate grub in enable_iommu_on_boot when needed 25/67125/1
Stepan Andrushko [Wed, 27 Feb 2019 11:40:13 +0000 (13:40 +0200)]
Update grub in enable_iommu_on_boot when needed

Improve conditions when to update grub in enable_iommu_on_boot
ansible role.

JIRA: YARDSTICK-1603

Change-Id: Ic16b84beb55e45e4b75c120761397dc3207ef6f4
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoFix failing if hugepages already configured 20/67120/1
Stepan Andrushko [Tue, 26 Feb 2019 17:29:34 +0000 (19:29 +0200)]
Fix failing if hugepages already configured

Fix ansible 'enable_hugepages_on_boot' role:
 - don't fail when hugepages are set;
 - removed manually created mount point as grub configuration does
 it after server reboot.

JIRA: YARDSTICK-1602

Change-Id: I11177a043e9d9b956f6d20cf1e679138f0e6c640
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Yardstick container rabbitmq supervisor RUN state"
Volodymyr Mytnyk [Mon, 25 Feb 2019 12:24:15 +0000 (12:24 +0000)]
Merge "Yardstick container rabbitmq supervisor RUN state"

5 years agoMerge "Add new scenario NSPerf-RFC3511"
Volodymyr Mytnyk [Mon, 25 Feb 2019 12:24:01 +0000 (12:24 +0000)]
Merge "Add new scenario NSPerf-RFC3511"

5 years agoMerge "Add Grafana Dashboard for vIPSec testcase"
Abhijit Sinha [Mon, 25 Feb 2019 11:37:26 +0000 (11:37 +0000)]
Merge "Add Grafana Dashboard for vIPSec testcase"

5 years agoMerge "Add VPP traffic profiles for TRex traffic generator"
Volodymyr Mytnyk [Mon, 25 Feb 2019 09:12:16 +0000 (09:12 +0000)]
Merge "Add VPP traffic profiles for TRex traffic generator"

5 years agoMerge "Add vIPSEC testcases"
Volodymyr Mytnyk [Mon, 25 Feb 2019 09:10:34 +0000 (09:10 +0000)]
Merge "Add vIPSEC testcases"

5 years agoAdd vIPSEC testcases 57/65257/9
treyad [Tue, 20 Nov 2018 09:56:05 +0000 (01:56 -0800)]
Add vIPSEC testcases

Test description files for Baremetal

JIRA: YARDSTICK-1487

Change-Id: Ifcbf022bd0625282fc0256316909bcef840929b3
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Change default vports type to int"
Volodymyr Mytnyk [Fri, 22 Feb 2019 15:55:42 +0000 (15:55 +0000)]
Merge "Change default vports type to int"

5 years agoAdd new scenario NSPerf-RFC3511 85/67085/1
Chornyi, TarasX [Fri, 22 Feb 2019 14:52:54 +0000 (16:52 +0200)]
Add new scenario NSPerf-RFC3511

New scenarion executes complete run per runner's
iteration and designed to work with IxLoad TG.

JIRA: YARDSTICK-1592

Change-Id: I43f37ae4ab211a29d75a9c9edd93141767a4c57d
Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
5 years agoAdd Trex traffic generator to initate Traffic for VPP IPSEC 51/65251/13
treyad [Tue, 20 Nov 2018 09:47:44 +0000 (01:47 -0800)]
Add Trex traffic generator to initate Traffic for VPP IPSEC

Send the traffic
Measure NDR or PDR throughputs
Measure packet loss and latency of VNFs

JIRA: YARDSTICK-1483

Change-Id: Ie844c0b786bfe1ca3efafdb56d8e473e6ad59cc9
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoUnify TG and VNF names in infrastructure files 97/66297/11
Orest Voznyy [Wed, 9 Jan 2019 08:30:44 +0000 (10:30 +0200)]
Unify TG and VNF names in infrastructure files

Update naming in related files, i.e. pod, docs, docstrings.
Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: I7596b915939f242349a99721b6088ae738dd277f
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoYardstick container rabbitmq supervisor RUN state 68/67068/2
Stepan Andrushko [Tue, 19 Feb 2019 17:14:55 +0000 (19:14 +0200)]
Yardstick container rabbitmq supervisor RUN state

Rabbitmq process exited supervisor and couldn't respawn it afterwards.
Updated the way rabbitmq service and node are spawned to have them
RUNNING after a service stop or node down.

JIRA: YARDSTICK-1600

Change-Id: Idd6812db7a1985e8c727efd7ea45572199c1a4a9
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoUnify IXIA/Trex test cases results 60/67060/5
Serhiy Pshyk [Mon, 18 Feb 2019 13:23:40 +0000 (13:23 +0000)]
Unify IXIA/Trex test cases results

List of changes:
 - Unified naming of all counters reported by IXIA/Trex
 - Removed not valid counters reported by IXIA
 - Added per interface stats reported by Trex
 - Fixed latency calculation for Trex tg

JIRA: YARDSTICK-1592

Change-Id: Ia3d450058f884579f4d331772a8cf6de22146ac3
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoChange default vports type to int 54/67054/1
Chornyi, TarasX [Mon, 18 Feb 2019 10:10:44 +0000 (12:10 +0200)]
Change default vports type to int

JIRA: YARDSTICK-1592

Change-Id: Ie64cadcfc9077aed3b4bfeed6055118dc7008eb8
Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
5 years agoQuick and ugly fix for "division by zero" 37/67037/1
Patrice Buriez [Fri, 15 Feb 2019 11:54:36 +0000 (12:54 +0100)]
Quick and ugly fix for "division by zero"

Workaround for "ZeroDivisionError: float division by zero" and
"RuntimeError: Unable to retrieve TSC" issues.
The actual clean fix requires reworking get_data() to accumulate
bytes received from PROX TCP port until EOL is received.
Since the other functions calling get_data() expect a synchronous
answer from PROX, timeout should be considered a fatal error, and
the current default at 10ms was just calling for problems!

Even if this change does not get merged, at least this workaround
will be available to end-users for cherry-picking from gerrit,
while the actual clean fix is being implemented.

JIRA: YARDSTICK-1381

Change-Id: I6af226ca31aaebeb50302e24b1eb209de70f6526
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoMerge "Extend TRex RFC2544 test case collected stats"
Volodymyr Mytnyk [Thu, 14 Feb 2019 13:20:11 +0000 (13:20 +0000)]
Merge "Extend TRex RFC2544 test case collected stats"

5 years agoMerge "[docs] Update on Yardstick NSB installation"
Volodymyr Mytnyk [Wed, 13 Feb 2019 09:43:19 +0000 (09:43 +0000)]
Merge "[docs] Update on Yardstick NSB installation"

5 years agoMerge "Added RFC2544 Trex template"
Volodymyr Mytnyk [Wed, 13 Feb 2019 09:38:09 +0000 (09:38 +0000)]
Merge "Added RFC2544 Trex template"

5 years agoAdd VPP traffic profiles for TRex traffic generator 53/65253/8
treyad [Tue, 20 Nov 2018 09:49:40 +0000 (01:49 -0800)]
Add VPP traffic profiles for TRex traffic generator

Create traffic streams dynamically for VPP test, based on traffic profiles

JIRA: YARDSTICK-1485

Change-Id: I9fe8575ef6527823b86214c3d7752486c79dee73
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoGenerate correct IMIX distribution for STL profile 93/66993/1
treyad [Tue, 12 Feb 2019 20:23:00 +0000 (12:23 -0800)]
Generate correct IMIX distribution for STL profile

JIRA: YARDSTICK-1599

Change-Id: I654644d7944d0af41d8da12cc002f31fcfecf62e
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoExtend TRex RFC2544 test case collected stats 91/66991/1
Oleksandr Naumets [Tue, 12 Feb 2019 18:40:26 +0000 (18:40 +0000)]
Extend TRex RFC2544 test case collected stats

Added new fields into Yardstick NSB TRex RFC2544 test case results:
- Iteration
- PktSize
- Status

JIRA: YARDSTICK-1592

Change-Id: Id746b537a0ef55a891653719cc1db29ef7e994fc
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoAdded RFC2544 Trex template 19/66919/2
Chornyi, TarasX [Mon, 11 Feb 2019 10:24:10 +0000 (12:24 +0200)]
Added RFC2544 Trex template

JIRA: YARDSTICK-1592

Change-Id: I36d96c932bff399be05e44dcd86096ee50614ad8
Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
5 years agoMerge changes from topic 'YARDSTICK-1116'
Volodymyr Mytnyk [Tue, 12 Feb 2019 16:26:29 +0000 (16:26 +0000)]
Merge changes from topic 'YARDSTICK-1116'

* changes:
  Rework TestScenarioHelper
  Rework TestSampleVNFDeployHelper
  Rework TestResourceHelper
  Rework TestDpdkVnfSetupEnvHelper

5 years agoMerge "[docs] Documentation for BNG PPPoE RFC2544 test cases"
Volodymyr Mytnyk [Tue, 12 Feb 2019 16:07:31 +0000 (16:07 +0000)]
Merge "[docs] Documentation for BNG PPPoE RFC2544 test cases"

5 years agoMerge "Add IXIA Tx/Rx Bytes stats into results"
Volodymyr Mytnyk [Mon, 11 Feb 2019 16:43:18 +0000 (16:43 +0000)]
Merge "Add IXIA Tx/Rx Bytes stats into results"

5 years agoAdd Grafana Dashboard for vIPSec testcase 59/65259/6
treyad [Tue, 20 Nov 2018 09:58:11 +0000 (01:58 -0800)]
Add Grafana Dashboard for vIPSec testcase

JIRA: YARDSTICK-1451

Change-Id: I712a5268d7126d9df970c02a7c717457e3f0e556
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Add Standalone Scale Up Test Case For Packet Flow Buffering."
Volodymyr Mytnyk [Mon, 11 Feb 2019 10:29:59 +0000 (10:29 +0000)]
Merge "Add Standalone Scale Up Test Case For Packet Flow Buffering."

5 years agoMerge "Add Standalone Scale Up Test Case For Load Balancing."
Volodymyr Mytnyk [Mon, 11 Feb 2019 10:29:48 +0000 (10:29 +0000)]
Merge "Add Standalone Scale Up Test Case For Load Balancing."

5 years agoMerge "Debugging information when dpdk bind fails should be improved"
Abhijit Sinha [Mon, 11 Feb 2019 10:09:18 +0000 (10:09 +0000)]
Merge "Debugging information when dpdk bind fails should be improved"

5 years agoAdd Standalone Scale Up Test Case For Load Balancing. 65/66565/3
Carey, Alan [Tue, 22 Jan 2019 14:52:20 +0000 (14:52 +0000)]
Add Standalone Scale Up Test Case For Load Balancing.

Files to be added:

tc_prox_sriov_lb-scale-up.yaml

tc_prox_ovs-dpdk_lb-scale-up.yam

JIRA: YARDSTICK-1584

Change-Id: I8f782451ff5ed1682f77be0c1a599ebaedf86b61
Signed-off-by: Carey, Alan <alan.carey@intel.com>
5 years ago[docs] Documentation for BNG PPPoE RFC2544 test cases 93/65793/3
Oleksandr Naumets [Thu, 13 Dec 2018 14:14:07 +0000 (14:14 +0000)]
[docs] Documentation for BNG PPPoE RFC2544 test cases

JIRA: YARDSTICK-1565

Change-Id: I233878228091f9ce542baa6e0f42037b9fad7a73
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoAdd Standalone Scale Up Test Case For Packet Flow Buffering. 51/66451/5
Carey, Alan [Thu, 17 Jan 2019 11:18:45 +0000 (11:18 +0000)]
Add Standalone Scale Up Test Case For Packet Flow Buffering.

Files to be added:

tc_prox_sriov_buffering-scale-up.yaml

tc_prox_ovs-dpdk_buffering-scale-up.yaml

JIRA: YARDSTICK-1581

Change-Id: I1339398a71607331f5b044be4c581acef1d49fbe
Signed-off-by: Carey, Alan <alan.carey@intel.com>
5 years agoMerge "Fix QnQ issue"
Volodymyr Mytnyk [Fri, 8 Feb 2019 16:14:30 +0000 (16:14 +0000)]
Merge "Fix QnQ issue"

5 years agoAdd IXIA Tx/Rx Bytes stats into results 01/66901/1
Oleksandr Naumets [Fri, 8 Feb 2019 15:32:07 +0000 (15:32 +0000)]
Add IXIA Tx/Rx Bytes stats into results

Add IXIA "Bytes Rx" and "Bytes Tx" ports stats into collected
results. This stats allows to calculate the throughput when
running IMIX traffic.

JIRA: YARDSTICK-1592

Change-Id: I1db678d410b37e7a0f64dc743e6e620e495115ed
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoMigrate Trex TG to use new NSPerf-RFC2544 scenario 59/66859/6
Mytnyk, Volodymyr [Tue, 5 Feb 2019 09:48:01 +0000 (11:48 +0200)]
Migrate Trex TG to use new NSPerf-RFC2544 scenario

JIRA: YARDSTICK-1592

Change-Id: Ic51a52385ac53df9b5f56387af4f1b661bb0d86f
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoRework TestScenarioHelper 57/60957/7
Emma Foley [Tue, 14 Aug 2018 17:24:21 +0000 (18:24 +0100)]
Rework TestScenarioHelper

Update network_services/vnf_generic/vnf/test_sample_vnf.py

JIRA: YARDSTICK-1434
Change-Id: I1bbf2bc139f3302d9882b28f9883e64fa595eb46
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoRework TestSampleVNFDeployHelper 55/60955/7
Emma Foley [Tue, 14 Aug 2018 17:23:16 +0000 (18:23 +0100)]
Rework TestSampleVNFDeployHelper

Update network_services/vnf_generic/vnf/test_sample_vnf.py

JIRA: YARDSTICK-1434
Change-Id: Ib15e37987ec336f611b27ea71cbc3005311e5d27
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoRework TestResourceHelper 53/60953/7
Emma Foley [Tue, 14 Aug 2018 17:19:23 +0000 (18:19 +0100)]
Rework TestResourceHelper

Update network_services/vnf_generic/vnf/test_sample_vnf.py

JIRA: YARDSTICK-1434
Change-Id: I56e14a2557554e1c461447f0567b5e028198b553
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoRework TestDpdkVnfSetupEnvHelper 51/60951/7
Emma Foley [Tue, 14 Aug 2018 17:18:14 +0000 (18:18 +0100)]
Rework TestDpdkVnfSetupEnvHelper

Update network_services/vnf_generic/vnf/test_sample_vnf.py

JIRA: YARDSTICK-1434
Change-Id: I5b3ef90909949882cec1c32b1f86c3aedbc950d8
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoUpdate Intel Copyright for files edited in 2019 93/66893/1
John O Loughlin [Thu, 7 Feb 2019 16:30:07 +0000 (16:30 +0000)]
Update Intel Copyright for files edited in 2019

JIRA: YARDSTICK-1591

Change-Id: I3ea9039d25bfce578681adb9e27e1598e84a1f56
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoMerge "Add Warning for key issue ixload"
Volodymyr Mytnyk [Thu, 7 Feb 2019 11:47:15 +0000 (11:47 +0000)]
Merge "Add Warning for key issue ixload"

5 years agoAdd Warning for key issue ixload 79/66479/10
John O Loughlin [Fri, 18 Jan 2019 09:16:31 +0000 (09:16 +0000)]
Add Warning for key issue ixload

Currently there is a section of code that assigns a gateway
links[name]["ip"]["gateway"] = gateway
If the ip field has not already been defined a key error is
thrown and not handled. This error is then suppressed so
the program fails silently and thus causes the test case to hang.

JIRA: YARDSTICK-1586

Change-Id: I94a1081a2038fb58989b3033444ea5f3a6e178f0
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoMerge "Extend IXIA RFC2544 test case collected stats"
Volodymyr Mytnyk [Thu, 7 Feb 2019 08:54:33 +0000 (08:54 +0000)]
Merge "Extend IXIA RFC2544 test case collected stats"

5 years agoMerge "Add CPU isolation support for Yardstick NSB setup"
Volodymyr Mytnyk [Thu, 7 Feb 2019 08:35:35 +0000 (08:35 +0000)]
Merge "Add CPU isolation support for Yardstick NSB setup"

5 years agoMerge "Add NSB test descriptors for vIPSEC testcase"
Volodymyr Mytnyk [Thu, 7 Feb 2019 08:32:24 +0000 (08:32 +0000)]
Merge "Add NSB test descriptors for vIPSEC testcase"

5 years agoDebugging information when dpdk bind fails should be improved 59/66459/3
DanielMartinBuckley [Thu, 17 Jan 2019 14:50:46 +0000 (14:50 +0000)]
Debugging information when dpdk bind fails should be improved

JIRA: YARDSTICK-1585

When dpdk-devbind.py is failing, the information provided is poor,
making it difficult to debug.

At least the exact command used should be printed, ideally with the
returned error. As of today, the more interesting line is

DpdkBindHelperException: /opt/nsb_bin/dpdk-devbind.py command
failed with rc=1

Change-Id: I7831c81ffa9e1f4695480eb140fa97a58ff88f8c
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
5 years agoAdd CPU isolation support for Yardstick NSB setup 15/63215/8
Stepan Andrushko [Fri, 5 Oct 2018 18:42:33 +0000 (21:42 +0300)]
Add CPU isolation support for Yardstick NSB setup

Add support to define CPU isolation in grub by using NSB setup script.
List of CPU's to be isolated is not used by default and is defined in
install-inventory.ini.
Warning: reboot is required to apply CPU isolation to grub.

JIRA: YARDSTICK-1467

Change-Id: I54ffa925a8f3059180d17ff4f1c41ff6e0f12066
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Mock time.sleep in slow tests"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:32:50 +0000 (16:32 +0000)]
Merge "Mock time.sleep in slow tests"

5 years agoMerge "Unify different VNF testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:09:32 +0000 (16:09 +0000)]
Merge "Unify different VNF testcases TG and VNF names"

5 years agoMerge "Unify ACL testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:07:50 +0000 (16:07 +0000)]
Merge "Unify ACL testcases TG and VNF names"

5 years agoMerge "Unify CGNAPT testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:07:01 +0000 (16:07 +0000)]
Merge "Unify CGNAPT testcases TG and VNF names"

5 years agoMerge "Unify Firewall testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:05:55 +0000 (16:05 +0000)]
Merge "Unify Firewall testcases TG and VNF names"

5 years agoMerge "Unify Router testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:05:10 +0000 (16:05 +0000)]
Merge "Unify Router testcases TG and VNF names"

5 years agoMerge "Unify PROX testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:04:26 +0000 (16:04 +0000)]
Merge "Unify PROX testcases TG and VNF names"

5 years agoMerge "Unify vFW testcases TG and VNF names"
Volodymyr Mytnyk [Wed, 6 Feb 2019 16:01:06 +0000 (16:01 +0000)]
Merge "Unify vFW testcases TG and VNF names"

5 years agoExtend IXIA RFC2544 test case collected stats 67/66867/2
Oleksandr Naumets [Wed, 6 Feb 2019 09:35:16 +0000 (09:35 +0000)]
Extend IXIA RFC2544 test case collected stats

Added new fields into Yardstick NSB IXIA RFC2544 test case results:
- Iteration (only for NSPerf-RFC2544 scenario)
- Rate (for NSPerf and NSPerf-RFC2544 scenarios)
- PktSize (for NSPerf and NSPerf-RFC2544 scenarios)

JIRA: YARDSTICK-1596

Change-Id: I3bbf4aabf8b57580ebe644e967a5dab69e3a7c8d
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoMerge "Improve SSH to Open/Close interactive terminal"
Volodymyr Mytnyk [Wed, 6 Feb 2019 13:25:53 +0000 (13:25 +0000)]
Merge "Improve SSH to Open/Close interactive terminal"

5 years agoMerge "Update Sequence runner to use ScenarioOutput class"
Volodymyr Mytnyk [Wed, 6 Feb 2019 12:22:20 +0000 (12:22 +0000)]
Merge "Update Sequence runner to use ScenarioOutput class"

5 years agoUnify different VNF testcases TG and VNF names 95/66295/9
Orest Voznyy [Wed, 9 Jan 2019 08:29:16 +0000 (10:29 +0200)]
Unify different VNF testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: I233b1ba24c85c2e93b831eefbcfe6757f5edf5ca
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoUnify ACL testcases TG and VNF names 93/66293/9
Orest Voznyy [Wed, 9 Jan 2019 08:27:09 +0000 (10:27 +0200)]
Unify ACL testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: Ic5c8121828505dabdedf0b1cf559a5aebff7124c
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoUnify CGNAPT testcases TG and VNF names 91/66291/9
Orest Voznyy [Wed, 9 Jan 2019 08:26:27 +0000 (10:26 +0200)]
Unify CGNAPT testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: Iab61828f6e80c65330ee133b7f674457c091de94
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoUnify Firewall testcases TG and VNF names 89/66289/11
Orest Voznyy [Wed, 9 Jan 2019 08:25:40 +0000 (10:25 +0200)]
Unify Firewall testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: I70ebfb3598febd02b089b4fb653ee81d1147edd7
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoUnify Router testcases TG and VNF names 87/66287/11
Orest Voznyy [Wed, 9 Jan 2019 08:22:38 +0000 (10:22 +0200)]
Unify Router testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: Ifd876811683675c38ee71187213fe6377cbb4eda
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoUnify PROX testcases TG and VNF names 85/66285/11
Orest Voznyy [Wed, 9 Jan 2019 08:21:14 +0000 (10:21 +0200)]
Unify PROX testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: Ic36a1f379422e5823db604ade84ea1d58b6df5a5
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoUnify vFW testcases TG and VNF names 83/66283/10
Orest Voznyy [Wed, 9 Jan 2019 08:17:23 +0000 (10:17 +0200)]
Unify vFW testcases TG and VNF names

Rename TGs and VNFs to follow a single naming convention, for all VNFs:
  name: trafficgen_0
  role: tg__0

  name: vnf_0
  role: vnf__0

JIRA: YARDSTICK-1578

Change-Id: I03438d1b9484df759fe0129bdb050ff88f02563f
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
5 years agoFix QnQ issue 41/64641/18
John O Loughlin [Fri, 23 Nov 2018 11:38:14 +0000 (11:38 +0000)]
Fix QnQ issue

Currently if multiple tests are run with a QnQ section defined the QnQ
segment gets appended to the frame. This leads to invalid frames when
the test is run for more than 1 iteration. With this patch the QnQ is
updated if the QnQ segment has already been created.

JIRA: YARDSTICK-1513

Change-Id: I4ba6ef89380ccf1cb8a132ff5bf048935a87f0c9
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoMerge "Add vBNG test cases stats processing functionality"
Volodymyr Mytnyk [Tue, 5 Feb 2019 12:56:33 +0000 (12:56 +0000)]
Merge "Add vBNG test cases stats processing functionality"

5 years agoUpdate Sequence runner to use ScenarioOutput class 47/66847/3
Serhiy Pshyk [Mon, 4 Feb 2019 13:50:18 +0000 (13:50 +0000)]
Update Sequence runner to use ScenarioOutput class

List of changes:
 - update Sequence runner to use new mechanism for reporting data (kpi)
 - add new rfc2544 example test case that executes the same test with
   different framesizes sequentially

JIRA: YARDSTICK-1592

Change-Id: I731cf1ca40f7232b26ea68f81d22248ebc53eb62
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoTrex client not starting in 4 port baremetal 89/66589/8
DanielMartinBuckley [Wed, 23 Jan 2019 11:11:00 +0000 (11:11 +0000)]
Trex client not starting in 4 port baremetal

JIRA: YARDSTICK-1589

After calling STLclient.connect() there is no check if
connection was sucessfull or not.

Added a check for success on connect, retry if failure
and disconnect and connect on timeout.

If still connect failed then do not resume .. end with
LOG.critial and exit.

Change-Id: Ifd306b7920d9acbc16681cf79bf952d5af31eb64
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
5 years agoSupport NSB NFVi buffering and Load Balance on 2 and 4 ports 33/66433/11
DanielMartinBuckley [Wed, 16 Jan 2019 16:45:56 +0000 (16:45 +0000)]
Support NSB NFVi buffering and Load Balance on 2 and 4 ports

JIRA: YARDSTICK-1582

Most use cases support 4 ports.
Buffering support only 1 core.
Request is about supporting buffering & Load balance
for 2 and 4 ports

Change-Id: I734f9d6702825b31253a21092c86fc72e367586b
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
5 years agoMerge "Replace script to install.yaml in nsb_setup.sh"
Volodymyr Mytnyk [Mon, 4 Feb 2019 08:23:19 +0000 (08:23 +0000)]
Merge "Replace script to install.yaml in nsb_setup.sh"

5 years ago[docs] Update on Yardstick NSB installation 43/66643/3
Stepan Andrushko [Fri, 25 Jan 2019 18:13:13 +0000 (20:13 +0200)]
[docs] Update on Yardstick NSB installation

Updated how to install Yardstick and NSB components.

Updated:
 - 04-installation.rst
 - 13-nsb-installation.rst

JIRA: YARDSTICK-1335

Change-Id: If3f88a316f0581b82bfe31abd5fbe5b54a559f6e
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoAdd vBNG test cases stats processing functionality 07/65207/19
Oleksandr Naumets [Mon, 19 Nov 2018 13:45:32 +0000 (13:45 +0000)]
Add vBNG test cases stats processing functionality

JIRA: YARDSTICK-1546

Change-Id: I3575223ef8231fb4d574e961360b0f2d90a71749
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoRefactor SampleVNF wait method 09/62709/7
Mytnyk, Volodymyr [Fri, 21 Sep 2018 15:31:23 +0000 (16:31 +0100)]
Refactor SampleVNF wait method

JIRA: YARDSTICK-1439

Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoAdd rate 'resolution' option for IXIA rfc2544 test 97/66797/1
Serhiy Pshyk [Thu, 31 Jan 2019 14:23:59 +0000 (14:23 +0000)]
Add rate 'resolution' option for IXIA rfc2544 test

Rate resolution value is compared with the difference between
the rates in two consecutive iterations. If the difference
is smaller than the resolution, the test stops.

JIRA: YYARDSTICK-1592

Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoMerge "Fix exception handling ixload"
Volodymyr Mytnyk [Thu, 31 Jan 2019 13:14:17 +0000 (13:14 +0000)]
Merge "Fix exception handling ixload"

5 years agoMerge "Refactor: add _get_timestamps()"
Volodymyr Mytnyk [Thu, 31 Jan 2019 13:01:44 +0000 (13:01 +0000)]
Merge "Refactor: add _get_timestamps()"

5 years agoMerge "Add new scenario NSPerf-RFC2544"
Volodymyr Mytnyk [Thu, 31 Jan 2019 12:46:13 +0000 (12:46 +0000)]
Merge "Add new scenario NSPerf-RFC2544"

5 years agoMock time.sleep in slow tests 79/66779/3
Emma Foley [Tue, 29 Jan 2019 18:15:23 +0000 (18:15 +0000)]
Mock time.sleep in slow tests

time.sleep was called in a number of classes which wasn't
mocked in the tests.
This accounted for 2.5 minutes of UT execution time.

The calls to time.sleep() have been mocked, and the test
execution time has been reduced.

JIRA: YARDSTICK-1595
Change-Id: I0a4f4962513cf8845471b074347601e33b35ef25
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoFix exception handling ixload 81/66481/11
John O Loughlin [Fri, 18 Jan 2019 11:27:03 +0000 (11:27 +0000)]
Fix exception handling ixload

Ixload uses its own version of python
By default it will fail to import yardstick.common exceptions.
For this reason for this reason ixload exceptions should be kept
in http_ixload.py

JIRA: YARDSTICK-1587

Change-Id: I5673fb5b89bbcdf4d3c60c283231d44d770999ec
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd new scenario NSPerf-RFC2544 61/66561/18
Serhiy Pshyk [Tue, 22 Jan 2019 13:31:58 +0000 (13:31 +0000)]
Add new scenario NSPerf-RFC2544

List of changes:
 - Added new scenario NSPerf-RFC2544 that runs complete test per
   runner's iteration
 - NSPerf is still present for backward compatibility
 - Added ScenarioOutput class which allows scenario to report
   data (kpi,...) at any moment of time (not only once per run)
 - New output mechanism is used only by new NSPerf-RFC2544 scenario

JIRA: YARDSTICK-1592

Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoAdd cli option framesize for router 09/66609/4
John O Loughlin [Thu, 24 Jan 2019 10:18:08 +0000 (10:18 +0000)]
Add cli option framesize for router

Remove any duplicated testcases
Default framesize to 64B: 100

JIRA: YARDSTICK-1554

Change-Id: I793cead17bc98c2487ca010a6639850bea5d7991
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd cli option framesize for cgnapt 75/66575/4
John O Loughlin [Tue, 22 Jan 2019 16:59:27 +0000 (16:59 +0000)]
Add cli option framesize for cgnapt

Remove any duplicated testcases
Default framesize to 64B: 100

JIRA: YARDSTICK-1554

Change-Id: I2fd7caba9565ba16b2d6494f71ad9b9d476e398b
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd cli option framesize for acl vnf 67/66567/4
John O Loughlin [Tue, 22 Jan 2019 15:10:02 +0000 (15:10 +0000)]
Add cli option framesize for acl vnf

Remove any duplicated testcases
Default framesize to 64B: 100

JIRA: YARDSTICK-1554

Change-Id: I61bbf2e7f0c4bd8c1b8e55769cae092e50140f6a
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd cli option framesize for vfw vnf 63/66563/5
John O Loughlin [Wed, 30 Jan 2019 17:06:20 +0000 (17:06 +0000)]
Add cli option framesize for vfw vnf

Remove any duplicated testcases
Default framesize to 64B: 100
Remove _64B_ from name

JIRA: YARDSTICK-1554

Change-Id: Ic759971d09102fdbd459d920c441bfd9e794e7e0
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>