yardstick.git
5 years agoUpdate Sequence runner to use ScenarioOutput class 47/66847/3
Serhiy Pshyk [Mon, 4 Feb 2019 13:50:18 +0000 (13:50 +0000)]
Update Sequence runner to use ScenarioOutput class

List of changes:
 - update Sequence runner to use new mechanism for reporting data (kpi)
 - add new rfc2544 example test case that executes the same test with
   different framesizes sequentially

JIRA: YARDSTICK-1592

Change-Id: I731cf1ca40f7232b26ea68f81d22248ebc53eb62
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoMerge "Replace script to install.yaml in nsb_setup.sh"
Volodymyr Mytnyk [Mon, 4 Feb 2019 08:23:19 +0000 (08:23 +0000)]
Merge "Replace script to install.yaml in nsb_setup.sh"

5 years agoRefactor SampleVNF wait method 09/62709/7
Mytnyk, Volodymyr [Fri, 21 Sep 2018 15:31:23 +0000 (16:31 +0100)]
Refactor SampleVNF wait method

JIRA: YARDSTICK-1439

Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoAdd rate 'resolution' option for IXIA rfc2544 test 97/66797/1
Serhiy Pshyk [Thu, 31 Jan 2019 14:23:59 +0000 (14:23 +0000)]
Add rate 'resolution' option for IXIA rfc2544 test

Rate resolution value is compared with the difference between
the rates in two consecutive iterations. If the difference
is smaller than the resolution, the test stops.

JIRA: YYARDSTICK-1592

Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoMerge "Fix exception handling ixload"
Volodymyr Mytnyk [Thu, 31 Jan 2019 13:14:17 +0000 (13:14 +0000)]
Merge "Fix exception handling ixload"

5 years agoMerge "Refactor: add _get_timestamps()"
Volodymyr Mytnyk [Thu, 31 Jan 2019 13:01:44 +0000 (13:01 +0000)]
Merge "Refactor: add _get_timestamps()"

5 years agoMerge "Add new scenario NSPerf-RFC2544"
Volodymyr Mytnyk [Thu, 31 Jan 2019 12:46:13 +0000 (12:46 +0000)]
Merge "Add new scenario NSPerf-RFC2544"

5 years agoFix exception handling ixload 81/66481/11
John O Loughlin [Fri, 18 Jan 2019 11:27:03 +0000 (11:27 +0000)]
Fix exception handling ixload

Ixload uses its own version of python
By default it will fail to import yardstick.common exceptions.
For this reason for this reason ixload exceptions should be kept
in http_ixload.py

JIRA: YARDSTICK-1587

Change-Id: I5673fb5b89bbcdf4d3c60c283231d44d770999ec
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd new scenario NSPerf-RFC2544 61/66561/18
Serhiy Pshyk [Tue, 22 Jan 2019 13:31:58 +0000 (13:31 +0000)]
Add new scenario NSPerf-RFC2544

List of changes:
 - Added new scenario NSPerf-RFC2544 that runs complete test per
   runner's iteration
 - NSPerf is still present for backward compatibility
 - Added ScenarioOutput class which allows scenario to report
   data (kpi,...) at any moment of time (not only once per run)
 - New output mechanism is used only by new NSPerf-RFC2544 scenario

JIRA: YARDSTICK-1592

Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoAdd cli option framesize for router 09/66609/4
John O Loughlin [Thu, 24 Jan 2019 10:18:08 +0000 (10:18 +0000)]
Add cli option framesize for router

Remove any duplicated testcases
Default framesize to 64B: 100

JIRA: YARDSTICK-1554

Change-Id: I793cead17bc98c2487ca010a6639850bea5d7991
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd cli option framesize for cgnapt 75/66575/4
John O Loughlin [Tue, 22 Jan 2019 16:59:27 +0000 (16:59 +0000)]
Add cli option framesize for cgnapt

Remove any duplicated testcases
Default framesize to 64B: 100

JIRA: YARDSTICK-1554

Change-Id: I2fd7caba9565ba16b2d6494f71ad9b9d476e398b
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd cli option framesize for acl vnf 67/66567/4
John O Loughlin [Tue, 22 Jan 2019 15:10:02 +0000 (15:10 +0000)]
Add cli option framesize for acl vnf

Remove any duplicated testcases
Default framesize to 64B: 100

JIRA: YARDSTICK-1554

Change-Id: I61bbf2e7f0c4bd8c1b8e55769cae092e50140f6a
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoAdd cli option framesize for vfw vnf 63/66563/5
John O Loughlin [Wed, 30 Jan 2019 17:06:20 +0000 (17:06 +0000)]
Add cli option framesize for vfw vnf

Remove any duplicated testcases
Default framesize to 64B: 100
Remove _64B_ from name

JIRA: YARDSTICK-1554

Change-Id: Ic759971d09102fdbd459d920c441bfd9e794e7e0
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoRefactor: add _get_timestamps() 35/66735/3
Emma Foley [Thu, 24 Jan 2019 11:35:34 +0000 (11:35 +0000)]
Refactor: add _get_timestamps()

JIRA: YARDSTICK-1593
Change-Id: I3ec352dd577c6030fa86a2817e264ba7c80773f1
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoMerge "NSB sync: clean-up draft IPC implementation (part 1)"
Volodymyr Mytnyk [Wed, 30 Jan 2019 13:18:22 +0000 (13:18 +0000)]
Merge "NSB sync: clean-up draft IPC implementation (part 1)"

5 years agoMerge "Concurrency testcases to be configured over cli"
Volodymyr Mytnyk [Wed, 30 Jan 2019 12:44:52 +0000 (12:44 +0000)]
Merge "Concurrency testcases to be configured over cli"

5 years agoConcurrency testcases to be configured over cli 57/66557/3
John O Loughlin [Tue, 22 Jan 2019 10:57:41 +0000 (10:57 +0000)]
Concurrency testcases to be configured over cli

This patch will allow the request size to be passed through cli
rather than having a seperate file for option.
yardstick -d task start --task-args='{page_size: "1b"}' <path to config>

JIRA: YARDSTICK-1554

Change-Id: I085d6d908533fb9a7a7566c7c669cb45cf1021e5
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoUpdate Intel Copyright 65/66765/2
John O Loughlin [Tue, 29 Jan 2019 15:02:36 +0000 (15:02 +0000)]
Update Intel Copyright

JIRA: YARDSTICK-1591

Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoNSB sync: clean-up draft IPC implementation (part 1) 41/66641/3
Mytnyk, Volodymyr [Thu, 24 Jan 2019 15:46:04 +0000 (17:46 +0200)]
NSB sync: clean-up draft IPC implementation (part 1)

  The existing implementation of IPC is not finished and isn't used
by any of the VNFs/TG implementation. It is used in the code but does
nothing from functionality perspective.
  New syncronization mechanism is going to be implemented by using
different approach than it was designed before. Thus, the current
IPC mechanism is not going to be re-used. So, removing it.
  The IPC consumer/producer implementation is left as it may be
required for other purposes.

- Remove SampleVNF MQ consumer class
- Remove IterationIPC MQ producer for VNF control messages
- Remove MQ producer from SampleVNFTrafficGen class
- Remove TrafficGeneratorProducer class
- Remove IterationIPC runner
- Remove unused task_id form VNF Generic initialization as it is not
  required for synchronization of VNFs/TGs anymore.
- Fix UT

JIRA: YARDSTICK-1592

Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoMerge "Remove redundant comment"
Emma Foley [Tue, 29 Jan 2019 09:30:11 +0000 (09:30 +0000)]
Merge "Remove redundant comment"

5 years agoMerge "Yardsitck Gambia Release 7.2.0 release notes."
Rex Lee [Fri, 25 Jan 2019 09:41:50 +0000 (09:41 +0000)]
Merge "Yardsitck Gambia Release 7.2.0 release notes."

5 years agoMerge changes from topic 'report/html_table'
Volodymyr Mytnyk [Thu, 24 Jan 2019 10:17:48 +0000 (10:17 +0000)]
Merge changes from topic 'report/html_table'

* changes:
  Additional rework of NSB report
  Only show metrics for selected nodes in data table
  Fix conversion to JS for HTML reports

5 years agoMerge "Add functional tests for HTML report"
Volodymyr Mytnyk [Thu, 24 Jan 2019 10:11:23 +0000 (10:11 +0000)]
Merge "Add functional tests for HTML report"

5 years agoYardsitck Gambia Release 7.2.0 release notes. 03/66603/1
rexlee8776 [Thu, 24 Jan 2019 08:12:26 +0000 (08:12 +0000)]
Yardsitck Gambia Release 7.2.0 release notes.

release notes for Gambia 7.2.0

Change-Id: Ib7bd231ee61c73f593d99ab3b13a64c70e758e8a
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoMerge "[dovetail] split the sla check results into process recovery and service recov...
Rex Lee [Thu, 24 Jan 2019 01:40:54 +0000 (01:40 +0000)]
Merge "[dovetail] split the sla check results into process recovery and service recovery for HA tcs"

5 years agoMerge "Concurrency testcases to be configured over cli"
Volodymyr Mytnyk [Tue, 22 Jan 2019 12:57:08 +0000 (12:57 +0000)]
Merge "Concurrency testcases to be configured over cli"

5 years agoMerge "[docs][userguide] Add content and comments to ch12"
Volodymyr Mytnyk [Tue, 22 Jan 2019 12:04:56 +0000 (12:04 +0000)]
Merge "[docs][userguide] Add content and comments to ch12"

5 years ago[docs][userguide] Add content and comments to ch12 97/63797/8
Emma Foley [Sun, 9 Sep 2018 12:21:44 +0000 (13:21 +0100)]
[docs][userguide] Add content and comments to ch12

JIRA: YARDSTICK-1335
Change-Id: Ibab629b44a8daeebab95fe7eee056b6403cd98c1
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoConcurrency testcases to be configured over cli 77/66277/7
John O Loughlin [Tue, 8 Jan 2019 14:44:09 +0000 (14:44 +0000)]
Concurrency testcases to be configured over cli

Remove old Concurrency test cases
These test cases are no longer working.
page_object:
    uplink: ["/1b.html"]
should be used to specify request size

JIRA: YARDSTICK-1588

Change-Id: I446b3179ee090ca7a83fdaab57a96ac0f780dd93
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years ago[dovetail] split the sla check results into process recovery and service 51/66551/1
rexlee8776 [Tue, 22 Jan 2019 03:34:30 +0000 (03:34 +0000)]
[dovetail] split the sla check results into process recovery and service
recovery for HA tcs

make sla check for process recovery optional: only check when sla is
set.

JIRA: YARDSTICK-1512

Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoMerge "Adding scale up feature to prox ACL SRIOV OvS-DPDK."
Volodymyr Mytnyk [Mon, 21 Jan 2019 17:04:04 +0000 (17:04 +0000)]
Merge "Adding scale up feature to prox ACL SRIOV OvS-DPDK."

5 years agoMerge "Pass the path of ssh public key to scenario method"
Emma Foley [Mon, 21 Jan 2019 11:19:39 +0000 (11:19 +0000)]
Merge "Pass the path of ssh public key to scenario method"

5 years agoAdding scale up feature to prox ACL SRIOV OvS-DPDK. 59/66359/3
Carey, Alan [Fri, 11 Jan 2019 17:05:25 +0000 (17:05 +0000)]
Adding scale up feature to prox ACL SRIOV OvS-DPDK.

Files to be added:

tc_prox_sriov_acl-scale-up.yaml

tc_prox_ovs-dpdk_acl-scale-up.yaml

JIRA: YARDSTICK-1553

Change-Id: Ib3a05aff2e6b9c0b3bced5b2b775e849a4e33ebf
Signed-off-by: Carey, Alan <alan.carey@intel.com>
5 years agoMerge "Updating yaml file to match other standalone test cases"
Volodymyr Mytnyk [Mon, 21 Jan 2019 09:21:50 +0000 (09:21 +0000)]
Merge "Updating yaml file to match other standalone test cases"

5 years agoRemove redundant comment 85/66485/1
Emma Foley [Fri, 18 Jan 2019 11:26:11 +0000 (11:26 +0000)]
Remove redundant comment

Change-Id: I6f301b0a3d77a692aa06d570eaa6ef3e820973d7
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoMerge "[docs][userguide] Update NSB intro in ch12"
Volodymyr Mytnyk [Thu, 17 Jan 2019 09:54:46 +0000 (09:54 +0000)]
Merge "[docs][userguide] Update NSB intro in ch12"

5 years agoMerge "[docs] Make heading levels consistent"
Volodymyr Mytnyk [Thu, 17 Jan 2019 09:54:40 +0000 (09:54 +0000)]
Merge "[docs] Make heading levels consistent"

5 years ago[docs][userguide] Update NSB intro in ch12 95/63795/6
Emma Foley [Tue, 28 Aug 2018 14:31:07 +0000 (15:31 +0100)]
[docs][userguide] Update NSB intro in ch12

This change removes the duplicated NSB entry in ch13 of the
userguide, and updates the intro in ch12. This gives a
better overview of NSB, and removes the duplicated intro.

JIRA: YARDSTICK-1335
Change-Id: Id40f998e4ae2c5256643b683c2e4d19ef472bbcf
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years ago[docs] Make heading levels consistent 93/63793/6
Emma Foley [Tue, 28 Aug 2018 13:16:54 +0000 (14:16 +0100)]
[docs] Make heading levels consistent

Update the symbols used to denote different headings
to make them consistent across the userguide.

JIRA: YARDSTICK-1335
Change-Id: Ib5ab1f14bbaa819cf882dc00d68bc27da3f1eadb
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoMerge "Suppress log outputs in test_ixnet_api"
Volodymyr Mytnyk [Wed, 16 Jan 2019 13:22:40 +0000 (13:22 +0000)]
Merge "Suppress log outputs in test_ixnet_api"

5 years agoMerge "Adding scale up feature to prox MPLS Tagging OvS-DPDK & SRIOV"
Volodymyr Mytnyk [Tue, 15 Jan 2019 15:45:19 +0000 (15:45 +0000)]
Merge "Adding scale up feature to prox MPLS Tagging OvS-DPDK & SRIOV"

5 years agoAdding scale up feature to prox MPLS Tagging OvS-DPDK & SRIOV 13/66313/2
Carey, Alan [Wed, 9 Jan 2019 08:44:39 +0000 (08:44 +0000)]
Adding scale up feature to prox MPLS Tagging OvS-DPDK & SRIOV

Files to be added:

tc_prox_sriov_mpls-tagging-scale-up.yaml

tc_prox_ovs-dpdk_mpls-tagging-scale-up.yaml

JIRA: YARDSTICK-1552

Change-Id: Ic40e3990378036304318058ed16170ecb36599e4
Signed-off-by: Carey, Alan <alan.carey@intel.com>
5 years agoFix minor issues with IxNet L3 rfc2544 01/66401/1
Chornyi, TarasX [Tue, 15 Jan 2019 13:18:28 +0000 (15:18 +0200)]
Fix minor issues with IxNet L3 rfc2544

Changed default rate from 100pps to 100%.
Set Ip mask to 32

JIRA: YARDSTICK-1566

Change-Id: I4c0245297b2d6b254c06155047c3499f6572e9c5
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
5 years agoReplace script to install.yaml in nsb_setup.sh 63/66163/4
Stepan Andrushko [Mon, 31 Dec 2018 10:54:40 +0000 (12:54 +0200)]
Replace script to install.yaml in nsb_setup.sh

Replace 'nsb_setup.yml' with 'install.yaml' in 'nsb_setup.sh'.
Ansible script 'install.yaml' supports installations on Ubuntu 16/18
of Yardstick, packages dependencies and VM images.
Add possibility to provide and add to OpenStack non-NSB VM image.

JIRA: YARDSTICK-1577

Change-Id: I0cf7cbb354a5f389da432b05cb6f0b470fb5d8f1
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "[docs][userguide] Update formatting on userguide chapters 12-14"
Volodymyr Mytnyk [Fri, 11 Jan 2019 10:04:20 +0000 (10:04 +0000)]
Merge "[docs][userguide] Update formatting on userguide chapters 12-14"

5 years agoMerge "Rework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper"
Volodymyr Mytnyk [Fri, 11 Jan 2019 09:51:14 +0000 (09:51 +0000)]
Merge "Rework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper"

5 years agoMerge "Update LABEL in docker file for Ubuntu 18"
Volodymyr Mytnyk [Fri, 11 Jan 2019 09:45:56 +0000 (09:45 +0000)]
Merge "Update LABEL in docker file for Ubuntu 18"

5 years agoMerge "Add IxNetwork L3 scenario implementation"
Volodymyr Mytnyk [Thu, 10 Jan 2019 15:46:03 +0000 (15:46 +0000)]
Merge "Add IxNetwork L3 scenario implementation"

5 years agoMerge "Remove duplicated Firewall baremetal testcases"
Volodymyr Mytnyk [Thu, 10 Jan 2019 08:11:02 +0000 (08:11 +0000)]
Merge "Remove duplicated Firewall baremetal testcases"

5 years agoMerge "Remove duplicated Firewall Heat testcases"
Volodymyr Mytnyk [Wed, 9 Jan 2019 15:25:03 +0000 (15:25 +0000)]
Merge "Remove duplicated Firewall Heat testcases"

5 years agoRemove duplicated Firewall baremetal testcases 49/66249/4
John O Loughlin [Mon, 7 Jan 2019 08:37:56 +0000 (08:37 +0000)]
Remove duplicated Firewall baremetal testcases

These tests are duplicated in vFW and thus invalid
Note: tc_baremetal_rfc2544_ipv4_1rule_1flow_1518B_ixia.yaml
is not present in vFW but is too similar to
tc_baremetal_rfc2544_ipv4_1rule_1flow_64B_ixia.yaml to have its
own testcase. Commandline options will be passed to theese
in future to spicify 64B or 1518B extra

JIRA: YARDSTICK-1564

Change-Id: I91f26f7649270b9b37e0abd1a6d4d720f5aaaaac
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoMerge "Adding Testcase for Prox Stanalone Scale Up L2FWD (SRIOV OvS-DPDK)"
Volodymyr Mytnyk [Wed, 9 Jan 2019 13:28:13 +0000 (13:28 +0000)]
Merge "Adding Testcase for Prox Stanalone Scale Up L2FWD (SRIOV OvS-DPDK)"

5 years agoMerge "Adding scale up files for l2fwd Multi-flow OvS-DPDK & SRIOV"
Volodymyr Mytnyk [Wed, 9 Jan 2019 13:25:07 +0000 (13:25 +0000)]
Merge "Adding scale up files for l2fwd Multi-flow OvS-DPDK & SRIOV"

5 years agoMerge "Update to DPDK 18.11 support fro PROX"
Volodymyr Mytnyk [Tue, 8 Jan 2019 13:09:11 +0000 (13:09 +0000)]
Merge "Update to DPDK 18.11 support fro PROX"

5 years agoAdding scale up files for l2fwd Multi-flow OvS-DPDK & SRIOV 73/66273/1
Carey, Alan [Tue, 8 Jan 2019 03:03:39 +0000 (03:03 +0000)]
Adding scale up files for l2fwd Multi-flow OvS-DPDK & SRIOV

Files added:
tc_prox_sriov_multi-flow-scale-up.yaml
tc_prox_ovs-dpdk_multi-flow-scale-up.yaml

JIRA: YARDSTICK-1551

Change-Id: I63c5adf79b00af4413dd1f131e918651567710d7
Signed-off-by: Carey, Alan <alan.carey@intel.com>
5 years agoMerge "Sync up 'install.yaml' with 'nsb_setup.yml'"
Emma Foley [Mon, 7 Jan 2019 15:29:27 +0000 (15:29 +0000)]
Merge "Sync up 'install.yaml' with 'nsb_setup.yml'"

5 years agoRemove duplicated Firewall Heat testcases 47/66247/1
John O Loughlin [Mon, 7 Jan 2019 07:47:32 +0000 (07:47 +0000)]
Remove duplicated Firewall Heat testcases

These tests are duplicated in vFW and thus invalid

JIRA: YARDSTICK-1564

Change-Id: Idf7369e7a07aa0a3bf1a05815218244bdc22721d
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
5 years agoUpdate LABEL in docker file for Ubuntu 18 11/66211/1
Stepan Andrushko [Fri, 4 Jan 2019 18:19:52 +0000 (20:19 +0200)]
Update LABEL in docker file for Ubuntu 18

Label for dcoker image is changed to opnfv/yardstick-ubuntu-18.04.

JIRA: YARDSTICK-1470

Change-Id: I983e2b25ba258bbf7ae96efa14f5f994bf783c81
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoUpdate to DPDK 18.11 support fro PROX 09/66209/1
Stepan Andrushko [Fri, 4 Jan 2019 18:06:40 +0000 (20:06 +0200)]
Update to DPDK 18.11 support fro PROX

Fix for undefined INSTALL_BIN_PATH variable and missing DPDK 18.11
dependency on libnuma-dev.

JIRA: YARDSTICK-1576

Change-Id: I544bc727f5ddc5bc43ac6ce4d1f8ff35c90077c7
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Add static ip mask support"
Volodymyr Mytnyk [Fri, 4 Jan 2019 16:54:38 +0000 (16:54 +0000)]
Merge "Add static ip mask support"

5 years agoMerge "NSB support for [core x-y] NSB PROX NFVI configuration"
Abhijit Sinha [Thu, 3 Jan 2019 17:27:11 +0000 (17:27 +0000)]
Merge "NSB support for [core x-y] NSB PROX NFVI configuration"

5 years agoMerge "Fix latency configuration for PROX testcases"
Abhijit Sinha [Wed, 2 Jan 2019 17:14:23 +0000 (17:14 +0000)]
Merge "Fix latency configuration for PROX testcases"

5 years agoMerge "Add support of DPDK version 18.11 for PROX, igb_uio"
Volodymyr Mytnyk [Wed, 2 Jan 2019 17:06:36 +0000 (17:06 +0000)]
Merge "Add support of DPDK version 18.11 for PROX, igb_uio"

5 years agoAdd support of DPDK version 18.11 for PROX, igb_uio 89/66089/3
Oleksandr Naumets [Thu, 27 Dec 2018 16:20:19 +0000 (16:20 +0000)]
Add support of DPDK version 18.11 for PROX, igb_uio

Adding DPDK version 18.11 support as per new requirement for PROX.
Since other sample VNFs are not supporting DPDK 18.11, they will
be using default DPDK version (17.05).

JIRA: YARDSTICK-1576

Change-Id: Ifab1886c51a22392f52f3e9e515a9d6b81edeefc
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoAdd static ip mask support 25/66125/1
Chornyi, TarasX [Mon, 31 Dec 2018 15:13:15 +0000 (17:13 +0200)]
Add static ip mask support

JIRA: YARDSTICK-1566

Change-Id: I6a826d5662a1dfc818c9f1ddf94b3f01c3d37d3b
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
5 years agoMerge "[docs][glossary] Update the glossary"
Volodymyr Mytnyk [Fri, 28 Dec 2018 16:04:52 +0000 (16:04 +0000)]
Merge "[docs][glossary] Update the glossary"

5 years agoSync up 'install.yaml' with 'nsb_setup.yml' 51/66051/2
Stepan Andrushko [Mon, 24 Dec 2018 17:26:39 +0000 (19:26 +0200)]
Sync up 'install.yaml' with 'nsb_setup.yml'

Add support for barometer container. Add VM image to OpenStack.

JIRA: YARDSTICK-1573

Change-Id: I7946f080f93bb69b0380c9ea7f4d7e04cb284c15
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoAdd IxNetwork L3 scenario implementation 11/65811/15
Myron Sosyak [Thu, 13 Dec 2018 17:53:07 +0000 (17:53 +0000)]
Add IxNetwork L3 scenario implementation

Protocol interfaces are creating with config from pod file
Static IP configuration are creating from testcase flow options

JIRA: YARDSTICK-1570

Change-Id: I74cde67b5084d5b65d09934fe8fce7760b5ea461
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
5 years agoNSB support for [core x-y] NSB PROX NFVI configuration 89/65989/5
DanielMartinBuckley [Wed, 19 Dec 2018 17:41:42 +0000 (17:41 +0000)]
NSB support for [core x-y] NSB PROX NFVI configuration

JIRA: YARDSTICK-1571

Cores in PROX support multiple configurations

NSB supports today the more basic one, i.e. [core x]

When one wants to use multiple cores sharing the same
configuration, instead of copying the whole [core]
section, PROX support the following syntax

[core x-y]
where x is the 1st core and y the last one
or (for instance) [core x,y,z]

NSB Now supports

[core a,b,c,d]
[core a-d]
[core a,c-d]

Change-Id: I34cd107143c89e16d58e7a99e1887ffbf720a5d1
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
5 years agoMerge "Compatible with python2 and 3 string check"
Jing Lu [Mon, 24 Dec 2018 09:06:49 +0000 (09:06 +0000)]
Merge "Compatible with python2 and 3 string check"

5 years agoFix latency configuration for PROX testcases 37/66037/1
Patrice Buriez [Sun, 23 Dec 2018 14:28:33 +0000 (15:28 +0100)]
Fix latency configuration for PROX testcases

JIRA: YARDSTICK-1460

Change-Id: Id6a633873a9b6fc8829d5282596200610cec5426
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoAdditional rework of NSB report 95/65995/2
Patrice Buriez [Mon, 17 Dec 2018 18:22:16 +0000 (19:22 +0100)]
Additional rework of NSB report

- Make format_for_jstree expect a list of metric names
- Avoid displaying timestamps twice in initial data table
- Sort metrics in initial data table
- Display testcase name
- Fix styling
- Make better use of JS and jQuery features
- Move event handler to JS file
- Avoid adding multiple tbody elements into data table
- Adjust unit tests and functional tests accordingly

JIRA: YARDSTICK-1367
Topic: report/html_table (12 of 12)

Change-Id: I85d853f8e392953cace67e94fa0af2e2492a2b86
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoOnly show metrics for selected nodes in data table 11/61011/19
Patrice Buriez [Fri, 9 Nov 2018 10:48:15 +0000 (11:48 +0100)]
Only show metrics for selected nodes in data table

Together with timestamps, separately added into the table.
Optimize the showcasing of graphs and table.

JIRA: YARDSTICK-1367
Topic: report/html_table (11 of 12)

Change-Id: I263960b059fd27409b36f825664da8c2804e0425
Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoFix conversion to JS for HTML reports 59/65159/8
Patrice Buriez [Thu, 15 Nov 2018 11:30:30 +0000 (12:30 +0100)]
Fix conversion to JS for HTML reports

Some new fields in InfluxDB have plain text contents that AST cannot
parse as valid expressions, resulting in exceptions being raised by
yardstick CLI commands "report generate" and "report generate-nsb".

Reworked _generate_common() to properly handle and convert:
- unicode, str and missing keys
- None, unicode, str, float, long and int values
- float, long and int stored as unicode or str values

Added test__generate_common() unit test, to verify all possible
conversion flavors.

Also renamed incorrect "tasks" to "metrics".

Also fixed warning in Python3 for some unit tests, caused by
deprecation of unittest.TestCase.assertRaisesRegexp().

JIRA: YARDSTICK-1367
Topic: report/html_table (10 of 12)

Change-Id: Iff75bfd2c1dcaf3806f67f52f0ea594f10aceb5b
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoAdd functional tests for HTML report 03/61203/12
Patrice Buriez [Fri, 9 Nov 2018 10:42:27 +0000 (11:42 +0100)]
Add functional tests for HTML report

JIRA: YARDSTICK-1367
Topic: report/html_table (9 of 12)

Change-Id: I987203c4b3f49fb0f205e9b4c71bcbf4618041a0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoMerge "Remove duplicated Firewall Concurrency testcases"
Volodymyr Mytnyk [Thu, 20 Dec 2018 14:31:59 +0000 (14:31 +0000)]
Merge "Remove duplicated Firewall Concurrency testcases"

5 years agoMerge "NSB installation fails at Yardstick GUI Ubuntu 18"
Volodymyr Mytnyk [Thu, 20 Dec 2018 12:28:09 +0000 (12:28 +0000)]
Merge "NSB installation fails at Yardstick GUI Ubuntu 18"

5 years agoMerge "Addition of IRQ Mode to NSB NFVI (PROX)"
Abhijit Sinha [Thu, 20 Dec 2018 10:11:08 +0000 (10:11 +0000)]
Merge "Addition of IRQ Mode to NSB NFVI (PROX)"

5 years agoAdd report generate-nsb command 05/60705/14
Patrice Buriez [Fri, 9 Nov 2018 10:24:21 +0000 (11:24 +0100)]
Add report generate-nsb command

JIRA: YARDSTICK-1367
Topic: report/html_table (8 of 12)

Change-Id: I8a2f96224a745334b67dd71875bebb3b69b9adc3
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoMerge "Extend ixnet api"
Volodymyr Mytnyk [Wed, 19 Dec 2018 17:58:31 +0000 (17:58 +0000)]
Merge "Extend ixnet api"

5 years agoMerge "Add JS file to NSB report template"
Volodymyr Mytnyk [Wed, 19 Dec 2018 17:05:19 +0000 (17:05 +0000)]
Merge "Add JS file to NSB report template"

5 years agoMerge "Use Chart.js for graphs in HTML reports"
Volodymyr Mytnyk [Wed, 19 Dec 2018 17:05:15 +0000 (17:05 +0000)]
Merge "Use Chart.js for graphs in HTML reports"

5 years agoExtend ixnet api 27/65727/4
Chornyi, TarasX [Tue, 11 Dec 2018 09:24:34 +0000 (11:24 +0200)]
Extend ixnet api

Add protocol interface creation.
Add static protocols ipv4 configuration.

JIRA: YARDSTICK-1566

Change-Id: I484d212873ce7e638626053baaf6a972a6ef9f69
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
5 years agoAdd JS file to NSB report template 07/60707/14
Patrice Buriez [Fri, 9 Nov 2018 10:29:36 +0000 (11:29 +0100)]
Add JS file to NSB report template

Moved function definitions into separate nsb_report.js file for ease
of editing, while keeping generated HTML reports self-contained, for
storage and publishing purposes.

JIRA: YARDSTICK-1367
Topic: report/html_table (7 of 12)

Change-Id: I3b3cf8aae8425b486a711a76f4bb2bf8d7fe5ab5
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoUse Chart.js for graphs in HTML reports 81/65981/1
Patrice Buriez [Fri, 30 Nov 2018 11:16:43 +0000 (12:16 +0100)]
Use Chart.js for graphs in HTML reports

This JavaScript library is available under MIT license.

Also adjusted version for jQuery and jsTree,
and added fallback font-family names.

JIRA: YARDSTICK-1367
Topic: report/html_table (6 of 12)

Change-Id: Ibe8b7e3d1f1365d2cbc019bfc22762aaa365a4e1
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
5 years agoRemove .rst extension in the list of TC 53/65953/1
Mytnyk, Volodymyr [Tue, 18 Dec 2018 15:46:31 +0000 (15:46 +0000)]
Remove .rst extension in the list of TC

YARDSTICK-1540

Change-Id: I8418754a34bd3e543db85dadf8386c928eee771c
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoMerge "[docs] Update influxDB container setup"
Abhijit Sinha [Mon, 17 Dec 2018 14:16:37 +0000 (14:16 +0000)]
Merge "[docs] Update influxDB container setup"

5 years agoMerge "Cleanup unittests for test_attacker_baremetal"
Abhijit Sinha [Mon, 17 Dec 2018 14:13:32 +0000 (14:13 +0000)]
Merge "Cleanup unittests for test_attacker_baremetal"

5 years agoMerge "Extend vBNG PPPoE test cases functionality"
Volodymyr Mytnyk [Mon, 17 Dec 2018 13:26:05 +0000 (13:26 +0000)]
Merge "Extend vBNG PPPoE test cases functionality"

5 years agoMerge "Add vFW TCs description"
Emma Foley [Mon, 17 Dec 2018 13:20:46 +0000 (13:20 +0000)]
Merge "Add vFW TCs description"

5 years agoNSB installation fails at Yardstick GUI Ubuntu 18 13/65913/1
Stepan Andrushko [Mon, 17 Dec 2018 11:38:35 +0000 (13:38 +0200)]
NSB installation fails at Yardstick GUI Ubuntu 18

Changed a configuration parameter in 'gui/package.json' file to be
able to install Yardstick GUI on Ubuntu 18.

JIRA: YARDSTICK-1569

Change-Id: I9fbc37fa689c443d56e2f81c6221b5e8ce2271c0
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Add support for configuring frame rate per traffic flow for IXIA"
Volodymyr Mytnyk [Mon, 17 Dec 2018 09:01:01 +0000 (09:01 +0000)]
Merge "Add support for configuring frame rate per traffic flow for IXIA"

5 years agoMerge "Update#2: Trex KPI not collected no rabbitmq user"
Volodymyr Mytnyk [Mon, 17 Dec 2018 08:38:40 +0000 (08:38 +0000)]
Merge "Update#2: Trex KPI not collected no rabbitmq user"

5 years agoMerge "Yardstick Gambia 7.1.0 release notes"
Rex Lee [Sat, 15 Dec 2018 04:49:57 +0000 (04:49 +0000)]
Merge "Yardstick Gambia 7.1.0 release notes"

5 years agoMerge "Add raise for iteration exception in IterationRunner"
Rex Lee [Fri, 14 Dec 2018 08:30:06 +0000 (08:30 +0000)]
Merge "Add raise for iteration exception in IterationRunner"

5 years agoAdd support for configuring frame rate per traffic flow for IXIA 09/65209/2
Serhiy Pshyk [Mon, 19 Nov 2018 13:52:11 +0000 (13:52 +0000)]
Add support for configuring frame rate per traffic flow for IXIA

Frame rate can be configured per traffic profile and per traffic flow.
By default traffic profile is applied to all traffic flows. If per
flow rate is specified it overrides default value from profile.

JIRA: YARDSTICK-1568

Change-Id: I388ed78869358de17d6485be0cd0d058983390e2
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoUpdate#2: Trex KPI not collected no rabbitmq user 55/65155/3
Stepan Andrushko [Thu, 15 Nov 2018 21:14:33 +0000 (23:14 +0200)]
Update#2: Trex KPI not collected no rabbitmq user

Changed the way how rabbitmq user is created. For baremetal it is done
using NSB installation script. For Yardstick installed in container
supervisor is updated with user name/password.

JIRA: YARDSTICK-1479

Change-Id: I4f42ab8d5ef1735b0416ed26d04e259efa155543
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoAdd raise for iteration exception in IterationRunner 57/65357/5
cope.li [Fri, 23 Nov 2018 08:34:23 +0000 (16:34 +0800)]
Add raise for iteration exception in IterationRunner

When we run the testcase, if there was a exception in iteration
_work_process, the process will still run on ,and the test result will
not affected by the exception.

JIRA: YARDSTICK-1555

Change-Id: I03803c0473015379bb0eb20ed7d474a2d923a4e3
Signed-off-by: cope.li <cope.li@huawei.com>
5 years agoRework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper 85/59885/6
Emma Foley [Tue, 14 Aug 2018 17:14:27 +0000 (18:14 +0100)]
Rework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper

JIRA: YARDSTICK-1434
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Ieabcdf401d608a3a5f0a0bd9fbbe754591878bd5

5 years ago[docs] Update influxDB container setup 01/61201/2
Emma Foley [Mon, 20 Aug 2018 16:31:06 +0000 (17:31 +0100)]
[docs] Update influxDB container setup

JIRA: YARDSTICK-1335
Change-Id: I87b95d686f2d7ad204076845505b2fb6d502dedc
Signed-off-by: Emma Foley <emma.l.foley@intel.com>