yardstick.git
4 years agoadd yardstick iruya 9.0.0 release notes 11/69511/1 master
rexlee8776 [Tue, 7 Jan 2020 07:40:42 +0000 (07:40 +0000)]
add yardstick iruya 9.0.0 release notes

add yardstick iruya 9.0.0 release notes

Change-Id: Ie631c831db4d1b38afe278488e8b934566743c31
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
4 years ago[bugfix] gui build faied in yardstick docker build 06/69506/2
rexlee8776 [Mon, 6 Jan 2020 02:43:56 +0000 (02:43 +0000)]
[bugfix] gui build faied in yardstick docker build

JIRA: YARDSTICK-1626
it's due to the version of nodejs and npm too old in ubuntu 16.04
default repo

Change-Id: I8c969530f7e538104bf5fb39223f720e53642d05
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
4 years agoAdd json file for opnfv_yardstick_tc015.yaml 39/69339/1
sungn [Fri, 13 Dec 2019 09:15:07 +0000 (17:15 +0800)]
Add json file for opnfv_yardstick_tc015.yaml

File opnfv_yardstick_tc015.json show sample data of test case
opnfv_yardstick_tc015.yaml. Power for energy scenario,
single_score and parallel_score for Unixbench scenario,
mpstat_average.cpu.%usr for cpu_load scenario.
You may also select other parameters to see the data trends
during test case running.

JIRA: YARDSTICK-1624
Co-authored by: Roland Picard <roland.picard@orange.com>

Signed-off-by: sungn <sungn2@lenovo.com>
Change-Id: I2b9993ad1d330c5f90ca8b5afda4e1dc73e8b150

4 years agoMerge "Add test case related to measure compute score and its energy consumption...
Rex Lee [Fri, 13 Dec 2019 07:47:41 +0000 (07:47 +0000)]
Merge "Add test case related to measure compute score and its energy consumption impact"

4 years agoMerge "Add energy to yardstick bench category"
Rex Lee [Fri, 13 Dec 2019 07:47:28 +0000 (07:47 +0000)]
Merge "Add energy to yardstick bench category"

4 years agoAdd energy base scenario and test files 60/69260/3
sungn [Fri, 6 Dec 2019 08:36:52 +0000 (16:36 +0800)]
Add energy base scenario and test files

Folder of energy contains scripts of energy measurement.
File __init__.py make it a module that can be imported.
File energy.py contains the main function of energy measurement
through redfish API.
File test_energy.py test function of energy.py
File energy_sample_chassis_output.txt provide a sample output of
chassis query.
File energy_sample_power_metrics.txt provide sample metrics of
power query.
This will allow users to collect data of energy consumption of
baremetal machines.

JIRA: YARDSTICK-1624
Co-authored by: Roland Picard <roland.picard@orange.com>

Signed-off-by: sungn <sungn2@lenovo.com>
Change-Id: Ied86894f3dcc2536f0cb1a044f4591351e5b3270

4 years ago[bugfix] functional_py3 failed in ci gating 53/69253/2
rexlee8776 [Wed, 4 Dec 2019 02:26:59 +0000 (02:26 +0000)]
[bugfix] functional_py3 failed in ci gating

import pip._internal.main and use correctly
JIRA: YARDSTICK-1627

Change-Id: I3613c651e474474329f55adda5b54ce5bf4fd9ca
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
4 years agoAdd energy to yardstick bench category 01/69101/2
Roland Picard [Tue, 26 Nov 2019 21:06:56 +0000 (22:06 +0100)]
Add energy to yardstick bench category

Update 02-methodology.rst file into user guide of yardstick to add energy as a
new category which is transverse to the others as to be used inside exitsing
test cases to consider energy metric when running a test case

JIRA: YARDSTICK-1624
Co-authored by: Sun Guannan <sungn2@lenovo.com>

Signed-off-by: Roland Picard <roland.picard@orange.com>
Change-Id: Id08a4e68ce45374b52c79b5bf7ebd6cb7106cb7e

4 years agoMerge "[bugfix] no ansible requirements when build docker image"
Rex Lee [Mon, 2 Dec 2019 11:20:55 +0000 (11:20 +0000)]
Merge "[bugfix] no ansible requirements when build docker image"

4 years ago[bugfix] no ansible requirements when build docker image 23/69223/1
rexlee8776 [Mon, 2 Dec 2019 10:39:08 +0000 (10:39 +0000)]
[bugfix] no ansible requirements when build docker image

ansible is needed when build docker image

JIRA: YARDSTICK-1626

Change-Id: Iecc8603e4c0cea9e0b3826aea32bea95be4cd87b
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
4 years agoAdd test case related to measure compute score and its energy consumption impact 24/69024/1
Roland Picard [Tue, 26 Nov 2019 16:21:08 +0000 (17:21 +0100)]
Add test case related to measure compute score and its energy consumption impact

Test case opnfv_yardstick_tc015.yaml is added that runs a CPU test and monitor
energy consumtion impact synchronized with cpu load.
opnfv_yardstick_tc015.rst is added to provide documentation of the test case.
energy.yaml sample is added to show how to add energy testing in any test case.

JIRA: YARDSTICK-1624
Co-authored by: Sun Guannan <sungn2@lenovo.com>

Signed-off-by: Roland Picard <roland.picard@orange.com>
Change-Id: I2403c38bbf320f96d2ed1d9e262560388efc44c9

4 years agoremove python2.7 test for python3 migrate 55/68855/2
rexlee8776 [Mon, 11 Nov 2019 12:10:31 +0000 (12:10 +0000)]
remove python2.7 test for python3 migrate

JIRA: YARDSTICK-1625

Change-Id: I0961bb5ef4d163aadc0bd0fdb9cdfda391e2fb17
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
4 years agoFix output parsing of Unixbench 01/68601/1
Deepanshu Bhatia [Tue, 8 Oct 2019 00:56:47 +0000 (06:26 +0530)]
Fix output parsing of Unixbench

Pick the last word in the awk as score for handling partial index score and index score

Change-Id: Ida56b704b14c7c27156f57590bb1ea8532650f90
JIRA: YARDSTICK-1622
Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
4 years agoLeverage on PBR 43/68043/12
Cédric Ollivier [Thu, 13 Jun 2019 14:50:01 +0000 (16:50 +0200)]
Leverage on PBR

It fixes requirements and constraints by switching to PBR [1].
It synchronizes requirements with OpenStack stable/stein and then
adds constraints to pip calls.

It also updates flask-restful-swagger to conform with OpenStack
upper-constraints [2] and the pip API calls.

It updates the unit tests verifying a few package versions.

It stops checking unicodecsv in py3 env which is against the
requirements defined in OpenStack.

It also skips one test indirectly highlighting that the pip usage
is incorrect [3]

[1] http://testresults.opnfv.org/functest/dockerslicing/
[2] https://github.com/rantav/flask-restful-swagger/commit/fd418b50723fe1e79f495aa400a8e9f055a5be27
[3] https://github.com/pypa/pip/issues/3889

Change-Id: I635bdb9d7411e619cee911b633fa8ad591a393a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoMerge "TC 088 and TC 089 gives error openstack command not found"
Rex Lee [Thu, 4 Jul 2019 03:08:32 +0000 (03:08 +0000)]
Merge "TC 088 and TC 089 gives error openstack command not found"

4 years agoTC 088 and TC 089 gives error openstack command not found 67/67967/3
Manik Sidana [Wed, 15 May 2019 09:23:33 +0000 (14:53 +0530)]
TC 088 and TC 089 gives error openstack command not found

Adding python-openstackclient in requirements.txt

JIRA: YARDSTICK-1615

Change-Id: If0adf4b3674c4321c1fa42fb47307e97f0509fbc
Co-Authored by: deep23bhatia <deepanshu@voereir.com>
Signed-off-by: msidana <manik@voereir.com>
5 years agoPing: Fix TypeError without SLA in timeout scenario 39/68039/1
Deepanshu Bhatia [Mon, 13 May 2019 07:22:17 +0000 (12:52 +0530)]
Ping: Fix TypeError without SLA in timeout scenario

In case of no SLA association with scenario, when the commands timeout,
stdout is empty and it gives TypeError.
Reverted the condition to the old one which was used before introduction
of verifySLA()

JIRA: YARDSTICK-1618

Change-Id: Ibd86ba7168f26ae5b15c21fd6129cc737a7038db
Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
5 years agoYardstick Hunter 8.0.0 release notes 92/67792/2
rexlee8776 [Wed, 8 May 2019 01:29:23 +0000 (01:29 +0000)]
Yardstick Hunter 8.0.0 release notes

Yardstick Hunter 8.0.0 release notes

Change-Id: I168047b81db828342164e0bf76c5baea04e0d2a6
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoMerge changes from topic 'feat/baro_nfvi_metrics'
Volodymyr Mytnyk [Fri, 26 Apr 2019 16:08:59 +0000 (16:08 +0000)]
Merge changes from topic 'feat/baro_nfvi_metrics'

* changes:
  Use baro and yardstick metrics in dynamic HTML report
  benchmark.core.report: Add _combine_times
  benchmark.core.report: Add _get_baro_metrics
  Add ability to get data from different DBs in influx
  Refactor: add _format_datasets

5 years agoMerge "Log VM OS version, Sample VNF branch/commit ID"
Volodymyr Mytnyk [Fri, 26 Apr 2019 16:06:52 +0000 (16:06 +0000)]
Merge "Log VM OS version, Sample VNF branch/commit ID"

5 years agoMerge "[docs] Document SRIOV configuration options"
Volodymyr Mytnyk [Fri, 26 Apr 2019 16:06:38 +0000 (16:06 +0000)]
Merge "[docs] Document SRIOV configuration options"

5 years agoMerge "Corrected MAC in trex_bm.yaml.sample"
Volodymyr Mytnyk [Fri, 26 Apr 2019 16:06:30 +0000 (16:06 +0000)]
Merge "Corrected MAC in trex_bm.yaml.sample"

5 years agoCorrected MAC in trex_bm.yaml.sample 99/67699/1
Stepan Andrushko [Thu, 25 Apr 2019 11:50:35 +0000 (14:50 +0300)]
Corrected MAC in trex_bm.yaml.sample

Corrected MAC in trex_bm.yaml.sample.

JIRA: YARDSTICK-1613

Change-Id: Icafe787dbdc8aa31b077b14dac94d7461b11c725
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years ago[docs] Document SRIOV configuration options 69/67669/2
Stepan Andrushko [Mon, 22 Apr 2019 15:47:06 +0000 (18:47 +0300)]
[docs] Document SRIOV configuration options

Update Yardstick documentation with SRIOV options.

JIRA: YARDSTICK-1611

Change-Id: I823a0a40f23dc53fb5316d4cef456eaf97f94b15
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years ago[docs] Update NSB documentation, fix warnings 92/67692/1
Stepan Andrushko [Thu, 25 Apr 2019 10:03:18 +0000 (13:03 +0300)]
[docs] Update NSB documentation, fix warnings

Updated NSB documentation, fixed some warnings.

JIRA: YARDSTICK-1612

Change-Id: I8fdb92734b63bf3b6ad23160ebfb4c17a8e6dad1
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Rework TestSampleVNFTrafficGen"
Rex Lee [Thu, 25 Apr 2019 03:41:00 +0000 (03:41 +0000)]
Merge "Rework TestSampleVNFTrafficGen"

5 years agoMerge "Rework TestSampleVnf"
Rex Lee [Thu, 25 Apr 2019 03:40:53 +0000 (03:40 +0000)]
Merge "Rework TestSampleVnf"

5 years agoLog VM OS version, Sample VNF branch/commit ID 09/64309/6
Stepan Andrushko [Wed, 31 Oct 2018 13:58:51 +0000 (15:58 +0200)]
Log VM OS version, Sample VNF branch/commit ID

Added debug logs to track VM, Sample VNF details during testing:
 - Virtual machine OS, kernel version;
 - Sample VNF branch, commit ID.

JIRA: YARDSTICK-1499

Change-Id: I243c435809d4541dfdb8c7c3466f50c5d524ac00
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "[bugfix] docker build failed in hunter due to storperf version"
Rex Lee [Thu, 18 Apr 2019 07:30:34 +0000 (07:30 +0000)]
Merge "[bugfix] docker build failed in hunter due to storperf version"

5 years agoAdd ansible scripts to deploy Kubernetes 23/67523/2
Mytnyk, Volodymyr [Fri, 11 May 2018 16:36:20 +0000 (17:36 +0100)]
Add ansible scripts to deploy Kubernetes

For know, only one node is supported.

- build/configure CNI drivers
- Init Kubernetes

Change-Id: I1a0eb44fcbba20870a6b7611d4ffaf0bc3be92f3
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoRework TestSampleVNFTrafficGen 61/60961/8
Emma Foley [Tue, 14 Aug 2018 17:28:52 +0000 (18:28 +0100)]
Rework TestSampleVNFTrafficGen

Update network_services/vnf_generic/vnf/test_sample_vnf.py

JIRA: YARDSTICK-1434
Change-Id: Iead085c2642a6960fdbff6905e55974fd8bd4fb2
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years ago[bugfix] docker build failed in hunter due to storperf version 88/67588/1
rexlee8776 [Mon, 15 Apr 2019 06:41:19 +0000 (06:41 +0000)]
[bugfix] docker build failed in hunter due to storperf version

storperf do not have hunter branch, so it need to be set
as stable/gambia

JIRA: YARDSTICK-1610

Change-Id: I818396c46ce165019159b9852abb02f176507ac0
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoRework TestSampleVnf 59/60959/9
Emma Foley [Tue, 14 Aug 2018 17:27:27 +0000 (18:27 +0100)]
Rework TestSampleVnf

Update network_services/vnf_generic/vnf/test_sample_vnf.py

JIRA: YARDSTICK-1434
Change-Id: I193068893664e7ed1a2487b51750d34d5c256e6c
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoMerge "Revert "Add ansible scripts to deploy Kubernetes""
Volodymyr Mytnyk [Wed, 10 Apr 2019 13:08:31 +0000 (13:08 +0000)]
Merge "Revert "Add ansible scripts to deploy Kubernetes""

5 years agoRevert "Add ansible scripts to deploy Kubernetes" 22/67522/1
Volodymyr Mytnyk [Wed, 10 Apr 2019 12:24:40 +0000 (12:24 +0000)]
Revert "Add ansible scripts to deploy Kubernetes"

This reverts commit c66efd482c9c4aabf8a82d1f554ef5fca91b3bcb.

Change-Id: I87ec6e2ed6d2ef8ad202833f134e758762345b02
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoMerge "[docs][nsb][install] Update source for sample pod files"
Volodymyr Mytnyk [Wed, 10 Apr 2019 11:56:46 +0000 (11:56 +0000)]
Merge "[docs][nsb][install] Update source for sample pod files"

5 years agoMerge "Add ansible scripts to deploy Kubernetes"
Volodymyr Mytnyk [Wed, 10 Apr 2019 11:53:33 +0000 (11:53 +0000)]
Merge "Add ansible scripts to deploy Kubernetes"

5 years agoAdd ansible scripts to deploy Kubernetes 31/57331/18
Mytnyk, Volodymyr [Fri, 11 May 2018 16:36:20 +0000 (17:36 +0100)]
Add ansible scripts to deploy Kubernetes

For know, only one node is supported.

- build/configure CNI drivers
- Init Kubernetes

Change-Id: I6dd9dff7a4c7dfe2d7148812d2656966115c5ce9
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoAdd a document descibing vCMTS testcase 73/67073/4
treyad [Wed, 20 Feb 2019 18:56:10 +0000 (10:56 -0800)]
Add a document descibing vCMTS testcase

JIRA: YARDSTICK-1601

Change-Id: Icfca620beb191fa935d820a23f8ce086498b130e
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Suppress log outputs in test_task.py"
Volodymyr Mytnyk [Tue, 9 Apr 2019 08:37:33 +0000 (08:37 +0000)]
Merge "Suppress log outputs in test_task.py"

5 years agoMerge "Upload config files for barometer collectd container"
Volodymyr Mytnyk [Mon, 8 Apr 2019 09:28:22 +0000 (09:28 +0000)]
Merge "Upload config files for barometer collectd container"

5 years agoMerge "Update to support using external heat template"
Volodymyr Mytnyk [Mon, 8 Apr 2019 09:26:31 +0000 (09:26 +0000)]
Merge "Update to support using external heat template"

5 years agoMerge "Fix UDPReplay VNF statistic parsing"
Volodymyr Mytnyk [Mon, 8 Apr 2019 09:24:31 +0000 (09:24 +0000)]
Merge "Fix UDPReplay VNF statistic parsing"

5 years agoMerge "Add sipp trafficgen based SampleVNFTrafficGen"
Volodymyr Mytnyk [Mon, 8 Apr 2019 09:23:23 +0000 (09:23 +0000)]
Merge "Add sipp trafficgen based SampleVNFTrafficGen"

5 years agoMerge "Allow testcases to be configured over cli"
Volodymyr Mytnyk [Mon, 8 Apr 2019 09:21:43 +0000 (09:21 +0000)]
Merge "Allow testcases to be configured over cli"

5 years agoFix UDPReplay VNF statistic parsing 69/66569/2
Mytnyk, Volodymyr [Tue, 22 Jan 2019 15:31:07 +0000 (15:31 +0000)]
Fix UDPReplay VNF statistic parsing

Fixed UDPReplay statistic parsing according to changes made in
UDPReplay sample VNF.

JIRA: YARDSTICK-1609

Change-Id: I093f6612cc736695fa96f15dce374c949d8c3459
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoAdd sipp trafficgen based SampleVNFTrafficGen 85/63985/24
treyad [Thu, 25 Oct 2018 05:02:42 +0000 (22:02 -0700)]
Add sipp trafficgen based SampleVNFTrafficGen

This patch defines:
  - Generic VNF APIs to test Network service:
  --> instantiate: prepare the arguments for run sipp
  --> run_traffic: run sipp test and handle the result file
  --> collect_kpi: collect results and push to queue
  --> terminate

JIRA: YARDSTICK-1446

Change-Id: I7f6b7dd253164bb5c359ac866cb8cae81f504d65
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Add a document describing vIMS testcase"
Volodymyr Mytnyk [Thu, 4 Apr 2019 14:54:41 +0000 (14:54 +0000)]
Merge "Add a document describing vIMS testcase"

5 years agoUpdate to support using external heat template 15/63615/9
treyad [Tue, 16 Oct 2018 17:50:12 +0000 (10:50 -0700)]
Update to support using external heat template

Modify the _get_server() function when using external heat template.
The server attrs should be read from stack.outputs.

JIRA: YARDSTICK-1453

Change-Id: I00eda7476e77fc0a5c15ef8db7d057fa1cf267e6
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoAllow testcases to be configured over cli 95/65595/21
John O Loughlin [Wed, 5 Dec 2018 15:57:32 +0000 (15:57 +0000)]
Allow testcases to be configured over cli

Add options for droprate and frame_rate for agnostic vnf

JIRA: YARDSTICK-1554

Change-Id: I0e9eb844a96b9d8af85fc3af750c56e43fea52b8
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
5 years agoMerge changes from topic 'manual_ci_test_cases'
Volodymyr Mytnyk [Wed, 3 Apr 2019 12:59:39 +0000 (12:59 +0000)]
Merge changes from topic 'manual_ci_test_cases'

* changes:
  Add IXIA Baremetal scale up testcases
  Add OpenStack test cases
  Add TRex Baremetal/SA scale up test cases

5 years agoUse baro and yardstick metrics in dynamic HTML report 45/66745/11
Emma Foley [Fri, 25 Jan 2019 14:44:20 +0000 (14:44 +0000)]
Use baro and yardstick metrics in dynamic HTML report

_combine_metrics combines metrics from different sources.
This is for use with the ``yardstick report generate-nsb``
command, which will combine yardstick and barometer metrics
in the dynamic HTML report.

JIRA: YARDSTICK-1593
Change-Id: I87002948ebb4cc88fb0932380bcb9920eb53db58
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoMerge "Support bind driver for QAT HW cards"
Volodymyr Mytnyk [Mon, 1 Apr 2019 09:22:50 +0000 (09:22 +0000)]
Merge "Support bind driver for QAT HW cards"

5 years agoMerge "Yardstick verify job could base on the filetype to run the test"
Rex Lee [Sat, 30 Mar 2019 04:12:53 +0000 (04:12 +0000)]
Merge "Yardstick verify job could base on the filetype to run the test"

5 years agoAdd a document describing vIMS testcase 25/63025/8
treyad [Fri, 28 Sep 2018 12:15:44 +0000 (05:15 -0700)]
Add a document describing vIMS testcase

Create a test case description file for NSB vIMS

JIRA: YARDSTICK-1441

Change-Id: Ib51839093dd90e0b70eac4030948985c2145f35e
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoSupport bind driver for QAT HW cards 47/65247/10
treyad [Tue, 20 Nov 2018 09:40:07 +0000 (01:40 -0800)]
Support bind driver for QAT HW cards

Load QAT driver
Initialize QAT VFs

JIRA: YARDSTICK-1504

Change-Id: I1f3768d5436bfaccac5f6226ba19131c4662a08d
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Add VNF descriptor for vIMS testcase"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:12:30 +0000 (10:12 +0000)]
Merge "Add VNF descriptor for vIMS testcase"

5 years agoMerge "Support FD.io Multiple Loss Ratio search (MLRsearch)"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:11:18 +0000 (10:11 +0000)]
Merge "Support FD.io Multiple Loss Ratio search (MLRsearch)"

5 years agoMerge "Setup IPSEC tunnel mode for VPP Crypto testing"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:10:07 +0000 (10:10 +0000)]
Merge "Setup IPSEC tunnel mode for VPP Crypto testing"

5 years agoMerge "Build VPP startup configuration file"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:10:03 +0000 (10:10 +0000)]
Merge "Build VPP startup configuration file"

5 years agoMerge "Added NSB descriptors for vCMTS testcase"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:08:18 +0000 (10:08 +0000)]
Merge "Added NSB descriptors for vCMTS testcase"

5 years agoMerge "Added test descriptors for vCMTS testcase"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:08:02 +0000 (10:08 +0000)]
Merge "Added test descriptors for vCMTS testcase"

5 years agoMerge "Add Pktgen traffic generator for vCMTS"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:07:42 +0000 (10:07 +0000)]
Merge "Add Pktgen traffic generator for vCMTS"

5 years agoMerge "Add vCMTS VNF for running vCMTSd containers"
Volodymyr Mytnyk [Fri, 29 Mar 2019 10:07:21 +0000 (10:07 +0000)]
Merge "Add vCMTS VNF for running vCMTSd containers"

5 years agoAdd IXIA Baremetal scale up testcases 40/67340/2
Mytnyk, Volodymyr [Fri, 22 Mar 2019 17:11:03 +0000 (17:11 +0000)]
Add IXIA Baremetal scale up testcases

JIRA: YARDSTICK-1608

Change-Id: Iebce802decff8c7111a3f6bf87669a764a5ee687
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoAdd OpenStack test cases 82/67282/9
Myron Sosyak [Mon, 18 Mar 2019 14:48:31 +0000 (14:48 +0000)]
Add OpenStack test cases

Add OpenStack test cases with different framesize and IMIX

JIRA: YARDSTICK-1608

Change-Id: Ia7231dab8d2ff405cbf7794b7e7843763970998a
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoMerge "Add a document describing vIPSEC testcase"
Rex Lee [Fri, 29 Mar 2019 02:37:53 +0000 (02:37 +0000)]
Merge "Add a document describing vIPSEC testcase"

5 years agoAdd TRex Baremetal/SA scale up test cases 84/67284/8
Oleksandr Naumets [Mon, 18 Mar 2019 15:59:36 +0000 (15:59 +0000)]
Add TRex Baremetal/SA scale up test cases

JIRA: YARDSTICK-1608

Change-Id: I99b1b0fcd578a0e1d3dd6fb67415f959a86c7371
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
5 years agoMerge "Fix Grafana dashboards for RFC2544"
Volodymyr Mytnyk [Thu, 28 Mar 2019 09:20:55 +0000 (09:20 +0000)]
Merge "Fix Grafana dashboards for RFC2544"

5 years agoSetup IPSEC tunnel mode for VPP Crypto testing 45/65245/11
treyad [Tue, 20 Nov 2018 09:34:19 +0000 (01:34 -0800)]
Setup IPSEC tunnel mode for VPP Crypto testing

Update startup config file
Enable logging
Create IPSEC in tunnel mode

JIRA: YARDSTICK-1503

Change-Id: Ifd2b05c063870b31c7f30decb1611a93322bf1e8
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoBuild VPP startup configuration file 43/65243/10
treyad [Tue, 20 Nov 2018 08:37:40 +0000 (00:37 -0800)]
Build VPP startup configuration file

Provided configuration parameters into /etc/vpp/startup.conf

JIRA: YARDSTICK-1502

Change-Id: Ib64908a2975a13a1cecd2e6bd7232071628ad431
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoSupport FD.io Multiple Loss Ratio search (MLRsearch) 55/65255/11
treyad [Tue, 20 Nov 2018 09:54:08 +0000 (01:54 -0800)]
Support FD.io Multiple Loss Ratio search (MLRsearch)

Optimized binary search algorithm for finding NDR and PDR bounds

JIRA: YARDSTICK-1486

Change-Id: Iba0e6c7065b61f7b7f3f65cceca509d1aaff8366
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "Docs: Updated OVS-DPDK options for NSB"
Volodymyr Mytnyk [Tue, 26 Mar 2019 14:32:30 +0000 (14:32 +0000)]
Merge "Docs: Updated OVS-DPDK options for NSB"

5 years agoDocs: Updated OVS-DPDK options for NSB 27/67327/2
Stepan Andrushko [Thu, 21 Mar 2019 19:26:49 +0000 (21:26 +0200)]
Docs: Updated OVS-DPDK options for NSB

Updated OVS-DPDK options for NSB.

JIRA: YARDSTICK-1607

Change-Id: I802dc6dd5aad52e6efdff2aa6597bcfc3d886395
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Docs: Updated NSB installation: VM image build DUT"
Volodymyr Mytnyk [Mon, 25 Mar 2019 15:25:56 +0000 (15:25 +0000)]
Merge "Docs: Updated NSB installation: VM image build DUT"

5 years agoMerge "Move VM image build to remote DUT"
Volodymyr Mytnyk [Mon, 25 Mar 2019 15:22:54 +0000 (15:22 +0000)]
Merge "Move VM image build to remote DUT"

5 years agoAdd vCMTS VNF for running vCMTSd containers 81/65481/14
treyad [Thu, 29 Nov 2018 04:29:25 +0000 (20:29 -0800)]
Add vCMTS VNF for running vCMTSd containers

Add a SampleVNF derived class to start vcmtsd

JIRA: YARDSTICK-1544
Change-Id: Ifafa43216a6bdd076ef1cbe5b722f4a39a97980b
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoAdd Pktgen traffic generator for vCMTS 83/65483/12
treyad [Thu, 29 Nov 2018 04:34:28 +0000 (20:34 -0800)]
Add Pktgen traffic generator for vCMTS

Add a class for Pktgen configuring and starting

JIRA: YARDSTICK-1543

Change-Id: Icf9a4e656ff340158bf5605016f75ed393753f89
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoAdded test descriptors for vCMTS testcase 85/65485/7
treyad [Thu, 29 Nov 2018 04:39:54 +0000 (20:39 -0800)]
Added test descriptors for vCMTS testcase

Add vCMTS testcase descriptor and topology files

JIRA: YARDSTICK-1545

Change-Id: I4acd9c8f4fc94a1310eb5ddd4dd0ea60471efd24
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoDocs: Updated NSB installation: VM image build DUT 30/67230/4
Stepan Andrushko [Mon, 11 Mar 2019 12:36:32 +0000 (14:36 +0200)]
Docs: Updated NSB installation: VM image build DUT

Updated documentation for NSB installation changes done in
"Move VM image to remote DUT".

JIRA: YARDSTICK-1606

Change-Id: I742284f00cd0cb7390d5562d2a90355cc13d1871
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMove VM image build to remote DUT 45/66945/4
Stepan Andrushko [Mon, 11 Feb 2019 19:10:54 +0000 (21:10 +0200)]
Move VM image build to remote DUT

VM image is built on localhost but should be on remote DUT server.
VM image will be built on server added to group 'yardstick-standalone'.
NSB dependencies will be installed on servers added to groups
'yardstick-baremetal' and 'yardstick-standalone'.
Added extra package installation, copy VM image to libvirt folder.

JIRA: YARDSTICK-1597

Change-Id: Iac4444c6f332c5ea80da033f2fe8371e208d7fbc
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "NSB: Improve get_url in ansible scripts"
Volodymyr Mytnyk [Fri, 15 Mar 2019 14:38:29 +0000 (14:38 +0000)]
Merge "NSB: Improve get_url in ansible scripts"

5 years agoMerge "Add PCSCF, HSS classes for NSB-vIMS"
Volodymyr Mytnyk [Fri, 15 Mar 2019 14:31:20 +0000 (14:31 +0000)]
Merge "Add PCSCF, HSS classes for NSB-vIMS"

5 years agoAdd PCSCF, HSS classes for NSB-vIMS 49/63849/13
treyad [Sun, 21 Oct 2018 16:14:37 +0000 (09:14 -0700)]
Add PCSCF, HSS classes for NSB-vIMS

Currently, these VNF life cycles are:
- instantiate
- terminate
Pass through function: collect_kpi

JIRA: YARDSTICK-1444
JIRA: YARDSTICK-1445

Change-Id: I418877f79b6578ad4d78d7de4885c8aa20246beb
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoAdd VNF descriptor for vIMS testcase 77/63977/6
treyad [Thu, 25 Oct 2018 01:17:00 +0000 (18:17 -0700)]
Add VNF descriptor for vIMS testcase

This patch defines:
  - vims-topology.yaml --> Define topology
  - tc_vims_baremetal_sipp.yaml,tc_vims_heat_sipp.yaml --> test cases
in yardstick format (scenarios/context)

JIRA: YARDSTICK-1443

Change-Id: Id0253c9fe7e0b65cdb1d57f853b229f7d628c84f
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoFix Grafana dashboards for RFC2544 51/67251/1
Myron Sosyak [Wed, 13 Mar 2019 15:07:15 +0000 (15:07 +0000)]
Fix Grafana dashboards for RFC2544

Fixed dashboards for RFC2544 and for RFC2544 multiframesize

YARDSTICK-1592

Change-Id: I8dfc835804e8e33fbb926dbc76168c58a1f9dd2f
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
5 years agoMerge "Add vIPSEC VNF for running Crypto performance test case"
Volodymyr Mytnyk [Wed, 13 Mar 2019 09:25:41 +0000 (09:25 +0000)]
Merge "Add vIPSEC VNF for running Crypto performance test case"

5 years agoAdd Grafana dashboards for RFC2544 31/67231/1
Myron Sosyak [Mon, 11 Mar 2019 12:46:16 +0000 (12:46 +0000)]
Add Grafana dashboards for RFC2544

Added two dashboards for RFC2544 and for RFC2544 multiframesize

YARDSTICK-1592

Change-Id: Ib474c3cd12e2771666f838ca58b0c2c2e46a17cb
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
5 years agoAdd a document describing vIPSEC testcase 13/63613/13
treyad [Tue, 16 Oct 2018 17:15:34 +0000 (10:15 -0700)]
Add a document describing vIPSEC testcase

Create a test case description file for NSB vIPSEC

JIRA: YARDSTICK-1450

Change-Id: Iebaca9535e0ebc9f597d8e3c82c4339637eb3180
Signed-off-by: treyad <treyad@viosoft.com>
5 years agoMerge "dovetail - no sla in bottlenecks ping test case would get exception"
Jing Lu [Mon, 11 Mar 2019 01:48:12 +0000 (01:48 +0000)]
Merge "dovetail - no sla in bottlenecks ping test case would get exception"

5 years agoMerge "Add Grafana Dashboard for vCMTS testcase"
Volodymyr Mytnyk [Thu, 7 Mar 2019 16:23:58 +0000 (16:23 +0000)]
Merge "Add Grafana Dashboard for vCMTS testcase"

5 years agoMerge "Support using existing private key when using external heat template file"
Volodymyr Mytnyk [Thu, 7 Mar 2019 16:20:51 +0000 (16:20 +0000)]
Merge "Support using existing private key when using external heat template file"

5 years agoMerge "Update grub in enable_iommu_on_boot when needed"
Volodymyr Mytnyk [Thu, 7 Mar 2019 16:05:42 +0000 (16:05 +0000)]
Merge "Update grub in enable_iommu_on_boot when needed"

5 years agoNSB: Improve get_url in ansible scripts 96/67196/1
Stepan Andrushko [Thu, 7 Mar 2019 15:55:01 +0000 (17:55 +0200)]
NSB: Improve get_url in ansible scripts

Added retries and delay to the ansible 'get_url' module to get more
robust script.

JIRA: YARDSTICK-1605

Change-Id: Ic4d0b937ad810e42db61c0a8b1f6f137557392f8
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Fix failing if hugepages already configured"
Volodymyr Mytnyk [Thu, 7 Mar 2019 14:50:19 +0000 (14:50 +0000)]
Merge "Fix failing if hugepages already configured"

5 years agoMerge "Add Trex traffic generator to initate Traffic for VPP IPSEC"
Volodymyr Mytnyk [Thu, 7 Mar 2019 12:42:35 +0000 (12:42 +0000)]
Merge "Add Trex traffic generator to initate Traffic for VPP IPSEC"

5 years agoMerge "Add Grafana dashboard files for vIMS testcases"
Volodymyr Mytnyk [Thu, 7 Mar 2019 12:42:02 +0000 (12:42 +0000)]
Merge "Add Grafana dashboard files for vIMS testcases"

5 years agoFix RFC2544 Trex template 87/67187/1
Chornyi, TarasX [Wed, 6 Mar 2019 14:49:42 +0000 (16:49 +0200)]
Fix RFC2544 Trex template

Use template traffic profile instead of static one

JIRA: YARDSTICK-1592

Change-Id: I665896c4e533cd7b29f8b906c8c10f769f9268a7
Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
5 years agodovetail - no sla in bottlenecks ping test case would get exception 73/67173/1
rexlee8776 [Tue, 5 Mar 2019 01:25:28 +0000 (01:25 +0000)]
dovetail - no sla in bottlenecks ping test case would get exception

JIRA: YARDSTICK-1604

Change-Id: Ic48aae99478dff861c45da226b5fcfd2d4a7bc06
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
5 years agoAdd description of NSB scenarios 56/67156/1
Serhiy Pshyk [Fri, 1 Mar 2019 14:30:13 +0000 (14:30 +0000)]
Add description of NSB scenarios

JIRA: YARDSTICK-1592

Change-Id: Ice5d288b1c95b71a5985fa58632f02bfab91e79d
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>