yardstick.git
5 years agoYardsitck Gambia Release 7.2.0 release notes. 33/66633/1 stable/gambia opnfv-7.2.0
rexlee8776 [Thu, 24 Jan 2019 08:12:26 +0000 (08:12 +0000)]
Yardsitck Gambia Release 7.2.0 release notes.

release notes for Gambia 7.2.0

Change-Id: Ib7bd231ee61c73f593d99ab3b13a64c70e758e8a
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit add524a0356443be8e60d534cec2838e8761e668)

5 years ago[dovetail] split the sla check results into process recovery and service 01/66601/1
rexlee8776 [Tue, 22 Jan 2019 03:34:30 +0000 (03:34 +0000)]
[dovetail] split the sla check results into process recovery and service
recovery for HA tcs

make sla check for process recovery optional: only check when sla is
set.

JIRA: YARDSTICK-1512

Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 39d89761aca4aaf724010a9f8cac73725b798b33)

5 years agoYardstick Gambia 7.1.0 release notes 67/65867/1 opnfv-7.1.0
rexlee8776 [Thu, 13 Dec 2018 03:40:22 +0000 (03:40 +0000)]
Yardstick Gambia 7.1.0 release notes

Change-Id: I25ee28d62f43a3e2edaaad49762fdf3ce603dac8
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 00446d6a140d21c2144a927b474343ec92ed6e3c)

5 years agoRevert "[docs] Update on Yardstick installation" 09/65809/2
Emma Foley [Thu, 13 Dec 2018 16:31:27 +0000 (16:31 +0000)]
Revert "[docs] Update on Yardstick installation"

The changes to install.yml were limited to Ubuntu 18.
This doc update was not needed in Gambia

This reverts commit ddeab7c51942b19c1c88efe58339964afca941bc.

Change-Id: I79e02bbf77496e3b856ce039cb9e21b48b981777
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoMerge "L3FWD Gradana Dashboards Out-of-date and incorrect" into stable/gambia
Abhijit Sinha [Fri, 7 Dec 2018 21:49:24 +0000 (21:49 +0000)]
Merge "L3FWD Gradana Dashboards Out-of-date and incorrect" into stable/gambia

5 years agoMerge "Prox standalone test case changes:" into stable/gambia
Abhijit Sinha [Fri, 7 Dec 2018 15:16:30 +0000 (15:16 +0000)]
Merge "Prox standalone test case changes:" into stable/gambia

5 years agoMerge "Adding scale up test case for l3fwd OvS-DPDK." into stable/gambia
Abhijit Sinha [Fri, 7 Dec 2018 15:16:17 +0000 (15:16 +0000)]
Merge "Adding scale up test case for l3fwd OvS-DPDK." into stable/gambia

5 years agoMerge "Update NSB PROX devguide" into stable/gambia
Abhijit Sinha [Fri, 7 Dec 2018 15:16:01 +0000 (15:16 +0000)]
Merge "Update NSB PROX devguide" into stable/gambia

5 years agoMerge "Adding scale up test case for l3fwd SRIOV." into stable/gambia
Abhijit Sinha [Fri, 7 Dec 2018 15:15:47 +0000 (15:15 +0000)]
Merge "Adding scale up test case for l3fwd SRIOV." into stable/gambia

5 years agoMerge "Add test suite for scenario "opnfv_os-ovn-nofeature-ha"" into stable/gambia
Emma Foley [Fri, 7 Dec 2018 15:11:57 +0000 (15:11 +0000)]
Merge "Add test suite for scenario "opnfv_os-ovn-nofeature-ha"" into stable/gambia

5 years agoL3FWD Gradana Dashboards Out-of-date and incorrect 55/65655/1
DanielMartinBuckley [Fri, 7 Dec 2018 14:07:20 +0000 (14:07 +0000)]
L3FWD Gradana Dashboards Out-of-date and incorrect

JIRA: Yardstick-1561

L3FWD-2 Port Grafana Dashboard does not work,
and is missing NFVI stats and Live data.

L3FWD-4 Port Grafana Dashbaord missing
"Load Generated" and "Load Received" metrics

Change-Id: I6802c993be6f6c93750fa5aa8e5c1652ca78dfce
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 3e16bc78e6ee82f55315bd25f684476a39ee9bc0)

5 years agoUpdate NSB PROX devguide 49/65649/1
DanielMartinBuckley [Mon, 9 Jul 2018 15:40:15 +0000 (16:40 +0100)]
Update NSB PROX devguide

JIRA: YARDSTICK-1241

Add latest updates about updated dashboard
Added Information on Standalone mode (SRIOV and OVS-DPDK)
Added Information on Override traffic profile in test file
Added Information on new Grafana updates
Added information NFVI metrics

Change-Id: Ifcf55ac93d1c9f8c92f3d9dd7eb68d49a6117ffe
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit e9e3d3363e069652b4909f597f9ede812873eefe)

5 years agoProx standalone test case changes: 05/65605/2
Carey, Alan [Fri, 9 Nov 2018 05:51:35 +0000 (05:51 +0000)]
Prox standalone test case changes:

Files renamed to include dpdk in name.
User/Password fields not needed in standalone context.
Fix with OvS test case file dpdk port number added.

JIRA: YARDSTICK-1500
JIRA: YARDSTICK-1475
JIRA: YARDSTICK-1471

Change-Id: I0422b5341172f098b1ff95b51b6fbc71b1b049f0
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit fe1abfff948e66cfc3a897cb6a69dde9c4196780)

5 years agoAdding scale up test case for l3fwd OvS-DPDK. 03/65603/2
Carey, Alan [Thu, 29 Nov 2018 09:08:12 +0000 (09:08 +0000)]
Adding scale up test case for l3fwd OvS-DPDK.

JIRA: YARDSTICK-1547

Change-Id: I5915c0e8df343e2c21396a9892d4728377e333bc
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit fa73f65df5b53b07ffe345e4586b5d0e96dd42e7)

5 years agoAdding scale up test case for l3fwd SRIOV. 01/65601/2
Carey, Alan [Thu, 29 Nov 2018 05:57:38 +0000 (05:57 +0000)]
Adding scale up test case for l3fwd SRIOV.

Topology file changed as original did not work.
Added 'standalone-args.yaml' file for context information/details

JIRA: YARDSTICK-1547

Change-Id: I76dc782dac14db50dc8802f4f69cf077da0257a2
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit fb8066f72e3cb67a1c3c88b7c26779e61a247bc3)

5 years agoFix pip environment 17/65617/1
John O Loughlin [Thu, 6 Dec 2018 10:54:10 +0000 (10:54 +0000)]
Fix pip environment

oslo.log==3.41.0 needs to be fixed for tox to pass

JIRA: YARDSTICK-1560

Change-Id: I01d257e892aa835775456d8334f2c4358b120c08
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
(cherry picked from commit 470029d121ad332b5b7aa388bdb211eb4b47cfb9)

5 years agoAdd test suite for scenario "opnfv_os-ovn-nofeature-ha" 05/65505/1
rexlee8776 [Fri, 9 Nov 2018 06:33:21 +0000 (06:33 +0000)]
Add test suite for scenario "opnfv_os-ovn-nofeature-ha"

JIRA: YARDSTICK-1517

Change-Id: I172c92cd6f892321687949647c33e47b9e9f9d74
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit c88b12fb68b3b1d6b40dedf2947e61a3f9fd88c8)

5 years agoMerge "Run testcase 074 result overridden by job status" into stable/gambia
Rex Lee [Fri, 30 Nov 2018 01:39:10 +0000 (01:39 +0000)]
Merge "Run testcase 074 result overridden by job status" into stable/gambia

5 years agoMerge "Prox L2FWD multiflow test fix" into stable/gambia
Abhijit Sinha [Thu, 29 Nov 2018 23:47:53 +0000 (23:47 +0000)]
Merge "Prox L2FWD multiflow test fix" into stable/gambia

5 years agoProx L2FWD multiflow test fix 65/65465/1
Abhijit Sinha [Tue, 20 Nov 2018 14:15:33 +0000 (14:15 +0000)]
Prox L2FWD multiflow test fix

Corrected the generator config file by adding the
latency position validated the test case with it.

JIRA: YARDSTICK-1530

Change-Id: I18dd1c7add8fc77bb59354fa96540ba8690057a4
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 10ea31ed7973e3e8893345e972f5bdef75657cf3)

5 years agoNSB NFVi PROX Should report realtime port activity not 63/65463/1
DanielMartinBuckley [Mon, 1 Oct 2018 15:30:01 +0000 (16:30 +0100)]
NSB NFVi PROX Should report realtime port activity not
historical data

JIRA: YARDSTICK-1458

The TG is only sampled at the end of every test interval.
This is incorrect. It should be sampled every interval.

Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit bf507da25ad1e6adc6a5c162a4d0de325baef888)

5 years agoRun testcase 074 result overridden by job status 91/65191/1
Ameed Ashour [Sun, 18 Nov 2018 08:47:21 +0000 (10:47 +0200)]
Run testcase 074 result overridden by job status

Change-Id: Icb24727fd7ca8a340ea424284b510b007055ec9c
JIRA: YARDSTICK-1526
Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
5 years agoMerge "[docs] Resolve "document isn't included in any toctree" warning" into stable...
Rex Lee [Fri, 9 Nov 2018 19:07:14 +0000 (19:07 +0000)]
Merge "[docs] Resolve "document isn't included in any toctree" warning" into stable/gambia

5 years ago[docs] Resolve "nested numbering in toctree?" warning 35/64935/1
Emma Foley [Mon, 8 Oct 2018 17:57:37 +0000 (18:57 +0100)]
[docs] Resolve "nested numbering in toctree?" warning

Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Id31c0484db2dc28c2237455b863d2eac9fcbc66a
(cherry picked from commit 7d977af3acd029bcf7e7e28df118d185c6123230)

5 years ago[docs] Resolve "document isn't included in any toctree" warning 33/64933/1 opnfv-7.0.0
Emma Foley [Fri, 5 Oct 2018 15:35:35 +0000 (16:35 +0100)]
[docs] Resolve "document isn't included in any toctree" warning

Some test cases and test results weren't included in the test case
lists.
This change updates the lists of TC to included the previously
omitted TCs and add test results to index.

JIRA: YARDSTICK-1335
Change-Id: I5ca3b679b308889e60b7db2679629dc9144a3226
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit f2a27e64dc6a1375af23b0b99e6cfdddeceb19f8)

5 years ago[docs] Add release notes for Gambia 59/64859/3
Emma Foley [Fri, 12 Oct 2018 18:40:15 +0000 (19:40 +0100)]
[docs] Add release notes for Gambia

Change-Id: If3e209ac3d2e80baadef0f4b76494028f8594f8b
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit eb5fa557a803d151cdcac41ce8b738435a0ad653)

5 years ago[docs][userguide] Update formatting for Influx instructions in ch04 17/64917/1
Emma Foley [Wed, 29 Aug 2018 16:05:52 +0000 (17:05 +0100)]
[docs][userguide] Update formatting for Influx instructions in ch04

JIRA: YARDSTICK-1335
Change-Id: I2422d12a8c34fe2afaab349cbbb4dfe579057cb1
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit a0811c8c5f57038c567c15974c9128591bc1d283)

5 years ago[docs][devguide] Fix line lengths in devguide_nsb_prox.rst 15/64915/1
Emma Foley [Wed, 22 Aug 2018 15:24:37 +0000 (16:24 +0100)]
[docs][devguide] Fix line lengths in devguide_nsb_prox.rst

JIRA: YARDSTICK-1335
Change-Id: I863da3318a71dbcf2dc3f2b43fda6a92feed2089
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 3914b4028025fee9f5037ba29453201f99720f24)

5 years ago[userguide] Update the directory structure listing 13/64913/1
Emma Foley [Tue, 28 Aug 2018 13:34:55 +0000 (14:34 +0100)]
[userguide] Update the directory structure listing

Change-Id: I4ff6f94a6d309e1604672a41c581d0768c91a5d2
JIRA: YARDSTICK-1335
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit b7c2a088b375bb6895c52383c4348b1cb1d4edb9)

5 years ago[docs] Rename image tc014_pod_frase{e,}r.png 11/64911/1
Emma Foley [Wed, 3 Oct 2018 13:01:18 +0000 (14:01 +0100)]
[docs] Rename image tc014_pod_frase{e,}r.png

docs/release/results/tc014-cpu-processing-speed.rst
includes the image tc014_pod_fraser.png. This image was
incorrectly named tc014_pod_fraseer.png.

This patch fixes the image name so that the link is valid.

JIRA: YARDSTICK-1416
Change-Id: I37d8ee687f4dbd1a8b906e2934a4119f9fdd8041
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 53f1e72aa5919b2df1e2d354d8523210af5c563f)

5 years ago[docs] Fix "Error in xxx directive" warning 09/64909/1
Emma Foley [Wed, 3 Oct 2018 12:56:47 +0000 (13:56 +0100)]
[docs] Fix "Error in xxx directive" warning

JIRA: YARDSTICK-1416
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: I58c511454e052496e0b72ea28142b331514475c5
(cherry picked from commit d5ff53dbdbcb1d97343a3122aabf312d81649eaa)

5 years ago[docs] Fix docs {un,}indent warnings in Testcase definitions 07/64907/1
Emma Foley [Wed, 3 Oct 2018 12:54:09 +0000 (13:54 +0100)]
[docs] Fix docs {un,}indent warnings in Testcase definitions

Mostly, the issues were with un/indentation.
This has been fixed, and `tox -e docs` now issues less warnings.

JIRA: YARDSTICK-1416
Change-Id: Ie58a8dba42e9868357e1dce414cb1a01af8ad1f4
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 28e64c520fc2a52c1d3eb736f88ad4608b87c142)

5 years agoMerge "[docs] Remove vtc results chapter and references" into stable/gambia
Rex Lee [Fri, 9 Nov 2018 18:01:50 +0000 (18:01 +0000)]
Merge "[docs] Remove vtc results chapter and references" into stable/gambia

5 years ago[docs] Update header levels 99/64899/1
Emma Foley [Wed, 3 Oct 2018 12:49:21 +0000 (13:49 +0100)]
[docs] Update header levels

JIRA: YARDSTICK-1335
Change-Id: I202634a7427a409f0e2ca786c8bb5e05a5b4351d
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 5456b070a8e05cd49d5626b002f6eeee71bcd67d)

5 years ago[docs] Remove vtc results chapter and references 97/64897/1
Emma Foley [Wed, 3 Oct 2018 12:38:57 +0000 (13:38 +0100)]
[docs] Remove vtc results chapter and references

The vTC chapter in the userguide was previously removed [1]
Some references and results still remained and needed to be removed.

[1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=commit;h=114a486558c96152fffb5050840460a54de64d15

JIRA: YARDSTICK-1335
Change-Id: I17806d90ae8bc4dbf813ef89bbc22dc012b4a686
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 766d498f9f4abcb79710d077c6a1886ae11a4c0a)

5 years ago[docs] Fix unresolved reference warning 95/64895/1
Emma Foley [Wed, 3 Oct 2018 12:55:16 +0000 (13:55 +0100)]
[docs] Fix unresolved reference warning

JIRA: YARDSTICK-1416
Change-Id: Ibdc9b48e31aff171c59278f9ca19767392f4eeba
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit e9db0b0e22ddfaa879aa08128d17ea6308355455)

5 years ago[docs] Update broken and redirected links 87/64887/1
Emma Foley [Mon, 17 Sep 2018 13:55:42 +0000 (14:55 +0100)]
[docs] Update broken and redirected links

A number of links were broken, or permenently redirected.
Some literal include directives pointed to the wrong location.

These have been updated, so the links are valid.

JIRA: YARDSTICK-1416
Change-Id: Icd20113e0ab099850fa58fa41bb27a00670f57ca
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 44a507c5aa92d4f4a518983bd4b6ecc244e7a66c)

5 years ago[docs] Fix links to remove references to submodules 67/64867/3
Aric Gardner [Fri, 14 Sep 2018 21:18:42 +0000 (17:18 -0400)]
[docs] Fix links to remove references to submodules

All references to submodules must be removed for docs to
work going forward.

Can be tested once your project has a local tox file

Change-Id: Id74581cc584f70ae0b31e31c9dd91593c7be6615
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
(cherry picked from commit 2ba5ef8eeac9f92436fcaed807fdd4ecaa79d2c0)

5 years ago[docs] Transition to local docs build job. 69/64869/1
Emma Foley [Sun, 9 Sep 2018 12:42:26 +0000 (13:42 +0100)]
[docs] Transition to local docs build job.

Docs builds have transitioned to using local
build jobs. This allows Yardstick docs to be
built and verified locally.
The time taken to build and verify docs in the
gate for new changes should be reduced, as the
docs for each project will be built separately.

This change also allow contributers to test
their docs builds locally, using tox::

    tox -e docs
    tox -e docs-linkcheck

TODO: Update the dev guide to include new tox
environment

Related: DOCS-191
JIRA: YARDSTICK-1415
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Ib8bab85475dcd5127a2c41a2d55dce8f8d9da574
(cherry picked from commit 7203ff5925b805d07a5df53b6cdcf7d44cc4e4d1)

5 years agoMerge "[docs] Update mailing list to use #yardstick" into stable/gambia
Rex Lee [Fri, 9 Nov 2018 02:02:03 +0000 (02:02 +0000)]
Merge "[docs] Update mailing list to use #yardstick" into stable/gambia

5 years agoMerge "add error logs to storperf" into stable/gambia
Rex Lee [Fri, 9 Nov 2018 02:01:55 +0000 (02:01 +0000)]
Merge "add error logs to storperf" into stable/gambia

5 years agoMerge "Fix python lib path for ixload control subprocess" into stable/gambia
Rex Lee [Fri, 9 Nov 2018 02:01:46 +0000 (02:01 +0000)]
Merge "Fix python lib path for ixload control subprocess" into stable/gambia

5 years agoMerge "Cleanup of ixia_profile attribute for IxNetwork TG" into stable/gambia
Rex Lee [Fri, 9 Nov 2018 02:01:36 +0000 (02:01 +0000)]
Merge "Cleanup of ixia_profile attribute for IxNetwork TG" into stable/gambia

5 years agoMerge "Adding new test case for prox Standalone L3FWD." into stable/gambia
Rex Lee [Fri, 9 Nov 2018 02:01:22 +0000 (02:01 +0000)]
Merge "Adding new test case for prox Standalone L3FWD." into stable/gambia

5 years agoCleanup of ixia_profile attribute for IxNetwork TG 97/64797/1
Orest Voznyy [Thu, 1 Nov 2018 11:39:44 +0000 (13:39 +0200)]
Cleanup of ixia_profile attribute for IxNetwork TG

Remove obsolete attribute "ixia_profile" from
 - test cases using IxNetwork as a TG
 - from unit tests related to IxNetwork

Remove ixncfg files from repo.
Remove mention of ixncfg files from test case files

JIRA: YARDSTICK-1506

Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
(cherry picked from commit fff1e25f3a882739b94458c741a5f86645f1210c)

5 years agoBugfix: Gambia ci job failed on apex and compass 85/64785/1
rexlee8776 [Thu, 8 Nov 2018 06:51:37 +0000 (06:51 +0000)]
Bugfix: Gambia ci job failed on apex and compass

update according to [1]

[1]
https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt

Change-Id: If21e39470a33b9e7591cebe7f24b8f689edf4898
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit c6469463d18afa4833483e99f2fa61087874bbac)

5 years agoAdding new test case for prox Standalone L3FWD. 77/64777/1
Carey, Alan [Wed, 7 Nov 2018 07:58:20 +0000 (07:58 +0000)]
Adding new test case for prox Standalone L3FWD.

This contains two files: 2 & 4 port test cases.

JIRA: YARDSTICK-1515

Change-Id: I9b6b5fd47a854571bc4e9f67c570b183e65245db
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit 6d68fedcff4f4cc3ff9d1a44ae2f57fe0ad10eab)

5 years agoMerge "Make OvS max_idle & queues configuration optional" into stable/gambia
Rex Lee [Thu, 8 Nov 2018 11:28:17 +0000 (11:28 +0000)]
Merge "Make OvS max_idle & queues configuration optional" into stable/gambia

5 years agoadd error logs to storperf 63/64763/1
Ameed Ashour [Tue, 4 Sep 2018 07:51:25 +0000 (10:51 +0300)]
add error logs to storperf

add error logs to storperf.py in order to show the errors
in task log API

JIRA: YARDSTICK-1407
Change-Id: I7cefd09cbd7bdefca98c9220f886675b6a5b02a4
Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
5 years agoMerge "Allow to see steady state status in the yardstick logs" into stable/gambia
Abhijit Sinha [Wed, 7 Nov 2018 17:26:03 +0000 (17:26 +0000)]
Merge "Allow to see steady state status in the yardstick logs" into stable/gambia

5 years agoMerge "Add Testcase for Prox Standalone SRIOV." into stable/gambia
Abhijit Sinha [Wed, 7 Nov 2018 16:10:33 +0000 (16:10 +0000)]
Merge "Add Testcase for Prox Standalone SRIOV." into stable/gambia

5 years agoMake OvS max_idle & queues configuration optional 79/64679/2
Mytnyk, Volodymyr [Fri, 12 Oct 2018 16:53:17 +0000 (17:53 +0100)]
Make OvS max_idle & queues configuration optional

Remove hardcoded rx queue value

JIRA: YARDSTICK-1493

Change-Id: Ia4944db21d94399c724bcabf4e0eae809518e7e9
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit 68c127e17028e9961abcbd1c9a72fe2b878c427b)

5 years agoMerge "Update Multi Port Stats reading for PROX" into stable/gambia
Abhijit Sinha [Tue, 6 Nov 2018 16:53:10 +0000 (16:53 +0000)]
Merge "Update Multi Port Stats reading for PROX" into stable/gambia

5 years agoMerge "Test case override of traffic profile settings." into stable/gambia
Abhijit Sinha [Tue, 6 Nov 2018 16:53:02 +0000 (16:53 +0000)]
Merge "Test case override of traffic profile settings." into stable/gambia

5 years agoMerge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambia
Abhijit Sinha [Tue, 6 Nov 2018 16:52:22 +0000 (16:52 +0000)]
Merge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambia

5 years agoMerge "[docs] Add vEPC test case preparation steps" into stable/gambia
Abhijit Sinha [Tue, 6 Nov 2018 16:50:51 +0000 (16:50 +0000)]
Merge "[docs] Add vEPC test case preparation steps" into stable/gambia

5 years agoAdd Testcase for Prox Standalone SRIOV. 01/64601/1
Carey, Alan [Thu, 11 Oct 2018 06:15:04 +0000 (07:15 +0100)]
Add Testcase for Prox Standalone SRIOV.

No sample testcase for prox SRIOV standalone.

Renamed pod file so that other prox testcases can use this file

JIRA: YARDSTICK-1471

Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit 0eaa53d46f1f2ced9a1d40ebf820580bf314b4a1)

5 years agoTest case override of traffic profile settings. 87/64587/1
DanielMartinBuckley [Thu, 12 Jul 2018 12:11:00 +0000 (13:11 +0100)]
Test case override of traffic profile settings.

JIRA: YARDSTICK-1298

Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml"
settings to override the values in the traffic_profile file
e.g. "prox_binsearch.yaml"

This is done by adding the "traffic_config" section to the
"options" section in the "test case file".

See below :-

  options:
    interface_speed_gbps: 10

    traffic_config:
      tolerated_loss: 0.001
      test_precision: 0.1
      packet_sizes: [64]
      duration: 30
      lower_bound: 0.0
      upper_bound: 100.0

    vnf__0:
      prox_path: /opt/nsb_bin/prox
      prox_config: "configs/handle_l2fwd-4.cfg"
      prox_args:
        "-t": ""

    tg__0:
      prox_path: /opt/nsb_bin/prox
      prox_config: "configs/gen_l2fwd-4.cfg"
      prox_args:
        "-e": ""
        "-t": ""

Precedence of the traffic settings.

1. Values provided in the "traffic_config" section, inside
   the "options" section, of the test case file
2. values provided in the "traffic_profile" section of the
   traffic_profile file

Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 383c438cda94a1004bc9552a5993fe3ff3e6da8f)

5 years agoUpdate Multi Port Stats reading for PROX 85/64585/1
DanielMartinBuckley [Thu, 5 Jul 2018 16:55:29 +0000 (17:55 +0100)]
Update Multi Port Stats reading for PROX

JIRA: YARDSTICK-1458

Removed excessive jitter by removing extra sleeps in start/stop/reset
  ssh
Removed extra retries when bad data returned
Added a slep at end of test to give runner a chance to empty the queue
  on shutdown
Added a timeout on port retry attempts

Change-Id: Ica60b11c7af242817a83c154157827581f60d16a
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit b2fd601c33e3322ccc9e675242f091dba2eeb644)

5 years ago[docs] Update mailing list to use #yardstick 53/64553/1
Emma Foley [Tue, 9 Oct 2018 14:14:32 +0000 (15:14 +0100)]
[docs] Update mailing list to use #yardstick

The mailing list is on a new system that lets you use #topics
instead of [topics]. The contact information has been updated
to reflect this.

JIRA: YARDSTICK-1335
Change-Id: Ida9af98f00761a3bff8903165fd2806163787ccd
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 3fec49e7a3926ddf4f9303ee47a33d109421a573)

5 years agoMerge "[docs] Test case documentation for vEPC testing" into stable/gambia
Rex Lee [Tue, 6 Nov 2018 06:36:58 +0000 (06:36 +0000)]
Merge "[docs] Test case documentation for vEPC testing" into stable/gambia

5 years agoMerge changes I526c328f,I7bb14112,Idfe77900 into stable/gambia
Rex Lee [Tue, 6 Nov 2018 06:35:15 +0000 (06:35 +0000)]
Merge changes I526c328f,I7bb14112,Idfe77900 into stable/gambia

* changes:
  [docs] Update on Yardstick installation
  [docs] Add conventions for writing unit tests.
  [docs] Add developer guidelines for contribution

5 years ago[docs] Add vEPC test case preparation steps 01/64501/1
Orest Voznyy [Wed, 31 Oct 2018 15:27:04 +0000 (17:27 +0200)]
[docs] Add vEPC test case preparation steps

Add documentation to review the changes to original vEPC infrastructure
files to configure NSB test run in a specific test setup.

Add initial steps to prepare NSB to use Spirent Landslide for vEPC tests.

JIRA: YARDSTICK-1459

Change-Id: I3b937b1a21d6ec6851a92946e46c679385fdff9c
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
(cherry picked from commit dc55a775f7aa62be7ed17cc33aa1b0bac54c081f)

5 years agoFix python lib path for ixload control subprocess 91/64491/1
Chornyi, TarasX [Fri, 28 Sep 2018 08:43:19 +0000 (11:43 +0300)]
Fix python lib path for ixload control subprocess

JIRA: YARDSTICK-1390

Change-Id: I3ef5242862c98d3b389ba127f909f47e26c0711d
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
(cherry picked from commit 376720a9ff56a9e71b6bc63b1d621f0c600088e1)

5 years ago[docs] Test case documentation for vEPC testing 95/64395/1
Abhijit Sinha [Wed, 24 Oct 2018 17:04:35 +0000 (18:04 +0100)]
[docs] Test case documentation for vEPC testing

JIRA: YARDSTICK-1349

The test case document will cover the following:
- test purpose
- test configuration
- pre-test conditions
- test sequence
- test verdict

Change-Id: I2841a7ff3d248bb3e4739579fad722dc02b5504f
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit c8bde3b59031b352bf09302ae7644436860602d7)

5 years agoMake OvS to listen on TCP by default 79/64379/1
Mytnyk, Volodymyr [Thu, 11 Oct 2018 17:16:06 +0000 (18:16 +0100)]
Make OvS to listen on TCP by default

JIRA: YARDSTICK-1492

Change-Id: I81c682d473ffe3d70ecbb42cce40c2d16e608b41
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
5 years agoMerge changes Ia8783de8,I61421095 into stable/gambia
Emma Foley [Thu, 1 Nov 2018 11:04:16 +0000 (11:04 +0000)]
Merge changes Ia8783de8,I61421095 into stable/gambia

* changes:
  Update: Trex KPI not collected no rabbitmq user
  Trex KPI are not collected due to rabbitmq user

5 years agoMerge "Fix default IPv4 mask for IxNetwork traffic config" into stable/gambia
Abhijit Sinha [Thu, 1 Nov 2018 10:07:30 +0000 (10:07 +0000)]
Merge "Fix default IPv4 mask for IxNetwork traffic config" into stable/gambia

5 years agoUpdate: Trex KPI not collected no rabbitmq user 47/64347/1
Stepan Andrushko [Wed, 31 Oct 2018 17:07:08 +0000 (19:07 +0200)]
Update: Trex KPI not collected no rabbitmq user

Update of review #63707: missed yardstick password hash.
This must be set on top of changes on review.

JIRA: YARDSTICK-1479

Change-Id: Ia8783de81ad91ea7421c6bbff87a30c59db2d44c
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoTrex KPI are not collected due to rabbitmq user 45/64345/1
Stepan Andrushko [Thu, 18 Oct 2018 18:16:09 +0000 (21:16 +0300)]
Trex KPI are not collected due to rabbitmq user

Changed the way rabbitmq-server user is created. Fix is needed to
collect KPIs from Trex.

JIRA: YARDSTICK-1479

Change-Id: I6142109563fcdb27e0ec554dd08567a1a43237e7
(cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498)
formerly: I54369535fdb7af6af76de30f758227736f83db78
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years agoMerge "Adding Grafana dashboard for visualizing the vEPC default bearer metrics....
Abhijit Sinha [Wed, 31 Oct 2018 18:25:26 +0000 (18:25 +0000)]
Merge "Adding Grafana dashboard for visualizing the vEPC default bearer metrics." into stable/gambia

5 years agoMerge "Revert "Trex KPI are not collected due to rabbitmq user"" into stable/gambia
Abhijit Sinha [Wed, 31 Oct 2018 17:19:58 +0000 (17:19 +0000)]
Merge "Revert "Trex KPI are not collected due to rabbitmq user"" into stable/gambia

5 years agoRevert "Trex KPI are not collected due to rabbitmq user" 27/64327/1
Emma Foley [Wed, 31 Oct 2018 16:34:59 +0000 (16:34 +0000)]
Revert "Trex KPI are not collected due to rabbitmq user"

This causes the docker-build jobs to fail in the CI.

This reverts commit ce809669d3051524508edf5a3d69e83dde8a9080.

Change-Id: Iea66bc92eaee39c5b7427ea55c190f8c0dbf5ad4
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoAdding Grafana dashboard for visualizing the vEPC default bearer metrics. 15/64315/1
Carey, Alan [Tue, 30 Oct 2018 09:02:28 +0000 (09:02 +0000)]
Adding Grafana dashboard for visualizing the vEPC default bearer metrics.

The dashboard will highlight the Network metrics captured from Spirent landslide traffic generator.

JIRA: YARDSTICK-1350

Change-Id: I47920446181355a97e875fd82afd633b336c8da6
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit 5bf76a7a2ead6e8c3a0d8bc05c7ec89d9faaa5a5)

5 years agoMerge "[docs] Update the glossary" into stable/gambia
Emma Foley [Wed, 31 Oct 2018 12:44:22 +0000 (12:44 +0000)]
Merge "[docs] Update the glossary" into stable/gambia

5 years agoFix default IPv4 mask for IxNetwork traffic config 03/64303/1
Serhiy Pshyk [Fri, 19 Oct 2018 08:46:05 +0000 (09:46 +0100)]
Fix default IPv4 mask for IxNetwork traffic config

IP mask is set depending on the IP range provided by the user in the
traffic profile. In case of single IP in range, IPV4LENGTH value is
used as mask should cover all address bits.

JIRA: YARDSTICK-1478

Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
5 years agoMerge "Adds option parameters to TC074" into stable/gambia
Rex Lee [Wed, 31 Oct 2018 11:28:56 +0000 (11:28 +0000)]
Merge "Adds option parameters to TC074" into stable/gambia

5 years agoMerge "Dashboard with Network and Platform NFVi metrics" into stable/gambia
Emma Foley [Wed, 31 Oct 2018 10:06:37 +0000 (10:06 +0000)]
Merge "Dashboard with Network and Platform NFVi metrics" into stable/gambia

5 years agoMerge "Add RFC2544 iteration status field" into stable/gambia
Abhijit Sinha [Wed, 31 Oct 2018 09:39:29 +0000 (09:39 +0000)]
Merge "Add RFC2544 iteration status field" into stable/gambia

5 years agoMerge "Add test library name update in DMF and mainflows" into stable/gambia
Emma Foley [Tue, 30 Oct 2018 20:36:49 +0000 (20:36 +0000)]
Merge "Add test library name update in DMF and mainflows" into stable/gambia

5 years agoAdd RFC2544 iteration status field 49/64249/1
Mytnyk, Volodymyr [Mon, 20 Aug 2018 19:16:36 +0000 (20:16 +0100)]
Add RFC2544 iteration status field

 Added new RFC2544 iteration status field into the
testcase result to be able to exctract the best
RX/TX throughput value from each iteration.

 The field equal "Success" if the trhoughput value is in the
given drop percentage range and "Failure" otherwise.

JIRA: YARDSTICK-1389

Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit 0ff5b131fa3f93f8d47b46c2f13661c5b88d37a1)

5 years agoDashboard with Network and Platform NFVi metrics 47/64247/1
Abhijit Sinha [Fri, 5 Oct 2018 14:44:52 +0000 (15:44 +0100)]
Dashboard with Network and Platform NFVi metrics

Added the PROX L3FWD Grafana dashboard with NFVi metrics
collected from barometer collectd container.

The dashboard has template field for HOST/SUT name
to get the collectd metrics from that SUT.

JIRA: YARDSTICK-1412

Update:
- Added table and graphs for TG NFVi metrics
- Added TG and SUT templates as IP address
- Added IPC(instruction per cycles) metric

Change-Id: I1f8971f551df27ad6a16241693527285610fc82d
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit e63084495f47a9f5b5b61b23529792d6898841bb)

5 years agoMerge "Pod file fix for Prox 2 port" into stable/gambia
Abhijit Sinha [Tue, 30 Oct 2018 17:06:19 +0000 (17:06 +0000)]
Merge "Pod file fix for Prox 2 port" into stable/gambia

5 years agoAdd Testcase for Prox Standalone OvS-DPDK. 41/64241/1
Carey, Alan [Tue, 16 Oct 2018 06:55:03 +0000 (07:55 +0100)]
Add Testcase for Prox Standalone OvS-DPDK.

No sample testcase for prox OvS-DPDK standalone.

JIRA: YARDSTICK-1475

Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f
Signed-off-by: Carey, Alan <alan.carey@intel.com>
(cherry picked from commit b0e92a357658f4ece21e356653e8eb52d7ab8d98)

5 years agoMerge "Fix latency for ACL test cases" into stable/gambia
Abhijit Sinha [Tue, 30 Oct 2018 16:19:30 +0000 (16:19 +0000)]
Merge "Fix latency for ACL test cases" into stable/gambia

5 years agoMerge "Add traffic duration support in test case" into stable/gambia
Abhijit Sinha [Tue, 30 Oct 2018 15:50:18 +0000 (15:50 +0000)]
Merge "Add traffic duration support in test case" into stable/gambia

5 years agoMerge "Trex KPI are not collected due to rabbitmq user" into stable/gambia
Abhijit Sinha [Tue, 30 Oct 2018 15:15:54 +0000 (15:15 +0000)]
Merge "Trex KPI are not collected due to rabbitmq user" into stable/gambia

5 years agoPod file fix for Prox 2 port 39/64239/1
Abhijit Sinha [Thu, 18 Oct 2018 09:53:24 +0000 (10:53 +0100)]
Pod file fix for Prox 2 port

Removing the "keyfile" from the pod file to align with other
pod files for 1 and 4 port. The file when used as such currently
gives an error. This change will fix that.

JIRA:YARDSTICK-1477

Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 31eac948bba5cf442981fdc7b1392992aaef1f15)

5 years agoFix latency for ACL test cases 37/64237/1
Patrice Buriez [Fri, 12 Oct 2018 17:03:33 +0000 (19:03 +0200)]
Fix latency for ACL test cases

JIRA: YARDSTICK-1460

Cores running "mode=lat" must be properly configured with a correct
"lat pos" parameter. When this parameter is missing, PROX exits with
an error message.
When the "lat pos" parameter is missing for cores running "mode=gen",
latency values are not written into the packets.
Also fixed some typos, packet inline format, IP len and UDP len.

Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
(cherry picked from commit 7bc7bfb1b43e6329bbfc0ed7a7c5554ebcf10c2b)

5 years agoAllow to see steady state status in the yardstick logs 31/64231/1
Ameed Ashour [Tue, 25 Sep 2018 12:38:43 +0000 (15:38 +0300)]
Allow to see steady state status in the yardstick logs

Change-Id: Ic2281b300ed1de6ecd3daf14b5273db22688de8d
JIRA: YARDSTICK-1454
Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
(cherry picked from commit ad08f101fa3a23e9a35fa9ba3e28dd22a054ef52)

5 years ago[docs] Update the glossary 27/64227/1
Emma Foley [Wed, 22 Aug 2018 18:09:15 +0000 (19:09 +0100)]
[docs] Update the glossary

Add some new terms (OpenStack, Docker, PROX).

JIRA: YARDSTICK-1335
Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 78b5a19e3071cbc080eeae0bdf22f5ab80c03180)

5 years agoMerge "Add OvS 2.8.1 support into SA context" into stable/gambia
Emma Foley [Tue, 30 Oct 2018 14:32:37 +0000 (14:32 +0000)]
Merge "Add OvS 2.8.1 support into SA context" into stable/gambia

5 years ago[docs] Update on Yardstick installation 25/64225/2
Stepan Andrushko [Fri, 14 Sep 2018 17:05:13 +0000 (20:05 +0300)]
[docs] Update on Yardstick installation

Added details how to install Yardstick using install.yaml.

Updated:
 - 04-installation.rst
 - 13-nsb-installation.rst

JIRA: YARDSTICK-1335

Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
5 years ago[docs] Add conventions for writing unit tests. 23/64223/2
Emma Foley [Wed, 15 Aug 2018 08:55:07 +0000 (09:55 +0100)]
[docs] Add conventions for writing unit tests.

Added details of conventions used when writing unit tests.

JIRA: YARDSTICK-1335
Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years ago[docs] Add developer guidelines for contribution 21/64221/2
Emma Foley [Thu, 2 Aug 2018 17:20:15 +0000 (18:20 +0100)]
[docs] Add developer guidelines for contribution

A new section was added to the devguide, stating
expectations for code contributions.

* What to include in a change
* Code style guidelines
* How to run tests

JIRA: YARDSTICK-1335
Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
5 years agoAdds option parameters to TC074 89/63989/2
Ameed Ashour [Tue, 10 Jul 2018 13:42:36 +0000 (16:42 +0300)]
Adds option parameters to TC074

Add option parameters to TC074 to allow the user to specify
volume type, volume count, availability zone, stack name,
and subnet cidr.

JIRA:YARDSTICK-1294
Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c
Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
(cherry picked from commit 43c28852a9c9abfe7fc66fca0dcc703b468db0cf)

5 years agoConfigure n_rxq DPDK port option when adding the port 19/64219/1
Mytnyk, Volodymyr [Thu, 4 Oct 2018 14:24:56 +0000 (15:24 +0100)]
Configure n_rxq DPDK port option when adding the port

On some platform, setting n_rxq option on port separately
does not work well and causes issues like port link down,
so changed the logic to set n_rxq DPDK port option during
adding the port to the bridge which help to resolve
the problem.

JIRA: YARDSTICK-1463

Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit adcc29e56130f0f047b99528ce72b6f149643da7)

5 years agoAdd OvS 2.8.1 support into SA context 17/64217/1
Mytnyk, Volodymyr [Thu, 4 Oct 2018 12:05:27 +0000 (13:05 +0100)]
Add OvS 2.8.1 support into SA context

JIRA: YARDSTICK-1462

Change-Id: I001a173fc728be6e88f5ae6d38c64b740e536ff2
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
(cherry picked from commit ad63af7f42d07cffde73c32727f170973ce5ba46)

5 years agoAdd test library name update in DMF and mainflows 97/64197/1
Orest Voznyy [Mon, 22 Oct 2018 15:27:31 +0000 (18:27 +0300)]
Add test library name update in DMF and mainflows

Add automatic update of traffic profile items library name update, as well
as update of session profile Dmf library name, to avoid the need of user
changing it in template files.

Update affected unit tests.

JIRA: YARDSTICK-1474

Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
(cherry picked from commit 1fd3806d6a6bac19f3173da4d6cb94cef81fd7f5)

5 years agoAdd traffic duration support in test case 89/64189/1
Orest Voznyy [Mon, 8 Oct 2018 17:06:02 +0000 (20:06 +0300)]
Add traffic duration support in test case

Implement code to support traffic_duration field in test case options.
This updates the 'duration' in Landslide session profile.
traffic_duration should always be much less than runner duration/timeout.

JIRA: YARDSTICK-1427

Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
(cherry picked from commit ae2ceba66519555749c67eefe2170ea716a1411b)