Merge "[docs] Update influxDB container setup"

Merge "Cleanup unittests for test_attacker_baremetal"

Merge "Extend vBNG PPPoE test cases functionality"

Merge "Add vFW TCs description"

Merge "Add support for configuring frame rate per traffic flow for IXIA"

Merge "Update#2: Trex KPI not collected no rabbitmq user"

Merge "Yardstick Gambia 7.1.0 release notes"

Merge "Add raise for iteration exception in IterationRunner"

Add support for configuring frame rate per traffic flow for IXIA

Frame rate can be configured per traffic profile and per traffic flow.
By default traffic profile is applied to all traffic flows. If per
flow rate is specified it overrides default value from profile.

JIRA: YARDSTICK-1568

Change-Id: I388ed78869358de17d6485be0cd0d058983390e2
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>

Update#2: Trex KPI not collected no rabbitmq user

Changed the way how rabbitmq user is created. For baremetal it is done
using NSB installation script. For Yardstick installed in container
supervisor is updated with user name/password.

JIRA: YARDSTICK-1479

Change-Id: I4f42ab8d5ef1735b0416ed26d04e259efa155543
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Add raise for iteration exception in IterationRunner

When we run the testcase, if there was a exception in iteration
_work_process, the process will still run on ,and the test result will
not affected by the exception.

JIRA: YARDSTICK-1555

Change-Id: I03803c0473015379bb0eb20ed7d474a2d923a4e3
Signed-off-by: cope.li <cope.li@huawei.com>

[docs] Update influxDB container setup

JIRA: YARDSTICK-1335
Change-Id: I87b95d686f2d7ad204076845505b2fb6d502dedc
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Yardstick Gambia 7.1.0 release notes

Change-Id: I25ee28d62f43a3e2edaaad49762fdf3ce603dac8
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Ubuntu 18 support for nsb_setup.yml flow

Added Ubuntu 18 support to nsb_setup.yml flow: playbook
build_yardstick_image.yml.
Resolved dependencies between sample VNF and npm installation.

JIRA: YARDSTICK-1567

Change-Id: Ie4012687af7cf1fc374c226325f2c71cd6017275
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Merge "Don't add IOMMU to grub when it is not bare metal"

Don't add IOMMU to grub when it is not bare metal

Fix needed when running 'enable_iommu_on_boot' ansible role
inside the VM where 'ansible_system_vendor' is neither
'AuthenticAMD' nor 'Intel Corporation'.

JIRA: YARDSTICK-1469

Change-Id: I37e399fd892d1ec41239632948758284ccbe98ac
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Merge "Create docker image for Ubuntu 18.04"

Merge "Modify install.yaml to support Ubuntu 18"

Extend vBNG PPPoE test cases functionality

Extended Ixia traffic generator with functionality to
create traffic flows between device groups.

JIRA: YARDSTICK-1521

Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>

Merge "Add option to allow user to pass vpe_script"

Add vFW TCs description

JIRA: YARDSTICK-1540

Change-Id: Ia5657f2b04dafe010812a3ad8d0bdb89de67ca7e
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>

Merge "Fix value undefined error: "fetch_url_and_verify""

Merge "Fix pylint warnings in fetch_url_and_verify"

Merge "Docs for vPE"

Add PROX TC into OPNFV test cases

JIRA: YARDSTICK-1562

Change-Id: I81b5429c8afebb5af70547e9781518845ce6ccff
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>

Cleanup unittests for test_attacker_baremetal

unused-arg check was re-enabled after being disabled at a file level.
Changes were made so that the file conforms to our testing conventions.

JIRA: YARDSTICK-1384
Change-Id: I27b41e79fd6e4e9fbefccf8b72c4a43926e25312
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Fix value undefined error: "fetch_url_and_verify"

Fix value undefined error in Yardstick internal ansible module
“fetch_url_and_verify” in case http unreachable.

JIRA: YARDSTICK-1527

Change-Id: Iea3c6c08291b74f6a4dbb715b00cbf14a5dcf00e
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Fix pylint warnings in fetch_url_and_verify

Disable pylint checking in ansible module, to avoid
unused-wildcard-import and wrong-import-position
The wildcard import is required for ansile to be able to
use the module.

JIRA: YARDSTICK-1527
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Icc358555f59c8cc088f6f22e4fab8ee2205daff2

Merge "Add vBNG PPPoE test cases functionality"

Merge "L3FWD Gradana Dashboards Out-of-date and incorrect"

Merge "Update NSB PROX devguide"

L3FWD Gradana Dashboards Out-of-date and incorrect

JIRA: Yardstick-1561

L3FWD-2 Port Grafana Dashboard does not work,
and is missing NFVI stats and Live data.

L3FWD-4 Port Grafana Dashbaord missing
"Load Generated" and "Load Received" metrics

Change-Id: I6802c993be6f6c93750fa5aa8e5c1652ca78dfce
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

Add vBNG PPPoE test cases functionality

Added vBNG PPPoE test cases functionality which allows to:
- create and configure access network connections (PPPoE subscribers);
- create and configure core network connections;
- configure and run traffic between access and core network
  topologies.

JIRA: YARDSTICK-1508

Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>

Merge "Add HTTP IxLoad test cases for agnostic VNF"

Merge "Add IOMMU to grub to support OVS/SRIOV SA contexts"

Fix pip environment

oslo.log==3.41.0 needs to be fixed for tox to pass

JIRA: YARDSTICK-1560

Change-Id: I01d257e892aa835775456d8334f2c4358b120c08
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Merge "Adding scale up test case for l3fwd SRIOV."

Add HTTP IxLoad test cases for agnostic VNF

New files added to support HTTP tests with IxLoad and AgnosticVNF
 - http traffic profile that is used in all HTTP IxLoad test cases
 - test case file for each type of HTTP test
 - IxLoad config file (rxf) for each type of HTTP test

JIRA: YARDSTICK-1549

Change-Id: I5afe0b6bae1483dcb12c5ec145a4d6d7acc65ac2
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>

Merge "Handle HTTP traffic profile parameters as optional"

Adding scale up test case for l3fwd SRIOV.

Topology file changed as original did not work.
Added 'standalone-args.yaml' file for context information/details

JIRA: YARDSTICK-1547

Change-Id: I76dc782dac14db50dc8802f4f69cf077da0257a2
Signed-off-by: Carey, Alan <alan.carey@intel.com>

Merge "Adding scale up test case for l3fwd OvS-DPDK."

Handle HTTP traffic profile parameters as optional

JIRA: YARDSTICK-1548

Change-Id: I1130b33a1ab441a7a9ebf24beb954c9dab0ebc29
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>

Merge "Add test suite for scenario "opnfv_os-ovn-nofeature-ha""

Merge "Distribute dpdk/vhostuser between CPUs for SA OVS"

Adding scale up test case for l3fwd OvS-DPDK.

JIRA: YARDSTICK-1547

Change-Id: I5915c0e8df343e2c21396a9892d4728377e333bc
Signed-off-by: Carey, Alan <alan.carey@intel.com>

Merge "Prox L2FWD multiflow test fix"

Prox L2FWD multiflow test fix

Corrected the generator config file by adding the
latency position validated the test case with it.

JIRA: YARDSTICK-1530

Change-Id: I18dd1c7add8fc77bb59354fa96540ba8690057a4
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>

Merge "Fix multiport/scale-out baremetal ansible scripts"

Merge "NSB NFVi PROX Should report realtime port activity not historical data"

NSB NFVi PROX Should report realtime port activity not
historical data

JIRA: YARDSTICK-1458

The TG is only sampled at the end of every test interval.
This is incorrect. It should be sampled every interval.

Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

Update NSB PROX devguide

JIRA: YARDSTICK-1241

Add latest updates about updated dashboard
Added Information on Standalone mode (SRIOV and OVS-DPDK)
Added Information on Override traffic profile in test file
Added Information on new Grafana updates
Added information NFVI metrics

Change-Id: Ifcf55ac93d1c9f8c92f3d9dd7eb68d49a6117ffe
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

Add option to allow user to pass vpe_script

Add option to allow user to pass their own vpe_script

vpe_script will be auto-generated by default.

To use your own config file use the 'script' parameter in the config file

vnf_config: { file: './vpe_config/vpe_config_2_ports',
              action_bulk_file: './vpe_config/action_bulk_512.txt',
              full_tm_profile_file: './vpe_config/full_tm_profile_10G.cfg',
              script_file: './vpe_config/vpe_script_sample }

JIRA: YARDSTICK-1525

Change-Id: Ie23e5705f4c0475e858be73b8a504a7df8898828
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Docs for vPE

JIRA: YARDSTICK-1529

Change-Id: I1a95bca8ff3713660874c395c6ad6525011ad8c6
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Add template and css for nsb report

JIRA: YARDSTICK-1367
Topic: report/html_table (5 of 11)

Change-Id: I7b8f2fa2aff3d5ee20ec23189acefe41452ad496
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>

Remove Django from requirements and update docs

Since ``yardstick report generate`` now uses Jinja2,
there is no need for python-django, which was only being
used for that command.

Update docs accordingly, and provide links to InfluxDB,
Jinja2 and Highcharts.

JIRA: YARDSTICK-1367
Topic: report/html_table (3 of 11)

Change-Id: I63ab03e0b57901f250920487760507062825d812
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>

Add parser to support jsTree in report

Allow the user to select what data to show in the report using
jsTree to navigate a hierarchical metrics list.

JIRA: YARDSTICK-1367
Topic: report/html_table (4 of 11)

Change-Id: I86d782a0a70b80a1cdfaab2f41afb7668066cbf7
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>

Generate report from a file instead of string

``$ yardstick report generate ...`` now renders a template stored
in a file instead of from an imported string

Instead of using Django, templating is done by jinja2, as this is
used in other parts of Yardstick.

JIRA: YARDSTICK-1367
Topic: report/html_table (2 of 11)

Change-Id: Iaff53e7e28903e46164ce0977f6b8adbe04d23d7
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>

Merge "Fix OvS-DPDK context mem allocation problem"

Merge "Fix hugepages calculation"

Fix OvS-DPDK context mem allocation problem

The hugepages allocated for OvS-DPDK context is not correct,
thus it is causing an issue to allocate the required
amount of memory for VM.

JIRA: YARDSTICK-1538

Change-Id: I1a34199d4f78c999476603fa86d79ffc1fbf27c8
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>

Fix hugepages calculation

JIRA: YARDSTICK-1537

Change-Id: If4e78fe49c8b248c180d5a8db3932d822b9e5f95
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>

Update unit tests for yardstick/benchmark/core/report.py

* Remove redundant imports
* Rename some constants
* Add additional unit tests
* Reword KeyError message

JIRA: YARDSTICK-1367
Topic: report/html_table (1 of 11)

Change-Id: I3d89c1ed9acaeb7421a0734e33075ebae252c035
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>

Merge "Install barometer collectd container on all hosts"

Install barometer collectd container on all hosts

nsb_install.sh script will now install docker and barometer
collectd container on all baremetal hosts.

JIRA: YARDSTICK-1510

Change-Id: I927f96ec2e11b2111b76217597054a6471189f29
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>

Merge "Make VM machine type as a user configuration"

Make VM machine type as a user configuration

For backward compatibility, the default value of this
option has been left unchanged.

JIRA: YARDSTICK-1528

Change-Id: I42ceca96501f1136cba27d85c2d82240bd45c10c
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>

Run testcase 074 result overridden by job status

Change-Id: Icb24727fd7ca8a340ea424284b510b007055ec9c
JIRA: YARDSTICK-1526
Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>

Create docker image for Ubuntu 18.04

Added possibility to build docker image from Ubuntu 18.04, resolved
package dependencies applied for both Ubuntu 16.04 and Ubuntu 18.04.
Removed conflicting Ubuntu '-proposed' repo from dependencies as it
should be used for testing purposes only.

JIRA: YARDSTICK-1470

Change-Id: Ia1ed5c5ab6799bd328cc517e753e3b867ce4915a
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Modify install.yaml to support Ubuntu 18

Modify install.yaml to be able to install Yardstick on the newest
Ubuntu 18.04 LTS. Yardstick installation on Ubuntu 16 is still
supported. Default version is Ubuntu 16.04 (xenial).

JIRA: YARDSTICK-1413

Change-Id: Ic8aca0699645c68831ee739deeaeceef418075f5
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Merge "Remove unused functions vpe"

Create vPE binary from dpdk

Build and move the vPE binary from dpdk to nsb_bin

JIRA: YARDSTICK-1473

Change-Id: I01c44fb375d200d990efd27e1f1717cd0e100bb0
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Remove unused functions vpe

JIRA: YARDSTICK-1473

Change-Id: Ib9d3eb01f3fd900cbb08d55fc21fb95beceec941
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Merge "Add option to pass config file to vPE"

Add option to pass config file to vPE

Yardstick should not generate config files for vPE.
The current autogenerated configfile is incorrect.
Therefore this patch is removing the auto-generation functionality.

JIRA: YARDSTICK-1473

Change-Id: I9d909fcd0ac517d5ccdefb024c89b6bf979ef9c0
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Merge "Prox standalone test case changes:"

Fix multiport/scale-out baremetal ansible scripts

- Fixed ansible scripts to generate multiport baremetal TCs
  for vACL/vFW/vCGNAPT.
- Added scale out correlated traffic TCs for vACL/vFW/vCGNAPT.

JIRA: YARDSTICK-1347

Change-Id: I3f6232dab1a45c70d1e22fbe2c7b0c3cb4773a4e
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>

Distribute dpdk/vhostuser between CPUs for SA OVS

Update Yardstick with ability to distribute DPDK/vhost-user ports/queues
between CPU cores. Extended OVS add vhost-user interface command with
option "n_rxq", provided in the test case. Ordered ports added to OVS.

JIRA: YARDSTICK-1490

Change-Id: I71f5d878a9ee3a11f636762fc16b04ee6bc79e14
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Prox standalone test case changes:

Files renamed to include dpdk in name.
User/Password fields not needed in standalone context.
Fix with OvS test case file dpdk port number added.

JIRA: YARDSTICK-1500
JIRA: YARDSTICK-1475
JIRA: YARDSTICK-1471

Change-Id: I0422b5341172f098b1ff95b51b6fbc71b1b049f0
Signed-off-by: Carey, Alan <alan.carey@intel.com>

Merge "Implement functionality for updating http client"

Implement functionality for updating http client

Implemented functionality for updating http client configuration.
Extended http_ixload.py with functions for update page object
and count of simulated users in http client on netTraffic.

JIRA: YARDSTICK-1435

Change-Id: I9a0be226d4201d861d3a764864b42e5d87a4a305
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>

Merge "[docs] Resolve "nested numbering in toctree?" warning"

Merge "[docs] Resolve "document isn't included in any toctree" warning"

Merge "[docs] Add release notes for Gambia"

[docs] Add release notes for Gambia

Change-Id: If3e209ac3d2e80baadef0f4b76494028f8594f8b
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Add test suite for scenario "opnfv_os-ovn-nofeature-ha"

JIRA: YARDSTICK-1517

Change-Id: I172c92cd6f892321687949647c33e47b9e9f9d74
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

[docs] Resolve "document isn't included in any toctree" warning

Some test cases and test results weren't included in the test case
lists.
This change updates the lists of TC to included the previously
omitted TCs and add test results to index.

JIRA: YARDSTICK-1335
Change-Id: I5ca3b679b308889e60b7db2679629dc9144a3226
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Cleanup of ixia_profile attribute for IxNetwork TG

Remove obsolete attribute "ixia_profile" from
 - test cases using IxNetwork as a TG
 - from unit tests related to IxNetwork

Remove ixncfg files from repo.
Remove mention of ixncfg files from test case files

JIRA: YARDSTICK-1506

Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>

Merge "Adding new test case for prox Standalone L3FWD."

Merge "add error logs to storperf"

Merge "Bugfix: Gambia ci job failed on apex and compass"

Merge "Add prox test case for OvS-DPDK & 4 Port"

Merge "Adding Test Cases for Prox PktTouch Standalone SRIOV"

Bugfix: Gambia ci job failed on apex and compass

update according to [1]

[1]
https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt

Change-Id: If21e39470a33b9e7591cebe7f24b8f689edf4898
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Merge "Setup hugepages on SA host(sriov, ovs_dpdk)"

Add prox test case for OvS-DPDK & 4 Port

JIRA: YARDSTICK-1475

Change-Id: I511130ad65acbd2a052b6285c8408bfc098adbb6
Signed-off-by: Carey, Alan <alan.carey@intel.com>

Merge "Add prox test case for SRIOV & 4 ports."

Merge "Make OvS max_idle & queues configuration optional"

Merge "Adding Test Cases for Prox PktTouch Standalone OvS-DPDK"

Merge "Add IxNextgen API for settings IP priority"

Merge "Add API for PPPoE clients statistic retrieval"