Add python-openstackclient in docker image

"openstack: command not found" error occurred in [1].
The version of python-openstackclient is listed in [2].
This program should be installed in the container image
to make CI work for now.

[1]: https://build.opnfv.org/ci/job/yardstick-daisy-baremetal-daily-master/114/
[2]: https://github.com/openstack/requirements/blob/stable/pike/global-requirements.txt

Change-Id: Idb50e26bb2ca36f2dd6b6dddf94680d479cb9c9f
Signed-off-by: Alex Yang <yangyang1@zte.com.cn>

Merge "'libvirt' guest console in Standalone model"

Merge "Check RS for virtualized OpenStack/Yardstick"

Merge "Cleanup of redundant files from Prox directory"

Check RS for virtualized OpenStack/Yardstick

Draft for env requirements reading and validation
Script can be run from tools/virt_ci_rampup.sh. First requirement file is
parsed/stored. This file must be created in ahead and named as
'infra_deploy.yaml'. Then separate ansible role is used to validate
resources. Ansible-role fails if there is not enough resources on the host
for cpu, ram, disk space.

JIRA: YARDSTICK-945

Change-Id: I86cd4bdc963de3aa51392fc73a239cbd426bc64a
Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>

Merge "Use assertIn(x, y) instead of other variations"

Cleanup of redundant files from Prox directory

JIRA: YARDSTICK-965

Removed the redundant files and directory from
Prox test folder.

Change-Id: I6167f0a4ccdd581153dad3ec9f5eaaf2619aacbd
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>

Merge "Enable iommu support in grub"

Rename ResourceProfile.check_if_sa_running()

* Update log message and rename method to make debugging easier
* Fix pep8 violations in touched files

JIRA: YARDSTICK-859

Change-Id: Id138d72cd8557ffacd5dcc81d06feeb484e13625
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Enable iommu support in grub

JIRA: YARDSTICK-895
It's required for sriov standalone yardstick tests.
This part of commit message will be deleted:
This code will be enabled when https://gerrit.opnfv.org/gerrit/#/c/47957/ will be merged,
because it requires host reboot.

Change-Id: I0ec9cbf90a9d83d54e545fcf421b8baf206601a4
Signed-off-by: Jan Malanik <janx.malanik@intel.com>
Signed-off-by: Malanik Jan <janx.malanik@intel.com>

Merge "Clean unit tests in "benchmark.scenarios.lib.test_create_volume.py"

Merge "Move tests: unit/dispatcher"

Merge "Move tests: unit/orchestrator/"

Merge "Replace "oslo_utils.importutils" with standard library "importlib""

Clean unit tests in "benchmark.scenarios.lib.test_create_volume.py

* Use mock_object.assert_called_with instead of
    self.assertTrue(mock_object.called)
* Remove an unneeded if clause in CreateVolume
* Add individual tests for each method in CreateVolume

Change-Id: I54cc56434d316f059b3822879145e6a299866fcb
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Merge "update docs for procedure after host reboot"

Merge "Vincenzo stepping down as Yardstick committer"

Change ansible version to 2.4.2

Modified requirements.txt to update ansible version to 2.4.2

For the ansible virt module [1] XML templates are required.

To edit, the XML templates the XML module is required.
This is new in ansible 2.4 [2]

There is no max version restriction for ansible in OpenStack [3].

[1] http://docs.ansible.com/ansible/latest/virt_module.html
[2] https://docs.ansible.com/ansible/2.4/xml_module.html
[3] https://github.com/openstack/kolla-ansible/blob/stable/pike/doc/source/user/quickstart.rst

JIRA: YARDSTICK-948

Change-Id: I19b178f695f7381a3ecfbdb74f953a1276250958
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Replace "oslo_utils.importutils" with standard library "importlib"

The current implementation of dynamic library importation is prone
to failure [1]:
- "sys.modules" is modified manually, which is something not
  recommended [2].
- When a module is imported is added to "sys.modules"; that means
  there is no need to manually create an entry in this object.
- "importlib" library is part of the standard library and is now
  available in PY3 and PY2 (backported). This library contains a
  function called "import_module" to import a module in runtime.

[1]https://github.com/opnfv/yardstick/blob/d2c7cc4e9768ed003257a95c92cdb278d516761b/yardstick/common/utils.py#L72-L93
[2]http://justus.science/blog/2015/04/19/sys.modules-is-dangerous.html

JIRA: YARDSTICK-949

Change-Id: Ide3b74f98858d06fa275fb6c9b78ceeaa64feed5
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Vincenzo stepping down as Yardstick committer

From: opnfv-tech-discuss-bounces@lists.opnfv.org [mailto:opnfv-tech-discuss-bounces@lists.opnfv.org] On Behalf Of Riccobene, Vincenzo M
Sent: Thursday, January 18, 2018 2:35 AM
To: opnfv-tech-discuss@lists.opnfv.org
Subject: [opnfv-tech-discuss] Stepping down as Yardstick committer

Hello,
I am currently a committer for the OPNFV Yardstick project, but as I see unfortunately in the last months I have been absent from the project since other commitments took higher priorities and all my time, resulting in no major contributions to Yardstick, and I consequently decided to step down from the positon of committer.

It has been a great pleasure to contribute to the community and I hope I will be able to contribute again in the future.
Thank you very much all!

Best Regards.
Vince

Change-Id: I809021b4081caddb60549204a742b93134190a87
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Fix Cirros image name in CI script"

Move tests: unit/orchestrator/

* Fix pylint errors
* Add notes where additional action is needed.

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged for follow-up, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Idbf56d0cd3b29b70691acd6af4d5ac3c400d2ccc

Proposing Emma Foley as a committer in Yardstick

Emma has contributed to Yardstick in many ways
Achievement/Contributions include:
- Provided high-quality code review comments.
- Tox improvements
- Refactored unittest to OpenStack conventions
- Improved unittest code coverage
- Improved code quality by fixing warnings and errors
- Documentation review and update
- Split out test-requirements.txt
- Attending OPNFV Euphrates Plugfest Portland
- Starting Traffic-Generator-as-a-service initiative with NFVBench and VSPerf
- Contributions:
  https://gerrit.opnfv.org/gerrit/#/q/owner:emma.l.foley%2540intel.com

Change-Id: I639fa27a7271bf9996b2ee0e19a689644af54afe
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Proposing Rodolfo Alonso Hernandez as a committer in Yardstick

Rodolfo has contributed to Yardstick in many ways
Achievement/Contributions include:
- Userguide review and update
- Provided high-quality code review comments.
- Improved unittest code coverage
- Improved code quality by fixing warnings and errors
- Jenkins gate check improvements
- Pip requirements checking and updating
- Migration to Shade removing OpenStack project clients.
- Regularly attending Yardstick meetings
- JIRA personal dashboard:
  https://jira.opnfv.org/secure/Dashboard.jspa?selectPageId=11400
- Contributions:
  https://gerrit.opnfv.org/gerrit/#/q/owner:rodolfo.alonso.hernandez%2540intel.com

Change-Id: I3e5f14a3f99fffcd4bd4973aedc44ce4beeb22be
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Proposing Jack Chan as a committer in Yardstick"

Fix Cirros image name in CI script

Fixed the name of Cirros image used in OpenStack. The image name
is written in lowercase letters.

JIRA: YARDSTICK-842

Change-Id: Iff0b494125be61a055da753eaf57903b64f18509
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "bugfix: Fix duplicate 'address' in standlone SRIOV"

bugfix: Fix duplicate 'address' in standlone SRIOV

* Add unit test per Rodolfo's comment

Creating a VM using generted xml file /tmp/vm_sriov_0.xml returns
an XML error: missing source address type.

This fix modifies generted xml from:
<source>
<address>
<address bus="0x1a" domain="0x0000" function="0x0" slot="0x10" type="pci" />
</address>
</source>

to:

<source>
<address bus="0x1a" domain="0x0000" function="0x0" slot="0x10" type="pci" />
</source>

Change-Id: I694153e7468986bacb19ba3e09e761993aad7184
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Emma Foley <emma.l.foley@intel.com>

Merge "bugfix:Incorrect title for testcase 081"

Merge "Update Dockerfile.aarch64.patch"

update docs for procedure after host reboot

Added instructions to restart nginx and uwsgi after the host is rebooted.
Added instructions to start yardstick container if the host is rebooted.
Removed section on virtual python environment as it is not needed.

JIRA: YARDSTICK-919

Change-Id: I6e8bd1d52954c2aa138ce7879211b91b3644ecb2
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>

Proposing Jack Chan as a committer in Yardstick

Jack Chan has contributed to the Yardstick project in many ways
Achievements/Contributions include:
- Kubernetes context
- GUI
- Yardstick API
- Reporting fixes
- Attending OPNFV Summit Beijing
- Regularly attending Yardstick meetings

Change-Id: Ie46a99619365893f3b877822f82f626cf7a36deb
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

bugfix:Incorrect title for testcase 081

JIRA: YARDSTICK-915

fix the wrongly numbered testcase title

Change-Id: I61f94b66e3f9dac655b5c71646524b19bae7307c
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Merge "Testcase 084 documentation"

Do not hide unit tests execution fail

While moving tests from ./tests/ to ./yardstick/tests, both unit tests
directories are executed. If the first test run fails, do not hide
the error and exit immediately.

Change-Id: Ib6c64ccf2f4b19722722eb43b3d45d5ad5f0169d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Use assertIn(x, y) instead of other variations

unittest.assertIn(x,y) should be used instead of:
* unittest.assertTrue(x in y)
* unittest.assertEqual(x in y, True)

Also fixes pep8 violations existing in the file.

Change-Id: I705c1bd4af74757b5c928995894aede436d66817
JIRA: YARDSTICK-901
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Update Dockerfile.aarch64.patch

The docker image was not built for aarch64 due to recent changes in the
Dockerfile. The updates to the Dockerfile.aarch64.patch are:
- update docker version to 16.04
- install dependencies for pyopenssl==17.5.0 (libssl-dev and libffi-dev)

JIRA: ARMBAND-353

Change-Id: I915172d4e7ce21b1f5de044b20301b076cb6fe20
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>

Move tests: unit/dispatcher

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: I1f8a6041424c4c69f46ef30bd5c66d2d51d24347

Move tests: unit/common

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Change-Id: I2847c380556985fae2c92bb8a7da9c47e91e1338
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

pylint: try to change formatting for Jenkins again

looks like we have to add var to tox passenv

Change-Id: Iba2da2123ae531e026897308769aa832c7eb6d04
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Move tests: functional/"

Merge "Move tests: unit/apiserver/"

Move tests: unit/apiserver/

* Fix pylint errors
* Add TODOs

Some errors are ignored locally, as they were a symptom of other problems.
These issues have been flagged with a TODO, and should be fixed later.

JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: I30d3f61e5ea479758f9a2f39cf415da18e49b9d6

Move tests: unit/test_ssh.py

Change-Id: I0eabdd5d7e918dcf0df747119a104dedf125606f
Jira: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Move tests: functional/

All tests in tests/functional have been moved to yardstick/tests/functional

JIRA: YARDSTICK-837
Change-Id: I89276b36635de74dd7b8f70e961c71aa0d2c494e
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

pylint: make Jenkins output parseable

Jenkins doesn't handle the color and the output is hard to read in
Jenkins logs

Change-Id: Ie8fc5a78e89f72c829e4bbbcbd1291a723dfde72
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Run tests in yardstick/tests/"

Run tests in yardstick/tests/

* Edit .testr.conf and tools/run_tests.sh
  * Run functional and unit tests in tests/ and yardstick/tests/
* Add yardstick/tests/unit/__init__.py and yardstick/tests/__init__.py
* Update pylintrc rules to disable:
  * missing-docstring
  * fixme
  * protected-access

Test will run in both tests/ and yardstick/tests/ initially

Change-Id: Iccd0df0d1b85b5d08f7faa56669bc32687925f7e
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Merge "pyOpenSSL missing: cause 'git review' failed"

pyOpenSSL missing: cause 'git review' failed

JIRA: YARDSTICK-905

In the latest Yardstick container, when use git review to upload patches, an Attribute Error will cause failure.

root@a80081a4dccd:/home/opnfv/repos/yardstick# git review
Traceback (most recent call last):
  File "/usr/bin/git-review", line 6, in <module>
    from git_review.cmd import main
  File "/usr/lib/python2.7/dist-packages/git_review/cmd.py", line 32, in <module>
    import requests
  File "/usr/local/lib/python2.7/dist-packages/requests/_init_.py", line 52, in <module>
    from .packages.urllib3.contrib import pyopenssl
  File "/usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/contrib/pyopenssl.py", line 46, in <module>
    import OpenSSL.SSL
  File "/usr/lib/python2.7/dist-packages/OpenSSL/_init_.py", line 8, in <module>
    from OpenSSL import rand, crypto, SSL
  File "/usr/lib/python2.7/dist-packages/OpenSSL/SSL.py", line 118, in <module>
    SSL_ST_INIT = _lib.SSL_ST_INIT
AttributeError: 'module' object has no attribute 'SSL_ST_INIT'

pyOpenSSL is required.

Change-Id: I88a4916c9c2dfcdee45320f6b1a37eaae0803671
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Merge "Bump requirements to match OpenStack Pike release"

Merge "Remove unnecessary function definition in IxLoadTrafficGen"

Testcase 084 documentation

JIRA: YARDSTICK-906

TC084 is to evaluate the IaaS compute performance by using SPEC CPU 2006 benchmark

Change-Id: I628edf1d73e12d9f18eaf9609fa862ca456a1c71
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Merge "Rename test/unit/cmd directory"

Remove unnecessary function definition in IxLoadTrafficGen

Removed call to 'instantiate' base class in IxLoadTrafficGen.

JIRA: YARDSTICK-894

Change-Id: I0ebee1f5e0f22cfd3a67eaac8accc67ecd35ad0c
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "ansible image build improvement"

Merge "delete obsoleted zte pod info"

Merge "SPEC cpu2006 test case for VM"

delete obsoleted zte pod info

Delete zte pod info in yardstick/etc/yardstick/nodes.

Change-Id: Ie22fd9fa4b84529f0b2a7d113776d3559106e67a
Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>

Remove tool provisioning in PROX helper

Tool provisioning in PROX setup environment helper is not needed [1]. The
tool (PROX traffic injector) is already provided during the VNF building:
  ./ansible/nsb_setup.yml -->
  ./ansible/build_yardstick_image.yml -->
  ./ansible/ubuntu_server_cloudimg_modify_samplevnfs.yml -->
  ./ansible/roles/install_samplevnf

[1]https://github.com/opnfv/yardstick/blob/master/yardstick/network_services/vnf_generic/vnf/prox_helpers.py#L641

JIRA: YARDSTICK-872

Change-Id: I0f925a7967a35a97901fbe5053793a791a7b1b01
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Make GenericVNF an abstract class

GenericVNF class is now an abstract class. Only optional methods are
implemented. Mandatory methods:
  - instantiate
  - wait_for_instantiate
  - terminate
  - scale
  - collect_kpi.

JIRA: YARDSTICK-866

Change-Id: Ia8766f9f98816e11894d1e72b0f3bd573d091d99
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Remove 'inconsistent-return-statements' check from Pylint

There are several bugs in Pylint [1] [2] affecting
'inconsistent-return-statements' check. It will be temporarily
removed.

[1] https://github.com/PyCQA/pylint/issues/1782
[2] https://github.com/PyCQA/pylint/issues/1794

JIRA: YARDSTICK-911

Change-Id: Ib655ef1befdc734c646cdfb9b48f1db0ccdf676d
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Fix inventory.ini for build_yardstick_image"

Merge "Adding vFW RFC2544 and ixload test cases with various packet sizes"

ansible image build improvement

JIRA: YARDSTICK-879

Add some image build vars
Add automatic image build of nsb
yardstick_image: ansible-playbook -e img_property="normal" -vvv -i inventory.ini build_yardstick_image.yml

nsb_image_build: ansible-playbook -e img_property="nsb" -vvv -i inventory.ini build_yardstick_image.yml

prepare for yardstick image uploading

Change-Id: I9fdf30084511ca9a008df3b53887b06273bbd549
Signed-off-by: Ace Lee <liyin11@huawei.com>

SPEC cpu2006 test case for VM

JIRA: YARDSTICK-906

This test case is for benchmarking VM(VNF) compute performance using SPEC CPU2006.

Change-Id: Ida87aa4d394e38b398acb0af3176dd1b4c858c35
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Fix inventory.ini for build_yardstick_image

In [1], 'no hosts matched' occured because 'jumphost' was not defined
in inventory.ini.

[1]: https://build.opnfv.org/ci/job/yardstick-daisy-baremetal-daily-master/72/console

Change-Id: I8cb36bf083ce589e94f5f8b115e99556f0bcb053
Signed-off-by: Alex Yang <yangyang1@zte.com.cn>

Add get function in ssh.py

JIRA: YARDSTICK-904

This task is about to implement a get function in ssh.py to
fetch desired files/folder in a remote VM to a local path.

In some test cases, test tools will produce results in files.
We want retain the original result files and archive them in
Yardstick docker for future usage.

Change-Id: Ifd333eb044ce31cffa6f5b2a8f6a46648a8858d1
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Merge "Replace subprocess "check_output" with "Popen""

Merge changes from topics 'YARDSTICK-875', 'YARDSTICK-874'

* changes:
  Check if multiverse repository is available in Ubuntu
  Specify supported architectures for Ubuntu backports repository

Merge "Bugfix in role enable_hugepages_on_boot"

Replace subprocess "check_output" with "Popen"

"check_output" is a blocking wrapper for "Popen" which returns the output
of the command execution or raises an exception in case of error.

"Popen" is a non-blocking function that allows to create asynchronous
tasks. It returns any possible execution error but doesn't raise an
exception; this is delegated to the developer.

This code is used in the Yardstick CLI base test class.

Change-Id: Ie3e1228b2d40cb306354447653678bf581bc9697
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Bugfix:proxy env, ansible multinode support"

Merge "Remove "flake8" and "pep8" from test-requirements"

Merge "Variable local_iface_name is read before it is set"

Check if multiverse repository is available in Ubuntu

In Ubuntu, multiverse repository is needed to install the image
dependencies [1]. If this repository is not enabled, it should be
added as part of the role "add_custom_repos".

[1] https://github.com/opnfv/yardstick/tree/master/ansible/roles/install_image_dependencies

JIRA: YARDSTICK-875

Change-Id: Ie37ebf87bf245185447f2b675568af9bd38219c0
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Specify supported architectures for Ubuntu backports repository

Currently Trusty (Ubuntu 14.04 LTS) and Xenial (Ubuntu 16.04 LTS) doesn't
have support for arch=ARM64 in backports repository:
- http://archive.ubuntu.com/ubuntu/dists/xenial-backports/
- http://archive.ubuntu.com/ubuntu/dists/trusty-backports/

During the Yardstick image building process, the repository is added to the
APT repository list. In order to avoid errors during the repository retrival,
the available architectures must be specified [1].

[1]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/roles/add_custom_repos/templates/sources.list.j2#L4

JIRA: YARDSTICK-874

Change-Id: I7774189fbdd7d74ff5df29526ba0da2693b3b53a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Bugfix in role enable_hugepages_on_boot

Make role idempotent.
Current regex doesn't match for:
linux   /boot/vmlinuz-4.10.0-30-generic root=/dev/nvme0n1p1 ro vga=788 text

Change-Id: If5eb20fce4ddc35bb109c00eb7565853b3763950
Signed-off-by: Jan Malanik <janx.malanik@intel.com>
Signed-off-by: Malanik Jan <janx.malanik@intel.com>

Merge "Fix the pylint version for pep8 tox target"

Add doc about installing YardStick on OpenSUSE

Add guide to install YardStick on OpenSUSE and modify the README
to state that OpenSUSE is supported.

Change-Id: Id107b24e0ec1ab441426bb150d9e863986d20fc1
Signed-off-by: Rossella Sblendido <rsblendido@suse.com>

Bump requirements to match OpenStack Pike release

Bumped requirements to match OpenStack Pike release
requirements [1].

[1] https://github.com/openstack/requirements/tree/stable/pike

JIRA: YARDSTICK-889

Change-Id: I18ccdc01c14693cb63bd74d29c14554f610629e3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Rename test/unit/cmd directory

Renamed test/unit/cmd directory to test/unit/test_cmd, in order to
avoid importing errors during the execution of unit tests. This directory
name collides with Python "cmd" library.

Change-Id: Ie06d58d4faace33df684c8e511a398aa0667b098
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Fix the pylint version for pep8 tox target

Change-Id: I5e1c169a6ca13b3f46129b2c4a15ccbab2677a63
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>

Variable local_iface_name is read before it is set

Moving variable setting before reading
Verified via TC:
yardstick/samples/vnf_samples/nsut/ping/tc_ping_heat_context.yaml

JIRA: YARDSTICK-899

Change-Id: Ia2feac1ed4e67dccd02446ba27afc9d40e87be35
Signed-off-by: Jiri Prokes <jirix.x.prokes@intel.com>

Merge "pretty cli format: runner/scenario/testcase list"

update release notes for Euphrates 5.1.0

Change-Id: I11b248882dd314baebd3ab4e7e676a1f3e0b50cd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Addition of NSB Prox test documentation of vPE and LW-AFTR test cases"

bugfix: tc078 have no data stored or dashboard to show results

JIRA: YARDSTICK-867

1.print result in the log, showing the txt format result

Change-Id: I6deeb4cf44895ef7a6c6d231c77b3843eec285d7
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Merge "bugfix: tc078 fails in some situations"

Merge "bugfix: kill process do not accurately kill "nova-api""

samples: Add generic L3 forwarder tests

A generic throughput test case that can be used as a
stub code for a Linux-based VNF configured as an L3 forwarder.

Supported context:
* Standalone OVSDPDK and SRIOV
* Baremetal

Code changes:
* Allow pmd-cpu-mask and lcore mask for OVS DPDK
* router_vnf.py - configures interface IP addresses and static arp entries
  using ip command
* NFVi KPIs
* Allow cputune tag for standalone context to be able to PIN on NUMA 1 cpus

SRIOV Test cases:
* RFC2544 Ethernet framesizes, 128K Flows
* 2,4 and 6 ports
* 2 and 3 vcpus per port
*
OVSDPDK Test cases:
* RFC2544 Ethernet framesizes, 128K Flows
* 2 and 4 ports
* 2 vcpus per port
* 2 PMD threads per port

TODO:
* Documentation
* Add 6 ports tests

References:
* router_vnf.py is based on sample_vnf.py
* tc_*.yaml files are based on acl/vfw test case files

Added unitests
Added get_stats to parse ip -s link

Change-Id: Id1b969d5420dfcab7c1e695acbd2cd1655747efe
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Signed-off-by: Kavindya Deegala <kavindya.s.deegala@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Emma Foley <emma.l.foley@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

'libvirt' guest console in Standalone model

Add support for 'libvirt' guest console in Standalone model.

Change-Id: I660e641339658d8abe4f040bec96e9d0041402c6
Signed-off-by: Jan Malanik <janx.malanik@intel.com>

pretty cli format: runner/scenario/testcase list

JIRA: YARDSTICK-855

1. using prettytable to reformat cli below:
yardstick runner list
yardstick scenario list
yardstick testcase list
2. remove redundant function print_hbar
3. fix pep8 problems, the framework using do_list dynamicly,
so disable unused-argument check for now.

Change-Id: I79e1226e21fca4624bf4436414917bd07ecabca0
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

NSB: Fix standalone.model.Libvirt SR-IOV modeling

Fixed standalone.model.Libvirt SR-IOV XML interface modeling, acording
to [1]:
- All PCI attributes now are printed in hexadecimal format.
- The PCI address is now added in the correct section, 'interface'.

network_services.utils.PciAddress was refactored to accept both 'domain:
bus:slot:function' and 'bus:slot:function' format inputs. This class is
used as input in the previous class, Libvirt, to print in XML the PCI
address of a SR-IOV interface.

network_services.utils.PciAddress.parse_address is now deprecated. Instead
the class standard instantiation must be used:

    libvirt_obj = utils.PciAddress(text_with_address)

A deprecation decorator is implemented along with this patch. This
decorator is used for the first time in the previously mentioned function.
This decorator stores every decorated function name and deprecation message
and raises a logging warning message the first time this function is used.

[1] https://goo.gl/so2Mrp

Change-Id: I22e95c488e27d6e2a8fdf6c1a07faab275fa6bba
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

bugfix: kill process do not accurately kill "nova-api"

JIRA: YARDSTICK-849

1. update the kill process RegEx pattern to be more accurate
2. make attack_process to be parameter so it can be customized if
the SUT is using a different name of attack_process

Change-Id: I569730ced6c24aafbffcf2fc5752d3560d0adac5
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Bugfix:proxy env, ansible multinode support

JIRA: YARDSTICK-893

- hosts and plays in ansible/nsb_setup.yml refactored
Fixed proxy configuration from env or /etc/environment in nsb_setup.sh
Fixed ansible parameter 'environment: "{{ proxy_env }}"' in:
 - roles for components download.
 - roles for components dependencies install.

Now, you can use ansible to modify all yardstick-standalone hosts at once.
1) Configure http[s]_proxy in
- /etc/environment
or
- env variables
2) Modify ansible/yardstick-install-inventory.ini:
  [jumphost]
  localhost  ansible_connection=local

  [yardstick-standalone]
  yardstick-standalone-node ansible_host=192.168.1.2
  yardstick-standalone-node-2 ansible_host=192.168.1.3

  [all:vars]
  ansible_user=root
  ansible_pass=root

3) start:
./nsb_setup.sh # for baremetal/sriov
./nsb_setup.sh <path to admin-openrc.sh> #for openstack heat

Change-Id: I167db8bae8303210f21e8ae6f3870ef054bbedce
Signed-off-by: Malanik Jan <janx.malanik@intel.com>

Merge "bugfix: tc006, tc079, tc082 miss grafana dashboard in local deployment"

Merge "Refactor userguide "Yardstick Installation""

Change testcases 'cirros' image to 'yardstick-image'

The default OpenStack 'cirros-0.3.5' image doesn't exist anymore. The
image included by default in any testing OpenStack deployment is now
called 'cirros-0.3.5-x86_64-disk', but this name can change.

Because Yardstick, during the installation, deploys a customized image,
'yardstick-image', it makes sense to use it as the default image.

JIRA: YARDSTICK-873

Change-Id: I8fd7cbc01d4fa52e9107f2fac7d2d9ff5d1091c7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Ansible: fix lowercasing issue with ConfigParser"