Replace subprocess "check_output" with "Popen"

"check_output" is a blocking wrapper for "Popen" which returns the output
of the command execution or raises an exception in case of error.

"Popen" is a non-blocking function that allows to create asynchronous
tasks. It returns any possible execution error but doesn't raise an
exception; this is delegated to the developer.

This code is used in the Yardstick CLI base test class.

Change-Id: Ie3e1228b2d40cb306354447653678bf581bc9697
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Bugfix:proxy env, ansible multinode support"

Merge "Remove "flake8" and "pep8" from test-requirements"

Merge "Variable local_iface_name is read before it is set"

Check if multiverse repository is available in Ubuntu

In Ubuntu, multiverse repository is needed to install the image
dependencies [1]. If this repository is not enabled, it should be
added as part of the role "add_custom_repos".

[1] https://github.com/opnfv/yardstick/tree/master/ansible/roles/install_image_dependencies

JIRA: YARDSTICK-875

Change-Id: Ie37ebf87bf245185447f2b675568af9bd38219c0
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Specify supported architectures for Ubuntu backports repository

Currently Trusty (Ubuntu 14.04 LTS) and Xenial (Ubuntu 16.04 LTS) doesn't
have support for arch=ARM64 in backports repository:
- http://archive.ubuntu.com/ubuntu/dists/xenial-backports/
- http://archive.ubuntu.com/ubuntu/dists/trusty-backports/

During the Yardstick image building process, the repository is added to the
APT repository list. In order to avoid errors during the repository retrival,
the available architectures must be specified [1].

[1]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/roles/add_custom_repos/templates/sources.list.j2#L4

JIRA: YARDSTICK-874

Change-Id: I7774189fbdd7d74ff5df29526ba0da2693b3b53a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Bugfix in role enable_hugepages_on_boot

Make role idempotent.
Current regex doesn't match for:
linux   /boot/vmlinuz-4.10.0-30-generic root=/dev/nvme0n1p1 ro vga=788 text

Change-Id: If5eb20fce4ddc35bb109c00eb7565853b3763950
Signed-off-by: Jan Malanik <janx.malanik@intel.com>
Signed-off-by: Malanik Jan <janx.malanik@intel.com>

Merge "Fix the pylint version for pep8 tox target"

Add doc about installing YardStick on OpenSUSE

Add guide to install YardStick on OpenSUSE and modify the README
to state that OpenSUSE is supported.

Change-Id: Id107b24e0ec1ab441426bb150d9e863986d20fc1
Signed-off-by: Rossella Sblendido <rsblendido@suse.com>

Bump requirements to match OpenStack Pike release

Bumped requirements to match OpenStack Pike release
requirements [1].

[1] https://github.com/openstack/requirements/tree/stable/pike

JIRA: YARDSTICK-889

Change-Id: I18ccdc01c14693cb63bd74d29c14554f610629e3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Rename test/unit/cmd directory

Renamed test/unit/cmd directory to test/unit/test_cmd, in order to
avoid importing errors during the execution of unit tests. This directory
name collides with Python "cmd" library.

Change-Id: Ie06d58d4faace33df684c8e511a398aa0667b098
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Fix the pylint version for pep8 tox target

Change-Id: I5e1c169a6ca13b3f46129b2c4a15ccbab2677a63
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>

Variable local_iface_name is read before it is set

Moving variable setting before reading
Verified via TC:
yardstick/samples/vnf_samples/nsut/ping/tc_ping_heat_context.yaml

JIRA: YARDSTICK-899

Change-Id: Ia2feac1ed4e67dccd02446ba27afc9d40e87be35
Signed-off-by: Jiri Prokes <jirix.x.prokes@intel.com>

Merge "pretty cli format: runner/scenario/testcase list"

update release notes for Euphrates 5.1.0

Change-Id: I11b248882dd314baebd3ab4e7e676a1f3e0b50cd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "Addition of NSB Prox test documentation of vPE and LW-AFTR test cases"

bugfix: tc078 have no data stored or dashboard to show results

JIRA: YARDSTICK-867

1.print result in the log, showing the txt format result

Change-Id: I6deeb4cf44895ef7a6c6d231c77b3843eec285d7
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Merge "bugfix: tc078 fails in some situations"

Merge "bugfix: kill process do not accurately kill "nova-api""

samples: Add generic L3 forwarder tests

A generic throughput test case that can be used as a
stub code for a Linux-based VNF configured as an L3 forwarder.

Supported context:
* Standalone OVSDPDK and SRIOV
* Baremetal

Code changes:
* Allow pmd-cpu-mask and lcore mask for OVS DPDK
* router_vnf.py - configures interface IP addresses and static arp entries
  using ip command
* NFVi KPIs
* Allow cputune tag for standalone context to be able to PIN on NUMA 1 cpus

SRIOV Test cases:
* RFC2544 Ethernet framesizes, 128K Flows
* 2,4 and 6 ports
* 2 and 3 vcpus per port
*
OVSDPDK Test cases:
* RFC2544 Ethernet framesizes, 128K Flows
* 2 and 4 ports
* 2 vcpus per port
* 2 PMD threads per port

TODO:
* Documentation
* Add 6 ports tests

References:
* router_vnf.py is based on sample_vnf.py
* tc_*.yaml files are based on acl/vfw test case files

Added unitests
Added get_stats to parse ip -s link

Change-Id: Id1b969d5420dfcab7c1e695acbd2cd1655747efe
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Signed-off-by: Kavindya Deegala <kavindya.s.deegala@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Emma Foley <emma.l.foley@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

'libvirt' guest console in Standalone model

Add support for 'libvirt' guest console in Standalone model.

Change-Id: I660e641339658d8abe4f040bec96e9d0041402c6
Signed-off-by: Jan Malanik <janx.malanik@intel.com>

pretty cli format: runner/scenario/testcase list

JIRA: YARDSTICK-855

1. using prettytable to reformat cli below:
yardstick runner list
yardstick scenario list
yardstick testcase list
2. remove redundant function print_hbar
3. fix pep8 problems, the framework using do_list dynamicly,
so disable unused-argument check for now.

Change-Id: I79e1226e21fca4624bf4436414917bd07ecabca0
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

NSB: Fix standalone.model.Libvirt SR-IOV modeling

Fixed standalone.model.Libvirt SR-IOV XML interface modeling, acording
to [1]:
- All PCI attributes now are printed in hexadecimal format.
- The PCI address is now added in the correct section, 'interface'.

network_services.utils.PciAddress was refactored to accept both 'domain:
bus:slot:function' and 'bus:slot:function' format inputs. This class is
used as input in the previous class, Libvirt, to print in XML the PCI
address of a SR-IOV interface.

network_services.utils.PciAddress.parse_address is now deprecated. Instead
the class standard instantiation must be used:

    libvirt_obj = utils.PciAddress(text_with_address)

A deprecation decorator is implemented along with this patch. This
decorator is used for the first time in the previously mentioned function.
This decorator stores every decorated function name and deprecation message
and raises a logging warning message the first time this function is used.

[1] https://goo.gl/so2Mrp

Change-Id: I22e95c488e27d6e2a8fdf6c1a07faab275fa6bba
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

bugfix: kill process do not accurately kill "nova-api"

JIRA: YARDSTICK-849

1. update the kill process RegEx pattern to be more accurate
2. make attack_process to be parameter so it can be customized if
the SUT is using a different name of attack_process

Change-Id: I569730ced6c24aafbffcf2fc5752d3560d0adac5
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Bugfix:proxy env, ansible multinode support

JIRA: YARDSTICK-893

- hosts and plays in ansible/nsb_setup.yml refactored
Fixed proxy configuration from env or /etc/environment in nsb_setup.sh
Fixed ansible parameter 'environment: "{{ proxy_env }}"' in:
 - roles for components download.
 - roles for components dependencies install.

Now, you can use ansible to modify all yardstick-standalone hosts at once.
1) Configure http[s]_proxy in
- /etc/environment
or
- env variables
2) Modify ansible/yardstick-install-inventory.ini:
  [jumphost]
  localhost  ansible_connection=local

  [yardstick-standalone]
  yardstick-standalone-node ansible_host=192.168.1.2
  yardstick-standalone-node-2 ansible_host=192.168.1.3

  [all:vars]
  ansible_user=root
  ansible_pass=root

3) start:
./nsb_setup.sh # for baremetal/sriov
./nsb_setup.sh <path to admin-openrc.sh> #for openstack heat

Change-Id: I167db8bae8303210f21e8ae6f3870ef054bbedce
Signed-off-by: Malanik Jan <janx.malanik@intel.com>

Merge "bugfix: tc006, tc079, tc082 miss grafana dashboard in local deployment"

Merge "Refactor userguide "Yardstick Installation""

Change testcases 'cirros' image to 'yardstick-image'

The default OpenStack 'cirros-0.3.5' image doesn't exist anymore. The
image included by default in any testing OpenStack deployment is now
called 'cirros-0.3.5-x86_64-disk', but this name can change.

Because Yardstick, during the installation, deploys a customized image,
'yardstick-image', it makes sense to use it as the default image.

JIRA: YARDSTICK-873

Change-Id: I8fd7cbc01d4fa52e9107f2fac7d2d9ff5d1091c7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Ansible: fix lowercasing issue with ConfigParser"

Remove "flake8" and "pep8" from test-requirements

Removed "flake8" and "pep8" from test-requirements. Since
44070670c798d2cde2824f3150b2b11bf35c6319, "pylint" is the
code style checker, instead of "flake8" or "pep8".

JIRA: YARDSTICK-832

Change-Id: Iee598b0b1793d71dc74be36fa1875387b17d1e25
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

bugfix: tc078 fails in some situations

1. make  "SPECint_benchmark, runspec_iterations, runspec_tune, runspec_size,
runspec_rate" parameterized and change the default value "int^429" to "int"
2. remove "become: true" in some roles since it does not need root privilege

JIRA: YARDSTICK-852

Change-Id: Icb384bddc12911e2681a981d0504e0e142d1a8ec
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Merge "NSB: Fix IndexError in pin_vcpu_for_perf"

Avoid pylint warning for "protected-access"

This warning should be disabled in order to access protected
methods during testing. Any access to protected methods done
outside the testing classes, must be catched during the reviewing
process.

Change-Id: I2127b41edf704d0cb4f68b33d98705039e058d1a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Avoid pylint warning for "missing-docstring"

Disabled pylint message for missing doctring in methods, classes and
modules. Modules must be auto-explanatory, and some methods are trivial
an doesn't need an explanation.

Change-Id: I01d80737d92a7345bc6a2a6f607eb35cbf28da67
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports"

Adding vFirewall HTTP Traffic Profiles.

Modified http_locator location for 64K, 256K, 512K and 1024K
concurrency files.

The traffic profiles include various http locator image sizes i.e
4K,64K,256K,512K and 1024K

The traffic schema is changed to "nsb" from "isb" for all the
traffic profiles

Change-Id: I012da8daaa880ca80db2d3b08cebd9a73c19cd47
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 

heat: allow overriding Heat/Neutron private IP for DPDK tests

For some L2/L3 DPDK testcases we need to use a custom
IP address space different from what Heat provides.

These testcases require port_security_enabled = False so
Neutron should allow for unrestricted L2 traffic.

This will work because we bind the ports to DPDK and thus
don't need DHCP.

  vnf_0:
    floating_ip: true
    placement: "pgrp1"
    network_ports:
      mgmt:
        - mgmt
      uplink_0:
        - xe0:
            local_ip: 10.44.0.20
            netmask: 255.255.255.0
      downlink_0:
        - xe1:
            local_ip: 10.44.0.30
            netmask: 255.255.255.0

Also fixup flake8 errors in unittests

Change-Id: Id29dfffa692f16fb1f526d208db43e476e2f7830
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Adding vFW RFC2544 and ixload test cases with various packet sizes

Changed private to uplink and public to downlink

Change-Id: Id9273d9489f58bd45b60a00fc9e5bcbe9e136c84
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 

Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports

Change-Id: I3c7f047dc6d1545093aed6f64ccaed9f90d85af3
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 

Adding new vFirewall Test cases based on Concurrency, Connections per second, Throughput and
Transactions per second for various http locator image sizes including 1b, 4k, 64k, 256k, 1024k

Change-Id: I253d1fa20a0324bc9efeaa4da1a24560e644734c
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 

Merge "bugfix: tc023 miss description and tc050-58 wrong description"

Merge "KVMFORNFV: Reverting LiveMigration changes"

KVMFORNFV: Reverting LiveMigration changes

This patch consists of reverting the changes of patch 45227 and
incudes redirecting the console output of the LiveMigration
execution to /dev/null as the stdout contains only the statistics,
i.e., totaltime, downtime and setuptime.

This reverts commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65.

Change-Id: I252b5a4045657cfa8362e9aae755249480cd3b77
Signed-off-by: Navya <navyax.bathula@intel.com>

Merge "Remove img_modify_playbook assignation in build_yardstick_image.yml"

Merge "Move test requirements into test-requirements.txt"

Merge "Move test scripts to tools/"

Merge "tox: Split tests into separate tox environments"

Merge "Tox: add a pep8 target"

Remove img_modify_playbook assignation in build_yardstick_image.yml

Variable "img_modify_playbook" is being assigned in first context of
./ansible/build_yardstick_image.yml [1]. However this variable is never used.
In second context [2], the variable used is a CLI input variable.

[1]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/build_yardstick_image.yml#L187
[2]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/build_yardstick_image.yml#L205

JIRA: YARDSTICK-871

Change-Id: I7bd5063c5e86520abcafdc782222ee53faf58f45
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Addition of NSB Prox test documentation of vPE and LW-AFTR test cases

YARDSTICK-840

NSB Prox test documentation of vPE and LW-AFTR test cases documenation.

Change-Id: Ic6da6546faf0494fdee71962a515083e6e10a410
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

fix docker client don't have trex_client

JIRA: YARDSTICK-854

Add trex_client in docker,
so we could run NSB testcase in docker container.

Change-Id: Iac1393d6e3a175137973190936ab69a1f2ce8272
Signed-off-by: Ace Lee <liyin11@huawei.com>

Merge "update docker version to 16.04"

NSB: Fix IndexError in pin_vcpu_for_perf

This addresses the IndexError in Standalone SRIOV/OVSDPDK context.
The correct sys_cpu number should be sys_cpu-1

Error:
    threads = "%s-%s" % (soc_cpu[socket][sys_cpu], soc_cpu[socket][-1])
IndexError: list index out of range

Tested platform: (Hyper-Threading disabled)
NUMA node0 CPU(s):     0-21
NUMA node1 CPU(s):     22-43

With socket equal to 0, sys_cpu value was 22 which resulted to IndexError.

Change-Id: I36b045cacce4caff4b5ddafaa9b6737f1c6df0a1
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>

bugfix: tc023 miss description and tc050-58 wrong description

also modify tc019,025,045-49 descrition to be unified

JIRA: YARDSTICK-850

Change-Id: I3f775f1ebff4063edc53b9bc26d7ba10b8af8a9d
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

Move test requirements into test-requirements.txt

Move the packages required for testing into test-requirements.txt
This follows conventions used in OpenStack projects.

JIRA: YARDSTICK-837
Change-Id: If08fc416aa21b11250066bc19a54daa35e863407
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Move test scripts to tools/

Move the scripts that tox uses for running tests
to the tools/ directory:
* run_tests.sh -> tools/run_tests.sh
* tests/ci/cover.{sh,awk} -> tools/

JIRA: YARDSTICK-837
Change-Id: I817c9e5f58c06b45f1de3f369318f4bb24168677
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

tox: Split tests into separate tox environments

* Add argument parsing to run_tests.sh so tests can be selected
* Define tox environments for:
  * Coverage
  * Unit tests
  * Functional tests
    * for py27 and py3
* Add environments to default env
  * Behaviour is the same when the tests are run
* Updates the py27 environment config, and adds a py3 config.
  * Commands from testenv are moved to py27
  * py3 env uses the same commands, but runs with python3

Change-Id: I22f17c0103101f01ec268b1de9d146780ae67a6d
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Tox: add a pep8 target

Adds a pep8, pep8-full targets to tox:
* pep8 target: runs pylint on the changed files
* pep8-full target: runs pylint on whole repo

Adds scripts to run pylint:
* stored in tools/

Documentation: changeed the command for running tests
(run_tests.sh -> tox). This runs the same set of tests as before.

JIRA: YARDSTICK-832

Change-Id: I652da87723682d958f3fcbc2eb4cd88422636a3b
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Merge "Dockerfile: apt-get clean to save layer space"

Make GenericTrafficGen class abstract

GenericTrafficGen class is now an abstract class. Only optional methods
are implemented.
  - 'run_traffic' and 'terminate' are mandatory.
  - 'listen_traffic', 'verify_traffic' and 'wait_for_instance' are
    optional. By default these methods doesn't execute any action.

JIRA: YARDSTICK-853

Change-Id: I2befdaa337af79cc2364bdd7c66183c31c5ab69a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Add vfw ixload testcase for heat"

Merge "NSB: update vfw tc_heat_external tests"

Merge "Check requirements against OpenStack requirements"

Merge "NSB Prox BM test case fixes for scale up"

Merge "Fix controller IP parsing in "nsb_setup.sh" script"

Merge "Clean functional tests in "test_cli_scenario""

Merge "Create get_description and get_scenario_type for Scenario"

Fix controller IP parsing in "nsb_setup.sh" script

Fixed the controller IP parsing in "nsb_setup.sh" script. The new
regex expression now accepts "OS_AUTH_URL" as:
  * http://10.237.223.168/identity
  * http://10.237.223.168:5000/identity
  * http://hostname/identity
  * http://hostname:5000/identity

JIRA: YARDSTICK-829

Change-Id: Ifaeab991bcbb6aa7b22c3533ab7554527184878b
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

bugfix: tc006, tc079, tc082 miss grafana dashboard in local deployment

JIRA: YARDSTICK-847

Change-Id: I0750f2d17bac9e0214caf640e4ea1141ea3b4a03
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

update docker version to 16.04

JIRA: YARDSTICK-690

This patch is for Yardstick Docker base image upgrade to 16.04

This patch will enable ansible build image in yardstick env prepare.

Add qemu-img convert to ansible build image.

Change-Id: I43127b6020bd20bd9f4aac4fca0df75353b24346
Signed-off-by: Ace Lee <liyin11@huawei.com>

NSB "Prox" : Cleanup duplicated traffic profile

JIRA: YARDSTICK-848

The NSB PROX MPLS test uses Binsearch traffic
profile and the mpls traffic profile is a duplicate.

Change-Id: Ie2124cebf306fd6917b70ecd7c23ae12ef4850dc
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>

NSB TRex: convert DPDK port number to logical TRex port number

when we create TRex config we sort based on PCI bus address
and create a logical port ordering.

We need to save this port ordering and re-use it everywhere.

redirect vnfd_helper.port_num() to resource_helper.port_num() to
use the logical mapping

Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

NSB Prox BM test case fixes for scale up

YARDSTICK-839

In a scale-up test the VNF number can start from
0 to MAX (num_vnf-1)

The NSB PROX BM test nodes are currently marked as:
    tg__0: trafficgen_1.yardstick
    vnf__0: vnf.yardstick
They need to be changed to the below:
    tg__0: tg_0.yardstick
    vnf__0: vnf_0.yardstick

Changes done are:
- All BM Prox test cases have tg_0 and vnf_0 as default
  test nodes
- The prox-baremetal-1/2/4.yaml sample pod file
- Cleaned Up some unused Prox test/config files

Change-Id: I819011bcb35eda62b17dd3e1035918918c582b13
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>

Refactor userguide "Yardstick Installation"

[1] must be refactored in order to:
  * Include proxy options.
  * Use OpenStack client, instead of project CLI.
  * Use sudo in some commands.
  * Adapt the document to rst coding style.
  * Fix minor errors.

JIRA: YARDSTICK-828

[1] https://github.com/opnfv/yardstick/blob/923aa1738cbf5a8053e77e00937fc26f2142f6a3/docs/testing/user/userguide/04-installation.rst

Change-Id: Ice63f344a8a87221bdf4daa6153b9ccac321e5b7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Merge "Remove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats"

Merge "tc053 kill haproxy wrong mismatch"

Merge "Heat: add availability_zone"

Merge "Update links to documentation in README.rst"

Merge "NSB: fix vpe_config license"

Merge "pmu: remove event_download_local workaround script"

NSB: fix vpe_config license

Use Apache 2.0

Change-Id: I199d09f04a5c84a25bd91dceba5e4ed1f93075f6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Check requirements against OpenStack requirements

Added a new tox environment to check the project requirements against
the OpenStack requirements. The openstack/requirements branch used will
depends on Yardstick release development.

At this point, Yardstick F release must be compliant with OpenStack Pike
release.

Change-Id: I77a4cfa4f99674176c3f5711dc1b6787bb400ecf
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Addition of IPv6 icpm, udp and tcp to Neutron Security Group

When creating a Neutron security group for a heat template. Add
IPv6 security group rules to access the resouces.

Change-Id: I0b541dfe400121e35908a70778665ee1576f0622
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

Merge "NSB Prox LW_AFTR Test"

Remove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats

* Remove the method which is unused and is marked as deprecated.

Change-Id: Ie64084fcd26985283c664445b173a757d3d908ab
JIRA: YARDSTICK-838
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

pmu: remove event_download_local workaround script

intel_pmu needs to download a config file based on the
CPU model.  When generating VNF images we don't have
access to the actual vCPU that will be used, so we
can't predownload.  This code was meant to be a fix
for that by downloading all the configs and then
selecting one that matched the vCPU.

However we have license issues with intel_pmu enven GPLv2 code,
so remove it for now.

Change-Id: I5257ff7c4ddc1d40537dadb29efa40d1d68cb852
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Fixed incorrect Copyright Notice

Changed Copyright notice on tuples.lua from "Intel Copyright" to Apache 2.0

Change-Id: I85e6f9eb86c116d552f86cddf05b3b368b32f776
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

Clean functional tests in "test_cli_scenario"

Changed how "test_cli_scenario" tests check the presence
of a string.

Fixed "test_scenario_show_Lmbench": logic in [1] was incorrectly
assigning an string value instead of the result of the "in"
clause.

[1] https://github.com/opnfv/yardstick/blob/stable/euphrates/tests/functional/test_cli_scenario.py#L35-L36

Change-Id: I71fceabad972e4c0d9e78cbfeb85dcd6a5ae4bda
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

Create get_description and get_scenario_type for Scenario

Created two new class functions for Scenario class:

* "get_description" will return the first line of the docstring,
  if exists.
* "get_scenario_type" will return the value of "__scenario_type__"
  variable.

Change-Id: I8e3b47e33e0bae101b874c3975bb9c383397d188
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>

NSB Prox LW_AFTR Test

JIRA: YARDSTICK-802

Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py
- This support BM and Openstack Heat
- This supports 4 Ports ONLY
- Grafana Dashboards included
- Code Coverage / Unit testing

Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7
Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>

Ansible: fix lowercasing issue with ConfigParser

by default ConfigParser will lowercase everything,
unless you override optionxform.

also sort key value in inventory line for consistency

https://docs.python.org/3/library/configparser.html#configparser.ConfigParser.optionxform

Transforms the option name option as found in an input file or as passed in by
client code to the form that should be used in the internal structures. The
default implementation returns a lower-case version of option; subclasses may
override this or client code can set an attribute of this name on instances to
affect this behavior.

You don’t need to subclass the parser to use this method, you can also set it
on an instance, to a function that takes a string argument and returns a
string. Setting it to str, for example, would make option names case sensitive:

cfgparser = ConfigParser()
cfgparser.optionxform = str

Note that when reading configuration files, whitespace around the option names
is stripped before optionxform() is called.

YARDSTICK-833

Change-Id: Ia1810b0c77922d84e11c9e538540b38816338593
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

test_sample_vnf: mock time

Change-Id: Id8aa734fee431d90cbdc1e0eb2173784ada822fe
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Update links to documentation in README.rst

The links to the docs in README were pointing to Colorodo documentation.

For master, this should not be pinned to a particular release, but
should show the most recent docs at all times.

Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>

Heat: add availability_zone

Users would like to ensure placement of VMs on specific compute nodes so
that the measurements are meaningful. Examples: Measure network
performance in different scenarios (VMs in same host, in different
hosts, across fabric, across tenants)

Example:

context:
  name: yardstick
  placement_groups:
    pgrp1:
      policy: "availability"
  servers:
    tg_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone2"
    vnf_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone1"

Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

NSB: remove validate_cpu_cfg and all app cpu methods

We don't really know what core we are going to use for the
VNF before we generate the MultiPortConfig, so these
methods are incorrect.

We may need some more advanced method to validate
the vCPU topology, but that will probably happen
in the MultiPortConfig

Change-Id: Ifee7ae4589ce0fce67771fb8d8b8dce0a0f06409
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "resource: remove cores args"

ixia: add 1024 and 1280 byte packet size to Ixia ipv4 traffic profile

This brings it to parity with its non-Ixia counterpart (ipv4_throughput.yaml).

Change-Id: I4c91d1ae507c7b5e0a23dcf49606b16891b400bd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

tc053 kill haproxy wrong mismatch

JIRA: YARDSTICK-831

Change-Id: I587c486572f439952b8a31da664d1e2c1fb8dc27
Signed-off-by: rexlee8776 <limingjiang@huawei.com>

resource: remove cores args

We used to try to probe all the cores that the VNF was using
and only dump CPU stats for those cores.

We can't really detect those core accurately and we would rather
dump all the core information and let influxdb and grafana filter
the information.

We do end up with excessive KPI output, especially on systems with 88
cores, but this is manageable.

The core logic was partially removed, this finishes the removal.

Change-Id: I5cbb694fd982519e2df54db49a21ed5948e13537
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Merge "KVMFORNFV: To avoid livemigration result update to json"