Bugfix: failed to generete gui files in stable/euphrates in CI

JIRA: YARDSTICK-898

Now the gui files failed to build in stable branch in CI.
(local work, CI master work, CI stable not work).
The reason is stable using ubuntu 14.04 and the nodejs version is 0.10.25.
We need to update it.

Change-Id: I15b9efb91eb6fc1e3245cf827c130d408034eae5
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>

update release notes for Euphrates 5.1.0

Change-Id: I11b248882dd314baebd3ab4e7e676a1f3e0b50cd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 9d0f99349d2ea4499670708aacb1569cad0389aa)

Addition of NSB Prox test documentation of vPE and LW-AFTR test cases

YARDSTICK-840

NSB Prox test documentation of vPE and LW-AFTR test cases documenation.

Change-Id: Ic6da6546faf0494fdee71962a515083e6e10a410
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit db6083d91499521bf3a486623e985cc3b1703524)

fix docker client don't have trex_client

JIRA: YARDSTICK-854

Add trex_client in docker,
so we could run NSB testcase in docker container.

Change-Id: Iac1393d6e3a175137973190936ab69a1f2ce8272
Signed-off-by: Ace Lee <liyin11@huawei.com>
(cherry picked from commit 75606db72e5d3afb6afe590e76b3baef3af3f5c6)

bugfix: tc078 have no data stored or dashboard to show results

JIRA: YARDSTICK-867

1.print result in the log, showing the txt format result

Change-Id: I6deeb4cf44895ef7a6c6d231c77b3843eec285d7
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 36c24ec9fc68c081d0bca507cff3ec81f8a001dc)

bugfix: tc078 fails in some situations

1. make  "SPECint_benchmark, runspec_iterations, runspec_tune, runspec_size,
runspec_rate" parameterized and change the default value "int^429" to "int"
2. remove "become: true" in some roles since it does not need root privilege

JIRA: YARDSTICK-852

Change-Id: Icb384bddc12911e2681a981d0504e0e142d1a8ec
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 7bd43b239b7be6f478399526a177922d4482bcc2)

bugfix: kill process do not accurately kill "nova-api"

JIRA: YARDSTICK-849

1. update the kill process RegEx pattern to be more accurate
2. make attack_process to be parameter so it can be customized if
the SUT is using a different name of attack_process

Change-Id: I569730ced6c24aafbffcf2fc5752d3560d0adac5
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 4bbd919e2b26fe606bb1b83efc579e0f2557593e)

samples: Add generic L3 forwarder tests

A generic throughput test case that can be used as a
stub code for a Linux-based VNF configured as an L3 forwarder.

Supported context:
* Standalone OVSDPDK and SRIOV
* Baremetal

Code changes:
* Allow pmd-cpu-mask and lcore mask for OVS DPDK
* router_vnf.py - configures interface IP addresses and static arp entries
  using ip command
* NFVi KPIs
* Allow cputune tag for standalone context to be able to PIN on NUMA 1 cpus

SRIOV Test cases:
* RFC2544 Ethernet framesizes, 128K Flows
* 2,4 and 6 ports
* 2 and 3 vcpus per port
*
OVSDPDK Test cases:
* RFC2544 Ethernet framesizes, 128K Flows
* 2 and 4 ports
* 2 vcpus per port
* 2 PMD threads per port

TODO:
* Documentation
* Add 6 ports tests

References:
* router_vnf.py is based on sample_vnf.py
* tc_*.yaml files are based on acl/vfw test case files

Added unitests
Added get_stats to parse ip -s link

Change-Id: Id1b969d5420dfcab7c1e695acbd2cd1655747efe
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Signed-off-by: Kavindya Deegala <kavindya.s.deegala@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Emma Foley <emma.l.foley@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 9bf492e01dad7309287e8491ec7ac29f43032aed)

Merge "tc053 kill haproxy wrong mismatch" into stable/euphrates

Merge "Refactor userguide "Yardstick Installation"" into stable/euphrates

Merge "bugfix: tc006, tc079, tc082 miss grafana dashboard in local deployment" into stable/euphrates

Refactor userguide "Yardstick Installation"

[1] must be refactored in order to:
  * Include proxy options.
  * Use OpenStack client, instead of project CLI.
  * Use sudo in some commands.
  * Adapt the document to rst coding style.
  * Fix minor errors.

JIRA: YARDSTICK-828

[1] https://github.com/opnfv/yardstick/blob/923aa1738cbf5a8053e77e00937fc26f2142f6a3/docs/testing/user/userguide/04-installation.rst

Change-Id: Ice63f344a8a87221bdf4daa6153b9ccac321e5b7
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit d20b876a02904653cf390a97c2ed9973821dc508)

NSB: Fix standalone.model.Libvirt SR-IOV modeling

Fixed standalone.model.Libvirt SR-IOV XML interface modeling, acording
to [1]:
- All PCI attributes now are printed in hexadecimal format.
- The PCI address is now added in the correct section, 'interface'.

network_services.utils.PciAddress was refactored to accept both 'domain:
bus:slot:function' and 'bus:slot:function' format inputs. This class is
used as input in the previous class, Libvirt, to print in XML the PCI
address of a SR-IOV interface.

network_services.utils.PciAddress.parse_address is now deprecated. Instead
the class standard instantiation must be used:

    libvirt_obj = utils.PciAddress(text_with_address)

A deprecation decorator is implemented along with this patch. This
decorator is used for the first time in the previously mentioned function.
This decorator stores every decorated function name and deprecation message
and raises a logging warning message the first time this function is used.

[1] https://goo.gl/so2Mrp

Change-Id: I22e95c488e27d6e2a8fdf6c1a07faab275fa6bba
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit 6cfec77db6b95af5b31b741d513955ee3dfa3bb2)

bugfix: tc006, tc079, tc082 miss grafana dashboard in local deployment

JIRA: YARDSTICK-847

Change-Id: I0750f2d17bac9e0214caf640e4ea1141ea3b4a03
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 1839527cfef72b58182d3c7bb2b06423684c0d46)

bugfix: tc023 miss description and tc050-58 wrong description

also modify tc019,025,045-49 descrition to be unified

JIRA: YARDSTICK-850

Change-Id: I3f775f1ebff4063edc53b9bc26d7ba10b8af8a9d
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 84a532cc7fbe2d99300d43b5431a7e3c5b2d22cc)

Ansible: fix lowercasing issue with ConfigParser

by default ConfigParser will lowercase everything,
unless you override optionxform.

also sort key value in inventory line for consistency

https://docs.python.org/3/library/configparser.html#configparser.ConfigParser.optionxform

Transforms the option name option as found in an input file or as passed in by
client code to the form that should be used in the internal structures. The
default implementation returns a lower-case version of option; subclasses may
override this or client code can set an attribute of this name on instances to
affect this behavior.

You don’t need to subclass the parser to use this method, you can also set it
on an instance, to a function that takes a string argument and returns a
string. Setting it to str, for example, would make option names case sensitive:

cfgparser = ConfigParser()
cfgparser.optionxform = str

Note that when reading configuration files, whitespace around the option names
is stripped before optionxform() is called.

YARDSTICK-833

Change-Id: Ia1810b0c77922d84e11c9e538540b38816338593
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 3e93bb8ff3ef9ff454d6be13295198dbeac75df7)

Merge "Fix controller IP parsing in "nsb_setup.sh" script" into stable/euphrates

Merge "NSB Prox BM test case fixes for scale up" into stable/euphrates

Merge "Add vfw ixload testcase for heat" into stable/euphrates

Merge "NSB "Prox" : Cleanup duplicated traffic profile" into stable/euphrates

Merge "NSB: update vfw tc_heat_external tests" into stable/euphrates

Merge "NSB TRex: convert DPDK port number to logical TRex port number" into stable/euphrates

Merge "NSB: Fix IndexError in pin_vcpu_for_perf" into stable/euphrates

NSB Prox BM test case fixes for scale up

YARDSTICK-839

In a scale-up test the VNF number can start from
0 to MAX (num_vnf-1)

The NSB PROX BM test nodes are currently marked as:
    tg__0: trafficgen_1.yardstick
    vnf__0: vnf.yardstick
They need to be changed to the below:
    tg__0: tg_0.yardstick
    vnf__0: vnf_0.yardstick

Changes done are:
- All BM Prox test cases have tg_0 and vnf_0 as default
  test nodes
- The prox-baremetal-1/2/4.yaml sample pod file
- Cleaned Up some unused Prox test/config files

Change-Id: I819011bcb35eda62b17dd3e1035918918c582b13
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 4b0bf9ea920b461b6464d0c6888b3b0bcc9a0004)

Merge "NSB Prox LW_AFTR Test" into stable/euphrates

Fix controller IP parsing in "nsb_setup.sh" script

Fixed the controller IP parsing in "nsb_setup.sh" script. The new
regex expression now accepts "OS_AUTH_URL" as:
  * http://10.237.223.168/identity
  * http://10.237.223.168:5000/identity
  * http://hostname/identity
  * http://hostname:5000/identity

JIRA: YARDSTICK-829

Change-Id: Ifaeab991bcbb6aa7b22c3533ab7554527184878b
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
(cherry picked from commit b5e35986a77831841b064e435a6041a121634bec)

Add vfw ixload testcase for heat

    - concurrency
    - connections/second
    - throughput

Change-Id: Idb977462952fba2e6a9684e916dfeca810f1ee94
Signed-off-by: Jennifer Li <jennifer.li@intel.com>
(cherry picked from commit 4e679598b82b5fe6931374452476b6d057868535)

NSB "Prox" : Cleanup duplicated traffic profile

JIRA: YARDSTICK-848

The NSB PROX MPLS test uses Binsearch traffic
profile and the mpls traffic profile is a duplicate.

Change-Id: Ie2124cebf306fd6917b70ecd7c23ae12ef4850dc
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 1b9cc8a38a4866797bd49d006e22607b348f42ac)

NSB: update vfw tc_heat_external tests

rename xe0, xe1 to uplink_0, downlink_0
enumerate tgs/vnfs starting from 0.
add disable_dhcp

Change-Id: Ia4f08b3ad5ab298192c249d04b10a6efbe4f210e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit b3a48eddc398c23523e379e6838160d456cf4368)

NSB TRex: convert DPDK port number to logical TRex port number

when we create TRex config we sort based on PCI bus address
and create a logical port ordering.

We need to save this port ordering and re-use it everywhere.

redirect vnfd_helper.port_num() to resource_helper.port_num() to
use the logical mapping

Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit ce52059f5f78912eeff2d97235c1028c218bf960)

Merge "Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports" into stable/euphrates

Merge "Adding vFirewall HTTP Traffic Profiles." into stable/euphrates

Merge "Dockerfile: apt-get clean to save layer space" into stable/euphrates

Merge "Heat: add availability_zone" into stable/euphrates

NSB Prox LW_AFTR Test

JIRA: YARDSTICK-802

Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py
- This support BM and Openstack Heat
- This supports 4 Ports ONLY
- Grafana Dashboards included
- Code Coverage / Unit testing

Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7
Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit b9e394b2f0955c76f883021c4f65c136b80d9261)

Merge "Addition of IPv6 icpm, udp and tcp to Neutron Security Group" into stable/euphrates

NSB: Fix IndexError in pin_vcpu_for_perf

This addresses the IndexError in Standalone SRIOV/OVSDPDK context.
The correct sys_cpu number should be sys_cpu-1

Error:
    threads = "%s-%s" % (soc_cpu[socket][sys_cpu], soc_cpu[socket][-1])
IndexError: list index out of range

Tested platform: (Hyper-Threading disabled)
NUMA node0 CPU(s):     0-21
NUMA node1 CPU(s):     22-43

With socket equal to 0, sys_cpu value was 22 which resulted to IndexError.

Change-Id: I36b045cacce4caff4b5ddafaa9b6737f1c6df0a1
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
(cherry picked from commit 78fff64b00e255d7e4624bcc62faddc0d135e5a2)

Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports

Change-Id: I3c7f047dc6d1545093aed6f64ccaed9f90d85af3
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 
(cherry picked from commit 61bf9771f05f0347f12617b7013b13d5fcb4981b)

Adding vFirewall HTTP Traffic Profiles.

Modified http_locator location for 64K, 256K, 512K and 1024K
concurrency files.

The traffic profiles include various http locator image sizes i.e
4K,64K,256K,512K and 1024K

The traffic schema is changed to "nsb" from "isb" for all the
traffic profiles

Change-Id: I012da8daaa880ca80db2d3b08cebd9a73c19cd47
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 
(cherry picked from commit bb2da407193d6a5747cf15069d61cceb4c6bf1f7)

Dockerfile: apt-get clean to save layer space

it seems like normally Dockerfiles do an apt-get clean
to remove apt cache and save space on docker layers

Change-Id: I2ac9d30daa917973c3ba76a50cda67d6ecb8c47a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 952c68f74c03facff84b987aa508040dd43ee30b)

Heat: add availability_zone

Users would like to ensure placement of VMs on specific compute nodes so
that the measurements are meaningful. Examples: Measure network
performance in different scenarios (VMs in same host, in different
hosts, across fabric, across tenants)

Example:

context:
  name: yardstick
  placement_groups:
    pgrp1:
      policy: "availability"
  servers:
    tg_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone2"
    vnf_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone1"

Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 81b9d338268f47f3d8863f10ef3940f0ea79d618)

Update links to documentation in README.rst

The links to the docs in README were pointing to Colorodo documentation.

For master, this should not be pinned to a particular release, but
should show the most recent docs at all times.

Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 9ea682e950598d39fa53ccabe6c1cd0a4fe426bd)

Addition of IPv6 icpm, udp and tcp to Neutron Security Group

When creating a Neutron security group for a heat template. Add
IPv6 security group rules to access the resouces.

Change-Id: I0b541dfe400121e35908a70778665ee1576f0622
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 3cfdda00a291cf911e2948da774929ad23a60452)

Merge "KVMFORNFV: Reverting LiveMigration changes" into stable/euphrates

tc053 kill haproxy wrong mismatch

JIRA: YARDSTICK-831

Change-Id: I587c486572f439952b8a31da664d1e2c1fb8dc27
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit d70cbc5c6bd03cb68a13dcab50a12178982f5c44)

heat: allow overriding Heat/Neutron private IP for DPDK tests

For some L2/L3 DPDK testcases we need to use a custom
IP address space different from what Heat provides.

These testcases require port_security_enabled = False so
Neutron should allow for unrestricted L2 traffic.

This will work because we bind the ports to DPDK and thus
don't need DHCP.

  vnf_0:
    floating_ip: true
    placement: "pgrp1"
    network_ports:
      mgmt:
        - mgmt
      uplink_0:
        - xe0:
            local_ip: 10.44.0.20
            netmask: 255.255.255.0
      downlink_0:
        - xe1:
            local_ip: 10.44.0.30
            netmask: 255.255.255.0

Also fixup flake8 errors in unittests

Change-Id: Id29dfffa692f16fb1f526d208db43e476e2f7830
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit ec6a90d449f8b1ab2b17083188ec65f75ab7818b)

Add "How to work with test case" into devguide

JIRA: YARDSTICK-73

add a new chapter about how to work with test case, now just add three sub chapter,

sample test case, release test case, test case description file, will update more for

how to write a new test case.

Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 1ca9d52152d54b51b4d9dcd6c429f114ad4fe24c)

KVMFORNFV: Reverting LiveMigration changes

This patch consists of reverting the changes of patch 45227 and
incudes redirecting the console output of the LiveMigration
execution to /dev/null as the stdout contains only the statistics,
i.e., totaltime, downtime and setuptime.

This reverts commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65.

Change-Id: I252b5a4045657cfa8362e9aae755249480cd3b77
Signed-off-by: Navya <navyax.bathula@intel.com>
(cherry picked from commit 3ca70b916c386b7ec4d9a7f2f9bb6fec2e917785)

KVMFORNFV: To avoid livemigration result update to json

This patch is used to remove the livemigration testcase result loaded
to json as there is no dashboard implemented for the testcase

Change-Id: I7a9589a0bbc5f2a28587c2878da042fc50af18e0
Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
(cherry picked from commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65)

Merge "NSB: fix vpe_config license" into stable/euphrates

Merge "Fixed incorrect Copyright Notice" into stable/euphrates

Fixed incorrect Copyright Notice

Changed Copyright notice on tuples.lua from "Intel Copyright" to Apache 2.0

Change-Id: I85e6f9eb86c116d552f86cddf05b3b368b32f776
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 204702db384241faffbf0848ad0bc63fa476b52d)

NSB: fix vpe_config license

Use Apache 2.0

Change-Id: I199d09f04a5c84a25bd91dceba5e4ed1f93075f6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 3e62c0669b73fd5a4b4d0d7e7a214853b343574a)

pmu: remove event_download_local workaround script

intel_pmu needs to download a config file based on the
CPU model.  When generating VNF images we don't have
access to the actual vCPU that will be used, so we
can't predownload.  This code was meant to be a fix
for that by downloading all the configs and then
selecting one that matched the vCPU.

However we have license issues with intel_pmu enven GPLv2 code,
so remove it for now.

Change-Id: I5257ff7c4ddc1d40537dadb29efa40d1d68cb852
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 7a5c45daa9b146dfc50068165aba5ec6bc2e1e2c)

BugFix: Fix to pod filename ext and prox path

As per defect:
- the "context:" stanza of every tc_prox_baremetal*.yaml"
 file has an incorrect pathname for the config file

-  tc_prox_baremetal_binsearch.yaml and
tc_prox_baremetal_ramp.yaml refer to
"prox-baremetal.yml", which idoes not exist

- incorrect prox bin path

Resolution:
- Unify the pod file name and path for all BM tests
- Prox bin path changed to "/opt/nsb_bin/prox"

Change-Id: I16b25189104ad5585ddc1c2c0dd71b3c4c2aecd3
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 2ebe6693b09a221de154a697ba24817a61e8548d)

Merge "Fix Malformed Table in User Guide docs" into stable/euphrates

Fix Malformed Table in User Guide docs

Change-Id: I2f98b75e9bbcd3d0cd4666c097a3280dd89eb02a
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
(cherry picked from commit 74c2176823913f09821ea2671c9008e5c74954b8)

Added NSB sample Test Case documentation.

Update:
Added Prox NSB test case documentation

Change-Id: Ia2f47d823581fc7f193d3123f080dd87f29d4b99
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 10c595ad0301d02944ae412e994e65027e9d69e6)

Docs: add yardstick gui descrption in userguide

Change-Id: I09bc55e296d2c641f10819972ec0d48a289432b8
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Docs: update new test cases in release note

Change-Id: Ie5ff6fe4f867ce68a33a3a857d8d051ba0020395
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit b463496e6515a42e29b814194d8b19ed2f639239)

DRAFT: update release notes for Euphrates

Change-Id: I7e437612ca52b75b71e38962a84d0dcdb453d5dd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 540659ee051d8c5b570541e1e4e0b92fa8b0e2ec)

Merge "Add missing RFC2544 Ethernet frame sizes" into stable/euphrates

Add missing RFC2544 Ethernet frame sizes

RFC2544 tests should include the following frame sizes:

9.1 Frame sizes to be used on Ethernet

       64, 128, 256, 512, 1024, 1280, 1518

Change-Id: I6ab9cccf2bb3b2678f50da157a9a49c0d9564cbd
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
(cherry picked from commit 7046a9139a60e0bc3e65f5dc6dcb8e6999528136)

nsb_installation: updates

JIRA: YARDSTICK-500

Change-Id: I6eef884ef6262abe49fc13bc353ca14a72a5b648
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
(cherry picked from commit 97b961aee6653553c5a35ecee5cb766924cd10f1)

NSB: fix trex config to use dpdk port number

From some reason Heat/Neutron is now creating
interfaces such that xe0 and xe1 are swapped.

xe0  fa:16:3e:38:c7:66  0000:00:05.0
xe1  fa:16:3e:2f:f3:e2  0000:00:03.0

this causes the DPDK port numbering to be swapped.

xe0 is DPDK port 1 because it has higher PCI address
xe1 is DPDK port 0 because it has lower PCI address.

The VNF is configured correctly because it uses DPDK port numbers,
whereas TRex was using interface list ordering.

Modify trex_cfg.yaml to use DPDK port ordering.  This also
requires running generate_cfg() after setup() in instantiate()

+------------------------------------+-------------------+------------------------------+--------+
| Name                               | MAC Address       | Fixed IP Addresses           | Status |
+------------------------------------+-------------------+------------------------------+--------+
| vnf_0.yardstick-af5ccb47-xe0-port  | fa:16:3e:66:a5:e4 | ip_address='10.1.0.7',       | ACTIVE |
| vnf_0.yardstick-af5ccb47-mgmt-port | fa:16:3e:fa:98:fe | ip_address='10.0.1.10',      | ACTIVE |
| tg_0.yardstick-af5ccb47-xe1-port   | fa:16:3e:2f:f3:e2 | ip_address='10.1.1.9',       | ACTIVE |
| vnf_0.yardstick-af5ccb47-xe1-port  | fa:16:3e:f3:1d:f5 | ip_address='10.1.1.4',       | ACTIVE |
|                                    | fa:16:3e:e3:8c:65 | ip_address='10.0.1.1',       | ACTIVE |
|                                    | fa:16:3e:ff:d1:b7 | ip_address='11.191.14.110',  | N/A    |
| tg_0.yardstick-af5ccb47-xe0-port   | fa:16:3e:38:c7:66 | ip_address='10.1.0.8',       | ACTIVE |
|                                    | fa:16:3e:ff:53:5f | ip_address='11.191.14.101',  | DOWN   |
|                                    | fa:16:3e:23:5d:2c | ip_address='10.0.1.2',       | ACTIVE |
| tg_0.yardstick-af5ccb47-mgmt-port  | fa:16:3e:7a:df:4e | ip_address='10.0.1.5',       | ACTIVE |
|                                    | fa:16:3e:22:65:36 | ip_address='11.191.14.109',  | N/A    |
+------------------------------------+-------------------+------------------------------+--------+

/sys/devices/pci0000:00/0000:00:03.0/virtio0/net/ens3/address:fa:16:3e:2f:f3:e2
/sys/devices/pci0000:00/0000:00:05.0/virtio2/net/ens5/address:fa:16:3e:38:c7:66

Change-Id: Iaef2c7d9a5af7f45bd805a8ad6ee545ce0495cb1
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 7ed018cddf88ac1c5a92f71fa5e421e66d259bc0)

BugFix: Negative dropped packets in Prox tests

Removed the abs function which can potentially mask
negative dropped packets.

Dropped packets in Prox workload VNF = max((tx_packets - rx_packets), 0)

Change-Id: I510a351e899cdf9a1f366d632b9f0528b1d9dcce
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit a27278dacaa54ae60cd3bdfa6e6145643f76fa02)

Merge "Adding sample trex example" into stable/euphrates

Merge "tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml updated" into stable/euphrates

Adding sample trex example

Change-Id: I3b79d33dba5cc559634122a135ff469f054214fc
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
(cherry picked from commit 255a77da00dd047ee0c5ab1e849cf7e6ce75ecf6)

Merge "Docs: update new implemented APIs" into stable/euphrates

Bugfix: move opnfv_os-odl-fdio_dvr-noha_daily.yaml to 'test_suites' directory

The opnfv_os-odl-fdio_dvr-noha_daily.yaml test suite file is wrongly put in Yardstick root directory,
this patch moves this file to the 'test_suites' directory.

Change-Id: Ib3f75845c7af658dc6f96ac2de737cfbd1faf15a
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit 14050ee3f720eb6aafaca256fc7bd982ac127cc7)

Docs: update new implemented APIs

Change-Id: If6b70791213099d53c82993bd22ac9eed6000c32
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit a4e465a23a41dfee5419085c43ed21aee3a0d97c)

Merge "Create the ovs-vswitchd logging directory" into stable/euphrates

tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml updated

Change-Id: Ie9cee3e0567e771cbf11a9802bd33a420cc1ee7a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 041aeb7d3505e98af5b167a5ee05bb72c3c87a26)

Create the ovs-vswitchd logging directory

Change-Id: Id7f55f7fcb2fec2866b76821595776908ac30c04
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
(cherry picked from commit bdcae10b04debea07e4553aab6e4ce43011d5f62)

NSB: update vfw scale-out testcases

Change-Id: I6bd8a87f70954f288975e3e73e3cfbd36ae561dc
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 39ead7aee3610dddbdeae33a5776ae5b98dfabea)

add CheckConnectivity scenario

Change-Id: I9d246828790467c2a57ba410826ee9751fff89c5
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit 4712d72a570dc9e2799227d489ee41768881a06d)

Merge changes from topic 'euphrates-sync-2017-10-18' into stable/euphrates

* changes:
  tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex_correlated_scale_2: fix indent
  Hamonization of the titles of the documents (Testing group)
  scale-out testcase template

Merge "Resolve full path to adminrc file if full path is not provided" into stable/euphrates

Merge "add VNF scale-up template" into stable/euphrates

add VNF scale-up template

adjust worker_threads based on number of vcpus

Change-Id: Ie5444a64c15711a0e813905c69581f189432fe0b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit bc6c77102684f69bccdce8509723e00ef38c69cf)

Resolve full path to adminrc file if full path is not provided

Change-Id: I7e9d8074b5d956c864a0b3264926eee89e66dc35
Signed-off-by: Charlie Kang <charlie.kang@intel.com>
(cherry picked from commit baa6c60b3216a41978a136b9d32e054c52153935)

tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex_correlated_scale_2: fix indent

bad YAML indent

Change-Id: I6aaf53b9bbf6005b6be4c2d6c69cefd41949f8c6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

NSB: MultiPortConfig adjust start_core

Change-Id: I8f4b6af898c9d3783f7b45471088a69e51c8baba
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Hamonization of the titles of the documents (Testing group)

Change-Id: I6065fb416a90544539316666aac92735ee84177a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>

Added required ubuntu packages to run IxLoad client

To fully enable IxLoad, after installing the IXIA client,
check /opt/ixia/ixload/<ver>/bin/ixloadpython and make sure
you can run this cmd inside the yardstick container. Usually
user is required to copy or link /opt/ixia/python/<ver>/bin/ixiapython
to /usr/bin/ixiapython<ver>.

Change-Id: I6bc633802ad6c70329581014ec89c75bb7f8d688
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>

scale-out testcase template

use anonymous flavors
force num_vnfs to int

added provider network examples

we have to disable port security for provider networks

removed vld_id, not needed

adjust num_vfs to allocate two physnets per VNF.

fix for multiports

Change-Id: Ic4c8314dc07f6295b9559188989d81058bb48eb0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

pmu mirror creation ansible error fix

  While creating the mirror for pmu event list generation, some of
  the links would fail, throwing error. This fixes that.

Change-Id: I52e96b1a6eacb5a9611845e815ecff9052df168a
Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>

Enable static cgnapt functionality.

Change-Id: Ie770ca69ebdc66589ed6ca5c25bfc9a75afb8938
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

BugFix: Fix to Load Balancer - Previously Dropped packets was acceptable

Dropped packets were tolerated. Now no longer tolerated (except 0.01%)

Change-Id: I69d4f1a84d82e03a091a61419fa05fea13176c1c
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

validate_non_string_sequence: use six.string_types

Change-Id: I7248d97a55974091daf20f0fba4b612101a0e4c5
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Disable spoof check on vfs in sriov setup

Change-Id: I8577231c2e78776cb30f7f7ded353a4fbc585aaa
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Adding cpu set to enable affinity for given vcpu

Change-Id: If2e079966939b7faa33d2833d81caad0a3669036
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Adding sample multi-port ansible script

- trex
- ixia
- ixia correlated

Change-Id: I7d1414227c27c2bb03454eac94592e07c434f070
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

fix invalid chracters in ansible scripts

Change-Id: I3d1a491e4c0f0554a861d9bb24fbd0ac94835759
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Update the traffic profile to support sample multi-port

Change-Id: Iaf8b3e0aa3855443b0628573a1df98d177f27c76
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Relocate iniparser to yardstick.network_services.helpers

Change-Id: I1f457c9c24f2ca84dde61b64f58edaff8952670a
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>

BugFix: Fix to negative dropped packets appearing in results.

As per defect:
   the "VNF packets dropped" time series is negative - negative number of packets dropped
   is not meaningful.

Solution:
   Return a positive value.

Change-Id: I358006a691f2d6b5954333b9f7a745aba97ae44f
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

BugFix: limit the count to supported range in min/max

In trex, giving count beyond the allowed range causes trex client to
fail. Check the range and reset the count before starting the traffic

Change-Id: I58e54f47edb5f249087b8f7178b807ddfb13b03c
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Docs: test case description for TC080 and TC081

JIRA: YARDSTICK-825

Change-Id: Ib2f8d0b88378c0dd0bd20ba38141a205fa7ae486
Signed-off-by: JingLu5 <lvjing5@huawei.com>