Merge "NSB: update vfw tc_heat_external tests" into stable/euphrates

Merge "NSB TRex: convert DPDK port number to logical TRex port number" into stable/euphrates

Merge "NSB: Fix IndexError in pin_vcpu_for_perf" into stable/euphrates

Merge "NSB Prox LW_AFTR Test" into stable/euphrates

NSB: update vfw tc_heat_external tests

rename xe0, xe1 to uplink_0, downlink_0
enumerate tgs/vnfs starting from 0.
add disable_dhcp

Change-Id: Ia4f08b3ad5ab298192c249d04b10a6efbe4f210e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit b3a48eddc398c23523e379e6838160d456cf4368)

NSB TRex: convert DPDK port number to logical TRex port number

when we create TRex config we sort based on PCI bus address
and create a logical port ordering.

We need to save this port ordering and re-use it everywhere.

redirect vnfd_helper.port_num() to resource_helper.port_num() to
use the logical mapping

Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit ce52059f5f78912eeff2d97235c1028c218bf960)

Merge "Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports" into stable/euphrates

Merge "Adding vFirewall HTTP Traffic Profiles." into stable/euphrates

Merge "Dockerfile: apt-get clean to save layer space" into stable/euphrates

Merge "Heat: add availability_zone" into stable/euphrates

NSB Prox LW_AFTR Test

JIRA: YARDSTICK-802

Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py
- This support BM and Openstack Heat
- This supports 4 Ports ONLY
- Grafana Dashboards included
- Code Coverage / Unit testing

Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7
Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit b9e394b2f0955c76f883021c4f65c136b80d9261)

Merge "Addition of IPv6 icpm, udp and tcp to Neutron Security Group" into stable/euphrates

NSB: Fix IndexError in pin_vcpu_for_perf

This addresses the IndexError in Standalone SRIOV/OVSDPDK context.
The correct sys_cpu number should be sys_cpu-1

Error:
    threads = "%s-%s" % (soc_cpu[socket][sys_cpu], soc_cpu[socket][-1])
IndexError: list index out of range

Tested platform: (Hyper-Threading disabled)
NUMA node0 CPU(s):     0-21
NUMA node1 CPU(s):     22-43

With socket equal to 0, sys_cpu value was 22 which resulted to IndexError.

Change-Id: I36b045cacce4caff4b5ddafaa9b6737f1c6df0a1
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
(cherry picked from commit 78fff64b00e255d7e4624bcc62faddc0d135e5a2)

Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports

Change-Id: I3c7f047dc6d1545093aed6f64ccaed9f90d85af3
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 
(cherry picked from commit 61bf9771f05f0347f12617b7013b13d5fcb4981b)

Adding vFirewall HTTP Traffic Profiles.

Modified http_locator location for 64K, 256K, 512K and 1024K
concurrency files.

The traffic profiles include various http locator image sizes i.e
4K,64K,256K,512K and 1024K

The traffic schema is changed to "nsb" from "isb" for all the
traffic profiles

Change-Id: I012da8daaa880ca80db2d3b08cebd9a73c19cd47
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 
(cherry picked from commit bb2da407193d6a5747cf15069d61cceb4c6bf1f7)

Dockerfile: apt-get clean to save layer space

it seems like normally Dockerfiles do an apt-get clean
to remove apt cache and save space on docker layers

Change-Id: I2ac9d30daa917973c3ba76a50cda67d6ecb8c47a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 952c68f74c03facff84b987aa508040dd43ee30b)

Heat: add availability_zone

Users would like to ensure placement of VMs on specific compute nodes so
that the measurements are meaningful. Examples: Measure network
performance in different scenarios (VMs in same host, in different
hosts, across fabric, across tenants)

Example:

context:
  name: yardstick
  placement_groups:
    pgrp1:
      policy: "availability"
  servers:
    tg_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone2"
    vnf_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone1"

Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 81b9d338268f47f3d8863f10ef3940f0ea79d618)

Update links to documentation in README.rst

The links to the docs in README were pointing to Colorodo documentation.

For master, this should not be pinned to a particular release, but
should show the most recent docs at all times.

Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 9ea682e950598d39fa53ccabe6c1cd0a4fe426bd)

Addition of IPv6 icpm, udp and tcp to Neutron Security Group

When creating a Neutron security group for a heat template. Add
IPv6 security group rules to access the resouces.

Change-Id: I0b541dfe400121e35908a70778665ee1576f0622
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 3cfdda00a291cf911e2948da774929ad23a60452)

Merge "KVMFORNFV: Reverting LiveMigration changes" into stable/euphrates

heat: allow overriding Heat/Neutron private IP for DPDK tests

For some L2/L3 DPDK testcases we need to use a custom
IP address space different from what Heat provides.

These testcases require port_security_enabled = False so
Neutron should allow for unrestricted L2 traffic.

This will work because we bind the ports to DPDK and thus
don't need DHCP.

  vnf_0:
    floating_ip: true
    placement: "pgrp1"
    network_ports:
      mgmt:
        - mgmt
      uplink_0:
        - xe0:
            local_ip: 10.44.0.20
            netmask: 255.255.255.0
      downlink_0:
        - xe1:
            local_ip: 10.44.0.30
            netmask: 255.255.255.0

Also fixup flake8 errors in unittests

Change-Id: Id29dfffa692f16fb1f526d208db43e476e2f7830
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit ec6a90d449f8b1ab2b17083188ec65f75ab7818b)

Add "How to work with test case" into devguide

JIRA: YARDSTICK-73

add a new chapter about how to work with test case, now just add three sub chapter,

sample test case, release test case, test case description file, will update more for

how to write a new test case.

Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39
Signed-off-by: kubi <jean.gaoliang@huawei.com>
(cherry picked from commit 1ca9d52152d54b51b4d9dcd6c429f114ad4fe24c)

KVMFORNFV: Reverting LiveMigration changes

This patch consists of reverting the changes of patch 45227 and
incudes redirecting the console output of the LiveMigration
execution to /dev/null as the stdout contains only the statistics,
i.e., totaltime, downtime and setuptime.

This reverts commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65.

Change-Id: I252b5a4045657cfa8362e9aae755249480cd3b77
Signed-off-by: Navya <navyax.bathula@intel.com>
(cherry picked from commit 3ca70b916c386b7ec4d9a7f2f9bb6fec2e917785)

KVMFORNFV: To avoid livemigration result update to json

This patch is used to remove the livemigration testcase result loaded
to json as there is no dashboard implemented for the testcase

Change-Id: I7a9589a0bbc5f2a28587c2878da042fc50af18e0
Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
(cherry picked from commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65)

Merge "NSB: fix vpe_config license" into stable/euphrates

Merge "Fixed incorrect Copyright Notice" into stable/euphrates

Fixed incorrect Copyright Notice

Changed Copyright notice on tuples.lua from "Intel Copyright" to Apache 2.0

Change-Id: I85e6f9eb86c116d552f86cddf05b3b368b32f776
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
(cherry picked from commit 204702db384241faffbf0848ad0bc63fa476b52d)

NSB: fix vpe_config license

Use Apache 2.0

Change-Id: I199d09f04a5c84a25bd91dceba5e4ed1f93075f6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 3e62c0669b73fd5a4b4d0d7e7a214853b343574a)

pmu: remove event_download_local workaround script

intel_pmu needs to download a config file based on the
CPU model.  When generating VNF images we don't have
access to the actual vCPU that will be used, so we
can't predownload.  This code was meant to be a fix
for that by downloading all the configs and then
selecting one that matched the vCPU.

However we have license issues with intel_pmu enven GPLv2 code,
so remove it for now.

Change-Id: I5257ff7c4ddc1d40537dadb29efa40d1d68cb852
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 7a5c45daa9b146dfc50068165aba5ec6bc2e1e2c)

BugFix: Fix to pod filename ext and prox path

As per defect:
- the "context:" stanza of every tc_prox_baremetal*.yaml"
 file has an incorrect pathname for the config file

-  tc_prox_baremetal_binsearch.yaml and
tc_prox_baremetal_ramp.yaml refer to
"prox-baremetal.yml", which idoes not exist

- incorrect prox bin path

Resolution:
- Unify the pod file name and path for all BM tests
- Prox bin path changed to "/opt/nsb_bin/prox"

Change-Id: I16b25189104ad5585ddc1c2c0dd71b3c4c2aecd3
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 2ebe6693b09a221de154a697ba24817a61e8548d)

Merge "Fix Malformed Table in User Guide docs" into stable/euphrates

Fix Malformed Table in User Guide docs

Change-Id: I2f98b75e9bbcd3d0cd4666c097a3280dd89eb02a
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
(cherry picked from commit 74c2176823913f09821ea2671c9008e5c74954b8)

Added NSB sample Test Case documentation.

Update:
Added Prox NSB test case documentation

Change-Id: Ia2f47d823581fc7f193d3123f080dd87f29d4b99
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit 10c595ad0301d02944ae412e994e65027e9d69e6)

Docs: add yardstick gui descrption in userguide

Change-Id: I09bc55e296d2c641f10819972ec0d48a289432b8
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Docs: update new test cases in release note

Change-Id: Ie5ff6fe4f867ce68a33a3a857d8d051ba0020395
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit b463496e6515a42e29b814194d8b19ed2f639239)

DRAFT: update release notes for Euphrates

Change-Id: I7e437612ca52b75b71e38962a84d0dcdb453d5dd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 540659ee051d8c5b570541e1e4e0b92fa8b0e2ec)

Merge "Add missing RFC2544 Ethernet frame sizes" into stable/euphrates

Add missing RFC2544 Ethernet frame sizes

RFC2544 tests should include the following frame sizes:

9.1 Frame sizes to be used on Ethernet

       64, 128, 256, 512, 1024, 1280, 1518

Change-Id: I6ab9cccf2bb3b2678f50da157a9a49c0d9564cbd
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
(cherry picked from commit 7046a9139a60e0bc3e65f5dc6dcb8e6999528136)

nsb_installation: updates

JIRA: YARDSTICK-500

Change-Id: I6eef884ef6262abe49fc13bc353ca14a72a5b648
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
(cherry picked from commit 97b961aee6653553c5a35ecee5cb766924cd10f1)

NSB: fix trex config to use dpdk port number

From some reason Heat/Neutron is now creating
interfaces such that xe0 and xe1 are swapped.

xe0  fa:16:3e:38:c7:66  0000:00:05.0
xe1  fa:16:3e:2f:f3:e2  0000:00:03.0

this causes the DPDK port numbering to be swapped.

xe0 is DPDK port 1 because it has higher PCI address
xe1 is DPDK port 0 because it has lower PCI address.

The VNF is configured correctly because it uses DPDK port numbers,
whereas TRex was using interface list ordering.

Modify trex_cfg.yaml to use DPDK port ordering.  This also
requires running generate_cfg() after setup() in instantiate()

+------------------------------------+-------------------+------------------------------+--------+
| Name                               | MAC Address       | Fixed IP Addresses           | Status |
+------------------------------------+-------------------+------------------------------+--------+
| vnf_0.yardstick-af5ccb47-xe0-port  | fa:16:3e:66:a5:e4 | ip_address='10.1.0.7',       | ACTIVE |
| vnf_0.yardstick-af5ccb47-mgmt-port | fa:16:3e:fa:98:fe | ip_address='10.0.1.10',      | ACTIVE |
| tg_0.yardstick-af5ccb47-xe1-port   | fa:16:3e:2f:f3:e2 | ip_address='10.1.1.9',       | ACTIVE |
| vnf_0.yardstick-af5ccb47-xe1-port  | fa:16:3e:f3:1d:f5 | ip_address='10.1.1.4',       | ACTIVE |
|                                    | fa:16:3e:e3:8c:65 | ip_address='10.0.1.1',       | ACTIVE |
|                                    | fa:16:3e:ff:d1:b7 | ip_address='11.191.14.110',  | N/A    |
| tg_0.yardstick-af5ccb47-xe0-port   | fa:16:3e:38:c7:66 | ip_address='10.1.0.8',       | ACTIVE |
|                                    | fa:16:3e:ff:53:5f | ip_address='11.191.14.101',  | DOWN   |
|                                    | fa:16:3e:23:5d:2c | ip_address='10.0.1.2',       | ACTIVE |
| tg_0.yardstick-af5ccb47-mgmt-port  | fa:16:3e:7a:df:4e | ip_address='10.0.1.5',       | ACTIVE |
|                                    | fa:16:3e:22:65:36 | ip_address='11.191.14.109',  | N/A    |
+------------------------------------+-------------------+------------------------------+--------+

/sys/devices/pci0000:00/0000:00:03.0/virtio0/net/ens3/address:fa:16:3e:2f:f3:e2
/sys/devices/pci0000:00/0000:00:05.0/virtio2/net/ens5/address:fa:16:3e:38:c7:66

Change-Id: Iaef2c7d9a5af7f45bd805a8ad6ee545ce0495cb1
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 7ed018cddf88ac1c5a92f71fa5e421e66d259bc0)

BugFix: Negative dropped packets in Prox tests

Removed the abs function which can potentially mask
negative dropped packets.

Dropped packets in Prox workload VNF = max((tx_packets - rx_packets), 0)

Change-Id: I510a351e899cdf9a1f366d632b9f0528b1d9dcce
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
(cherry picked from commit a27278dacaa54ae60cd3bdfa6e6145643f76fa02)

Merge "Adding sample trex example" into stable/euphrates

Merge "tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml updated" into stable/euphrates

Adding sample trex example

Change-Id: I3b79d33dba5cc559634122a135ff469f054214fc
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
(cherry picked from commit 255a77da00dd047ee0c5ab1e849cf7e6ce75ecf6)

Merge "Docs: update new implemented APIs" into stable/euphrates

Bugfix: move opnfv_os-odl-fdio_dvr-noha_daily.yaml to 'test_suites' directory

The opnfv_os-odl-fdio_dvr-noha_daily.yaml test suite file is wrongly put in Yardstick root directory,
this patch moves this file to the 'test_suites' directory.

Change-Id: Ib3f75845c7af658dc6f96ac2de737cfbd1faf15a
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit 14050ee3f720eb6aafaca256fc7bd982ac127cc7)

Docs: update new implemented APIs

Change-Id: If6b70791213099d53c82993bd22ac9eed6000c32
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit a4e465a23a41dfee5419085c43ed21aee3a0d97c)

Merge "Create the ovs-vswitchd logging directory" into stable/euphrates

tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml updated

Change-Id: Ie9cee3e0567e771cbf11a9802bd33a420cc1ee7a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 041aeb7d3505e98af5b167a5ee05bb72c3c87a26)

Create the ovs-vswitchd logging directory

Change-Id: Id7f55f7fcb2fec2866b76821595776908ac30c04
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
(cherry picked from commit bdcae10b04debea07e4553aab6e4ce43011d5f62)

NSB: update vfw scale-out testcases

Change-Id: I6bd8a87f70954f288975e3e73e3cfbd36ae561dc
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit 39ead7aee3610dddbdeae33a5776ae5b98dfabea)

add CheckConnectivity scenario

Change-Id: I9d246828790467c2a57ba410826ee9751fff89c5
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit 4712d72a570dc9e2799227d489ee41768881a06d)

Merge changes from topic 'euphrates-sync-2017-10-18' into stable/euphrates

* changes:
  tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex_correlated_scale_2: fix indent
  Hamonization of the titles of the documents (Testing group)
  scale-out testcase template

Merge "Resolve full path to adminrc file if full path is not provided" into stable/euphrates

Merge "add VNF scale-up template" into stable/euphrates

add VNF scale-up template

adjust worker_threads based on number of vcpus

Change-Id: Ie5444a64c15711a0e813905c69581f189432fe0b
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit bc6c77102684f69bccdce8509723e00ef38c69cf)

Resolve full path to adminrc file if full path is not provided

Change-Id: I7e9d8074b5d956c864a0b3264926eee89e66dc35
Signed-off-by: Charlie Kang <charlie.kang@intel.com>
(cherry picked from commit baa6c60b3216a41978a136b9d32e054c52153935)

tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex_correlated_scale_2: fix indent

bad YAML indent

Change-Id: I6aaf53b9bbf6005b6be4c2d6c69cefd41949f8c6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

NSB: MultiPortConfig adjust start_core

Change-Id: I8f4b6af898c9d3783f7b45471088a69e51c8baba
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Hamonization of the titles of the documents (Testing group)

Change-Id: I6065fb416a90544539316666aac92735ee84177a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>

Added required ubuntu packages to run IxLoad client

To fully enable IxLoad, after installing the IXIA client,
check /opt/ixia/ixload/<ver>/bin/ixloadpython and make sure
you can run this cmd inside the yardstick container. Usually
user is required to copy or link /opt/ixia/python/<ver>/bin/ixiapython
to /usr/bin/ixiapython<ver>.

Change-Id: I6bc633802ad6c70329581014ec89c75bb7f8d688
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>

scale-out testcase template

use anonymous flavors
force num_vnfs to int

added provider network examples

we have to disable port security for provider networks

removed vld_id, not needed

adjust num_vfs to allocate two physnets per VNF.

fix for multiports

Change-Id: Ic4c8314dc07f6295b9559188989d81058bb48eb0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

pmu mirror creation ansible error fix

  While creating the mirror for pmu event list generation, some of
  the links would fail, throwing error. This fixes that.

Change-Id: I52e96b1a6eacb5a9611845e815ecff9052df168a
Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>

Enable static cgnapt functionality.

Change-Id: Ie770ca69ebdc66589ed6ca5c25bfc9a75afb8938
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

BugFix: Fix to Load Balancer - Previously Dropped packets was acceptable

Dropped packets were tolerated. Now no longer tolerated (except 0.01%)

Change-Id: I69d4f1a84d82e03a091a61419fa05fea13176c1c
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

validate_non_string_sequence: use six.string_types

Change-Id: I7248d97a55974091daf20f0fba4b612101a0e4c5
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Disable spoof check on vfs in sriov setup

Change-Id: I8577231c2e78776cb30f7f7ded353a4fbc585aaa
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Adding cpu set to enable affinity for given vcpu

Change-Id: If2e079966939b7faa33d2833d81caad0a3669036
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Adding sample multi-port ansible script

- trex
- ixia
- ixia correlated

Change-Id: I7d1414227c27c2bb03454eac94592e07c434f070
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

fix invalid chracters in ansible scripts

Change-Id: I3d1a491e4c0f0554a861d9bb24fbd0ac94835759
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Update the traffic profile to support sample multi-port

Change-Id: Iaf8b3e0aa3855443b0628573a1df98d177f27c76
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Relocate iniparser to yardstick.network_services.helpers

Change-Id: I1f457c9c24f2ca84dde61b64f58edaff8952670a
Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>

BugFix: Fix to negative dropped packets appearing in results.

As per defect:
   the "VNF packets dropped" time series is negative - negative number of packets dropped
   is not meaningful.

Solution:
   Return a positive value.

Change-Id: I358006a691f2d6b5954333b9f7a745aba97ae44f
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

BugFix: limit the count to supported range in min/max

In trex, giving count beyond the allowed range causes trex client to
fail. Check the range and reset the count before starting the traffic

Change-Id: I58e54f47edb5f249087b8f7178b807ddfb13b03c
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Docs: test case description for TC080 and TC081

JIRA: YARDSTICK-825

Change-Id: Ib2f8d0b88378c0dd0bd20ba38141a205fa7ae486
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Fio: support input job file configuration

Change-Id: I4bb15a398819e54f7fb3e9eac17daa4059c03376
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit a5d0491b47fd1bab27fa603353861ea8eaba8da5)

add opnfv_os-odl-fdio_dvr-noha testsutie for Apex

Change-Id: Idd60153e6097cbef6513942653429d2ec96a8c17
Signed-off-by: JingLu5 <lvjing5@huawei.com>
(cherry picked from commit b122091bcc2e780be3694cf0faa1b771994798f6)

NSB: rename private->uplink, public->downlink in example

Change-Id: Ieb8943a432a59375b7e68a708666ad4caa4affd2
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

resource: move make_resource_profile to ResourceProfile

move factory method from Collector to ResourceProfile

Change-Id: I1ddf3cffed7a3b2d45aa9cbffd3c0a5925c325d6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

bugfix: remove pod_name in host and unify host parameter

for none-ha test case, use host to be parameter
for ha test case, use attack_host as parameter

Change-Id: I053df00adab17814dd54584a1ae081548163dc68
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 18b2c357c3d281fbdf5261958ef60abb98915486)

Create test suite opnfv_os-nosdn-openbaton-ha_daily

JIRA: YARDSTICK-823

We need to create test sutie opnfv_os-nosdn-openbaton-ha_daily.yaml
to enable this scenario.

Change-Id: Ia800a9c74aaecf0d73e6f0fd559630b741ad2432
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
(cherry picked from commit 164d60cedff53c520e4c36a37cb1a02bf873f7fb)

Support to add multiple src/dst ports in flow

Change-Id: I888a6029efaad8308de8df6b6787dd46af5f1c55
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

task: use CONF_FILE from constants

I'm not sure why we hardcoded config_file when
the CONF_FILE constant will work.

Change-Id: I45a1dc17ac2b185c659725f55462214acb74838d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

collectd: set intel_pmu events path and OVS socket path

switch from hardcoded path to dynamic path
based on bin_path

also enable proxy for install_collectd

add barometer settings for virt and ovs_stats

Change-Id: Id138aef548332a3e3fcb3963b746e7c9f10c0948
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Version changes for collectd, pmu-tools, intel_cmt_cat

  Bumping collectd version to include pmu plugin enablement,
  bounding pmu-tools and intel_cmt_cat to a commit-id

Change-Id: I666d52c5574cec0caebb07535332984fa77e5b65
Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>

NSB Prox Grafana dashboard updates

JIRA: YARDSTICK-802

Updating the Grafana dashboards with common data
format for all BM and Opensatck Prox tests and
adding minor improvements

- Correct the test description
- Re-run the tests and verify that all the
  fields are graph correct
- Label the axes correctly.
  eg: For Throughput added label "MPPS"

Change-Id: I62b471926fe3c4c8876b70053a92d06f4373e296
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>

KVMFORNFV: To verify the execution of the bash script

This patch is used to verify the parameters passed and
the flow of qemu_migrate_benchmark.bash script to handle
the bugs

Change-Id: Ifc1bfa7a91a2eed178b9dc984c222074f06e0599
Signed-off-by: Navya Bathula <navyax.bathula@intel.com>

Move arp route tbl to script and update defailt vnf config files

Change-Id: I8674caa15c9fc32cfacb17f558da5fb31094877e
Signed-off-by: Deepak S <deepak.s@linux.intel.com>
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

cgnat: duplicate keys are not allowed

the current ConfigParser does not handle duplicate keys
in ini files.

Change-Id: Iaafbbab740a809a59edfd93c84d0029ef10ac6f3
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

increase number of open files for collectd

for collectd KPIs we need may need to open 10,000+ files

one file for each core * number of CPU counters we read.

Use the ansible pam_limits moules to increase the nofile
setting.  This should allow the VNF to boot with increased
number of files open

Change-Id: I46b75d5ca59e8e359c985a1e37daaee89897884c
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

task: drain background runner queues

We were not draining the queues in the background
runners.

Modify the main runner_join loop to loop over
all the runners and drain them.

The runner join method does extra work for periodic actions
so we can't change its behavior.

Instead create a new poll() method and use that
to check runner status

Change-Id: I9466ba40a6a4c45c82cedff279cbb4817c6b66ad
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>

Bug in  NSB Prox ACL Test 4 Port

JIRA: YARDSTICK-802

Generator was incorrectly configured to generated traffic for p0, p1 (twice), and p3

Should be p0, p1, p2 and p3

Change-Id: Ib62a3c6523b1eda635b8c727c36e140fd480003e
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>

Updating NSBperf to print right testcase

Change-Id: I7be7bc61624fa14eb552477bdc701a44d65e68b7
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

private-> uplink and public->downlink

changing private and public to new uplink/downlink name

Change-Id: I8c3f582ba5592418a397e2500e0b998c3eed54f2
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

Enable intel_pmu plugin in collectd

Change-Id: I62c6416e5c79d0b90880985bb5c076b65e34192e
Signed-off-by: Deepak S <deepak.s@linux.intel.com>

ping: always save rtt data, influxdb ignore empty data

If the SLA was failing we were raising AssertionError and not storing
the rtt in the data dict.  This caused influxdb parse errors because the
data was empty.

Fixup influxdb to ignore records with no data, so we don't try to parse
no data.

Change the ping logic to always record the rtt result even if the SLA
was not met.

Also fixup ping logic in cases where ping does not return results.  If
SLA is defined use SLA * 10 otherwise use large float that doesn't break
the grafana scale too much, maybe 999999

JIRA: YARDSTICK-809

Change-Id: Id2d51216581644a80e8c7b9aa98919a766008adf
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
(cherry picked from commit af011b16787e8fd9fc6f918b1d1427dd1be562ec)

Bugfix: Add opnfv_os-nosdn-ovs_dpdk testsuite for Compass4nfv

Change-Id: I35e6471bb561eb773bd188b36b912969188955d2
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Bugfix: Add opnfv_os-odl_l2-moon-ha_daily testsuite for Compass4nfv

Change-Id: I46c6b56e1293c3d594804d77a73c391922f03653
Signed-off-by: JingLu5 <lvjing5@huawei.com>

Change 'SUCCESS' to 'PASS' when report to MongoDB

JIRA: YARDSTICK-822

To keep consistent with other testing project, we need to
change 'SUCCESS' to 'PASS', 'FAILED' to 'FAIL'.

Change-Id: I392e4dc6dd2e028cd43cba0d1bf8ee04618326d7
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
(cherry picked from commit f4680c872fbb34816d809c41852740f5cb960fd1)

Bugfix: Reference for the tool used in TC044 mentioned in the user guide is wrong

JIRA: YARDSTICK-821

Change-Id: I09b189008df4ec2e6db92cf24c45d8206ed2062f
Signed-off-by: JingLu5 <lvjing5@huawei.com>