yardstick.git
6 years agoMerge "NSB: Fix IndexError in pin_vcpu_for_perf"
Ross Brattain [Tue, 12 Dec 2017 16:01:12 +0000 (16:01 +0000)]
Merge "NSB: Fix IndexError in pin_vcpu_for_perf"

6 years agoAvoid pylint warning for "protected-access" 75/48475/5
Rodolfo Alonso Hernandez [Wed, 6 Dec 2017 16:52:36 +0000 (16:52 +0000)]
Avoid pylint warning for "protected-access"

This warning should be disabled in order to access protected
methods during testing. Any access to protected methods done
outside the testing classes, must be catched during the reviewing
process.

Change-Id: I2127b41edf704d0cb4f68b33d98705039e058d1a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoAvoid pylint warning for "missing-docstring" 63/48463/5
Rodolfo Alonso Hernandez [Wed, 6 Dec 2017 16:23:35 +0000 (16:23 +0000)]
Avoid pylint warning for "missing-docstring"

Disabled pylint message for missing doctring in methods, classes and
modules. Modules must be auto-explanatory, and some methods are trivial
an doesn't need an explanation.

Change-Id: I01d80737d92a7345bc6a2a6f607eb35cbf28da67
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS...
Ross Brattain [Tue, 12 Dec 2017 07:19:11 +0000 (07:19 +0000)]
Merge "Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports"

6 years agoAdding vFirewall HTTP Traffic Profiles. 59/45259/5
Phani Kiran Thaticharla [Mon, 16 Oct 2017 17:39:22 +0000 (10:39 -0700)]
Adding vFirewall HTTP Traffic Profiles.

Modified http_locator location for 64K, 256K, 512K and 1024K
concurrency files.

The traffic profiles include various http locator image sizes i.e
4K,64K,256K,512K and 1024K

The traffic schema is changed to "nsb" from "isb" for all the
traffic profiles

Change-Id: I012da8daaa880ca80db2d3b08cebd9a73c19cd47
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 
6 years agoheat: allow overriding Heat/Neutron private IP for DPDK tests 93/45393/12
Ross Brattain [Tue, 17 Oct 2017 21:30:37 +0000 (14:30 -0700)]
heat: allow overriding Heat/Neutron private IP for DPDK tests

For some L2/L3 DPDK testcases we need to use a custom
IP address space different from what Heat provides.

These testcases require port_security_enabled = False so
Neutron should allow for unrestricted L2 traffic.

This will work because we bind the ports to DPDK and thus
don't need DHCP.

  vnf_0:
    floating_ip: true
    placement: "pgrp1"
    network_ports:
      mgmt:
        - mgmt
      uplink_0:
        - xe0:
            local_ip: 10.44.0.20
            netmask: 255.255.255.0
      downlink_0:
        - xe1:
            local_ip: 10.44.0.30
            netmask: 255.255.255.0

Also fixup flake8 errors in unittests

Change-Id: Id29dfffa692f16fb1f526d208db43e476e2f7830
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoAdding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT... 45/48345/1
Phani Kiran Thaticharla [Mon, 4 Dec 2017 22:02:10 +0000 (14:02 -0800)]
Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports

Change-Id: I3c7f047dc6d1545093aed6f64ccaed9f90d85af3
Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com>
Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> 
6 years agoMerge "bugfix: tc023 miss description and tc050-58 wrong description"
Ross Brattain [Fri, 1 Dec 2017 19:18:02 +0000 (19:18 +0000)]
Merge "bugfix: tc023 miss description and tc050-58 wrong description"

6 years agoMerge "KVMFORNFV: Reverting LiveMigration changes"
Jing Lu [Fri, 1 Dec 2017 05:40:23 +0000 (05:40 +0000)]
Merge "KVMFORNFV: Reverting LiveMigration changes"

6 years agoKVMFORNFV: Reverting LiveMigration changes 29/48129/2
Navya Bathula [Thu, 30 Nov 2017 21:46:15 +0000 (21:46 +0000)]
KVMFORNFV: Reverting LiveMigration changes

This patch consists of reverting the changes of patch 45227 and
incudes redirecting the console output of the LiveMigration
execution to /dev/null as the stdout contains only the statistics,
i.e., totaltime, downtime and setuptime.

This reverts commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65.

Change-Id: I252b5a4045657cfa8362e9aae755249480cd3b77
Signed-off-by: Navya <navyax.bathula@intel.com>
6 years agoMerge "Remove img_modify_playbook assignation in build_yardstick_image.yml"
Ross Brattain [Wed, 29 Nov 2017 11:51:15 +0000 (11:51 +0000)]
Merge "Remove img_modify_playbook assignation in build_yardstick_image.yml"

6 years agoMerge "Move test requirements into test-requirements.txt"
Ross Brattain [Wed, 29 Nov 2017 11:50:53 +0000 (11:50 +0000)]
Merge "Move test requirements into test-requirements.txt"

6 years agoMerge "Move test scripts to tools/"
Ross Brattain [Wed, 29 Nov 2017 11:50:30 +0000 (11:50 +0000)]
Merge "Move test scripts to tools/"

6 years agoMerge "tox: Split tests into separate tox environments"
Ross Brattain [Wed, 29 Nov 2017 11:50:07 +0000 (11:50 +0000)]
Merge "tox: Split tests into separate tox environments"

6 years agoMerge "Tox: add a pep8 target"
Ross Brattain [Wed, 29 Nov 2017 11:50:04 +0000 (11:50 +0000)]
Merge "Tox: add a pep8 target"

6 years agoRemove img_modify_playbook assignation in build_yardstick_image.yml 35/47935/1
Rodolfo Alonso Hernandez [Tue, 28 Nov 2017 14:02:34 +0000 (14:02 +0000)]
Remove img_modify_playbook assignation in build_yardstick_image.yml

Variable "img_modify_playbook" is being assigned in first context of
./ansible/build_yardstick_image.yml [1]. However this variable is never used.
In second context [2], the variable used is a CLI input variable.

[1]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/build_yardstick_image.yml#L187
[2]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/build_yardstick_image.yml#L205

JIRA: YARDSTICK-871

Change-Id: I7bd5063c5e86520abcafdc782222ee53faf58f45
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agofix docker client don't have trex_client 03/47503/1
Ace Lee [Mon, 20 Nov 2017 10:47:19 +0000 (10:47 +0000)]
fix docker client don't have trex_client

JIRA: YARDSTICK-854

Add trex_client in docker,
so we could run NSB testcase in docker container.

Change-Id: Iac1393d6e3a175137973190936ab69a1f2ce8272
Signed-off-by: Ace Lee <liyin11@huawei.com>
6 years agoMerge "update docker version to 16.04"
Ross Brattain [Mon, 20 Nov 2017 08:57:01 +0000 (08:57 +0000)]
Merge "update docker version to 16.04"

6 years agoNSB: Fix IndexError in pin_vcpu_for_perf 85/45885/3
Dino Madarang [Thu, 19 Oct 2017 20:41:05 +0000 (20:41 +0000)]
NSB: Fix IndexError in pin_vcpu_for_perf

This addresses the IndexError in Standalone SRIOV/OVSDPDK context.
The correct sys_cpu number should be sys_cpu-1

Error:
    threads = "%s-%s" % (soc_cpu[socket][sys_cpu], soc_cpu[socket][-1])
IndexError: list index out of range

Tested platform: (Hyper-Threading disabled)
NUMA node0 CPU(s):     0-21
NUMA node1 CPU(s):     22-43

With socket equal to 0, sys_cpu value was 22 which resulted to IndexError.

Change-Id: I36b045cacce4caff4b5ddafaa9b6737f1c6df0a1
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
6 years agobugfix: tc023 miss description and tc050-58 wrong description 39/47239/4
rexlee8776 [Wed, 15 Nov 2017 09:40:21 +0000 (09:40 +0000)]
bugfix: tc023 miss description and tc050-58 wrong description

also modify tc019,025,045-49 descrition to be unified

JIRA: YARDSTICK-850

Change-Id: I3f775f1ebff4063edc53b9bc26d7ba10b8af8a9d
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoMove test requirements into test-requirements.txt 33/47133/6
Emma Foley [Tue, 7 Nov 2017 22:52:42 +0000 (22:52 +0000)]
Move test requirements into test-requirements.txt

Move the packages required for testing into test-requirements.txt
This follows conventions used in OpenStack projects.

JIRA: YARDSTICK-837
Change-Id: If08fc416aa21b11250066bc19a54daa35e863407
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMove test scripts to tools/ 75/46875/6
Emma Foley [Tue, 7 Nov 2017 21:04:08 +0000 (21:04 +0000)]
Move test scripts to tools/

Move the scripts that tox uses for running tests
to the tools/ directory:
* run_tests.sh -> tools/run_tests.sh
* tests/ci/cover.{sh,awk} -> tools/

JIRA: YARDSTICK-837
Change-Id: I817c9e5f58c06b45f1de3f369318f4bb24168677
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agotox: Split tests into separate tox environments 73/46873/6
Emma Foley [Tue, 7 Nov 2017 20:29:03 +0000 (20:29 +0000)]
tox: Split tests into separate tox environments

* Add argument parsing to run_tests.sh so tests can be selected
* Define tox environments for:
  * Coverage
  * Unit tests
  * Functional tests
    * for py27 and py3
* Add environments to default env
  * Behaviour is the same when the tests are run
* Updates the py27 environment config, and adds a py3 config.
  * Commands from testenv are moved to py27
  * py3 env uses the same commands, but runs with python3

Change-Id: I22f17c0103101f01ec268b1de9d146780ae67a6d
JIRA: YARDSTICK-837
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoTox: add a pep8 target 75/46575/14
Emma Foley [Thu, 2 Nov 2017 16:50:14 +0000 (16:50 +0000)]
Tox: add a pep8 target

Adds a pep8, pep8-full targets to tox:
* pep8 target: runs pylint on the changed files
* pep8-full target: runs pylint on whole repo

Adds scripts to run pylint:
* stored in tools/

Documentation: changeed the command for running tests
(run_tests.sh -> tox). This runs the same set of tests as before.

JIRA: YARDSTICK-832

Change-Id: I652da87723682d958f3fcbc2eb4cd88422636a3b
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoMerge "Dockerfile: apt-get clean to save layer space"
Ross Brattain [Fri, 17 Nov 2017 17:16:51 +0000 (17:16 +0000)]
Merge "Dockerfile: apt-get clean to save layer space"

6 years agoMake GenericTrafficGen class abstract 39/47339/2
Rodolfo Alonso Hernandez [Thu, 16 Nov 2017 08:56:56 +0000 (08:56 +0000)]
Make GenericTrafficGen class abstract

GenericTrafficGen class is now an abstract class. Only optional methods
are implemented.
  - 'run_traffic' and 'terminate' are mandatory.
  - 'listen_traffic', 'verify_traffic' and 'wait_for_instance' are
    optional. By default these methods doesn't execute any action.

JIRA: YARDSTICK-853

Change-Id: I2befdaa337af79cc2364bdd7c66183c31c5ab69a
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoMerge "Add vfw ixload testcase for heat"
Ross Brattain [Fri, 17 Nov 2017 10:36:43 +0000 (10:36 +0000)]
Merge "Add vfw ixload testcase for heat"

6 years agoMerge "NSB: update vfw tc_heat_external tests"
Ross Brattain [Fri, 17 Nov 2017 10:34:28 +0000 (10:34 +0000)]
Merge "NSB: update vfw tc_heat_external tests"

6 years agoMerge "Check requirements against OpenStack requirements"
Ross Brattain [Fri, 17 Nov 2017 09:55:41 +0000 (09:55 +0000)]
Merge "Check requirements against OpenStack requirements"

6 years agoMerge "NSB Prox BM test case fixes for scale up"
Ross Brattain [Fri, 17 Nov 2017 09:48:39 +0000 (09:48 +0000)]
Merge "NSB Prox BM test case fixes for scale up"

6 years agoMerge "Fix controller IP parsing in "nsb_setup.sh" script"
Ross Brattain [Fri, 17 Nov 2017 09:46:46 +0000 (09:46 +0000)]
Merge "Fix controller IP parsing in "nsb_setup.sh" script"

6 years agoMerge "Clean functional tests in "test_cli_scenario""
Ross Brattain [Fri, 17 Nov 2017 09:46:00 +0000 (09:46 +0000)]
Merge "Clean functional tests in "test_cli_scenario""

6 years agoMerge "Create get_description and get_scenario_type for Scenario"
Ross Brattain [Fri, 17 Nov 2017 09:45:55 +0000 (09:45 +0000)]
Merge "Create get_description and get_scenario_type for Scenario"

6 years agoFix controller IP parsing in "nsb_setup.sh" script 11/46311/6
Rodolfo Alonso Hernandez [Fri, 27 Oct 2017 10:43:29 +0000 (11:43 +0100)]
Fix controller IP parsing in "nsb_setup.sh" script

Fixed the controller IP parsing in "nsb_setup.sh" script. The new
regex expression now accepts "OS_AUTH_URL" as:
  * http://10.237.223.168/identity
  * http://10.237.223.168:5000/identity
  * http://hostname/identity
  * http://hostname:5000/identity

JIRA: YARDSTICK-829

Change-Id: Ifaeab991bcbb6aa7b22c3533ab7554527184878b
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoupdate docker version to 16.04 23/46623/6
Ace Lee [Fri, 3 Nov 2017 06:39:00 +0000 (06:39 +0000)]
update docker version to 16.04

JIRA: YARDSTICK-690

This patch is for Yardstick Docker base image upgrade to 16.04

This patch will enable ansible build image in yardstick env prepare.

Add qemu-img convert to ansible build image.

Change-Id: I43127b6020bd20bd9f4aac4fca0df75353b24346
Signed-off-by: Ace Lee <liyin11@huawei.com>
6 years agoNSB "Prox" : Cleanup duplicated traffic profile 67/47367/1
Abhijit Sinha [Thu, 16 Nov 2017 17:40:02 +0000 (17:40 +0000)]
NSB "Prox" : Cleanup duplicated traffic profile

JIRA: YARDSTICK-848

The NSB PROX MPLS test uses Binsearch traffic
profile and the mpls traffic profile is a duplicate.

Change-Id: Ie2124cebf306fd6917b70ecd7c23ae12ef4850dc
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agoNSB TRex: convert DPDK port number to logical TRex port number 99/46599/10
Ross Brattain [Thu, 2 Nov 2017 23:54:56 +0000 (16:54 -0700)]
NSB TRex: convert DPDK port number to logical TRex port number

when we create TRex config we sort based on PCI bus address
and create a logical port ordering.

We need to save this port ordering and re-use it everywhere.

redirect vnfd_helper.port_num() to resource_helper.port_num() to
use the logical mapping

Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoNSB Prox BM test case fixes for scale up 31/47131/2
Abhijit Sinha [Mon, 13 Nov 2017 17:23:27 +0000 (17:23 +0000)]
NSB Prox BM test case fixes for scale up

YARDSTICK-839

In a scale-up test the VNF number can start from
0 to MAX (num_vnf-1)

The NSB PROX BM test nodes are currently marked as:
    tg__0: trafficgen_1.yardstick
    vnf__0: vnf.yardstick
They need to be changed to the below:
    tg__0: tg_0.yardstick
    vnf__0: vnf_0.yardstick

Changes done are:
- All BM Prox test cases have tg_0 and vnf_0 as default
  test nodes
- The prox-baremetal-1/2/4.yaml sample pod file
- Cleaned Up some unused Prox test/config files

Change-Id: I819011bcb35eda62b17dd3e1035918918c582b13
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agoMerge "Remove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats"
Ross Brattain [Fri, 10 Nov 2017 15:09:57 +0000 (15:09 +0000)]
Merge "Remove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats"

6 years agoMerge "tc053 kill haproxy wrong mismatch"
Ross Brattain [Fri, 10 Nov 2017 15:06:20 +0000 (15:06 +0000)]
Merge "tc053 kill haproxy wrong mismatch"

6 years agoMerge "Heat: add availability_zone"
Ross Brattain [Fri, 10 Nov 2017 15:05:51 +0000 (15:05 +0000)]
Merge "Heat: add availability_zone"

6 years agoMerge "Update links to documentation in README.rst"
Ross Brattain [Fri, 10 Nov 2017 15:04:57 +0000 (15:04 +0000)]
Merge "Update links to documentation in README.rst"

6 years agoMerge "NSB: fix vpe_config license"
Ross Brattain [Fri, 10 Nov 2017 14:59:30 +0000 (14:59 +0000)]
Merge "NSB: fix vpe_config license"

6 years agoMerge "pmu: remove event_download_local workaround script"
Ross Brattain [Fri, 10 Nov 2017 14:58:03 +0000 (14:58 +0000)]
Merge "pmu: remove event_download_local workaround script"

6 years agoNSB: fix vpe_config license 31/47031/1
Ross Brattain [Thu, 9 Nov 2017 15:40:23 +0000 (15:40 +0000)]
NSB: fix vpe_config license

Use Apache 2.0

Change-Id: I199d09f04a5c84a25bd91dceba5e4ed1f93075f6
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoCheck requirements against OpenStack requirements 75/46975/3
Rodolfo Alonso Hernandez [Wed, 8 Nov 2017 17:55:54 +0000 (17:55 +0000)]
Check requirements against OpenStack requirements

Added a new tox environment to check the project requirements against
the OpenStack requirements. The openstack/requirements branch used will
depends on Yardstick release development.

At this point, Yardstick F release must be compliant with OpenStack Pike
release.

Change-Id: I77a4cfa4f99674176c3f5711dc1b6787bb400ecf
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoAddition of IPv6 icpm, udp and tcp to Neutron Security Group 61/46661/4
DanielMartinBuckley [Fri, 3 Nov 2017 11:28:23 +0000 (11:28 +0000)]
Addition of IPv6 icpm, udp and tcp to Neutron Security Group

When creating a Neutron security group for a heat template. Add
IPv6 security group rules to access the resouces.

Change-Id: I0b541dfe400121e35908a70778665ee1576f0622
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoMerge "NSB Prox LW_AFTR Test"
Ross Brattain [Thu, 9 Nov 2017 10:18:21 +0000 (10:18 +0000)]
Merge "NSB Prox LW_AFTR Test"

6 years agoRemove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats 79/46879/1
Emma Foley [Wed, 8 Nov 2017 17:48:59 +0000 (17:48 +0000)]
Remove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats

* Remove the method which is unused and is marked as deprecated.

Change-Id: Ie64084fcd26985283c664445b173a757d3d908ab
JIRA: YARDSTICK-838
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agopmu: remove event_download_local workaround script 13/46813/3
Ross Brattain [Tue, 7 Nov 2017 19:49:47 +0000 (19:49 +0000)]
pmu: remove event_download_local workaround script

intel_pmu needs to download a config file based on the
CPU model.  When generating VNF images we don't have
access to the actual vCPU that will be used, so we
can't predownload.  This code was meant to be a fix
for that by downloading all the configs and then
selecting one that matched the vCPU.

However we have license issues with intel_pmu enven GPLv2 code,
so remove it for now.

Change-Id: I5257ff7c4ddc1d40537dadb29efa40d1d68cb852
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoFixed incorrect Copyright Notice 07/46807/3
DanielMartinBuckley [Tue, 7 Nov 2017 17:48:18 +0000 (17:48 +0000)]
Fixed incorrect Copyright Notice

Changed Copyright notice on tuples.lua from "Intel Copyright" to Apache 2.0

Change-Id: I85e6f9eb86c116d552f86cddf05b3b368b32f776
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
6 years agoClean functional tests in "test_cli_scenario" 79/46979/1
Rodolfo Alonso Hernandez [Tue, 7 Nov 2017 16:48:15 +0000 (16:48 +0000)]
Clean functional tests in "test_cli_scenario"

Changed how "test_cli_scenario" tests check the presence
of a string.

Fixed "test_scenario_show_Lmbench": logic in [1] was incorrectly
assigning an string value instead of the result of the "in"
clause.

[1] https://github.com/opnfv/yardstick/blob/stable/euphrates/tests/functional/test_cli_scenario.py#L35-L36

Change-Id: I71fceabad972e4c0d9e78cbfeb85dcd6a5ae4bda
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoCreate get_description and get_scenario_type for Scenario 77/46977/1
Rodolfo Alonso Hernandez [Tue, 7 Nov 2017 16:27:43 +0000 (16:27 +0000)]
Create get_description and get_scenario_type for Scenario

Created two new class functions for Scenario class:

* "get_description" will return the first line of the docstring,
  if exists.
* "get_scenario_type" will return the value of "__scenario_type__"
  variable.

Change-Id: I8e3b47e33e0bae101b874c3975bb9c383397d188
Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
6 years agoNSB Prox LW_AFTR Test 75/44775/14
DanielMartinBuckley [Wed, 11 Oct 2017 11:05:54 +0000 (12:05 +0100)]
NSB Prox LW_AFTR Test

JIRA: YARDSTICK-802

Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py
- This support BM and Openstack Heat
- This supports 4 Ports ONLY
- Grafana Dashboards included
- Code Coverage / Unit testing

Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7
Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agotest_sample_vnf: mock time 01/46601/1
Ross Brattain [Fri, 3 Nov 2017 01:12:33 +0000 (18:12 -0700)]
test_sample_vnf: mock time

Change-Id: Id8aa734fee431d90cbdc1e0eb2173784ada822fe
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoUpdate links to documentation in README.rst 83/46583/1
Emma Foley [Tue, 31 Oct 2017 15:53:05 +0000 (15:53 +0000)]
Update links to documentation in README.rst

The links to the docs in README were pointing to Colorodo documentation.

For master, this should not be pinned to a particular release, but
should show the most recent docs at all times.

Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
6 years agoHeat: add availability_zone 79/40179/7
Ross Brattain [Thu, 24 Aug 2017 22:06:50 +0000 (15:06 -0700)]
Heat: add availability_zone

Users would like to ensure placement of VMs on specific compute nodes so
that the measurements are meaningful. Examples: Measure network
performance in different scenarios (VMs in same host, in different
hosts, across fabric, across tenants)

Example:

context:
  name: yardstick
  placement_groups:
    pgrp1:
      policy: "availability"
  servers:
    tg_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone2"
    vnf_0:
      floating_ip: true
      placement: "pgrp1"
      availability_zone: "zone1"

Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoNSB: remove validate_cpu_cfg and all app cpu methods 49/46349/2
Ross Brattain [Fri, 27 Oct 2017 20:43:28 +0000 (13:43 -0700)]
NSB: remove validate_cpu_cfg and all app cpu methods

We don't really know what core we are going to use for the
VNF before we generate the MultiPortConfig, so these
methods are incorrect.

We may need some more advanced method to validate
the vCPU topology, but that will probably happen
in the MultiPortConfig

Change-Id: Ifee7ae4589ce0fce67771fb8d8b8dce0a0f06409
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "resource: remove cores args"
Ross Brattain [Tue, 31 Oct 2017 22:37:43 +0000 (22:37 +0000)]
Merge "resource: remove cores args"

6 years agoixia: add 1024 and 1280 byte packet size to Ixia ipv4 traffic profile 45/46145/2
Ross Brattain [Mon, 23 Oct 2017 21:07:01 +0000 (14:07 -0700)]
ixia: add 1024 and 1280 byte packet size to Ixia ipv4 traffic profile

This brings it to parity with its non-Ixia counterpart (ipv4_throughput.yaml).

Change-Id: I4c91d1ae507c7b5e0a23dcf49606b16891b400bd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agotc053 kill haproxy wrong mismatch 97/46297/2
rexlee8776 [Fri, 27 Oct 2017 09:23:16 +0000 (17:23 +0800)]
tc053 kill haproxy wrong mismatch

JIRA: YARDSTICK-831

Change-Id: I587c486572f439952b8a31da664d1e2c1fb8dc27
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
6 years agoresource: remove cores args 67/45267/6
Ross Brattain [Mon, 16 Oct 2017 21:30:13 +0000 (14:30 -0700)]
resource: remove cores args

We used to try to probe all the cores that the VNF was using
and only dump CPU stats for those cores.

We can't really detect those core accurately and we would rather
dump all the core information and let influxdb and grafana filter
the information.

We do end up with excessive KPI output, especially on systems with 88
cores, but this is manageable.

The core logic was partially removed, this finishes the removal.

Change-Id: I5cbb694fd982519e2df54db49a21ed5948e13537
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "KVMFORNFV: To avoid livemigration result update to json"
Jing Lu [Thu, 26 Oct 2017 07:50:50 +0000 (07:50 +0000)]
Merge "KVMFORNFV: To avoid livemigration result update to json"

6 years agoKVMFORNFV: To avoid livemigration result update to json 27/45227/15
Navya [Mon, 16 Oct 2017 14:26:41 +0000 (07:26 -0700)]
KVMFORNFV: To avoid livemigration result update to json

This patch is used to remove the livemigration testcase result loaded
to json as there is no dashboard implemented for the testcase

Change-Id: I7a9589a0bbc5f2a28587c2878da042fc50af18e0
Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
6 years agoRemoving trailing whitespace 95/46195/1
JingLu5 [Wed, 25 Oct 2017 02:13:01 +0000 (02:13 +0000)]
Removing trailing whitespace

Change-Id: I0380deec3e41a6dc02571ed9c4fa16e304f7f85e
Signed-off-by: JingLu5 <lvjing5@huawei.com>
6 years agoAdd "How to work with test case" into devguide 05/46105/2
kubi [Mon, 23 Oct 2017 07:51:03 +0000 (15:51 +0800)]
Add "How to work with test case" into devguide

JIRA: YARDSTICK-73

add a new chapter about how to work with test case, now just add three sub chapter,

sample test case, release test case, test case description file, will update more for

how to write a new test case.

Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39
Signed-off-by: kubi <jean.gaoliang@huawei.com>
6 years agoAdd vfw ixload testcase for heat 89/45389/6
Jennifer Li [Tue, 17 Oct 2017 19:58:31 +0000 (12:58 -0700)]
Add vfw ixload testcase for heat

    - concurrency
    - connections/second
    - throughput

Change-Id: Idb977462952fba2e6a9684e916dfeca810f1ee94
Signed-off-by: Jennifer Li <jennifer.li@intel.com>
6 years agoNSB: update vfw tc_heat_external tests 47/46147/1
Ross Brattain [Mon, 23 Oct 2017 21:51:04 +0000 (14:51 -0700)]
NSB: update vfw tc_heat_external tests

rename xe0, xe1 to uplink_0, downlink_0
enumerate tgs/vnfs starting from 0.
add disable_dhcp

Change-Id: Ia4f08b3ad5ab298192c249d04b10a6efbe4f210e
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoBugFix: Fix to pod filename ext and prox path 13/46113/1
Abhijit Sinha [Mon, 23 Oct 2017 09:27:27 +0000 (10:27 +0100)]
BugFix: Fix to pod filename ext and prox path

As per defect:
- the "context:" stanza of every tc_prox_baremetal*.yaml"
 file has an incorrect pathname for the config file

-  tc_prox_baremetal_binsearch.yaml and
tc_prox_baremetal_ramp.yaml refer to
"prox-baremetal.yml", which idoes not exist

- incorrect prox bin path

Resolution:
- Unify the pod file name and path for all BM tests
- Prox bin path changed to "/opt/nsb_bin/prox"

Change-Id: I16b25189104ad5585ddc1c2c0dd71b3c4c2aecd3
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agoMerge "Fix Malformed Table in User Guide docs"
Jing Lu [Fri, 20 Oct 2017 23:42:36 +0000 (23:42 +0000)]
Merge "Fix Malformed Table in User Guide docs"

6 years agoMerge "Added NSB sample Test Case documentation."
Jing Lu [Fri, 20 Oct 2017 23:41:08 +0000 (23:41 +0000)]
Merge "Added NSB sample Test Case documentation."

6 years agoFix Malformed Table in User Guide docs 59/46059/1
Trevor Bramwell [Fri, 20 Oct 2017 18:35:27 +0000 (11:35 -0700)]
Fix Malformed Table in User Guide docs

Change-Id: I2f98b75e9bbcd3d0cd4666c097a3280dd89eb02a
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoAdded NSB sample Test Case documentation. 87/45887/3
Maciej Skrocki [Thu, 19 Oct 2017 21:02:00 +0000 (14:02 -0700)]
Added NSB sample Test Case documentation.

Update:
Added Prox NSB test case documentation

Change-Id: Ia2f47d823581fc7f193d3123f080dd87f29d4b99
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agoDocs: add yardstick gui descrption in userguide 27/45927/3
JingLu5 [Fri, 20 Oct 2017 03:04:12 +0000 (03:04 +0000)]
Docs: add yardstick gui descrption in userguide

Change-Id: I09bc55e296d2c641f10819972ec0d48a289432b8
Signed-off-by: JingLu5 <lvjing5@huawei.com>
6 years agoMerge "Docs: update new test cases in release note"
Jing Lu [Fri, 20 Oct 2017 01:52:06 +0000 (01:52 +0000)]
Merge "Docs: update new test cases in release note"

6 years agoDocs: update new test cases in release note 91/45791/2
JingLu5 [Thu, 19 Oct 2017 09:49:51 +0000 (09:49 +0000)]
Docs: update new test cases in release note

Change-Id: Ie5ff6fe4f867ce68a33a3a857d8d051ba0020395
Signed-off-by: JingLu5 <lvjing5@huawei.com>
6 years agoMerge "nsb_installation: updates"
Trevor Cooper [Thu, 19 Oct 2017 21:52:53 +0000 (21:52 +0000)]
Merge "nsb_installation: updates"

6 years agonsb_installation: updates 95/45395/24
Ross Brattain [Tue, 17 Oct 2017 21:38:39 +0000 (14:38 -0700)]
nsb_installation: updates

JIRA: YARDSTICK-500

Change-Id: I6eef884ef6262abe49fc13bc353ca14a72a5b648
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
6 years agoMerge "NSB: fix trex config to use dpdk port number"
Ross Brattain [Thu, 19 Oct 2017 17:09:22 +0000 (17:09 +0000)]
Merge "NSB: fix trex config to use dpdk port number"

6 years agoMerge "BugFix: Negative dropped packets in Prox tests"
Ross Brattain [Thu, 19 Oct 2017 15:52:50 +0000 (15:52 +0000)]
Merge "BugFix: Negative dropped packets in Prox tests"

6 years agoBugFix: Negative dropped packets in Prox tests 77/45577/3
Abhijit Sinha [Wed, 18 Oct 2017 15:44:45 +0000 (16:44 +0100)]
BugFix: Negative dropped packets in Prox tests

Removed the abs function which can potentially mask
negative dropped packets.

Dropped packets in Prox workload VNF = rx_packets - tx_packets

Change-Id: I510a351e899cdf9a1f366d632b9f0528b1d9dcce
Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
6 years agoMerge "Adding sample trex example"
Ross Brattain [Thu, 19 Oct 2017 15:07:31 +0000 (15:07 +0000)]
Merge "Adding sample trex example"

6 years agoMerge "Add missing RFC2544 Ethernet frame sizes"
Rex Lee [Thu, 19 Oct 2017 12:23:57 +0000 (12:23 +0000)]
Merge "Add missing RFC2544 Ethernet frame sizes"

6 years agoMerge "DRAFT: update release notes for Euphrates"
Jing Lu [Thu, 19 Oct 2017 09:15:53 +0000 (09:15 +0000)]
Merge "DRAFT: update release notes for Euphrates"

6 years agoBugfix: move opnfv_os-odl-fdio_dvr-noha_daily.yaml to 'test_suites' directory 73/45773/1
JingLu5 [Thu, 19 Oct 2017 08:26:13 +0000 (08:26 +0000)]
Bugfix: move opnfv_os-odl-fdio_dvr-noha_daily.yaml to 'test_suites' directory

The opnfv_os-odl-fdio_dvr-noha_daily.yaml test suite file is wrongly put in Yardstick root directory,
this patch moves this file to the 'test_suites' directory.

Change-Id: Ib3f75845c7af658dc6f96ac2de737cfbd1faf15a
Signed-off-by: JingLu5 <lvjing5@huawei.com>
6 years agoMerge "Docs: update new implemented APIs"
Jing Lu [Thu, 19 Oct 2017 08:19:34 +0000 (08:19 +0000)]
Merge "Docs: update new implemented APIs"

6 years agoDocs: update new implemented APIs 11/45711/7
JingLu5 [Thu, 19 Oct 2017 03:07:39 +0000 (03:07 +0000)]
Docs: update new implemented APIs

Change-Id: If6b70791213099d53c82993bd22ac9eed6000c32
Signed-off-by: JingLu5 <lvjing5@huawei.com>
6 years agoDRAFT: update release notes for Euphrates 29/45629/4
Ross Brattain [Wed, 18 Oct 2017 22:18:52 +0000 (15:18 -0700)]
DRAFT: update release notes for Euphrates

Change-Id: I7e437612ca52b75b71e38962a84d0dcdb453d5dd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml updated"
Ross Brattain [Thu, 19 Oct 2017 04:43:51 +0000 (04:43 +0000)]
Merge "tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml updated"

6 years agoMerge "Create the ovs-vswitchd logging directory"
Ross Brattain [Thu, 19 Oct 2017 04:34:36 +0000 (04:34 +0000)]
Merge "Create the ovs-vswitchd logging directory"

6 years agoNSB: update vfw scale-out testcases 29/45729/2
Ross Brattain [Thu, 19 Oct 2017 03:53:53 +0000 (20:53 -0700)]
NSB: update vfw scale-out testcases

Change-Id: I6bd8a87f70954f288975e3e73e3cfbd36ae561dc
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoMerge "add CheckConnectivity scenario"
Jing Lu [Thu, 19 Oct 2017 02:04:58 +0000 (02:04 +0000)]
Merge "add CheckConnectivity scenario"

6 years agoadd CheckConnectivity scenario 49/44749/12
JingLu5 [Wed, 11 Oct 2017 05:54:25 +0000 (05:54 +0000)]
add CheckConnectivity scenario

Change-Id: I9d246828790467c2a57ba410826ee9751fff89c5
Signed-off-by: JingLu5 <lvjing5@huawei.com>
6 years agoNSB: fix trex config to use dpdk port number 97/45697/1
Ross Brattain [Thu, 19 Oct 2017 01:14:13 +0000 (18:14 -0700)]
NSB: fix trex config to use dpdk port number

From some reason Heat/Neutron is now creating
interfaces such that xe0 and xe1 are swapped.

xe0  fa:16:3e:38:c7:66  0000:00:05.0
xe1  fa:16:3e:2f:f3:e2  0000:00:03.0

this causes the DPDK port numbering to be swapped.

xe0 is DPDK port 1 because it has higher PCI address
xe1 is DPDK port 0 because it has lower PCI address.

The VNF is configured correctly because it uses DPDK port numbers,
whereas TRex was using interface list ordering.

Modify trex_cfg.yaml to use DPDK port ordering.  This also
requires running generate_cfg() after setup() in instantiate()

+------------------------------------+-------------------+------------------------------+--------+
| Name                               | MAC Address       | Fixed IP Addresses           | Status |
+------------------------------------+-------------------+------------------------------+--------+
| vnf_0.yardstick-af5ccb47-xe0-port  | fa:16:3e:66:a5:e4 | ip_address='10.1.0.7',       | ACTIVE |
| vnf_0.yardstick-af5ccb47-mgmt-port | fa:16:3e:fa:98:fe | ip_address='10.0.1.10',      | ACTIVE |
| tg_0.yardstick-af5ccb47-xe1-port   | fa:16:3e:2f:f3:e2 | ip_address='10.1.1.9',       | ACTIVE |
| vnf_0.yardstick-af5ccb47-xe1-port  | fa:16:3e:f3:1d:f5 | ip_address='10.1.1.4',       | ACTIVE |
|                                    | fa:16:3e:e3:8c:65 | ip_address='10.0.1.1',       | ACTIVE |
|                                    | fa:16:3e:ff:d1:b7 | ip_address='11.191.14.110',  | N/A    |
| tg_0.yardstick-af5ccb47-xe0-port   | fa:16:3e:38:c7:66 | ip_address='10.1.0.8',       | ACTIVE |
|                                    | fa:16:3e:ff:53:5f | ip_address='11.191.14.101',  | DOWN   |
|                                    | fa:16:3e:23:5d:2c | ip_address='10.0.1.2',       | ACTIVE |
| tg_0.yardstick-af5ccb47-mgmt-port  | fa:16:3e:7a:df:4e | ip_address='10.0.1.5',       | ACTIVE |
|                                    | fa:16:3e:22:65:36 | ip_address='11.191.14.109',  | N/A    |
+------------------------------------+-------------------+------------------------------+--------+

/sys/devices/pci0000:00/0000:00:03.0/virtio0/net/ens3/address:fa:16:3e:2f:f3:e2
/sys/devices/pci0000:00/0000:00:05.0/virtio2/net/ens5/address:fa:16:3e:38:c7:66

Change-Id: Iaef2c7d9a5af7f45bd805a8ad6ee545ce0495cb1
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
6 years agoAdd missing RFC2544 Ethernet frame sizes 99/45699/1
Dino Madarang [Thu, 19 Oct 2017 01:14:28 +0000 (01:14 +0000)]
Add missing RFC2544 Ethernet frame sizes

RFC2544 tests should include the following frame sizes:

9.1 Frame sizes to be used on Ethernet

       64, 128, 256, 512, 1024, 1280, 1518

Change-Id: I6ab9cccf2bb3b2678f50da157a9a49c0d9564cbd
Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com>
Reviewed-by: Alain Jebara <alain.jebara@intel.com>
Reviewed-by: Deepak S <deepak.s@linux.intel.com>
Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
6 years agoMerge "add VNF scale-up template"
Ross Brattain [Thu, 19 Oct 2017 00:12:16 +0000 (00:12 +0000)]
Merge "add VNF scale-up template"

6 years agoMerge "Resolve full path to adminrc file if full path is not provided"
Ross Brattain [Thu, 19 Oct 2017 00:11:17 +0000 (00:11 +0000)]
Merge "Resolve full path to adminrc file if full path is not provided"

6 years agoMerge "Disable spoof check on vfs in sriov setup"
Ross Brattain [Thu, 19 Oct 2017 00:05:09 +0000 (00:05 +0000)]
Merge "Disable spoof check on vfs in sriov setup"

6 years agoMerge "Adding cpu set to enable affinity for given vcpu"
Ross Brattain [Thu, 19 Oct 2017 00:04:57 +0000 (00:04 +0000)]
Merge "Adding cpu set to enable affinity for given vcpu"

6 years agoMerge "Added required ubuntu packages to run IxLoad client"
Ross Brattain [Wed, 18 Oct 2017 22:58:43 +0000 (22:58 +0000)]
Merge "Added required ubuntu packages to run IxLoad client"