yardstick.git
7 years agoMerge "Add a new runner to test end-to-end fast data path"
Rex Lee [Mon, 24 Apr 2017 01:57:19 +0000 (01:57 +0000)]
Merge "Add a new runner to test end-to-end fast data path"

7 years agoMerge "Add SRIOV support"
Kubi [Sun, 23 Apr 2017 10:41:27 +0000 (10:41 +0000)]
Merge "Add SRIOV support"

7 years agoYardstick virtualenv support 87/33187/3
chenjiankun [Mon, 10 Apr 2017 11:01:57 +0000 (11:01 +0000)]
Yardstick virtualenv support

JIRA: YARDSTICK-620

In the patch, I separate python-setuptools from install.sh
and separate appdirs from requirements.txt because there will be
error when install them in virtualenv.
Also I will update the documentation when this patch merged;

Change-Id: I99a532d1851983775869e7c5e8e65fd0229e86df
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd SRIOV support 89/32789/11
Jing Zhang [Fri, 31 Mar 2017 13:20:46 +0000 (09:20 -0400)]
Add SRIOV support

A generic provider network solution is introduced. To identify whether a network specified in the test case is a provider network new attributes are introduced in the test case network section:

networks:
  test-net:
    cidr: '192.168.1.0/24'
    provider: "sriov"
    physical_network: 'physnet1'

If the "provider" attribute is present, the network is an existing provider network. If the value is "sriov", binding:vnic_type=direct is added to the interface in the heat deployment template. In orchestrator/heat.py, the interface creating functions are given a new parameter that tells if the network in use is a provider network. The benchmark/contexts/model.py is changed to store the value of the provider attribute from the test case and function calls to port creation is updated with the provider parameter. The same change is made in contexts/heat.py as well. Also calls for creating a new tenant network is replaced for creating a new provider network if the provider attribute is present.

Update-1: Change test_model.py
Update-2: Per comment, change comment style to """"
Update-3: Change test_heat.py
Update-4: Add unit test cases to pass coverage test
Update-5: Add SRIOV provider network example in opnfv_yardstick_tc008.yaml
Update-6: Per comment, remove empty line in orchestrator/test_heat.py
Update-7: Per comment, change comment lines in orchestrator/test_heat.py
Update-8: Add more unit test cases to pass coverage test
Update-9: Change to create SRIOV provider network on the fly so as to support co-current test runs
Update-10: Per comment, init physical_network to 'physnet1'

Change-Id: I76004c4fcc9bffcfd8ed021fd647e0cecb346ef4
JIRA: YARDSTICK-612
Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
7 years agoKVMFORNFV:Passing breaktrace option to cyclictest. 07/33407/2
kalyanreddy [Mon, 17 Apr 2017 05:16:23 +0000 (10:46 +0530)]
KVMFORNFV:Passing breaktrace option to cyclictest.

This patch is used to add breaktrace option to monitor the latency
values while executing cyclictest test cases as a part of kvmfornfv
verify and daily jobs.

Change-Id: I035ea72a8946a9d3db37a6ee33ffbf3ca67834a2
Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
7 years agoMerge "Bugfix: fix typo"
Rex Lee [Thu, 13 Apr 2017 04:03:52 +0000 (04:03 +0000)]
Merge "Bugfix: fix typo"

7 years agoBugfix: fix typo 61/33261/3
JingLu5 [Mon, 27 Mar 2017 02:15:00 +0000 (02:15 +0000)]
Bugfix: fix typo

Change-Id: I9b7cd5f94b1663af3b807ce24c941868b10d85d1
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoAdd a new runner to test end-to-end fast data path 71/33271/1
Jing Zhang [Tue, 11 Apr 2017 19:24:22 +0000 (15:24 -0400)]
Add a new runner to test end-to-end fast data path

This runner caters testing fast host data path (e.g. SRIOV) plus fast VM data path (VM running pktgen-dpdk).
It is implemented as a new flavor of the existing Iteration runner.
(1) Add a new SLA action rate-control
(2) While the SLA target is not met, reduce packet rate until packet loss target is met.

Change-Id: I633f391f1790f03ff31458458d79d3f272475ab5
JIRA: YARDSTICK-615
Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
7 years agoKVMFORNFV: Grafana config for Packet Forwarding test cases. 83/33183/3
kalyanreddy [Mon, 10 Apr 2017 10:05:41 +0000 (15:35 +0530)]
KVMFORNFV: Grafana config for Packet Forwarding test cases.

This patch is used for adding configuration file to opnfv grafana
dashboard for kvmfornfv packet forwarding test cases as a part of
daily job.

Change-Id: If2f06d2c01a7f6863ae1aa25942c3197856d895b
Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
7 years agoMerge "cyclictest: use raw strings to escape \[8"
Jing Lu [Mon, 10 Apr 2017 00:53:12 +0000 (00:53 +0000)]
Merge "cyclictest: use raw strings to escape \[8"

7 years agoMerge "attacker_general: fix logging to use %s"
Jing Lu [Thu, 6 Apr 2017 07:23:17 +0000 (07:23 +0000)]
Merge "attacker_general: fix logging to use %s"

7 years agocyclictest: use raw strings to escape \[8 81/32981/2
Ross Brattain [Tue, 4 Apr 2017 06:46:51 +0000 (23:46 -0700)]
cyclictest: use raw strings to escape \[8

Change-Id: I36d93eacab2470f90af5653104ad5c07853411bf
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agopip install yardstick failed in Apex 35/33035/1
JingLu5 [Thu, 6 Apr 2017 05:02:12 +0000 (05:02 +0000)]
pip install yardstick failed in Apex

JIRA: YARDSTICK-625

In Apex, yardstick uninstall and install via pip failed.
This bug blocks yardstick CI jobs.
This patch enables pip install yardstick in editable mode.
So the install_yardstick() in yardstick_verify is unnecessary.

Change-Id: If290dac5fee5584601064ae9753ae2340643d3ca
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: fix ubuntu image name typo 27/33027/1
JingLu5 [Thu, 6 Apr 2017 01:56:48 +0000 (01:56 +0000)]
Bugfix: fix ubuntu image name typo

Change-Id: I8722f2ddd096bc784f45d4bcf58ea6a84d319fb2
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: fix query job status in TC074 53/32853/5
JingLu5 [Wed, 5 Apr 2017 06:11:16 +0000 (06:11 +0000)]
Bugfix: fix query job status in TC074

JIRA: YARDSTICK-621
The storperf job status query in TC074 didn' work properly. The cause is the
"type: status" is not passed in the URL. This patch also update storperf VM
image to xenial.

Change-Id: Idd9f501416b24612f6045a57ba2a95e2ed3a9572
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoattacker_general: fix logging to use %s 87/32987/1
Ross Brattain [Tue, 4 Apr 2017 06:43:56 +0000 (23:43 -0700)]
attacker_general: fix logging to use %s

Change-Id: Ib451d7883eb5df13cfe95477cea43c076ac0452a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "Add opnfv_os-ovn-nofeature-noha_daily test suite"
Jing Lu [Wed, 5 Apr 2017 04:22:38 +0000 (04:22 +0000)]
Merge "Add opnfv_os-ovn-nofeature-noha_daily test suite"

7 years agoMerge "Yardstick virtualenv support"
Jing Lu [Wed, 5 Apr 2017 04:22:26 +0000 (04:22 +0000)]
Merge "Yardstick virtualenv support"

7 years agoAdd opnfv_os-ovn-nofeature-noha_daily test suite 73/32973/1
JingLu5 [Wed, 5 Apr 2017 01:43:50 +0000 (01:43 +0000)]
Add opnfv_os-ovn-nofeature-noha_daily test suite

JIRA: YARDSTICK-624

Change-Id: Ia783bec53e4d889736db7e510d28c32377d4f9b2
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "yardstick offline support"
Jing Lu [Sat, 1 Apr 2017 09:36:06 +0000 (09:36 +0000)]
Merge "yardstick offline support"

7 years agoBugfix: take test case modification into effect in load_images.sh 55/32855/1
JingLu5 [Sat, 1 Apr 2017 08:03:24 +0000 (08:03 +0000)]
Bugfix: take test case modification into effect in load_images.sh

JIRA: YARDSTICK-622

Bug log: https://build.opnfv.org/ci/view/armband/job/yardstick-fuel-armband-baremetal-daily-danube/24/console

This error is because the file changes done in the load_images.sh is not updated.
After file modification, pip install -U . is required to tack changes into effect.

Change-Id: I8be3ffc963e3d5cec861b68a33efc2fa5bdabbd2
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoYardstick virtualenv support 37/32837/2
chenjiankun [Sat, 1 Apr 2017 01:19:16 +0000 (01:19 +0000)]
Yardstick virtualenv support

JIRA: YARDSTICK-620

Currently we recommend using docker to run yardstick.
And it is hard to use virtualenv to install yardstick.
So I modify install.sh in yardstick root path.
It will support using virtualenv to install yardstick(including API) in
linux.
In this patch, I make yardstick support read yardstick configuration
have priority over constants.

Change-Id: I9ea1241b228532a6497451e6c8f232173ddb783e
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoRefine documentation 45/32745/3
JingLu5 [Fri, 31 Mar 2017 09:17:26 +0000 (09:17 +0000)]
Refine documentation

Change-Id: Ic9a84954fdb18ac97afde01541b4c84157df8441
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Store packetsize in influxdb"
Rex Lee [Fri, 31 Mar 2017 06:52:23 +0000 (06:52 +0000)]
Merge "Store packetsize in influxdb"

7 years agoStore packetsize in influxdb 19/32519/3
Jing Zhang [Thu, 30 Mar 2017 13:26:55 +0000 (09:26 -0400)]
Store packetsize in influxdb

This allows calculating throughput in Gbps.

Add: test_pktgen.py

Change-Id: I7e2132ec71985c14570ef18b952b2264ebf7abbc
JIRA: YARKSTICK-611
Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
7 years agoMerge "add yardstick_user_interface chapter in userguide"
Jing Lu [Fri, 31 Mar 2017 01:40:59 +0000 (01:40 +0000)]
Merge "add yardstick_user_interface chapter in userguide"

7 years agoMerge "Bugfix: cacert should suppot insecure mode if needed"
Jing Lu [Fri, 31 Mar 2017 01:40:34 +0000 (01:40 +0000)]
Merge "Bugfix: cacert should suppot insecure mode if needed"

7 years agoadd yardstick_user_interface chapter in userguide 77/32477/1
JingLu5 [Thu, 30 Mar 2017 11:50:02 +0000 (11:50 +0000)]
add yardstick_user_interface chapter in userguide

JIRA: YARDSTICK-618

Change-Id: I690c24d665016a381ae1ed7d8fa94d5a34bc1b1b
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Bugfix: Add test suite for opnfv_os-odl_l3-ovs-ha_daily scenario"
Jing Lu [Thu, 30 Mar 2017 11:36:18 +0000 (11:36 +0000)]
Merge "Bugfix: Add test suite for opnfv_os-odl_l3-ovs-ha_daily scenario"

7 years agoMerge "Refine documentation"
Jing Lu [Thu, 30 Mar 2017 09:40:07 +0000 (09:40 +0000)]
Merge "Refine documentation"

7 years agoRefine documentation 59/31959/28
JingLu5 [Tue, 28 Mar 2017 01:43:21 +0000 (01:43 +0000)]
Refine documentation

Change-Id: I0d3387a520e3decf51bb0f7db53996f148a611d0
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: Add test suite for opnfv_os-odl_l3-ovs-ha_daily scenario 81/32381/2
JingLu5 [Thu, 30 Mar 2017 06:36:29 +0000 (06:36 +0000)]
Bugfix: Add test suite for opnfv_os-odl_l3-ovs-ha_daily scenario

JIRA: YARDSTICK-617

Apex has a new scenario 'opnfv_os-odl_l3-ovs-ha_daily' in CI.
This patch add yardstick test suite for this scenario.

Change-Id: I50eb84fb506e7cf87cbd6bcb67f3df6d185d8b6b
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: cacert should suppot insecure mode if needed 59/32359/1
rexlee8776 [Thu, 30 Mar 2017 02:37:02 +0000 (10:37 +0800)]
Bugfix: cacert should suppot insecure mode if needed

currently, we use env variable "OS_CACERT" to specify the location of
cert file. but if there's no cacert and use for personal verification,
it's better to also support insecure mode by set OS_CACERT=False

JIRA: YARDSTICK-616

Change-Id: I73b0860863bf6386f9114328c52594ef87e02fa3
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
7 years agoMerge "Set work directory in Yardstick container"
Jing Lu [Wed, 29 Mar 2017 03:21:58 +0000 (03:21 +0000)]
Merge "Set work directory in Yardstick container"

7 years agoBugfix: improper license header in swagger docs 59/32059/1
chenjiankun [Tue, 28 Mar 2017 13:51:42 +0000 (13:51 +0000)]
Bugfix: improper license header in swagger docs

JIRA: YARDSTICK-609

In the patch:
https://gerrit.opnfv.org/gerrit/#/c/28833/

It update the license header, but it is improper to swagger yaml file.
The license information will show in swagger docs.
So I remove it.

Change-Id: Ib87f0f43a95e3b2145c4b59059c4573000f1997c
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoyardstick offline support 05/32005/3
chenjiankun [Tue, 28 Mar 2017 07:58:49 +0000 (07:58 +0000)]
yardstick offline support

JIRA: YARDSTICK-597

Currently yardstick can not run offline.
In some case this will block the process, causing yardstick job failed
The reason is yardstick will pull the latest code when run in CI.
Actually we need not pull the latest code because the code in yardstick
is already the latest code.
So I remove them.
Also I check the environment variable and yardstick-image when fetch
openrc file and load images.

Change-Id: I797da272932ab5292aa40585c82c119aa71b8849
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Bugfix: Error validating value 'cirros-0.3.5'"
Jing Lu [Tue, 28 Mar 2017 08:48:42 +0000 (08:48 +0000)]
Merge "Bugfix: Error validating value 'cirros-0.3.5'"

7 years agoMerge "Bugfix:add storperf flavor for TC074"
Jing Lu [Tue, 28 Mar 2017 03:31:19 +0000 (03:31 +0000)]
Merge "Bugfix:add storperf flavor for TC074"

7 years agoSet work directory in Yardstick container 67/31967/2
JingLu5 [Tue, 28 Mar 2017 03:15:35 +0000 (03:15 +0000)]
Set work directory in Yardstick container

JIRA: YARDSTICK-608

Set the work directory to /home/opnfv/repos in yardstick docker container to
help users better understand file structure.
This is a improvement related with document improvement.

Change-Id: Ief4b76e6d6898ceab4a546574f5a09d51eb0d945
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: Error validating value 'cirros-0.3.5' 55/31955/1
JingLu5 [Tue, 28 Mar 2017 01:21:20 +0000 (01:21 +0000)]
Bugfix: Error validating value 'cirros-0.3.5'

JIRA: YARDSTICK-607

some scenarios come with a Cirros-0.3.5 image, Yardstick's load_images.sh will
load a second cirros-0.3.5 image, causing the following error:
2017-03-27 07:42:58,317 yardstick.orchestrator.heat heat.py:449 INFO Creating stack 'demo-2ada98f3'
error: failed to deploy stack: 'ERROR: Property error: : resources.ares.demo-2ada98f3.properties.image: : Error validating value 'cirros-0.3.5': No images unique match found for
{'name': u'cirros-0.3.5'}

This patch fixs this error by skipping load cirros image if there already exist
one in the glance.

Change-Id: I4d43d82d331f6575efd4560be9b6be175e03cd1b
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "pathspec 'master' did not match any file(s) known to git"
Jing Lu [Mon, 27 Mar 2017 04:02:56 +0000 (04:02 +0000)]
Merge "pathspec 'master' did not match any file(s) known to git"

7 years agoMerge "model: pylint fixes"
Rex Lee [Mon, 27 Mar 2017 03:23:32 +0000 (03:23 +0000)]
Merge "model: pylint fixes"

7 years agopathspec 'master' did not match any file(s) known to git 29/31829/3
chenjiankun [Mon, 27 Mar 2017 02:18:05 +0000 (02:18 +0000)]
pathspec 'master' did not match any file(s) known to git

JIRA: YARDSTICK-605

On stable branch, exec_tests.sh will also try to git checkout master
branch, which cause error "pathspec 'master' did not match any file(s)
known to git." This is a remianing bug from the previous release.
see at:
https://build.opnfv.org/ci/view/yardstick/job/yardstick-apex-lf-pod1-daily-danube/62/console
This error occur in line 48.
But the reason is 'set -e'
If we set 'set -e':
'git checkout master && git pull' return 1 but it will go on executing;
but 'git checkout master' will return 1 and terminate immediately.
If we do not set, it will return 1 but will terminate immediately.
Actually we not need 'git checkout master' here because it is already in
stable/danube branch.
So I remove it.

Change-Id: I106a1da28cf2deee90ebcb25adaf638a210928ee
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Bugfix:HA test cases rely on dynamic ip addresses in fuel pods"
Jing Lu [Mon, 27 Mar 2017 00:41:31 +0000 (00:41 +0000)]
Merge "Bugfix:HA test cases rely on dynamic ip addresses in fuel pods"

7 years agoBugfix:HA test cases rely on dynamic ip addresses in fuel pods 47/31747/1
JingLu5 [Sat, 25 Mar 2017 01:17:53 +0000 (01:17 +0000)]
Bugfix:HA test cases rely on dynamic ip addresses in fuel pods

JIRA: YARDSTICK-602

change HA test cases to rely on dynamical generated pod.yaml in fuel pods

Change-Id: I0efb01489eb2dd94babf1a45bff2fbf6adef5f6e
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix:add storperf flavor for TC074 37/31737/1
JingLu5 [Thu, 23 Mar 2017 07:53:10 +0000 (07:53 +0000)]
Bugfix:add storperf flavor for TC074

JIRA: YARDSTICK-604

the storperf container now uses a flavor called "storperf", if this flavor is
absent, stack creating process will fail. also the openstack variables that
passed to the storperf container also needs a update

Change-Id: Iab4be6491cc9b24526948e5571f0476ec885a93d
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoUpdate cirros image to latest version 99/31699/1
Michael Polenchuk [Fri, 24 Mar 2017 13:55:39 +0000 (17:55 +0400)]
Update cirros image to latest version

Change-Id: Iffa1e4529e5b6e9664ac503a5815ea9a034d7515
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
7 years agomodel: pylint fixes 21/30621/2
Ross Brattain [Thu, 16 Mar 2017 02:47:24 +0000 (19:47 -0700)]
model: pylint fixes

remove redundnant parens
replace type with isinstance
fix import order

Change-Id: I0407cbbf6993290f392f17c398827603b5bc1ebd
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "Update yardstick framework architecture in userguide"
Jing Lu [Thu, 23 Mar 2017 08:38:12 +0000 (08:38 +0000)]
Merge "Update yardstick framework architecture in userguide"

7 years agoMerge "Bugfix: Could not load EntryPoint.parse when using 'openstack -h'"
Jing Lu [Thu, 23 Mar 2017 06:26:50 +0000 (06:26 +0000)]
Merge "Bugfix: Could not load EntryPoint.parse when using 'openstack -h'"

7 years agoBugfix: TC002 image error in fuel-arm pod scenarios 53/31453/1
JingLu5 [Thu, 23 Mar 2017 01:14:43 +0000 (01:14 +0000)]
Bugfix: TC002 image error in fuel-arm pod scenarios

JIRA: YARDSTICK-601

This error is cause because the TC 002 configuration file has been modified in
image section, the old sed command in load_images.sh
"sed -i 's/image: cirros-0.3.3/image: TestVM/g' tests/opnfv/test_cases/opnfv_yardstick_tc002.yaml samples/ping.yaml" didn't work properly.

Change-Id: Ie897213622d05bb267f94b466eb2529e797d484e
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Yardstick: User interface for Yardstick."
Jing Lu [Wed, 22 Mar 2017 09:04:15 +0000 (09:04 +0000)]
Merge "Yardstick: User interface for Yardstick."

7 years agoMerge "aarch64: Improve arch detection snippet"
Jing Lu [Wed, 22 Mar 2017 07:58:48 +0000 (07:58 +0000)]
Merge "aarch64: Improve arch detection snippet"

7 years agoMerge "aarch64: Fix missing qemu-aarch64-static in chroot"
Jing Lu [Wed, 22 Mar 2017 07:31:17 +0000 (07:31 +0000)]
Merge "aarch64: Fix missing qemu-aarch64-static in chroot"

7 years agoMerge "Refine test case description for tc076"
Jing Lu [Wed, 22 Mar 2017 07:17:40 +0000 (07:17 +0000)]
Merge "Refine test case description for tc076"

7 years agoUpdate yardstick framework architecture in userguide 45/30545/15
JingLu5 [Wed, 15 Mar 2017 09:56:09 +0000 (09:56 +0000)]
Update yardstick framework architecture in userguide

JIRA: YARDSTICK-590

This patch update the yardstick framework architecture in the userguide,
also fix some rst grammar mistakes

Change-Id: I84e7c24b4cd936a01f4c191e9f530f15f9f711de
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoaarch64: Fix missing qemu-aarch64-static in chroot 01/31201/2
Paul Vaduva [Tue, 21 Mar 2017 14:36:46 +0000 (15:36 +0100)]
aarch64: Fix missing qemu-aarch64-static in chroot

During recent rework, we lost the explicit copy of qemu-aarch64-static
from docker to chroot; so when trying to execute AArch64 binaries
inside chroot, no emulator was present to handle it.

This change brings back (inside chroot) the missing emulator binary.

JIRA: YARDSTICK-595

Change-Id: I146e2eeec2e9452a0db36f0bf0a466a8affc2005
Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
7 years agoBugfix: Could not load EntryPoint.parse when using 'openstack -h' 39/31139/1
JingLu5 [Tue, 21 Mar 2017 07:35:17 +0000 (07:35 +0000)]
Bugfix: Could not load EntryPoint.parse when using 'openstack -h'

JIRA: YARDSTICK-599

Python-openstackclient 3.7.0 has a issus that cause -help info can not be
loaded properly when executing 'openstack -h' command.

Change-Id: I0a5f7a0943d56764b1c4d5d7335aa67b30f39b4c
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "yardstick offline support"
Jing Lu [Tue, 21 Mar 2017 06:47:52 +0000 (06:47 +0000)]
Merge "yardstick offline support"

7 years agoMerge "Dockerfile: Use qemu-user-static from xenial "
Kubi [Tue, 21 Mar 2017 04:37:26 +0000 (04:37 +0000)]
Merge "Dockerfile: Use qemu-user-static from xenial "

7 years agoMerge "update lxd image disk format for openstack CLI"
Jing Lu [Tue, 21 Mar 2017 01:58:22 +0000 (01:58 +0000)]
Merge "update lxd image disk format for openstack CLI"

7 years agoMerge "Bugfix: remove vivid as it is EOL"
Jing Lu [Tue, 21 Mar 2017 01:24:16 +0000 (01:24 +0000)]
Merge "Bugfix: remove vivid as it is EOL"

7 years agoMerge "Bugfix: replace MD5SUM with SHA256SUMs"
Jing Lu [Tue, 21 Mar 2017 01:23:48 +0000 (01:23 +0000)]
Merge "Bugfix: replace MD5SUM with SHA256SUMs"

7 years agoMerge "Bugfix: netperf_bottleneck execute failed because is_same_heat_context return...
Jing Lu [Tue, 21 Mar 2017 01:15:16 +0000 (01:15 +0000)]
Merge "Bugfix: netperf_bottleneck execute failed because is_same_heat_context return True"

7 years agoMerge "add missing test suite files for new scenarios"
Jing Lu [Tue, 21 Mar 2017 00:31:31 +0000 (00:31 +0000)]
Merge "add missing test suite files for new scenarios"

7 years agoaarch64: Improve arch detection snippet 95/31095/1
Matei Valeanu [Mon, 20 Mar 2017 19:19:32 +0000 (20:19 +0100)]
aarch64: Improve arch detection snippet

Get the arch from a compute node
Also move code that depends on YARD_IMG_ARCH,
after YARD_IMG_ARCH gets set

JIRA: YARDSTICK-591

Change-Id: I5ed3ef9cfa92e5bf9e6ada21396d18643cf1a55c
Signed-off-by: Matei Valeanu <Matei.Valeanu@enea.com>
7 years agoBugfix: netperf_bottleneck execute failed because is_same_heat_context return True 25/31025/1
chenjiankun [Mon, 20 Mar 2017 10:31:40 +0000 (10:31 +0000)]
Bugfix: netperf_bottleneck execute failed because is_same_heat_context return True

JIRA: YARDSTICK-600

Bugfix: netperf_bottleneck execute failed because is_same_heat_context return True
So it exit without warning.
I will remove the 'return True' from it.

Change-Id: I48d62bd15ec359e2121f236c48d9d349174f2c10
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Add NUMA pinning support for node context"
Jing Lu [Mon, 20 Mar 2017 09:33:32 +0000 (09:33 +0000)]
Merge "Add NUMA pinning support for node context"

7 years agoMerge "Add CPU pinning support for node context"
Jing Lu [Mon, 20 Mar 2017 09:33:24 +0000 (09:33 +0000)]
Merge "Add CPU pinning support for node context"

7 years agoBugfix: remove vivid as it is EOL 01/31001/1
Ross Brattain [Mon, 20 Mar 2017 08:52:25 +0000 (01:52 -0700)]
Bugfix: remove vivid as it is EOL

Vivid is end of life, and thus not supported.

Change-Id: Ia293fcd6fd2a3279a642a6dbbb7ad1811334c3e1
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoBugfix: replace MD5SUM with SHA256SUMs 99/30999/1
Ross Brattain [Mon, 20 Mar 2017 08:49:18 +0000 (01:49 -0700)]
Bugfix: replace MD5SUM with SHA256SUMs

MD5 is broken and should not be used

Change-Id: Ib168932387f58f0a538d865f8ef4e3cda046a35a
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoupdate lxd image disk format for openstack CLI 75/30975/1
JingLu5 [Mon, 20 Mar 2017 02:32:51 +0000 (02:32 +0000)]
update lxd image disk format for openstack CLI

JIRA: YARDSTICK-598

As we have replaced 'glance image-create' command with 'openstack image create'
command, we also need to update the disk-format for openstack CLI. the
'root-tar' is no longer a valid choice. (choose from 'ami', 'ari', 'aki',
'vhd', 'vmdk', 'raw', 'qcow2', 'vhdx', 'vdi', 'iso', 'ploop')

Change-Id: I53f839f658c5a6f216f5bb942b1c4f4dcdbf9814
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoyardstick offline support 67/30967/1
chenjiankun [Mon, 20 Mar 2017 01:37:44 +0000 (01:37 +0000)]
yardstick offline support

JIRA: YARDSTICK-597

Currently yardstick can not run offline.
The reason is yardstick will pull the latest code when run in CI.
Actually we need not pull the latest code because the code in yardstick
is already the latest code.
So I remove them.

Change-Id: Ief87c529625ccaa26e758a2206318b3797bbfd74
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoadd missing test suite files for new scenarios 63/30963/3
JingLu5 [Mon, 20 Mar 2017 01:10:39 +0000 (01:10 +0000)]
add missing test suite files for new scenarios

JIRA: YARDSTICK-589

Change-Id: I1690d4e2bd741fe1514c8496ee6ff10b72158859
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Bugfix: load_images cleanup, shellcheck fixes"
Kubi [Mon, 20 Mar 2017 01:13:06 +0000 (01:13 +0000)]
Merge "Bugfix: load_images cleanup, shellcheck fixes"

7 years agoMerge "add missing test suite files for new scenarios"
Jing Lu [Sat, 18 Mar 2017 02:08:47 +0000 (02:08 +0000)]
Merge "add missing test suite files for new scenarios"

7 years agoDockerfile: Use qemu-user-static from xenial 37/30837/2
Paul Vaduva [Fri, 17 Mar 2017 14:25:23 +0000 (15:25 +0100)]
Dockerfile: Use qemu-user-static from xenial

qemu-user-static from Trusty crashes when ssl is used in chroot.

JIRA: YARDSTICK-592

Change-Id: I81e8f04d7469082ceb6512cb09e11dfa672e5e98
Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
7 years agoMerge "Bugfix: yardstick-image built without test tools"
Jing Lu [Fri, 17 Mar 2017 16:05:12 +0000 (16:05 +0000)]
Merge "Bugfix: yardstick-image built without test tools"

7 years agoYardstick: User interface for Yardstick. 35/29435/17
rajesh_4k [Mon, 27 Feb 2017 12:39:00 +0000 (18:09 +0530)]
Yardstick: User interface for Yardstick.

Currently Yardstick doesnt have any UI which gives detail analysis
of the test-results.
This commit generates a HTML page after the execution of a command
"yardstick report generate <task-ID> <TC-name>" which intern
can be executed after the execution of test-case.
Used: Highcharts.js for the graphs.

JIRA: YARDSTICK-280

Change-Id: Ic98cc348719f3922bff178f52e7944a4a931763a
Signed-off-by: Rajesh K <4k.rajesh@gmail.com>
7 years agoMerge "Bugfix: network_utilization: parse error"
Kubi [Fri, 17 Mar 2017 09:07:58 +0000 (09:07 +0000)]
Merge "Bugfix: network_utilization: parse error"

7 years agoMerge "Bug Fix: force the network to attacht to trex to start the traffic"
Kubi [Fri, 17 Mar 2017 09:06:19 +0000 (09:06 +0000)]
Merge "Bug Fix: force the network to attacht to trex to start the traffic"

7 years agoMerge "Adding Labels"
Kubi [Fri, 17 Mar 2017 09:05:41 +0000 (09:05 +0000)]
Merge "Adding Labels"

7 years agoadd missing test suite files for new scenarios 93/30493/3
JingLu5 [Wed, 15 Mar 2017 01:30:23 +0000 (01:30 +0000)]
add missing test suite files for new scenarios

JIRA: YARDSTICK-589

Some new scenarios, e.g, opnfv_k8-nosdn-nofeature-noha_daily, have been added
in the Danube release, test suite files for these scenarios should be added.

Change-Id: If3f4ef233b7b1516e182ed28f15feece1728e6d9
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoRefine test case description for tc076 63/30763/1
JingLu5 [Fri, 17 Mar 2017 03:23:34 +0000 (03:23 +0000)]
Refine test case description for tc076

JIRA: YARDSTICK-594

Change-Id: Ieaf13a875d00c279d4da57dcdba5bcfb09f44e8f
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoBugfix: yardstick-image built without test tools 59/30759/1
JingLu5 [Fri, 17 Mar 2017 02:08:55 +0000 (02:08 +0000)]
Bugfix: yardstick-image built without test tools

JIRA: YARDSTICK-593

The yardstick-image now built dosen't have test tools in it.
This patch aims to fix this issus.

Change-Id: I9863a933106236835c16e21f84aa107ffd554df7
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agofix fuel plugin installation issue 15/30515/1
Guo Ruijing [Tue, 14 Mar 2017 23:41:25 +0000 (07:41 +0800)]
fix fuel plugin installation issue

Change-Id: Ie17ba0ac941d1b96148ee23ed9522a93309f56c5
Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>
7 years agoBugfix: fatal: destination path '/opt/tempT' already exists and is not an empty direc... 31/30331/1
chenjiankun [Mon, 13 Mar 2017 09:25:19 +0000 (09:25 +0000)]
Bugfix: fatal: destination path '/opt/tempT' already exists and is not an empty directory.

JIRA: YARDSTICK-588

ubuntu-server-cloudimg-modify.sh: fixes and cleanup
https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console
saw this in an error log, not sure if it is a real error
+ [[ amd64 = \a\r\m\6\4 ]]
+ git clone https://github.com/kdlucas/byte-unixbench.git /opt/tempT
fatal: destination path '/opt/tempT' already exists and is not an empty
directory.
+ error_trap
+ local rc=128
+ set +e
+ '[' -z '' ']'
+ exitcode=128
workaround by deletign /opt/tempT always before cloning
also improve ln with relative symlink and forcing filename target

Change-Id: Ia9c35a877207494623055b1b2134f7834fadedf8
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoBugfix: network_utilization: parse error 39/30139/2
chenjiankun [Thu, 9 Mar 2017 08:59:29 +0000 (08:59 +0000)]
Bugfix: network_utilization: parse error

JIRA: YARDSTICK-586

When run tc072, there is a bug: network_utilization: parse error, see the log:
ERROR ('network_utilization: parse error', [], [u'05:10:46', u'IFACE',
        u'rxpck/s', u'txpck/s', u'rxkB/s', u'txkB/s', u'rxcmp/s',
        u'txcmp/s', u'rxmcst/s', u'%ifutil'])
Traceback (most recent call last):
    File
    "/usr/local/lib/python2.7/dist-packages/yardstick/benchmark/runners/duration.py",
    line 69, in _worker_process
    method(data)
    File
    "/usr/local/lib/python2.7/dist-packages/yardstick/benchmark/scenarios/networking/netutilization.py",
    line 191, in run
    result.update(self._get_network_utilization())
    File
    "/usr/local/lib/python2.7/dist-packages/yardstick/benchmark/scenarios/networking/netutilization.py",
    line 182, in _get_network_utilization
    result = self._filtrate_result(raw_result)
    File
    "/usr/local/lib/python2.7/dist-packages/yardstick/benchmark/scenarios/networking/netutilization.py",
    line 146, in _filtrate_result
    fields, line)
    RuntimeError: ('network_utilization: parse error', [], [u'05:10:46',
            u'IFACE', u'rxpck/s', u'txpck/s', u'rxkB/s', u'txkB/s',
            u'rxcmp/s', u'txcmp/s', u'rxmcst/s', u'%ifutil'])

Maybe the tool has some changes.

Change-Id: I6c4fe3fe9f749ec942fb5fbd799b8f4ab9a5c16c
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoAdd CPU pinning support for node context 33/29333/5
JingLu5 [Wed, 8 Mar 2017 03:28:27 +0000 (03:28 +0000)]
Add CPU pinning support for node context

JIRA: YARDSTICK-573

Since the yardstick framework now has supported an improved node type context,
this patch adds support for VM vcpu pinning ability in the node type context.
It provides several scripts that can be used to configurate the controller and
compute nodes.

Change-Id: If2c6e7b1b85ff78b9d2a5997bf03bdc6877aaf74
Signed-off-by: JingLu5 <lvjing5@huawei.com>
7 years agoMerge "Bugfix: heat: don't json encode template"
Jing Lu [Mon, 13 Mar 2017 03:53:31 +0000 (03:53 +0000)]
Merge "Bugfix: heat: don't json encode template"

7 years agoMerge "ubuntu-server-cloudimg-modify.sh: shellcheck fixes"
Jing Lu [Mon, 13 Mar 2017 03:53:00 +0000 (03:53 +0000)]
Merge "ubuntu-server-cloudimg-modify.sh: shellcheck fixes"

7 years agoMerge "Bugfix: ubuntu-server-cloudimg-modify.sh: fix grep syntax with if"
Jing Lu [Mon, 13 Mar 2017 03:52:44 +0000 (03:52 +0000)]
Merge "Bugfix: ubuntu-server-cloudimg-modify.sh: fix grep syntax with if"

7 years agoMerge "Bugfix: yardstick https support"
Rex Lee [Mon, 13 Mar 2017 01:23:45 +0000 (01:23 +0000)]
Merge "Bugfix: yardstick https support"

7 years agoMerge "ubuntu-server-cloudimg-dpdk-modify.sh: fixes and cleanup"
Jing Lu [Mon, 13 Mar 2017 00:47:53 +0000 (00:47 +0000)]
Merge "ubuntu-server-cloudimg-dpdk-modify.sh: fixes and cleanup"

7 years agoBugfix: yardstick https support 47/30247/1
chenjiankun [Fri, 10 Mar 2017 10:43:28 +0000 (10:43 +0000)]
Bugfix: yardstick https support

JIRA: YARDSTICK-587

When run in https environment, there is a bug:
error: failed to deploy stack: '_init_() got an unexpected keyword argument 'ca_cert''
The reason is the key pass to Session() is cacert, but the key should be
verify.

Change-Id: Ia9fc1d7908c2fca9d827a5f64deac7cd333d5c07
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
7 years agoMerge "Bugfix: Using the right trex version to support both py2.7 & py3"
Rex Lee [Fri, 10 Mar 2017 06:15:58 +0000 (06:15 +0000)]
Merge "Bugfix: Using the right trex version to support both py2.7 & py3"

7 years agoBugfix: heat: don't json encode template 09/29509/5
Ross Brattain [Wed, 1 Mar 2017 00:33:50 +0000 (16:33 -0800)]
Bugfix: heat: don't json encode template

heatclient.common.http.SessionClient
automatically json.dumps the data in kwargs.
If we json dump ourselves we end up double-decoding
which is invalid.

heatclient.common.http.py:

class SessionClient(adapter.LegacyJsonAdapter):
    """HTTP client based on Keystone client session."""

    def request(self, url, method, **kwargs):
        redirect = kwargs.get('redirect')
        kwargs.setdefault('user_agent', USER_AGENT)

        if 'data' in kwargs:
            kwargs['data'] = jsonutils.dumps(kwargs['data'])

kwargs['data'] includes the template,
so this is double-decoding in JSON

JIRA: YARDSTICK-584

Change-Id: I663af42f7e92e285b540b614ceda87f17da5f22d
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
7 years agoMerge "Bugfix: Failed executing command: 'free -s 1 -c 10'"
Rex Lee [Thu, 9 Mar 2017 17:56:59 +0000 (17:56 +0000)]
Merge "Bugfix: Failed executing command: 'free -s 1 -c 10'"

7 years agoAdding Labels 01/30201/2
rexlee8776 [Thu, 9 Mar 2017 17:40:30 +0000 (01:40 +0800)]
Adding Labels

Labels serve as anchors/ refs when referenced from other documents
This patch adds labels to docs/*/*/index.rst

Change-Id: I046277771130cc6298636fb30f9d6dae7de224cf
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
7 years agoBug Fix: force the network to attacht to trex to start the traffic 79/30179/2
Deepak S [Thu, 9 Mar 2017 14:26:30 +0000 (19:56 +0530)]
Bug Fix: force the network to attacht to trex to start the traffic

Change-Id: I73744a9e0f1830688a171f3f28044926b13f8a43
Signed-off-by: Deepak S <deepak.s@linux.intel.com>