yardstick.git
8 years agoAdd heat template workaround for odl-l3 51/10151/3
Jo¶rgen Karlsson [Wed, 17 Feb 2016 15:17:04 +0000 (16:17 +0100)]
Add heat template workaround for odl-l3

Change-Id: I476fdd4d0e0e97cb1457ae15f92442c42aa77b4e
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoci: Freeze pip requirements + cleanups 91/10091/5
Jo¶rgen Karlsson [Tue, 16 Feb 2016 19:24:56 +0000 (20:24 +0100)]
ci: Freeze pip requirements + cleanups

Freeze pip requirements for brahmaputra release to make sure we
keep track of dependencies.

Fixes internalURL problem with ericsson-virtual1

Add check to verify that nova, glance and heat services are functional

Change-Id: I15c3d215596eaad31f8e260d129b8e07a7d63976
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd test suite for ericsson-virtual1 blade 63/10063/1
Fatih Degirmenci [Tue, 16 Feb 2016 14:05:56 +0000 (15:05 +0100)]
Add test suite for ericsson-virtual1 blade

Change-Id: I6c22a32fd3197a5475ee4f41db946bd78b08dfa0
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
8 years agoAdd more debug to image build 69/9869/1
Jo¶rgen Karlsson [Fri, 12 Feb 2016 16:00:30 +0000 (17:00 +0100)]
Add more debug to image build

Change-Id: Icfbed0433cb9cfb6f8f479fc69699d08ad49602b
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd license info and update structure 47/9747/2
Ana C [Wed, 10 Feb 2016 18:07:13 +0000 (19:07 +0100)]
Add license info and update structure

This change adds license to all .rst files under userguide.
It also combines all configguide files into user guide.
New reference.rst with list of links.
Updated glossary, removed separate directories for apexlake and yardstick
framework.

Change-Id: I6532ed073905b0fa85a17e759ea7dc3c24acb91f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoUpdated install requirements 17/9717/2
Jo¶rgen Karlsson [Wed, 10 Feb 2016 13:11:08 +0000 (14:11 +0100)]
Updated install requirements

Change-Id: I594eb3fc976bc65a9fa01e48a805c3564ad3a5f3
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoRevert "Test: Workaround for ODL Lithium" 21/9621/2
Jörgen Karlsson [Tue, 9 Feb 2016 13:45:03 +0000 (13:45 +0000)]
Revert "Test: Workaround for ODL Lithium"

This reverts commit 912fe3bb9877456cb8ef363f9304bfab733eaffd.

Change-Id: I82e032ae43e49edff78cb8f7a0881a5ecd3f54db

8 years agoAdd influxdb credentials. 09/9609/2
Jo¶rgen Karlsson [Tue, 9 Feb 2016 13:04:14 +0000 (14:04 +0100)]
Add influxdb credentials.

This is temporary!!!!!

Credentials should be moved to a more secure place.

Change-Id: Ifc0985aa58bb9fc861e0974e54d7ec34eb445a43
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd deploy scenario tag to influxdb measurements 07/9607/1
Jo¶rgen Karlsson [Tue, 9 Feb 2016 12:53:11 +0000 (13:53 +0100)]
Add deploy scenario tag to influxdb measurements

Change-Id: I7e303f8445e4910074fcae6e48f142fa7b61923c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoyardstick image build cleanups 31/9531/1
Jo¶rgen Karlsson [Mon, 8 Feb 2016 14:40:48 +0000 (15:40 +0100)]
yardstick image build cleanups

 - reduce progress verbosity when downloading with wget
 - added some debug printouts for trouble shooting
   mount issues

Change-Id: Ic608f847b0fe74df231ce3d7d419dcf6c19807ed
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agobug fix: wrong POD name used in result dispatchers 21/9521/1
Jo¶rgen Karlsson [Mon, 8 Feb 2016 12:24:17 +0000 (13:24 +0100)]
bug fix: wrong POD name used in result dispatchers

Change-Id: I04a300b3478dd075208f9c904dcb281d74089344
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agobug fix: huawei sc lab virtual pod task fail 05/9005/3
kubi [Tue, 2 Feb 2016 08:16:24 +0000 (16:16 +0800)]
bug fix: huawei sc lab  virtual pod task fail

opnfv_yardstick_tc027.yaml 's configure file is written for physical pod

it shouldn't be added into virtual pod task, so remove it. otherwise, task will failed

Change-Id: Ic2f03c6522cace32426a7aade1da56ed2c1766d1
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoadd precondition check 69/9369/3
kubi [Fri, 5 Feb 2016 08:48:00 +0000 (08:48 +0000)]
add precondition check

as we discussed yersterday, for daily jenkins task,
i have a new idea, i add a precondition check and a key parameter in test case,
if environment info(eg. "DEPLOY_SCENARIO") meet the preconditon which was defined in test case ,
this test case will run, if not meet, this test case will skip.

and default is allow all test case to run, so this patch will not influence existing test case.
any comments are welcomed

Change-Id: I4300ac58994d51c0ddb4dd6d58b7191f796ddcee
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoTest: Workaround for ODL Lithium 81/9281/4
Jörgen Karlsson [Thu, 4 Feb 2016 15:55:56 +0000 (15:55 +0000)]
Test: Workaround for ODL Lithium

Change-Id: I9db7f95beb618e2a3125b5252a79bf1a400b6af1

8 years agoHEAT HTTPS SSL Support 15/9115/2
rsritesh [Tue, 2 Feb 2016 03:47:26 +0000 (06:47 +0300)]
HEAT HTTPS SSL Support

Currently yardstick does not provide the support for
OS_CACERT option.
The addition OS_CACERT options makes the user to use certificate
to communicate with the HEAT.

Closes-Bug: #YARDSTICK-227
Change-Id: I045c3f4b94dba9dfb6fd0e2706d758647d3fe4af
Signed-off-by: rsritesh <p.ritesh@tcs.com>
8 years agobug fix : git clone yardstick repo failed 21/8821/1
kubi [Mon, 1 Feb 2016 06:26:57 +0000 (14:26 +0800)]
bug fix : git clone yardstick repo failed

line45: git clone YARDSTICK_REPO $YARDSTICK_REPO_DIR fail

Change-Id: I7f2973b320a30a02264b3f65fb3e1397218a5d9a
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd test suites for huawei lab virtual deploy 61/8761/2
QiLiang [Sat, 30 Jan 2016 15:12:03 +0000 (15:12 +0000)]
Add test suites for huawei lab virtual deploy

JIRA: -

Change-Id: Ibc44bf11fb8bef4878ec57187877624a557f9937
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoService Function Chaining test cases 93/7393/25
Ricardo Noriega [Tue, 19 Jan 2016 16:41:22 +0000 (17:41 +0100)]
Service Function Chaining test cases

Change-Id: Id4c8b1bc05e768bdb2b8f17798f13f4d83dcd9d6
Signed-off-by: Ricardo Noriega <ricardo.noriega.de.soto@ericsson.com>
8 years agoAdd directory for code documentation 09/8609/2
Ana C [Fri, 29 Jan 2016 16:49:32 +0000 (17:49 +0100)]
Add directory for code documentation

This change adds a folder for yardstick code documentation under docs,
apidocs. An index.rst  file is added, and a modules.rst to list the
modules.
The documentation will be automatically generated from code docstrings,
using sphinx autodoc directive.

JIRA:YARDSTICK-161

Change-Id: I56ff1904c319a00352842be5ba7bb0cb52bbc3d6
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoAdd debug info to solve image build errors 07/8607/1
Jo¶rgen Karlsson [Fri, 29 Jan 2016 16:53:24 +0000 (17:53 +0100)]
Add debug info to solve image build errors

Add more debug output and clear devmap table in order to
solve build problems in YARDSTICK-226.

Change-Id: Idfdbb925501c8debb67406f2dd316e1d4bfbaaa8
JIRA: YARDSTICK-226
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoLicense for PCAP files 91/8291/1
Vincenzo Riccobene [Thu, 28 Jan 2016 11:10:28 +0000 (11:10 +0000)]
License for PCAP files

Change-Id: Id2fdedf56099200b59392b5b337fcdde502d5f3a
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd test suite for huawei lab virtual deploy 81/8281/2
QiLiang [Thu, 28 Jan 2016 18:25:10 +0000 (18:25 +0000)]
Add test suite for huawei lab virtual deploy

JIRA: -

Change-Id: I0cd58a2acb0a2a55431eebd6b4adcde95d50d7bc
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoRevert "Test: Workaround for ODL scenarios" 73/8173/1
Jörgen Karlsson [Wed, 27 Jan 2016 17:22:47 +0000 (17:22 +0000)]
Revert "Test: Workaround for ODL scenarios"

This reverts commit 8236c94ecef8aa25af073c50f7a0eaafae9b4bc6.

Change-Id: I4652efe4f75e7f2605945e9896b33379eff059d1

8 years agoTest: Workaround for ODL scenarios 17/8017/4
Jo¶rgen Karlsson [Tue, 26 Jan 2016 12:18:32 +0000 (13:18 +0100)]
Test: Workaround for ODL scenarios

Temporarily removing security group from generated heat template.

This patch is pushed through for testing purposes and should be
reverted when a proper solution is found.

Change-Id: I64c86f41664499d46d8317bb1ebbe304083554ab
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoInfluxDB add authentication support 83/7983/1
QiLiang [Tue, 26 Jan 2016 08:55:00 +0000 (08:55 +0000)]
InfluxDB add authentication support

JIRA: YARDSTICK-212

Change-Id: I6b669800160268db70b5c9e43cbbc053576ec4b5
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agofix some missing license file 35/7535/2
kubi [Thu, 21 Jan 2016 02:42:33 +0000 (10:42 +0800)]
fix some  missing license file

fix .coveragerc, etc/yardstick/nodes/pod.yaml.sample
etc/yardstick/yardstick.conf.sample

Change-Id: Iece74c80316202fb000dda0ea2b3f8fdb6fe5eb8
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd license to files for Apex Lake directory 03/7403/2
Vincenzo Riccobene [Wed, 20 Jan 2016 09:26:53 +0000 (09:26 +0000)]
Add license to files for Apex Lake directory

Change-Id: I25978755d4ec705d01eeb78c2d8e91e45e556011
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd apexlake CI script 39/7439/3
Jo¶rgen Karlsson [Wed, 20 Jan 2016 12:33:42 +0000 (13:33 +0100)]
Add apexlake CI script

Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Change-Id: I5dcd45692938afddadbf17650c96fddf1f99dce7

8 years agoInfluxdb change tc as measurement 63/7263/3
QiLiang [Tue, 19 Jan 2016 10:44:48 +0000 (10:44 +0000)]
Influxdb change tc as measurement

Add host and taget tags (initially for cpuload scenario to
                         identify  where the test run)

JIRA: YARDSTICK-212

Change-Id: I895bd435ec4a5e036e5ae2dc965df23ccfa6bf24
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoMove the test case of TC025 to the test cases folder 53/7253/2
wym_libra [Tue, 19 Jan 2016 18:46:30 +0000 (02:46 +0800)]
Move the test case of TC025 to the test cases folder

Change-Id: Ia3760a4fcc17f810940240d1778939333e8ffdc6
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoFix EXTERNAL_NETWORK for joid 69/7269/2
Jo¶rgen Karlsson [Tue, 19 Jan 2016 11:35:45 +0000 (12:35 +0100)]
Fix EXTERNAL_NETWORK for joid

Change-Id: I31c932a9098933fe139c28a65c3989a0014d0f8d
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix Apexlake Documentation 43/7143/3
Vincenzo Riccobene [Mon, 18 Jan 2016 15:35:52 +0000 (15:35 +0000)]
Fix Apexlake Documentation

Change-Id: If9519d1660fe21bc13307ce35711424c6e2b8176
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agosupport os+odl for ipv6 29/7229/4
kubi [Tue, 19 Jan 2016 08:02:05 +0000 (16:02 +0800)]
support os+odl for ipv6

As we known, the network of os+odl scenario is still not available.
so this patch still need to do more debug work.
however, Jan 19th is code freeze day, i think a good way is to merge it at first
when os+odl become available, i will do rest debug work and fix it

Change-Id: I518f759069e74d2e57e40b52dfecaef4b4d26a02
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoCreate weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clara 99/7099/1
kubi [Mon, 18 Jan 2016 10:48:22 +0000 (18:48 +0800)]
Create weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clara

Test Case 040 :parser is added into weekly yaml
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: I0cb4a9e273b5cac55b9a7a278ea17b1ad78d1ac6

8 years agoHttpDispatcher case_name value update 55/7055/1
QiLiang [Mon, 18 Jan 2016 07:07:55 +0000 (07:07 +0000)]
HttpDispatcher case_name value update

See details on https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
section Questions 6.1

Change-Id: I72268c827a2321859c405f45b7e1e475c0ffb4a0
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoFixed documentation for ApexLake 03/6903/2
Vincenzo Riccobene [Fri, 15 Jan 2016 17:19:10 +0000 (17:19 +0000)]
Fixed documentation for ApexLake

Integration of ApexLake documentation into the main docs directory

Change-Id: I3398acc16cc2ff4bb039783fc5bcb6a10afda4e1
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agomodify sc lab pod yaml as real configure 63/6963/3
kubi [Sat, 16 Jan 2016 10:31:42 +0000 (18:31 +0800)]
modify sc lab pod yaml as real configure

Change-Id: I6587794b7206cb3d5f13b6c448670d1c97ecd596
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoenable ipv6 test case in sc lab 47/6947/1
kubi [Sat, 16 Jan 2016 07:59:10 +0000 (15:59 +0800)]
enable ipv6 test case in sc lab

Change-Id: I4609fcb4427413fd6cde435f7bd062c9dde61949
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoUpdate test suite files. 31/6831/3
Jo¶rgen Karlsson [Fri, 15 Jan 2016 12:18:46 +0000 (13:18 +0100)]
Update test suite files.

Added TC 10, 11 and 14.
Removed TC 1 as it is already included in TC 37

Change-Id: Iea483c4a26c657984769400f2949ca300c2504bd
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoDump test result when test finished 97/6797/3
QiLiang [Fri, 15 Jan 2016 06:02:54 +0000 (14:02 +0800)]
Dump test result when test finished

JIRA: -

Change-Id: I8712f1c4a0a063bdf7ba6a425015dea894c34d16
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agofix some bug in ipv6 to make it run in ci 29/6829/3
kubi [Fri, 15 Jan 2016 11:40:28 +0000 (19:40 +0800)]
fix some bug in ipv6 to make it run in ci

JIRA:YARDSTICK-187

Change-Id: Ia15d17afdef145f7b230a8a4d25a61eed5cdfd76
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdds desription for TC024, the CPU load/mpstat test case 23/6723/3
Per Holmgren [Thu, 14 Jan 2016 15:06:34 +0000 (16:06 +0100)]
Adds desription for TC024, the CPU load/mpstat test case

Change-Id: Ifbc571e3e216349d065ac21df1a3f10fe94d4e9a
JIRA: -

8 years agoCorrect some typos 75/6775/1
wym_libra [Fri, 15 Jan 2016 10:07:01 +0000 (18:07 +0800)]
Correct some typos

Change-Id: Ia9fd31580ff75663514aebbb46a8b87021cb01de
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoAdd test case description and task file for TC011 37/6637/5
wym_libra [Thu, 14 Jan 2016 14:53:10 +0000 (22:53 +0800)]
Add test case description and task file for TC011

Add test case description for Packet delay variation between VMs (TC011)
and test case .yaml task file.

** Please note that the SLA value has not yet been determined. **

Change-Id: I68a374224946d46c173ad477c14cb79d573b1eee
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoHeatContext model update to match heat code update 47/6647/4
QiLiang [Thu, 14 Jan 2016 08:09:40 +0000 (08:09 +0000)]
HeatContext model update to match heat code update

In Heat Liberty release OS::Nova::Server will always use the user
pre-configured in the image (e.g. "fedora" for stock Fedora cloud
images, "ubuntu" for stock Ubuntu cloud images, "cloud-user" for
stock CentOS cloud images etc)

Change all ec2-user -> ubuntu

Add admin-user in Heat model for backwards compatibility.

Refer below links for detalis:
https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
https://github.com/openstack/heat/commit/e423bec7f10b0f5d07f05d195b3b7860f6bceb00
http://blog.scottlowe.org/2015/04/23/ubuntu-openstack-heat-cloud-init/

JIRA: -

Change-Id: I6b8b2b21daf113a3a86aee1126b0c3e74737ef4f
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoUpdate results for Test Cases 6, 7, 20, 21 09/6709/5
Vincenzo Riccobene [Thu, 14 Jan 2016 13:55:57 +0000 (13:55 +0000)]
Update results for Test Cases 6, 7, 20, 21

JIRA: YARDSTICK-219

Change-Id: I06143f074592e05cd17b740eb9751414a56c9fde
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd test suite for Orange POD2 17/6717/2
Jo¶rgen Karlsson [Thu, 14 Jan 2016 14:29:43 +0000 (15:29 +0100)]
Add test suite for Orange POD2

Change-Id: I667a54793be39c74a9f787b055b07fda9b2ba06c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd template for test results report 85/6585/2
Ana C [Wed, 13 Jan 2016 17:43:13 +0000 (18:43 +0100)]
Add template for test results report

This change is a proposal for a report for yardstick test case reesults.
One report for all the executed tests, summarizing the results and the
labs where the tests were executed.

JIRA: -

Change-Id: I7cdfdc82d6ee07d2b9da426f33ce34b86362b5b4
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoFix small bugs for running Apexlake on Montreal testbed 83/6583/8
user [Wed, 13 Jan 2016 17:36:50 +0000 (12:36 -0500)]
Fix small bugs for running Apexlake on Montreal testbed

JIRA: YARDSTICK-219

Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
8 years agoci: add influxdb target options 43/6543/2
Jo¶rgen Karlsson [Wed, 13 Jan 2016 14:53:00 +0000 (15:53 +0100)]
ci: add influxdb target options

Change-Id: I50cbbf4d2fe59d688a4951cc8bec3362b098adcb
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix flake8 errors 51/6551/2
Jo¶rgen Karlsson [Wed, 13 Jan 2016 15:19:58 +0000 (16:19 +0100)]
Fix flake8 errors

Change-Id: I14f21092f5e97abf0629a92a27062846a6d3130b
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix minor format details in tc descriptions 11/6411/1
Ana C [Tue, 12 Jan 2016 17:02:31 +0000 (18:02 +0100)]
Fix minor format details in tc descriptions

This change fixes minor formating in TC025, remove one extra line in TC028
and update 03-list-of-tcs.

The formating caused the pdf to fail.

Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoRename tc019/tc025 & fix description for tc005 77/6377/1
QiLiang [Tue, 12 Jan 2016 22:53:22 +0000 (22:53 +0000)]
Rename tc019/tc025 & fix description for tc005

Added tc019 and tc025 to index of test cases in 03-list-of-tcs.

JIRA: -

Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoAdd test case description for TC028-kvm 73/6373/1
QiLiang [Tue, 12 Jan 2016 22:45:42 +0000 (22:45 +0000)]
Add test case description for TC028-kvm

JIRA: YARDSTICK-188

Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoMerge "Add test case description and task file for TC025"
qi liang [Tue, 12 Jan 2016 14:12:34 +0000 (14:12 +0000)]
Merge "Add test case description and task file for TC025"

8 years agoMerge "Add test case description and task file for TC019"
qi liang [Tue, 12 Jan 2016 14:11:59 +0000 (14:11 +0000)]
Merge "Add test case description and task file for TC019"

8 years agoMerge "Workround for openstack nova bug"
QiLiang [Tue, 12 Jan 2016 13:21:36 +0000 (13:21 +0000)]
Merge "Workround for openstack nova bug"

8 years agoWorkround for openstack nova bug 37/6337/2
QiLiang [Tue, 12 Jan 2016 20:10:40 +0000 (20:10 +0000)]
Workround for openstack nova bug

Notes: if placement_groups policy is "availability"
and > 2 servers in this group may still have this issue.

JIRA: YARDSTICK-200

Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoInclude vTC overview in Yardstick documentation 17/6317/4
Ana C [Tue, 12 Jan 2016 10:29:15 +0000 (11:29 +0100)]
Include vTC overview in Yardstick documentation

This change includes the vTC overview in Yardstick configguide, the
original vTC/README has been renamed to 04-vTC-overview and added in the
configguide.

The vTC/abbreviations is deleted, all included in glossary.rst

Index and 03-list-of-tcs are updated.

JIRA:-

Change-Id: Ifc5cf1cc258dee6743af189f347e8adbbec6a32f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoImplementation of opnfv-yardstick-tc021 in Yardstick 11/6211/1
Vincenzo Riccobene [Mon, 11 Jan 2016 17:23:12 +0000 (17:23 +0000)]
Implementation of opnfv-yardstick-tc021 in Yardstick

Includes
 - Yardstick Scenario for integration with ApexLake
 - Yardstick Task .yaml file
 - Documentation

JIRA: YARDSTICK-219

Change-Id: I0554d0a211392902207ba9ceccf0b98dc3c2cdf1
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd vTC daily+weekly test suites 31/6131/2
Jo¶rgen Karlsson [Mon, 11 Jan 2016 10:34:42 +0000 (11:34 +0100)]
Add vTC daily+weekly test suites

Change-Id: Id557b5ef4d686da041b8097e390c7e5b563a0c3c
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoImplementation of opnfv-yardstick-tc020 in Yardstick 37/6137/2
Vincenzo Riccobene [Mon, 11 Jan 2016 11:39:16 +0000 (11:39 +0000)]
Implementation of opnfv-yardstick-tc020 in Yardstick

Includes
 - Yardstick Scenario for integration with ApexLake
 - Yardstick Task .yaml file
 - Documentation

JIRA: YARDSTICK-219

Change-Id: Ibbba1d9864e788fb6c81cc00c503e9f69e885651
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoImplementation of yardstick-tc007 in Yardstick 13/6113/6
Vincenzo Riccobene [Mon, 11 Jan 2016 09:45:04 +0000 (09:45 +0000)]
Implementation of yardstick-tc007 in Yardstick

Includes
- Yardstick Scenario for integration with ApexLake
- Yardstick Task .yaml file
- Documentation

JIRA: YARDSTICK-219

Change-Id: Ifa2555336098e68d0fad8045e2f759aed587ad92
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd apexlake package path 95/6195/2
Jo¶rgen Karlsson [Mon, 11 Jan 2016 16:01:47 +0000 (17:01 +0100)]
Add apexlake package path

Workaround/hack to be able to use apexlake packages modules
and run unit tests without having to install apexlake.

Change-Id: Ibfa34f56bdb1cafa60d2090e16544a81badc2e85
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoIPv6 connectivity between nodes on the tenant network 85/6185/3
kubi [Mon, 11 Jan 2016 15:34:45 +0000 (23:34 +0800)]
IPv6 connectivity between nodes on the tenant network

Test case yaml and .rst file for ipv6

Change-Id: Ib9a554dc05445023687efb0ac608c7cbd0da4c21
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoTest case to measure processing speed(score) 81/6181/5
kubi [Mon, 11 Jan 2016 14:58:13 +0000 (22:58 +0800)]
Test case to measure processing speed(score)

run unixbench to get the score of processing performance
This patch includes the .yaml for the test case and the .rst for test case description.

JIRA:YARDSTICK-116

Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoImplementation of yardstick-tc006 in Yardstick 41/6141/3
Vincenzo Riccobene [Mon, 11 Jan 2016 11:59:48 +0000 (11:59 +0000)]
Implementation of yardstick-tc006 in Yardstick

Includes
 - Yardstick Scenario for integration with ApexLake
 - Yardstick Task .yaml file
 - Documentation

JIRA: YARDSTICK-219

Change-Id: Iabde8fa63f346cf1e4a02691f22d1761de79a239
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoTest Case 040 Verify Parser Yang-to-Tosca 63/6163/3
kubi [Mon, 11 Jan 2016 13:30:45 +0000 (21:30 +0800)]
Test Case 040 Verify Parser Yang-to-Tosca

running Parser Yang-to-Tosca module as a tool, validating output against expected outcome.
this patch is about task yaml and rst for test case description.
JIRA:YARDSTICK-224

Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Id254c5cf45de33b023bef889a58044a21ed0db43
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd missing yaml schema for TC037 and TC038 25/6125/1
Jo¶rgen Karlsson [Mon, 11 Jan 2016 10:20:55 +0000 (11:20 +0100)]
Add missing yaml schema for TC037 and TC038

Change-Id: I299eb5a94afb8a29dee89938ff1d7b1bb7f43f3b
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd test case description and task file for TC005 77/6077/3
QiLiang [Mon, 11 Jan 2016 06:24:12 +0000 (06:24 +0000)]
Add test case description and task file for TC005

JIRA: YARDSTICK-93

Change-Id: I74adef0e6bae52a7080479d7054a92342f7324a7
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoSupport run cyclictest on BareMetal 33/3633/3
QiLiang [Wed, 25 Nov 2015 01:23:46 +0000 (09:23 +0800)]
Support run cyclictest on BareMetal

JIRA: YARDSTICK-122

Change-Id: I8144215059a9abea08314a4c1e6a733dcdf0df53
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoThe secondi HA test case-shutdown controller 79/5479/2
wym_libra [Thu, 31 Dec 2015 12:02:09 +0000 (20:02 +0800)]
The secondi HA test case-shutdown controller

1) add "attacker_baremetal.py" for fault injection
2) modify the monitor to excute on remote node after ssh connection
3) move all shell scripts together

JIRA: YARDSTICK-182

Change-Id: Ibb9dc908224ddb8b99a0140b75c1a046503f6dfb
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoRewrite the HA test case (2) 19/5219/2
wym_libra [Mon, 7 Dec 2015 08:02:18 +0000 (16:02 +0800)]
Rewrite the HA test case (2)

idea: refact the Monitor class in old file "monitor.py" with the base
class and sub-class.
detail:
1) the BaseMonitor is the base class of other monitor
2) each monitor run in independent process
3) there are two monitor("openstack-cmd" and "process") for the first test case
4) MonitorMgr class used to manager monitor process

JIRA: YARDSTICK-149

Change-Id: I2eede94481f740812212e6cb673d175b5f543c15
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agorunning Parser Yang-to-Tosca module as a tool 39/5339/7
kubi [Tue, 29 Dec 2015 03:04:20 +0000 (11:04 +0800)]
running Parser Yang-to-Tosca module as a tool

with jnon and fatih's help, new docker image has been uploaded
so this part is about parser verify
validating output against expected outcome.

Change-Id: If50d241a5338888f14fd11a752dc72678e0c569b
JIRA:YARDSTICK-224
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd TC037 to POD test suites 45/5945/1
Jo¶rgen Karlsson [Fri, 8 Jan 2016 15:05:22 +0000 (16:05 +0100)]
Add TC037 to POD test suites

JIRA: YARDSTICK-213
Change-Id: I55ff36b02a0d0e0334505d68d361b8a14d36063c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agosupport for ipv6 27/5727/3
kubi [Thu, 31 Dec 2015 06:38:49 +0000 (14:38 +0800)]
support for ipv6

JIRA:YARDSTICK-187

Change-Id: I1cecd400b4449a09d22d43f4a42e889f00dd4fe7
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agosupport lxml for parser in docker container 57/5857/2
kubi [Fri, 8 Jan 2016 04:36:14 +0000 (12:36 +0800)]
support lxml for parser in docker container

this is part1 of patch, this part is to define dockefile,and wait a docker image to be uploaded
JIRA:YARDSTICK-224
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ia206c54ab2d964a94753abef0767b74d26259081

8 years agoupdate docs build dir names in .gitignore 51/5851/1
Ryota MIBU [Fri, 8 Jan 2016 02:45:15 +0000 (11:45 +0900)]
update docs build dir names in .gitignore

Change-Id: Id4b1e2e87ac51b67f392417357b2693c76def457
Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
8 years agoRename folders in yardstick/docs 89/5789/1
Ana C [Thu, 7 Jan 2016 14:00:56 +0000 (15:00 +0100)]
Rename folders in yardstick/docs

Adapt the naming of the folders under yardstick/docs to the naming adopted by
the release documentation defined by opnfvdocs.

JIRA: -

Change-Id: Icc57720d585abbbf7252bcbf76e2f2a403cb1732
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoFix description for TC037 and TC038 83/5783/1
Ana C [Thu, 7 Jan 2016 13:00:26 +0000 (14:00 +0100)]
Fix description for TC037 and TC038

Update rst files for TC037 and TC038 for latest template format.
Added TC037 and TC038 to index of test cases in 03-list-of-tcs.

JIRA: -

Change-Id: I32657b564ff1c393f8048a74e676b3f5791d6d0d
Signed-by: Ana C <ana.cunha@ericsson.com>
8 years agoFix glance yardstick-image cmd in installation doc 09/5309/2
Kristian Hunt [Mon, 28 Dec 2015 12:26:10 +0000 (14:26 +0200)]
Fix glance yardstick-image cmd in installation doc

Glance image-create command should use --os-image-api-version 1 flag
for the is-public argument.

JIRA: YARDSTICK-68

Change-Id: I43a60a7dac186ae7c586aa98b6e5de9821caee60
Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
8 years agoAdd test case description and task file for TC038 89/5489/3
Jo¶rgen Karlsson [Mon, 4 Jan 2016 13:30:10 +0000 (14:30 +0100)]
Add test case description and task file for TC038

JIRA: YARDSTICK-214

Change-Id: I3a2358e8c36755a684f09524bd6fc8af9bf43f60
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd test case description and task file for TC037 81/5481/5
Jo¶rgen Karlsson [Mon, 4 Jan 2016 12:53:36 +0000 (13:53 +0100)]
Add test case description and task file for TC037

JIRA: YARDSTICK-213

Change-Id: I3f1f521da6a824c96cbc8712a098c61ff6b0540d
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoStructure test case descriptions 81/5281/20
Ana C [Sat, 26 Dec 2015 14:50:13 +0000 (15:50 +0100)]
Structure test case descriptions

This commit structures the test case descriptions.

The file index.rst lists the subsequent chapters.
01-introduction.rst contains an overview of the project and deliverables.
02-methodology.rst describes the methodology for the generic test cases.
03-list-of-tcs.rst contains a list of merged generic test cases and a
sub-chapter for the feature test cases.
Glossary extracts definitions and abbreviations.

TC001, TC002, TC008, TC009, TC010, TC012 were adapted to work for pdf.
Template testcase_description_v2_template.rst was adapted to work for pdf.

Change-Id: Ia11e27e5d508f1a784e2a412b50739e32b13797f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoInfluxDB dispatcher add more tags 21/5721/1
QiLiang [Wed, 30 Dec 2015 14:58:53 +0000 (14:58 +0000)]
InfluxDB dispatcher add more tags

- add runner_id tag
- add test case name tag
- add task_id tag

JIRA: YARDSTICK-212

Change-Id: I75c27e23942a6e2189019e94bfe8026a5fd67621
Signed-off-by: QiLiang <liangqi1@huawei.com>
Conflicts:
yardstick/dispatcher/influxdb.py

8 years agoInitial InfluxDB dispatcher 41/5141/9
QiLiang [Wed, 23 Dec 2015 14:13:15 +0000 (22:13 +0800)]
Initial InfluxDB dispatcher

Supports:
    - Basic influxDB write with timestamp
    - Add general result format func
    - Add UT

TODO:
    - refine database schema (e.g. add more tags) plan in another patch

JIRA: YARDSTICK-212

Change-Id: I1526568bbd850f1343135420ec59ed1b833bb99f
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoFix ApexLake setup 95/5595/2
Vincenzo Riccobene [Tue, 5 Jan 2016 16:53:43 +0000 (16:53 +0000)]
Fix ApexLake setup

Changes the directories where to store apexlake data in order to
allow a non super user to run the setup.

JIRA: YARDSTICK-35

Change-Id: I871b2ab793183887c86666bfe2241e3c26b4f427
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoFix some small things in ApexLake tests 89/5589/4
Vincenzo Riccobene [Tue, 5 Jan 2016 15:28:05 +0000 (15:28 +0000)]
Fix some small things in ApexLake tests

JIRA: YARDSTICK-35

Change-Id: I280365dd64d2f6c00befb984acd0d4c9ca2645bd
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd yardstick daily suite config files for CI PODs 85/5685/1
Fatih Degirmenci [Wed, 6 Jan 2016 21:26:30 +0000 (22:26 +0100)]
Add yardstick daily suite config files for CI PODs

opnfv-jump-1: apex stable/brahmaputra branch
intel-pod5: joid stable/brahmaputra branch
intel-pod2: apex master branch
intel-pod6: joid master branch
intel-pod8: compass master branch

Change-Id: Ia659e10525863ee11854a266df58449c625c7f7c
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
8 years agoAdd test case description and task file for TC019 75/4175/4
wym_libra [Thu, 10 Dec 2015 07:09:59 +0000 (15:09 +0800)]
Add test case description and task file for TC019

Add test case description for Control node-OpenStack service down (TC019)
and test case .yaml task file.

** Please note that the SLA value has not yet been determined. **

JIRA: YARDSTICK-135

Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoRemove data manager from ApexLake 75/5475/4
Vincenzo Riccobene [Mon, 4 Jan 2016 11:18:01 +0000 (11:18 +0000)]
Remove data manager from ApexLake

Since the InfluxBD dispatcher is used to store the data, the apexlake data manager is not required anymore

JIRA: YARDSTICK-35

Change-Id: I8d85161814d83a991ee149532af0437e9c248445
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd test suite file for ZTE-NJ LAB. 27/5427/1
wu.zhihui [Mon, 4 Jan 2016 03:58:28 +0000 (11:58 +0800)]
Add test suite file for ZTE-NJ LAB.

JIRA: yardstick-210

Change-Id: Ib888b654e742761a8be1b263f643950ea02380f8
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
8 years agoAdd Dummy context and scenario type 85/5385/1
QiLiang [Thu, 31 Dec 2015 02:11:21 +0000 (02:11 +0000)]
Add Dummy context and scenario type

Dummy Context Usage:

- if no context specified in the task file then automatically use
  Dummy Context

- or specify the context with type Dummy in the task file, like

    context:
      type: Dummy

Note: context without type name default use Heat Context.
      (e.g. samples/fio.yaml)

JIRA: -

Change-Id: I7f798a7260bdd6ac24902e2c835a3b121319fd8c
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoFix small things for integration of ApexLake with Yardstick 97/5197/4
Vincenzo Riccobene [Thu, 24 Dec 2015 13:21:51 +0000 (13:21 +0000)]
Fix small things for integration of ApexLake with Yardstick

Changes small things required for the integration of ApexLake with Yardstick

JIRA: YARDSTICK-35

Change-Id: I6f92d738cb80e34108b76f900382e9c05ecabe70
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoComplete all the code and files required to run ApexLake 01/5201/4
Vincenzo Riccobene [Thu, 24 Dec 2015 14:08:58 +0000 (14:08 +0000)]
Complete all the code and files required to run ApexLake

Inludes the last files required by ApexLake for a complete execution.

JIRA: YARDSTICK-35

Change-Id: I4315b8081554c8fad98c8fa72f9e2796ecb9360b
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoadd scenario and sample file for Unixbench. 71/4571/6
kubi [Mon, 14 Dec 2015 11:51:45 +0000 (19:51 +0800)]
add scenario and sample file for Unixbench.

JIRA:YARDSTICK-184

Change-Id: Iedd4a3708e08305b1c8fa7a8e1766ceef03ab8bb
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd some other tests to ApexLake 43/5143/4
Vincenzo Riccobene [Wed, 23 Dec 2015 15:14:52 +0000 (15:14 +0000)]
Add some other tests to ApexLake

Include some other tests to reach the required coverage

JIRA: YARDSTICK-35

Change-Id: Ie47b0ca9451d4dcc0f5e31ba98f8c38923689475
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd Benchmarking Unit to ApexLake 39/5139/5
Vincenzo Riccobene [Wed, 23 Dec 2015 13:47:07 +0000 (13:47 +0000)]
Add Benchmarking Unit to ApexLake

Includes benchmarking unit to run benchmarks in ApexLake
Also includes tests.

JIRA: YARDSTICK-35

Change-Id: I67c62efd6cbe0883963e8c4ddc86d003b1d355ac
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd Deployment Unit to ApexLake 37/5137/3
Vincenzo Riccobene [Wed, 23 Dec 2015 13:26:15 +0000 (13:26 +0000)]
Add Deployment Unit to ApexLake

Includes the deployment unit module used for deployment by Apexlake
Also includes tests

JIRA: YARDSTICK-35

Change-Id: Ia5c89f3cd03d53b1fc4e418215955fd91aff9d03
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd API to configure and execute ApexLake 87/4887/5
Vincenzo Riccobene [Fri, 18 Dec 2015 16:03:29 +0000 (16:03 +0000)]
Add API to configure and execute ApexLake

Add python module providing API for Yardstick to configure and execute
ApexLake and the test cases for the virtual Traffic Classifier.
Includes documentation.

JIRA: YARDSTICK-215

Change-Id: I87af59c715d789ac78c836123e9ed3d8e0036eec
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>