yardstick.git
8 years agoadd support for Latency between NFVI nodes(Ping) 39/11939/2
rexlee8776 [Wed, 6 Apr 2016 01:47:18 +0000 (01:47 +0000)]
add support for Latency between NFVI nodes(Ping)

Change-Id: I13cc3f6cdfc243391df6e15827428352a8d6634d
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
8 years agoadd "yardstick testcase show" command function 59/11659/3
rexlee8776 [Mon, 28 Mar 2016 08:35:56 +0000 (04:35 -0400)]
add "yardstick testcase show" command function

"yardstick testcase show" will show the details of specific test case

yardstick testcase show <case-name> (e.g. yardstick testcase show opnfv_yardstick_tc001)

JIRA:-

Change-Id: Ibb91625dc3e6802855f28160ee0aa8c7e386cf7a
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
8 years agoMerge "add "yardstick testcase list" command function"
qi liang [Fri, 1 Apr 2016 03:15:58 +0000 (03:15 +0000)]
Merge "add "yardstick testcase list" command function"

8 years agoRelease notes for Brahmaputra2.0 93/11693/2
Ana C [Wed, 23 Mar 2016 14:06:05 +0000 (15:06 +0100)]
Release notes for Brahmaputra2.0

This change updates the release notes for Brahmaputra2.0.
It also includes minor updates on reuslts report.

Change-Id: Id0b5def1fc2b9b6cd03821bb3d248ecc28c0e06d
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoDocumentation and results explanation for vTC generic test case 51/11651/2
Akis Kourtis [Sun, 27 Mar 2016 21:51:50 +0000 (17:51 -0400)]
Documentation and results explanation for vTC generic test case

Change-Id: Idff2bc3e857414469a7d9ce42ad8bf1e82f423bf

8 years agoadd "yardstick testcase list" command function 41/11641/1
kubi [Sat, 26 Mar 2016 08:55:00 +0000 (16:55 +0800)]
add "yardstick testcase list" command function

"yardstick testcase list" will list test cases info(Name, Description)
 in tests/OPNFV/test_cases/

Change-Id: Icf2e6a803d90d33012f009519e47e750bfd57489
JIRA:-
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoDocumentation: Installation and Results for vTC test cases 67/11567/2
Vincenzo Riccobene [Thu, 24 Mar 2016 08:40:27 +0000 (08:40 +0000)]
Documentation: Installation and Results for vTC test cases

Change-Id: I6b0d11255b4edfe9fe5070f880ad75ca597e1960
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd Logical view part of SWA 29/11629/1
QiLiang [Fri, 25 Mar 2016 00:37:52 +0000 (17:37 -0700)]
Add Logical view part of SWA

JIRA: -

Change-Id: I64ada7e2ea1b7e668b93ae10c22c7c1c9facf6f7
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoDeployment View part of SWA 19/11619/2
Patrick [Thu, 24 Mar 2016 04:14:02 +0000 (12:14 +0800)]
Deployment View part of SWA

this part will shows how yardstick can be deployed into the underlying platform.

Change-Id: Ia24f52fd85056e1ab5718cdf560a4ede7c7aaa69
Signed-off-by: Patrick <shamrock.pang@huawei.com>
8 years agoProcess Case View Part Of SWA 77/11577/4
rexlee8776 [Thu, 24 Mar 2016 10:44:14 +0000 (18:44 +0800)]
Process Case View Part Of SWA

this part will show a sequence graph of test execution flow to help users to use yardstick

Change-Id: Ie72ee6da93eb2fbe89f3a121190b6a87d232dfb0
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
8 years agoUse Case View Part Of SWA 63/11563/6
kubi [Thu, 24 Mar 2016 02:34:45 +0000 (10:34 +0800)]
Use Case View Part Of SWA

this part will show some use case to help users to use yardstick

Change-Id: If521bebaff066185ba59ffa5ab35347915818926
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoadd software Architecture chapter for user guide 19/11519/9
kubi [Wed, 23 Mar 2016 04:10:03 +0000 (12:10 +0800)]
add software Architecture chapter for user guide

this is a part of SWA, referenced with Per Holmgren's patch(9815).
Because Brahmaputra 2.0 is coming, Qiliang,Patrick,Mingjiang Lin
will work with me together to finish this chapter before doc freeze.

Change-Id: I1e6abe55658671fb1fcc66f2d81b5c2d0b364822
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoSet environment variables when running VTC daily 33/11533/2
Jo¶rgen Karlsson [Wed, 23 Mar 2016 13:29:06 +0000 (14:29 +0100)]
Set environment variables when running VTC daily

Change-Id: I791434ac5ac263cb12f256414cbc7e07a9a20765
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix configuration files according to the last working configuration in Montreal testbed 37/11437/2
user [Fri, 18 Mar 2016 18:15:09 +0000 (14:15 -0400)]
Fix configuration files according to the last working configuration in Montreal testbed

Change-Id: Icd4d56de8bd60b2b4333459ce8669363ba54a33b
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
8 years agoAdded a Yardstick test scenario for the OPNFV-Playground development CI pipeline 17/11517/1
Jonas Bjurel [Tue, 22 Mar 2016 20:02:49 +0000 (21:02 +0100)]
Added a Yardstick test scenario for the OPNFV-Playground development CI pipeline

Change-Id: I6d2e825c1080bb91c8b0f91ab0f37ce66462bcb9
Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
8 years agoAdd missing dependencies to docker file 49/11349/2
Jo¶rgen Karlsson [Tue, 15 Mar 2016 15:41:30 +0000 (16:41 +0100)]
Add missing dependencies to docker file

Change-Id: I51e198e5992cc52070b9ddddad59a123d1c476fd
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoChange copyright for cover.sh. 23/11323/2
kubi [Tue, 15 Mar 2016 04:01:10 +0000 (12:01 +0800)]
Change copyright for cover.sh.

Change-Id: Ib342ac40adf5a48aca0269eee1baaf7db2a95135
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoMerge "Change copyright for dispatchers."
QiLiang [Wed, 16 Mar 2016 08:32:28 +0000 (08:32 +0000)]
Merge "Change copyright for dispatchers."

8 years agoUpdate setup.py and dependencies 61/11261/4
Jo¶rgen Karlsson [Fri, 11 Mar 2016 11:54:22 +0000 (12:54 +0100)]
Update setup.py and dependencies

Fixes dependency problem with python-openstackclient
Freezes requirements to use latest/current upstream versions

Yardstick can be installed with:

$ python setup.py install

or with:

$ easy_install -U pip
$ pip install -r ci/requirements.txt
$ pip install .      (or for develop mode: pip install -e .)

if fixed package versions are required

Change-Id: I9cb44d29011509c9c388dc2e7dc8bb60ee25e790
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoImprovement of debug messages to the user 37/11337/1
user [Tue, 15 Mar 2016 12:16:39 +0000 (08:16 -0400)]
Improvement of debug messages to the user

Change-Id: I09fa9cd865021701f53e0df2a2cd79d60ea04d6c
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
8 years agoSupport for port_security extension 33/11333/1
user [Tue, 15 Mar 2016 11:35:29 +0000 (07:35 -0400)]
Support for port_security extension

Change-Id: I5c513eb4024a3cd35c27e3ba6b9ace92af278432
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
8 years agoChange copyright for dispatchers. 25/11325/1
QiLiang [Tue, 15 Mar 2016 04:05:02 +0000 (12:05 +0800)]
Change copyright for dispatchers.

Changed to ceilometer/influxdb-python copyright as lots of concepts
and code have been reused.

JIRA: -

Change-Id: I5fb0a8f9dac2e7b816240f5cf4d43f31f8e1a2f3
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoBug Fix - Fixes the heat template for noisy neighbours and its deployment 95/11095/2
user [Thu, 10 Mar 2016 15:10:27 +0000 (10:10 -0500)]
Bug Fix - Fixes the heat template for noisy neighbours and its deployment

Change-Id: I4c45b204a06a728db276a2e4a5f905f3a34f2de5
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
8 years agoBug Fix - select specific commit for smcroute within the vTC VM 59/11059/2
Vincenzo Riccobene [Wed, 9 Mar 2016 13:47:47 +0000 (13:47 +0000)]
Bug Fix - select specific commit for smcroute within the vTC VM

Change-Id: I515c6355546758365346fab5babc3a0810de1f4a
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoChange copyright for base scenario 95/11295/1
Jo¶rgen Karlsson [Mon, 14 Mar 2016 10:15:24 +0000 (11:15 +0100)]
Change copyright for base scenario

Changed to rally copyright as lots of concepts and code have
been reused.

Change-Id: I00d3665fc37634b1ad5f8b2aaca31fffb8fa8942
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoChange copyright for runners. 93/11293/2
Jo¶rgen Karlsson [Mon, 14 Mar 2016 09:15:23 +0000 (10:15 +0100)]
Change copyright for runners.

Changed to rally copyright as lots of concepts and code have
been reused.

Change-Id: Id850b94c9ad05a075614870b293456f2d5fb6e5f
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoBackup of grafana dashboard 69/10869/1
Jo¶rgen Karlsson [Fri, 26 Feb 2016 14:20:03 +0000 (15:20 +0100)]
Backup of grafana dashboard

Temprarily backing up dashboard files in case of server crash.
We should automate this in the future.

Change-Id: Ia56a41aaff9bd66dccb4146320938851c875989e
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd test suite for huawei shanghai pod 65/10865/1
QiLiang [Fri, 26 Feb 2016 08:54:22 +0000 (16:54 +0800)]
Add test suite for huawei shanghai pod

JIRA: -

Change-Id: If314e5e7b3f93a3368452b7401e320ce0c64b99f
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoupdate ipv6 test case user guide 17/10717/3
kubi [Thu, 25 Feb 2016 15:33:05 +0000 (10:33 -0500)]
update ipv6 test case user guide

add more introduce into ipv6 test case of user guide
JIRA:-
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: I96e78d6bf5553bb53ba1837d45126726981c9d42
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdds test results for scenario: fuel_os_nosdn_nofeature_ha 77/10377/7
Per Holmgren [Mon, 22 Feb 2016 10:56:26 +0000 (11:56 +0100)]
Adds test results for scenario: fuel_os_nosdn_nofeature_ha

All scenario TCs included, except TC011 which has had
an InfluxDB population problem. This is now solved but too
late to run with scenario in R2 release time frame.

Change-Id: I0eefa9b3599e7813ec8b21df863d885766cae4d0
Signed-off-by: Per Holmgren <per.q.holmgren@ericsson.com>
8 years agoAdds test scenario result report: fuel-os-odl_l2-nofeature-ha 89/10589/5
Per Holmgren [Wed, 24 Feb 2016 13:35:33 +0000 (14:35 +0100)]
Adds test scenario result report: fuel-os-odl_l2-nofeature-ha

Change-Id: I2574411fe5ac670851ea9d1be5ba5f2da5defb17
Signed-off-by: Per Holmgren <per.q.holmgren@ericsson.com>
8 years agoAdds test results for scenario: fuel_os_onos_nofeature_ha 07/10607/4
Per Holmgren [Wed, 24 Feb 2016 15:37:53 +0000 (16:37 +0100)]
Adds test results for scenario: fuel_os_onos_nofeature_ha

All scenario TCs included, except TC011 which has had an
InfluxDB population problem. This is now solved but too
late to run with scenario in R2 release time frame.

Change-Id: I341bd4109baf14069b6241f37da4c62da4cad394
Signed-off-by: Per Holmgren <per.q.holmgren@ericsson.com>
8 years agoTest results for apex and joid 05/10705/3
Ana C [Tue, 23 Feb 2016 12:45:46 +0000 (13:45 +0100)]
Test results for apex and joid

Adds test results for apex-odl-l2 and joid-odl-l2 scenarios.

Change-Id: I76869112a8225ff33d19cde179b2e6ca7e988fd4
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoTest results for compass onos and odl l2 15/10715/2
Ana C [Tue, 23 Feb 2016 13:07:11 +0000 (14:07 +0100)]
Test results for compass onos and odl l2

Add short summary for tests using compass, scenarios onos and odl l2.

Change-Id: I1f1f0ba4f2aeae4e656ae9a6d06fbd948da41424
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoadd test result: compass_os_nosdn_nofeature_ha 99/10699/3
kubi [Tue, 23 Feb 2016 20:06:46 +0000 (15:06 -0500)]
add test result: compass_os_nosdn_nofeature_ha

Reference to PerH's patch, modify the real value of
every test case, and add two more test cases about ipv6 and parser.
All scenario TCs included, except TC011 which has had an InfluxDB
population problem. this is now solved but too late to run with scenario
in R2 release time frame

JIRA:-
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: Ic58613b6bdf45de449ca3f0c381d716f0c03a736
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoTest Result of TC019 and TC025 43/7543/7
wym_libra [Thu, 21 Jan 2016 11:45:55 +0000 (19:45 +0800)]
Test Result of TC019 and TC025

JIRA: None

Change-Id: I425f957dade4bdb3bffe2f6c172fa6c3b68ce382
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoAdd Yardstick release note 07/9807/7
Ana C [Thu, 11 Feb 2016 15:42:08 +0000 (16:42 +0100)]
Add Yardstick release note

This change adds Brahmaputra release note for Yardstick, listing
deliverables.

Test results for the release and scenarios will be documented separately.

Test cases for vTC have been removed, will be delivered in SR1.

Change-Id: Ia9575249c8155d5a417722a8a1e89102e942784f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoRelease results overview 29/10629/2
Ana C [Tue, 23 Feb 2016 10:19:06 +0000 (11:19 +0100)]
Release results overview

This change includes the list of scenarios tested for the release.

Change-Id: Id1e6a07378560e7b88cabde16caca0fcc26544dc
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoiperf3: fix for influxDb schema errors 01/10501/2
Jo¶rgen Karlsson [Tue, 23 Feb 2016 12:10:00 +0000 (13:10 +0100)]
iperf3: fix for influxDb schema errors

Convert integers to float before dumping to influxDb.

Iperf3 is not always consistent about data types in its
JSON output. This may cause schema errors when values with
different types (integer and float) are written to the same
field in InfluxDb.

This is a quick fix. A Future improvement would be to write a
format func for the data.

Change-Id: I7011adc19693f91db5889554fd6bec0d46dc6679
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoMerge "ipv6-bug-fix: update physical pod yaml configure"
qi liang [Tue, 23 Feb 2016 12:44:00 +0000 (12:44 +0000)]
Merge "ipv6-bug-fix: update physical pod yaml configure"

8 years agoipv6-bug-fix: update physical pod yaml configure 91/10491/2
kubi [Tue, 23 Feb 2016 20:17:51 +0000 (15:17 -0500)]
ipv6-bug-fix: update physical pod yaml configure

due to the configure of huawei sc physical pod has been changed, ipv6 testing failed,
so i update the pod.yaml in yardstick to make it run successfully again

JIRA: YARDSTICK-186

Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAltering the name to ensure it is included in the configuration guide and not drawn... 89/10489/1
ChristopherPrice [Tue, 23 Feb 2016 11:50:41 +0000 (12:50 +0100)]
Altering the name to ensure it is included in the configuration guide and not drawn into the user guide.

Change-Id: I51f91b4ac94a869bd00bc7ded18ec1df78a4c073
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
8 years agoAdd missing license files 87/10387/1
Ana C [Mon, 22 Feb 2016 13:37:44 +0000 (14:37 +0100)]
Add missing license files

This change adds missing license information.

Change-Id: I2ddc85e3fb7b92a86b8a0f054d4ee177af198c8f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoinfluxdb: log error when result posting fails 95/10295/1
Jo¶rgen Karlsson [Fri, 19 Feb 2016 15:01:55 +0000 (16:01 +0100)]
influxdb: log error when result posting fails

Change-Id: I628e3919af56586a481708cb97ac4e38b7ccc5fa
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoResults for Yardstick test cases 75/9875/2
Ana C [Fri, 12 Feb 2016 01:48:15 +0000 (02:48 +0100)]
Results for Yardstick test cases

This change adds folder Results and templates for all scenarios as well as
tests not included in scenarios.

Change-Id: I2e93cd12e9af9ac8c3717515339e2c7687ef1943
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoYardstick input for Release central doc 81/9881/3
Ana C [Fri, 12 Feb 2016 02:25:27 +0000 (03:25 +0100)]
Yardstick input for Release central doc

This change adds a file, userguide.rst, that will be used by the release
central document as a summary of the Yardstick Project.

This file shall not be included in the index of the userguide.

The file has been renamed to testusage.rst, as per request.

Change-Id: Id8099349a7e626be3d800499bf98171d23239ded
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoAdd heat template workaround for odl-l3 51/10151/3
Jo¶rgen Karlsson [Wed, 17 Feb 2016 15:17:04 +0000 (16:17 +0100)]
Add heat template workaround for odl-l3

Change-Id: I476fdd4d0e0e97cb1457ae15f92442c42aa77b4e
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoci: Freeze pip requirements + cleanups 91/10091/5
Jo¶rgen Karlsson [Tue, 16 Feb 2016 19:24:56 +0000 (20:24 +0100)]
ci: Freeze pip requirements + cleanups

Freeze pip requirements for brahmaputra release to make sure we
keep track of dependencies.

Fixes internalURL problem with ericsson-virtual1

Add check to verify that nova, glance and heat services are functional

Change-Id: I15c3d215596eaad31f8e260d129b8e07a7d63976
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd test suite for ericsson-virtual1 blade 63/10063/1
Fatih Degirmenci [Tue, 16 Feb 2016 14:05:56 +0000 (15:05 +0100)]
Add test suite for ericsson-virtual1 blade

Change-Id: I6c22a32fd3197a5475ee4f41db946bd78b08dfa0
Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
8 years agoAdd more debug to image build 69/9869/1
Jo¶rgen Karlsson [Fri, 12 Feb 2016 16:00:30 +0000 (17:00 +0100)]
Add more debug to image build

Change-Id: Icfbed0433cb9cfb6f8f479fc69699d08ad49602b
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd license info and update structure 47/9747/2
Ana C [Wed, 10 Feb 2016 18:07:13 +0000 (19:07 +0100)]
Add license info and update structure

This change adds license to all .rst files under userguide.
It also combines all configguide files into user guide.
New reference.rst with list of links.
Updated glossary, removed separate directories for apexlake and yardstick
framework.

Change-Id: I6532ed073905b0fa85a17e759ea7dc3c24acb91f
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoUpdated install requirements 17/9717/2
Jo¶rgen Karlsson [Wed, 10 Feb 2016 13:11:08 +0000 (14:11 +0100)]
Updated install requirements

Change-Id: I594eb3fc976bc65a9fa01e48a805c3564ad3a5f3
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoRevert "Test: Workaround for ODL Lithium" 21/9621/2
Jörgen Karlsson [Tue, 9 Feb 2016 13:45:03 +0000 (13:45 +0000)]
Revert "Test: Workaround for ODL Lithium"

This reverts commit 912fe3bb9877456cb8ef363f9304bfab733eaffd.

Change-Id: I82e032ae43e49edff78cb8f7a0881a5ecd3f54db

8 years agoAdd influxdb credentials. 09/9609/2
Jo¶rgen Karlsson [Tue, 9 Feb 2016 13:04:14 +0000 (14:04 +0100)]
Add influxdb credentials.

This is temporary!!!!!

Credentials should be moved to a more secure place.

Change-Id: Ifc0985aa58bb9fc861e0974e54d7ec34eb445a43
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd deploy scenario tag to influxdb measurements 07/9607/1
Jo¶rgen Karlsson [Tue, 9 Feb 2016 12:53:11 +0000 (13:53 +0100)]
Add deploy scenario tag to influxdb measurements

Change-Id: I7e303f8445e4910074fcae6e48f142fa7b61923c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoyardstick image build cleanups 31/9531/1
Jo¶rgen Karlsson [Mon, 8 Feb 2016 14:40:48 +0000 (15:40 +0100)]
yardstick image build cleanups

 - reduce progress verbosity when downloading with wget
 - added some debug printouts for trouble shooting
   mount issues

Change-Id: Ic608f847b0fe74df231ce3d7d419dcf6c19807ed
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agobug fix: wrong POD name used in result dispatchers 21/9521/1
Jo¶rgen Karlsson [Mon, 8 Feb 2016 12:24:17 +0000 (13:24 +0100)]
bug fix: wrong POD name used in result dispatchers

Change-Id: I04a300b3478dd075208f9c904dcb281d74089344
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agobug fix: huawei sc lab virtual pod task fail 05/9005/3
kubi [Tue, 2 Feb 2016 08:16:24 +0000 (16:16 +0800)]
bug fix: huawei sc lab  virtual pod task fail

opnfv_yardstick_tc027.yaml 's configure file is written for physical pod

it shouldn't be added into virtual pod task, so remove it. otherwise, task will failed

Change-Id: Ic2f03c6522cace32426a7aade1da56ed2c1766d1
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoadd precondition check 69/9369/3
kubi [Fri, 5 Feb 2016 08:48:00 +0000 (08:48 +0000)]
add precondition check

as we discussed yersterday, for daily jenkins task,
i have a new idea, i add a precondition check and a key parameter in test case,
if environment info(eg. "DEPLOY_SCENARIO") meet the preconditon which was defined in test case ,
this test case will run, if not meet, this test case will skip.

and default is allow all test case to run, so this patch will not influence existing test case.
any comments are welcomed

Change-Id: I4300ac58994d51c0ddb4dd6d58b7191f796ddcee
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoTest: Workaround for ODL Lithium 81/9281/4
Jörgen Karlsson [Thu, 4 Feb 2016 15:55:56 +0000 (15:55 +0000)]
Test: Workaround for ODL Lithium

Change-Id: I9db7f95beb618e2a3125b5252a79bf1a400b6af1

8 years agoHEAT HTTPS SSL Support 15/9115/2
rsritesh [Tue, 2 Feb 2016 03:47:26 +0000 (06:47 +0300)]
HEAT HTTPS SSL Support

Currently yardstick does not provide the support for
OS_CACERT option.
The addition OS_CACERT options makes the user to use certificate
to communicate with the HEAT.

Closes-Bug: #YARDSTICK-227
Change-Id: I045c3f4b94dba9dfb6fd0e2706d758647d3fe4af
Signed-off-by: rsritesh <p.ritesh@tcs.com>
8 years agobug fix : git clone yardstick repo failed 21/8821/1
kubi [Mon, 1 Feb 2016 06:26:57 +0000 (14:26 +0800)]
bug fix : git clone yardstick repo failed

line45: git clone YARDSTICK_REPO $YARDSTICK_REPO_DIR fail

Change-Id: I7f2973b320a30a02264b3f65fb3e1397218a5d9a
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd test suites for huawei lab virtual deploy 61/8761/2
QiLiang [Sat, 30 Jan 2016 15:12:03 +0000 (15:12 +0000)]
Add test suites for huawei lab virtual deploy

JIRA: -

Change-Id: Ibc44bf11fb8bef4878ec57187877624a557f9937
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoService Function Chaining test cases 93/7393/25
Ricardo Noriega [Tue, 19 Jan 2016 16:41:22 +0000 (17:41 +0100)]
Service Function Chaining test cases

Change-Id: Id4c8b1bc05e768bdb2b8f17798f13f4d83dcd9d6
Signed-off-by: Ricardo Noriega <ricardo.noriega.de.soto@ericsson.com>
8 years agoAdd directory for code documentation 09/8609/2
Ana C [Fri, 29 Jan 2016 16:49:32 +0000 (17:49 +0100)]
Add directory for code documentation

This change adds a folder for yardstick code documentation under docs,
apidocs. An index.rst  file is added, and a modules.rst to list the
modules.
The documentation will be automatically generated from code docstrings,
using sphinx autodoc directive.

JIRA:YARDSTICK-161

Change-Id: I56ff1904c319a00352842be5ba7bb0cb52bbc3d6
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoAdd debug info to solve image build errors 07/8607/1
Jo¶rgen Karlsson [Fri, 29 Jan 2016 16:53:24 +0000 (17:53 +0100)]
Add debug info to solve image build errors

Add more debug output and clear devmap table in order to
solve build problems in YARDSTICK-226.

Change-Id: Idfdbb925501c8debb67406f2dd316e1d4bfbaaa8
JIRA: YARDSTICK-226
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoLicense for PCAP files 91/8291/1
Vincenzo Riccobene [Thu, 28 Jan 2016 11:10:28 +0000 (11:10 +0000)]
License for PCAP files

Change-Id: Id2fdedf56099200b59392b5b337fcdde502d5f3a
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd test suite for huawei lab virtual deploy 81/8281/2
QiLiang [Thu, 28 Jan 2016 18:25:10 +0000 (18:25 +0000)]
Add test suite for huawei lab virtual deploy

JIRA: -

Change-Id: I0cd58a2acb0a2a55431eebd6b4adcde95d50d7bc
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoRevert "Test: Workaround for ODL scenarios" 73/8173/1
Jörgen Karlsson [Wed, 27 Jan 2016 17:22:47 +0000 (17:22 +0000)]
Revert "Test: Workaround for ODL scenarios"

This reverts commit 8236c94ecef8aa25af073c50f7a0eaafae9b4bc6.

Change-Id: I4652efe4f75e7f2605945e9896b33379eff059d1

8 years agoTest: Workaround for ODL scenarios 17/8017/4
Jo¶rgen Karlsson [Tue, 26 Jan 2016 12:18:32 +0000 (13:18 +0100)]
Test: Workaround for ODL scenarios

Temporarily removing security group from generated heat template.

This patch is pushed through for testing purposes and should be
reverted when a proper solution is found.

Change-Id: I64c86f41664499d46d8317bb1ebbe304083554ab
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoInfluxDB add authentication support 83/7983/1
QiLiang [Tue, 26 Jan 2016 08:55:00 +0000 (08:55 +0000)]
InfluxDB add authentication support

JIRA: YARDSTICK-212

Change-Id: I6b669800160268db70b5c9e43cbbc053576ec4b5
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agofix some missing license file 35/7535/2
kubi [Thu, 21 Jan 2016 02:42:33 +0000 (10:42 +0800)]
fix some  missing license file

fix .coveragerc, etc/yardstick/nodes/pod.yaml.sample
etc/yardstick/yardstick.conf.sample

Change-Id: Iece74c80316202fb000dda0ea2b3f8fdb6fe5eb8
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdd license to files for Apex Lake directory 03/7403/2
Vincenzo Riccobene [Wed, 20 Jan 2016 09:26:53 +0000 (09:26 +0000)]
Add license to files for Apex Lake directory

Change-Id: I25978755d4ec705d01eeb78c2d8e91e45e556011
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd apexlake CI script 39/7439/3
Jo¶rgen Karlsson [Wed, 20 Jan 2016 12:33:42 +0000 (13:33 +0100)]
Add apexlake CI script

Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
Change-Id: I5dcd45692938afddadbf17650c96fddf1f99dce7

8 years agoInfluxdb change tc as measurement 63/7263/3
QiLiang [Tue, 19 Jan 2016 10:44:48 +0000 (10:44 +0000)]
Influxdb change tc as measurement

Add host and taget tags (initially for cpuload scenario to
                         identify  where the test run)

JIRA: YARDSTICK-212

Change-Id: I895bd435ec4a5e036e5ae2dc965df23ccfa6bf24
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoMove the test case of TC025 to the test cases folder 53/7253/2
wym_libra [Tue, 19 Jan 2016 18:46:30 +0000 (02:46 +0800)]
Move the test case of TC025 to the test cases folder

Change-Id: Ia3760a4fcc17f810940240d1778939333e8ffdc6
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoFix EXTERNAL_NETWORK for joid 69/7269/2
Jo¶rgen Karlsson [Tue, 19 Jan 2016 11:35:45 +0000 (12:35 +0100)]
Fix EXTERNAL_NETWORK for joid

Change-Id: I31c932a9098933fe139c28a65c3989a0014d0f8d
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix Apexlake Documentation 43/7143/3
Vincenzo Riccobene [Mon, 18 Jan 2016 15:35:52 +0000 (15:35 +0000)]
Fix Apexlake Documentation

Change-Id: If9519d1660fe21bc13307ce35711424c6e2b8176
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agosupport os+odl for ipv6 29/7229/4
kubi [Tue, 19 Jan 2016 08:02:05 +0000 (16:02 +0800)]
support os+odl for ipv6

As we known, the network of os+odl scenario is still not available.
so this patch still need to do more debug work.
however, Jan 19th is code freeze day, i think a good way is to merge it at first
when os+odl become available, i will do rest debug work and fix it

Change-Id: I518f759069e74d2e57e40b52dfecaef4b4d26a02
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoCreate weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clara 99/7099/1
kubi [Mon, 18 Jan 2016 10:48:22 +0000 (18:48 +0800)]
Create weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clara

Test Case 040 :parser is added into weekly yaml
Signed-off-by: kubi <jean.gaoliang@huawei.com>
Change-Id: I0cb4a9e273b5cac55b9a7a278ea17b1ad78d1ac6

8 years agoHttpDispatcher case_name value update 55/7055/1
QiLiang [Mon, 18 Jan 2016 07:07:55 +0000 (07:07 +0000)]
HttpDispatcher case_name value update

See details on https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
section Questions 6.1

Change-Id: I72268c827a2321859c405f45b7e1e475c0ffb4a0
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoFixed documentation for ApexLake 03/6903/2
Vincenzo Riccobene [Fri, 15 Jan 2016 17:19:10 +0000 (17:19 +0000)]
Fixed documentation for ApexLake

Integration of ApexLake documentation into the main docs directory

Change-Id: I3398acc16cc2ff4bb039783fc5bcb6a10afda4e1
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agomodify sc lab pod yaml as real configure 63/6963/3
kubi [Sat, 16 Jan 2016 10:31:42 +0000 (18:31 +0800)]
modify sc lab pod yaml as real configure

Change-Id: I6587794b7206cb3d5f13b6c448670d1c97ecd596
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoenable ipv6 test case in sc lab 47/6947/1
kubi [Sat, 16 Jan 2016 07:59:10 +0000 (15:59 +0800)]
enable ipv6 test case in sc lab

Change-Id: I4609fcb4427413fd6cde435f7bd062c9dde61949
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoUpdate test suite files. 31/6831/3
Jo¶rgen Karlsson [Fri, 15 Jan 2016 12:18:46 +0000 (13:18 +0100)]
Update test suite files.

Added TC 10, 11 and 14.
Removed TC 1 as it is already included in TC 37

Change-Id: Iea483c4a26c657984769400f2949ca300c2504bd
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoDump test result when test finished 97/6797/3
QiLiang [Fri, 15 Jan 2016 06:02:54 +0000 (14:02 +0800)]
Dump test result when test finished

JIRA: -

Change-Id: I8712f1c4a0a063bdf7ba6a425015dea894c34d16
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agofix some bug in ipv6 to make it run in ci 29/6829/3
kubi [Fri, 15 Jan 2016 11:40:28 +0000 (19:40 +0800)]
fix some bug in ipv6 to make it run in ci

JIRA:YARDSTICK-187

Change-Id: Ia15d17afdef145f7b230a8a4d25a61eed5cdfd76
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAdds desription for TC024, the CPU load/mpstat test case 23/6723/3
Per Holmgren [Thu, 14 Jan 2016 15:06:34 +0000 (16:06 +0100)]
Adds desription for TC024, the CPU load/mpstat test case

Change-Id: Ifbc571e3e216349d065ac21df1a3f10fe94d4e9a
JIRA: -

8 years agoCorrect some typos 75/6775/1
wym_libra [Fri, 15 Jan 2016 10:07:01 +0000 (18:07 +0800)]
Correct some typos

Change-Id: Ia9fd31580ff75663514aebbb46a8b87021cb01de
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoAdd test case description and task file for TC011 37/6637/5
wym_libra [Thu, 14 Jan 2016 14:53:10 +0000 (22:53 +0800)]
Add test case description and task file for TC011

Add test case description for Packet delay variation between VMs (TC011)
and test case .yaml task file.

** Please note that the SLA value has not yet been determined. **

Change-Id: I68a374224946d46c173ad477c14cb79d573b1eee
Signed-off-by: wym_libra <yimin.wang@huawei.com>
8 years agoHeatContext model update to match heat code update 47/6647/4
QiLiang [Thu, 14 Jan 2016 08:09:40 +0000 (08:09 +0000)]
HeatContext model update to match heat code update

In Heat Liberty release OS::Nova::Server will always use the user
pre-configured in the image (e.g. "fedora" for stock Fedora cloud
images, "ubuntu" for stock Ubuntu cloud images, "cloud-user" for
stock CentOS cloud images etc)

Change all ec2-user -> ubuntu

Add admin-user in Heat model for backwards compatibility.

Refer below links for detalis:
https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting
https://github.com/openstack/heat/commit/e423bec7f10b0f5d07f05d195b3b7860f6bceb00
http://blog.scottlowe.org/2015/04/23/ubuntu-openstack-heat-cloud-init/

JIRA: -

Change-Id: I6b8b2b21daf113a3a86aee1126b0c3e74737ef4f
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoUpdate results for Test Cases 6, 7, 20, 21 09/6709/5
Vincenzo Riccobene [Thu, 14 Jan 2016 13:55:57 +0000 (13:55 +0000)]
Update results for Test Cases 6, 7, 20, 21

JIRA: YARDSTICK-219

Change-Id: I06143f074592e05cd17b740eb9751414a56c9fde
Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com>
Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
8 years agoAdd test suite for Orange POD2 17/6717/2
Jo¶rgen Karlsson [Thu, 14 Jan 2016 14:29:43 +0000 (15:29 +0100)]
Add test suite for Orange POD2

Change-Id: I667a54793be39c74a9f787b055b07fda9b2ba06c
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoAdd template for test results report 85/6585/2
Ana C [Wed, 13 Jan 2016 17:43:13 +0000 (18:43 +0100)]
Add template for test results report

This change is a proposal for a report for yardstick test case reesults.
One report for all the executed tests, summarizing the results and the
labs where the tests were executed.

JIRA: -

Change-Id: I7cdfdc82d6ee07d2b9da426f33ce34b86362b5b4
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoFix small bugs for running Apexlake on Montreal testbed 83/6583/8
user [Wed, 13 Jan 2016 17:36:50 +0000 (12:36 -0500)]
Fix small bugs for running Apexlake on Montreal testbed

JIRA: YARDSTICK-219

Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded
Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
8 years agoci: add influxdb target options 43/6543/2
Jo¶rgen Karlsson [Wed, 13 Jan 2016 14:53:00 +0000 (15:53 +0100)]
ci: add influxdb target options

Change-Id: I50cbbf4d2fe59d688a4951cc8bec3362b098adcb
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix flake8 errors 51/6551/2
Jo¶rgen Karlsson [Wed, 13 Jan 2016 15:19:58 +0000 (16:19 +0100)]
Fix flake8 errors

Change-Id: I14f21092f5e97abf0629a92a27062846a6d3130b
JIRA:-
Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
8 years agoFix minor format details in tc descriptions 11/6411/1
Ana C [Tue, 12 Jan 2016 17:02:31 +0000 (18:02 +0100)]
Fix minor format details in tc descriptions

This change fixes minor formating in TC025, remove one extra line in TC028
and update 03-list-of-tcs.

The formating caused the pdf to fail.

Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80
Signed-off-by: Ana C <ana.cunha@ericsson.com>
8 years agoRename tc019/tc025 & fix description for tc005 77/6377/1
QiLiang [Tue, 12 Jan 2016 22:53:22 +0000 (22:53 +0000)]
Rename tc019/tc025 & fix description for tc005

Added tc019 and tc025 to index of test cases in 03-list-of-tcs.

JIRA: -

Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9
Signed-off-by: QiLiang <liangqi1@huawei.com>
8 years agoAdd test case description for TC028-kvm 73/6373/1
QiLiang [Tue, 12 Jan 2016 22:45:42 +0000 (22:45 +0000)]
Add test case description for TC028-kvm

JIRA: YARDSTICK-188

Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804
Signed-off-by: QiLiang <liangqi1@huawei.com>