bottlenecks.git
6 years agoMerge "Add description of environment clean-up" into stable/danube danube.2.0
Yu Yang (Gabriel) [Thu, 4 May 2017 06:57:07 +0000 (06:57 +0000)]
Merge "Add description of environment clean-up" into stable/danube

6 years agoChange PTL informatin in INFO 03/34203/1
yuyang [Thu, 4 May 2017 06:33:17 +0000 (14:33 +0800)]
Change PTL informatin in INFO

Due to recent email voting results, change the PTL promotion
result in INFO. Detailed information could be found below.
https://lists.opnfv.org/pipermail/opnfv-tsc/2017-April/003422.html

Change-Id: I5c942668cbe03e697bd0865cc8aee1980afed104
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 1a3307f228055404930a7d53dc225270a70a174a)

6 years agoAdd description of environment clean-up 01/34201/1
yuyang [Tue, 2 May 2017 04:16:22 +0000 (12:16 +0800)]
Add description of environment clean-up

JIRA: BOTTLENECK-165

More details of the environment clean-up for ping test case

Change-Id: I4b12a219155400235ae2bcb970efb3ba237153d9
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 15355fd57080a7ac625549e9e9b98237164e46d2)

6 years agoDocs for Danube 2.0 81/33981/1
yuyang [Tue, 25 Apr 2017 03:17:25 +0000 (11:17 +0800)]
Docs for Danube 2.0

JIRA: BOTTLENECK-165

Documents adapted to Danube 2.0

Change-Id: Ic46cc0ad2f2706986b294f539bba1264ec6f8b0b
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit e2fd28497f0083099181a9b65696e5ea8c422007)

6 years agoAdd more information to Table for stress ping 41/33641/1
yuyang [Thu, 20 Apr 2017 16:01:56 +0000 (00:01 +0800)]
Add more information to Table for stress ping

JIRA: BOTTLENECK-164

Table for stress ping is showing results categories for different number of users.
It does not show the results for every testing round, just show uniquely
testing round with different success rates.
This patch is to make sure showing every results.

Change-Id: I3a33164024e3da23de31d546767f0fb29952983d
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
6 years agoBugfix of docker-compose file for privileged 39/33639/1
yuyang [Thu, 20 Apr 2017 07:05:58 +0000 (15:05 +0800)]
Bugfix of docker-compose file for privileged

JIRA: BOTTLENECK-163

privileged option in docker-compose file should be true to avoid
"permission deny" error when accessing directories

Change-Id: I1a57146236efb5fe71405c5b7682af706a8814bf
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit c988d5fa114a659f19f0db1fd0db9f6abc5247dd)

7 years agoFix code style issues for specificed path 59/33259/1
yuyang [Tue, 11 Apr 2017 06:47:07 +0000 (14:47 +0800)]
Fix code style issues for specificed path

JIRA: BOTTLENECK-100

Fix code syle issues for the path flake8 specified before flake8
check merged into CI pipeline.

Change-Id: Iee59bada206fafd4740023e90d08a4b4a7a030db
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fc30c5208a680d0059cfa48891a1d97747f7f778)

7 years agoFinalize docs for Danube 1.0 53/32653/4 danube.1.0 danube.1.RC1
yuyang [Thu, 30 Mar 2017 16:26:31 +0000 (00:26 +0800)]
Finalize docs for Danube 1.0

JIRA: BOTTLENECK-145

Polishing docs and finalizing docs for Danube 1.0.

Change-Id: Iea5490785bce802aff37b7f52172d7f14ea358e0
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 529508e4be82ef3e329e9ca3bec6210fb5ef90e6)

7 years agobugfix: bottlenecks devguide in docs.opnfv.org 57/32157/1
yuyang [Wed, 29 Mar 2017 01:58:10 +0000 (09:58 +0800)]
bugfix: bottlenecks devguide in docs.opnfv.org

JIRA: BOTTLENECK-149

Adjust the directory structure to make Bottlenecks devguide
on docs.opnfv.org.

Change-Id: Ib773a26ca5f4eaee94834ff641ec45531ef3025c
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 3480c32bb5113a8a5f56b7e1db82c3a9236418fb)

7 years agobugfix: fix bugs for running 'teststory run' 51/32151/1
yuyang [Tue, 28 Mar 2017 02:40:35 +0000 (10:40 +0800)]
bugfix: fix bugs for running 'teststory run'

JIRA: BOTTLENECK-144

utils/parser.py:56 has incorrect var:cls which cause pass more
var to testcase_read function.

Change-Id: I2d4b93f95d19a205e537515529746f6d9e13fe2c
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 1760c89637ac71b877a17896e5768640a20360c3)

7 years agoAdd docker clean-up for run test 49/32149/1
yuyang [Mon, 27 Mar 2017 07:41:23 +0000 (15:41 +0800)]
Add docker clean-up for run test

JIRA: BOTTLENECK-148

Currently, only OPNFV CI includes env-cleanup for Bottlenecks.
It is preferable to also include the operation locally
for test automation and repeatability.

Changes:
1. Translate tab into 4 spaces

Change-Id: I9f4efb95c155e442afd3141c00f707421c61b2da
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fe83578bd2fe1a09f8334f85e30a0afbb68cc5cc)

7 years agoCLI acommadation to the current test case calling method 99/31899/1
yuyang [Sat, 25 Mar 2017 10:31:39 +0000 (18:31 +0800)]
CLI acommadation to the current test case calling method

JIRA: BOTTLENECK-144

Calling method of POSCA test case has changed. CLI for calling
the run test case script should also adjust.

Change-Id: Ia007b658903c8133c824358943f325b070d1e195
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 2bf5dbd9b63288e8ce77c7c4e42df8b1e4deb2ce)

7 years agoAdd task selection to test suite entrance file 97/31897/1
yuyang [Sat, 25 Mar 2017 08:40:19 +0000 (16:40 +0800)]
Add task selection to test suite entrance file

JIRA: BOTTLENECK-143

Add task selection to test suite entrance file

Change-Id: Ia21b3121d104a457a66e2c77e3caf091e102f388
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 15c3931fd723f565e847033bc6c1df818a761b4a)

7 years agoUpdate document according to Danube release plan 85/31885/1
yuyang [Fri, 24 Mar 2017 03:24:17 +0000 (11:24 +0800)]
Update document according to Danube release plan

JIRA: BOTTLENECK-145

Currently, the docs of Bottlenecks still follow the format
from Colorado. Some work need to be done regarding reorganizing
the contents according to the Danube release.

Change-Id: I4ece51abc558bb7128565125224b5e8579a198f7
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 566a7246d6a8e9451be511ddae84f7067bf013ea)

7 years agoBugfix: set docker api version to 1.24 65/31565/1
yuyang [Thu, 23 Mar 2017 11:59:29 +0000 (19:59 +0800)]
Bugfix: set docker api version to 1.24

JIRA: BOTTLENECK-146

Set docker api version to 1.24

Change-Id: Id05527e628c7fa6ff3382bd68741bd36fc706fe6
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 4b36a57727cad302976ee38ad0046a7595339849)

7 years agoBugfix: fix docker version to 2.1.0 43/31543/1
yuyang [Thu, 23 Mar 2017 09:40:27 +0000 (17:40 +0800)]
Bugfix: fix docker version to 2.1.0

JIRA: BOTTLENECK-146

Fix the docker API library to 2.1.0

Change-Id: I4cf2801db2adc28325a587411f802515176e8d03
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 3a3bb4df2db4f58d3e76dcdd41b3327bd2094eb3)

7 years agoBugfix: fix docker version instead of API version 37/31537/1
yuyang [Thu, 23 Mar 2017 09:23:35 +0000 (17:23 +0800)]
Bugfix: fix docker version instead of API version

JIRA: BOTTLENECK-146

In 31527, API version is 1.24, docker version should be 1.12

Change-Id: I529f16372aaa00b4fc802344b559453677b7b560
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 2f1f35479f0449d4b91eb5c28e94a50af202e18f)

7 years agobugfix: docker client version newer than docker server 27/31527/1
yuyang [Thu, 23 Mar 2017 08:59:52 +0000 (16:59 +0800)]
bugfix: docker client version newer than docker server

JIRA: BOTTLENECK-146

Docker client is needed in Bottlenecks docker for the purpose to
use docker command within docker.
The inconsistence of docker client version with
docker server version causing building falure.

Change-Id: Ib4ecf9c40db5492438b27550636413e5f3a69ea3
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 136b188b4713f4ec2a20d6a09b4284a02f520aa3)

7 years agoUpdate docs structure according to Danube agreement 05/31505/1
yuyang [Wed, 22 Mar 2017 10:24:46 +0000 (18:24 +0800)]
Update docs structure according to Danube agreement

JIRA: BOTTLENECK-141

docs.opnfv.org has trouble indexing all the testing docs.
So testing projects have to adjust the docs structure.

Change-Id: I586b2c1626ca4fb8e1980130e132e6079a0977a7
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 3bc1b97e2a594959a9966c6f967e50fa33d2893b)

7 years agoUpdate test suite running entrance 71/31471/1
yuyang [Wed, 22 Mar 2017 11:57:59 +0000 (19:57 +0800)]
Update test suite running entrance

JIRA: BOTTLENECK-142

Update the entrance for POSCA test suite.Currently, test case
selection for POSCA is not support for this entrance.
The function will be added later.
For Rubbos and VSTF, after OPNFV Colorado release,
they are not updating anymore. This entrance for running them
within Bottlenecks is no longer supported.
These testsuites are also not in the release plan with Bottlenecks
since then. If you want to run Rubbos and VSTF,
please refer to ealier releases.

Change-Id: Idaf7da147489c6371e46ac3234179133762a05cd
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fc9a89857e121c2015a34e49c441cb234fa10c13)

7 years agoMerge "Add liscense to file headers"
Yu Yang (Gabriel) [Fri, 10 Mar 2017 08:24:57 +0000 (08:24 +0000)]
Merge "Add liscense to file headers"

7 years agoAdd liscense to file headers 41/29041/10
yuyang [Mon, 20 Feb 2017 03:28:17 +0000 (11:28 +0800)]
Add liscense to file headers

JIRA: BOTTLENECK-133

Some Yaml, XML and __init__.py file do not have liscense headers.
This patch is to add headers to those files or delete those are deprecated.

Change-Id: Ie059b1f1879eb420eec171f96985247510c74642
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoApply docs strucutre to Danube agreement 09/30009/5
yuyang [Wed, 8 Mar 2017 03:17:40 +0000 (11:17 +0800)]
Apply docs strucutre to Danube agreement

JIRA: BOTTLENECK-137

According to the agreement in Testperf meeting.
Change the structure of docs.

Change-Id: Ie370de1e7a24c918aedc8a2cdb2cca0508ef4257
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add Danube Document Framework"
Yu Yang (Gabriel) [Wed, 1 Mar 2017 06:33:22 +0000 (06:33 +0000)]
Merge "Add Danube Document Framework"

7 years agoAdd Danube Document Framework 19/28819/22
yuyang [Thu, 16 Feb 2017 12:44:47 +0000 (20:44 +0800)]
Add Danube Document Framework

JIRA: BOTTLENECK-137

Bottlenecks document framwork meeting Danube document requirement.

Changes:
1. Add POSCA testsuite document
2. Combine configuration and installation directory
  2.1 https://wiki.opnfv.org/display/DEV/Documentation+Toolchain
3. Change file names in /user_guide
4. Add requirements notes to release notes
5. Add stress test configuartion details

Change-Id: I8d9055097ddae280d985120d4501819d20ad1dcb
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoquota limit for posca_stress_ping 31/29131/1
liyin [Tue, 21 Feb 2017 09:20:28 +0000 (17:20 +0800)]
quota limit for posca_stress_ping

JIRA:BOTTLENECK-140

Those code will update an action of quota.
Before out test begin we will make quota no limit.
so we could do stress test.
Those quota limit will change openstack forever.
maybe will create damage for openstack.

Change-Id: I0a6a06c6c303589881cb2ab7b754213ecf1a845f
Signed-off-by: liyin <liyin11@huawei.com>
7 years agostress_test_dashboard_code 23/29023/2
liyin [Sat, 18 Feb 2017 14:24:18 +0000 (22:24 +0800)]
stress_test_dashboard_code

JIRA:BOTTLENECK-138

Those codes will create dashboard for stress test.
And we have fixed a bug, that we will increace env prepare in this patch
besides: we also add some code of how to yardstick api.

Change-Id: I64bb249ee0df9fe37e998a784ba346719bf25197
Signed-off-by: liyin <liyin11@huawei.com>
7 years agostress test of ping testcase 77/28777/6
liyin [Thu, 16 Feb 2017 04:30:12 +0000 (12:30 +0800)]
stress test of ping testcase

JIRA:BOTTLENECK-136

those code will add a new testcase: posca_stress_ping
This will use docker python client to realize the fountion of
calling yardstick to test.
And yardstick will create several VM pairs to test.
Because of the limites of quotas,
we now create 2,5,10 VM pairs.

Change-Id: I096250c547cd598c7c632a884b31d81c2be125f8
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoDashboard and output file code reconstruction 71/28571/1
liyin [Tue, 14 Feb 2017 02:42:07 +0000 (10:42 +0800)]
Dashboard and output file code reconstruction

JIRA:BOTTLENECK-134

Those code will change the way to create dashboard.
And dashboard as a spare function to show data.
And we add log system to dashboard creation.
The output file is created anyway.

Change-Id: Ia3c4d5a8ada27005702e3eed08757f61610da22f
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bug fix: yardstick result return no content"
Yu Yang (Gabriel) [Mon, 13 Feb 2017 07:05:05 +0000 (07:05 +0000)]
Merge "Bug fix: yardstick result return no content"

7 years agoBug fix: yardstick result return no content 57/28357/1
liyin [Thu, 9 Feb 2017 09:59:09 +0000 (17:59 +0800)]
Bug fix: yardstick result return no content

JIRA:BOTTLENECK-130

this patch will fix this bug:
we try to expect this error,
And we try to run it again.
if failed, then yardstick RestAPI or have some error.

Change-Id: I9fa63da637456a16c151f4fe7c566b3f5ff0e01d
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd POSCA jenkins job support 97/28097/5
yuyang [Mon, 6 Feb 2017 08:21:36 +0000 (16:21 +0800)]
Add POSCA jenkins job support

JIRA: BOTTLENECK-128

This patch is to make the POSCA testsuite could be built
automatically for OPNFV CI job.

Change-Id: I21d7fd553ce3591aea3391a33fe0a7b8579b57d4
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoLog_dir bug fix&Add function of test_ip init 77/28177/5
liyin [Tue, 7 Feb 2017 07:29:50 +0000 (15:29 +0800)]
Log_dir bug fix&Add function of test_ip init

JIRA:BOTTLENECK-129

This patch fix the error of log_dir can't be found.
And change several thing:
1.Add if config don't have test_ip, it will use local:8888 as test ip.
2.Fix the bug in setup.py.
3.Add parser init to logger file.

Change-Id: I808c69e2b2ff3c04f271cc7f3e14e1ab406a4d1b
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoBottlenecks stack config parser. 65/28165/1
liyin [Tue, 7 Feb 2017 03:26:14 +0000 (11:26 +0800)]
Bottlenecks stack config parser.

JIRA:BOTTLENECK-126

realize the function of parsering stack config.
include the function all the jira mationed.
it's important for stack creating.
this patch also include manager.py.
This file modify some file such like template intial.

Change-Id: Iaa6fdbde6bf9cb1ff9875d47268440dfe70ecc49
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks POSCA testing code reconstruction"
Yu Yang (Gabriel) [Tue, 7 Feb 2017 02:22:29 +0000 (02:22 +0000)]
Merge "Bottlenecks POSCA testing code reconstruction"

7 years agoBottlenecks POSCA testing code reconstruction 37/27437/5
liyin [Tue, 24 Jan 2017 09:26:21 +0000 (17:26 +0800)]
Bottlenecks POSCA testing code reconstruction

JIRA:BOTTLENECK-103

This is the foundation of adding stack samples.
This code change a lot code.
but it's a basic.
Those code will be changed in the furture.

Change-Id: I8d5bbb9cc401b1aaac54ec4dffc4c005a42d17ac
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "bottlenecks ssh to VM by python"
Yu Yang (Gabriel) [Fri, 3 Feb 2017 07:36:29 +0000 (07:36 +0000)]
Merge "bottlenecks ssh to VM by python"

7 years agoMerge "Add paths to flake8 style check"
Yu Yang (Gabriel) [Mon, 23 Jan 2017 01:27:07 +0000 (01:27 +0000)]
Merge "Add paths to flake8 style check"

7 years agobottlenecks ssh to VM by python 61/27261/1
liyin [Fri, 20 Jan 2017 01:22:20 +0000 (09:22 +0800)]
bottlenecks ssh to VM by python

JIRA:BOTTLENECK-127

This file is a copy of yardstick.
This file have been tested.
All function could be used in bottlenecks VM.
This include some function about how to excute commonds to VM.
This will be used in Bottlenecks functional testing.

Change-Id: I123a6753d0b7855948ae9bf7bedc245f90c4a3b6
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoModify utils/ code into PEP8 style 69/27069/1
liyin [Tue, 17 Jan 2017 02:56:19 +0000 (10:56 +0800)]
Modify utils/ code into PEP8 style

JIRA: BOTTLENECK-100

Modify all the code in the utils folder into PEP8 style.
Using more standard way to realize our function.

Change-Id: Ie75c57f7fdd2a9d03849c3cb240918a6779d6be9
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks stack environment prepare"
Yu Yang (Gabriel) [Tue, 17 Jan 2017 02:45:28 +0000 (02:45 +0000)]
Merge "Bottlenecks stack environment prepare"

7 years agoMerge "bottlenecks create stack image"
Yu Yang (Gabriel) [Tue, 17 Jan 2017 02:44:11 +0000 (02:44 +0000)]
Merge "bottlenecks create stack image"

7 years agobottlenecks create stack image 25/26925/2
liyin [Thu, 12 Jan 2017 08:09:29 +0000 (16:09 +0800)]
bottlenecks create stack image

JIRA:BOTTLENECK-125

This code incloud the actions below:
 1)download unbuntu image.
 2)modify this image bu mount it.
 3)pack all files into a new image.
those two files are copied from yardstick and slightly modified.

Change-Id: I99c1ab266202767717906aed544d7e96cfeaa1a3
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Modify utils/ code into PEP8 style"
Yu Yang (Gabriel) [Thu, 12 Jan 2017 08:42:52 +0000 (08:42 +0000)]
Merge "Modify utils/ code into PEP8 style"

7 years agoModify utils/ code into PEP8 style 19/26819/5
liyin [Tue, 10 Jan 2017 11:42:20 +0000 (19:42 +0800)]
Modify utils/ code into PEP8 style

JIRA: BOTTLENECK-100

Modify all the code in the utils folder into PEP8 style.
Using more standard way to realize our function.

Change-Id: I965c507390adcb4404d33710f783b22241542890
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoBottlenecks stack environment prepare 69/26869/4
liyin [Wed, 11 Jan 2017 11:10:57 +0000 (19:10 +0800)]
Bottlenecks stack environment prepare

JIRA: BOTTLENECK-124

This code is for Bottlenecks to have a common way to prepare stack
environment.
those action are divided into three part: fetch os file, source file
and adding ext-net to source file.
those function also need change other file like fetch_os_creds.sh.
And add some config to config file.
remove parser file logging function.

This code is relying on the patch:
Modify utils/ code into PEP8 style

Change-Id: I54405776b6dc3f5fb939e511c96963a9c1624938
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd paths to flake8 style check 21/26921/1
yuyang [Thu, 12 Jan 2017 07:55:00 +0000 (15:55 +0800)]
Add paths to flake8 style check

JIRA: BOTTLENECK-100

Add paths utils/ to flake8 style check and
change tests.sh->verify.sh to make it self-explanatory

Change-Id: I653dd4412633c026a47472abd25df021bcd093a4
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoBottlenecks frame support parser config 95/26795/2
liyin [Mon, 9 Jan 2017 10:28:35 +0000 (18:28 +0800)]
Bottlenecks frame support parser config

JIRA: BOTTLENECK-123

This code is for Bottlenecks to have a common way to parser config.
those config are divided into three part: common config, test config
and stack config.
those function could build a frame of config read.
we will modify it after a few times.

Change-Id: I7d3ddc2c8af3043dc9cd89b519e506eca6a03514
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks frame support log information"
Yu Yang (Gabriel) [Mon, 9 Jan 2017 09:03:36 +0000 (09:03 +0000)]
Merge "Bottlenecks frame support log information"

7 years agoBottlenecks frame support log information 01/26701/5
liyin [Thu, 5 Jan 2017 07:49:19 +0000 (15:49 +0800)]
Bottlenecks frame support log information

JIRA: BOTTLENECK-122

This code is for Bottlenecks to have a common way
to export log information
the way to use it is:
xxx = Logger.(__name__).getLogger()
xxx.info('xxxxxx')
It will only out info if you don't set DEBUG=true.
the default log file located '/tmp/bottlenecks.log'
we will add configuring log file  function when config funtion complate.

Change-Id: I11cdc8a27f657736c3ec0e0bc1195f0ce0a2fce4
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks frame support stack create"
Yu Yang (Gabriel) [Mon, 9 Jan 2017 02:02:44 +0000 (02:02 +0000)]
Merge "Bottlenecks frame support stack create"

7 years agoMerge "bottlenecks openstack Newton support"
Yu Yang (Gabriel) [Wed, 4 Jan 2017 06:36:33 +0000 (06:36 +0000)]
Merge "bottlenecks openstack Newton support"

7 years agoBottlenecks frame support stack create 55/26555/3
liyin [Wed, 28 Dec 2016 06:25:06 +0000 (14:25 +0800)]
Bottlenecks frame support stack create

JIRA: BOTTLENECK-120

add the common.py,manager.py,template.py,
could use the function
import utils.infra_setup.heat.x
then the code could import the package.

Change-Id: I7bbd115bd13d87c4f43b7e4bb35e6a6bf8465bc8
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobottlenecks openstack Newton support 07/26507/7
liyin [Tue, 27 Dec 2016 07:43:06 +0000 (15:43 +0800)]
bottlenecks openstack Newton support

JIRA: BOTTLENECK-119

Change the file of template.py manager.py and common.py file
This change helps Bottlenecks project support Newton.
template.py support stack operation.
manager.py support nova and glance operation.
common.py support some operations of openstack Newton.

Change-Id: Ibee110a2b7918c80b2651bb86a9fb7160414e842
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobugfix: remove timeField for Kibana index-pattern 87/26487/1
yuyang [Mon, 26 Dec 2016 16:10:43 +0000 (00:10 +0800)]
bugfix: remove timeField for Kibana index-pattern

JIRA: BOTTLENECK-121

Remove timeField item in index-pattern which causes kibana
no reading test results.

Change-Id: I855dba186cc0e0db8e5c9dbd7aa21df80722d70e
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add flake8 style config and for POSCA"
Yu Yang (Gabriel) [Thu, 22 Dec 2016 02:43:25 +0000 (02:43 +0000)]
Merge "Add flake8 style config and for POSCA"

7 years agoAdd flake8 style config and for POSCA 19/26219/3
yuyang [Mon, 19 Dec 2016 16:37:59 +0000 (00:37 +0800)]
Add flake8 style config and for POSCA

JIRA: BOTTLENECK-100

Adding flake8 configuration and fix for POSCA

Change-Id: Ib822d5abde535263a4473d67c15cc17995f1417b
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agobugfix: correct typo in Dockerfile 07/26207/1
yuyang [Mon, 19 Dec 2016 13:52:50 +0000 (21:52 +0800)]
bugfix: correct typo in Dockerfile

JIRA: BOTTLENECK-108

Typo in Dockerfile that causing $BRANCH var not effective

Change-Id: I1f156e5b554ebd6f9a1b2d689b1c23c783a4e8af
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agobugfix:enabling the repo branch choosing 05/26005/1
yuyang [Thu, 15 Dec 2016 10:25:34 +0000 (18:25 +0800)]
bugfix:enabling the repo branch choosing

JIRA: BOTTLENECK-108

Enabling the git repo branch choosing in dockerfile for Bottlenecks.

Change-Id: Id03c39e59cb1b38d198ec37f613c9660bcf335cd
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agobugfix:fix the version support problem of setuptools 99/25999/1
yuyang [Thu, 15 Dec 2016 10:19:03 +0000 (18:19 +0800)]
bugfix:fix the version support problem of setuptools

JIRA: BOTTLENECK-108

Due the version problem, docker build job fails each time.

Change-Id: I179ec56295f344fbd14ffeb8650c8d4625507379
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agocpu_burden script&configure 11/25611/1
liyin [Wed, 7 Dec 2016 09:24:29 +0000 (17:24 +0800)]
cpu_burden script&configure

JIRA: BOTTLENECK-118

This patch add a new function cpu_burden.
there are two things:
1.add configure file of cpu_burden, this default file could run test case
2.add script of cpu_burden, this script use the configure file could
use yardstick restful api call date.

Change-Id: Icd88b317fb97d8f12d81279eaffc2d3effc8ab65
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodocker-compose yardstick file change 19/25519/1
liyin [Tue, 6 Dec 2016 08:52:39 +0000 (16:52 +0800)]
docker-compose yardstick file change

JIRA: BOTTLENECK-117

This patch change the docker-compose file.
because of yardstick dockerfile.
so bottlenecks also need to change the style of docker-compose.

Change-Id: Idb82120c5b00ef8595a993886fa3fc0d6b6c4c32
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodashboard log info check 29/25429/1
liyin [Fri, 2 Dec 2016 14:52:55 +0000 (22:52 +0800)]
dashboard log info check

JIRA: BOTTLENECK-115

This patch change an error that last patch haven't covered.
so i need to correct it.

Change-Id: I1ab1fbe4e60463482728ec3ab58ec71c4e1d7049
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodashboard bug: can't deploy dashboard 15/25415/2
liyin [Fri, 2 Dec 2016 10:12:06 +0000 (18:12 +0800)]
dashboard bug: can't deploy dashboard

JIRA: BOTTLENECK-116

This patch fix the bug that bottlenecks project can't establish
dashboard, error message is elasticsearch is not install.
after install elasticsearch, the error message is can't get ip.
to fix this bug, change file requriment.txt and dashboard file.

Change-Id: Ibad0dc46ab44d500b799bbf67e169d76c59e7199
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoadd more debug info 03/25403/1
liyin [Fri, 2 Dec 2016 07:41:21 +0000 (15:41 +0800)]
add more debug info

JIRA: BOTTLENECK-115

This patch add some debug info to screen.
so test situation will be displayed to every one.
And it's could be easier to understand

Change-Id: Iecf767eedf42825a13dae59235ab99d1767e744e
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobug fix patch 97/25397/1
liyin [Fri, 2 Dec 2016 06:14:54 +0000 (14:14 +0800)]
bug fix patch

JIRA: BOTTLENECK-114

this patch fix a problem that docker can't run
because of lacking pyroute2.
the way to solve it is add return value judgement to avoid circle
return value error, is return relue when get into circle function

Change-Id: I3af9abdb417abc5cf04c0e4db7eed576222bb1ea
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobug fix patch 27/25327/1
liyin [Thu, 1 Dec 2016 12:35:38 +0000 (20:35 +0800)]
bug fix patch

JIRA: BOTTLENECK-113

this patch fix a problem that docker can't run
because of lacking pyroute2.
the next is docker-compose file have some error that yardstick can't
pull inluxdb container.
the next is fix some bug incode.

Change-Id: I238b69b456d2810e84bae5c134e6b05a8fc5da63
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodocker-compose dockerfile change 03/25303/1
liyin [Thu, 1 Dec 2016 07:32:13 +0000 (15:32 +0800)]
docker-compose dockerfile change

JIRA: BOTTLENECK-112

this patch change the yardstick and bottlenecks dockerfile
from stable to latest

Change-Id: I095957dc6aba25d76bb8e60be97c171c4a59ce57
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoposca test suite urls change 99/25299/2
liyin [Thu, 1 Dec 2016 04:38:38 +0000 (12:38 +0800)]
posca test suite urls change

JIRA: BOTTLENECK-111

This patch add two functions to bottlenecks project:
1.change yardstick urls and some return value.
2.bottlenecks project wait time change.

Change-Id: I1a7f98f69676cda8cb0dc62276704c2cfcf240d8
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Add virtual enviroment support for cli"
Yu Yang (Gabriel) [Thu, 1 Dec 2016 02:20:00 +0000 (02:20 +0000)]
Merge "Add virtual enviroment support for cli"

7 years agoposca test suite support influxDB container 29/25229/1
liyin [Wed, 30 Nov 2016 09:42:14 +0000 (17:42 +0800)]
posca test suite support influxDB container

JIRA: BOTTLENECK-110

This patch support bottlenecks testsuites posca support use yardstick
rest api to pull InfluxDB container.
the yardstick use this container to store its test result.

Change-Id: I6ad6b5d7a9748c385787567b3d6d1dfe4cee167f
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "posca system bandwidth dashboard"
Yu Yang (Gabriel) [Wed, 30 Nov 2016 09:23:11 +0000 (09:23 +0000)]
Merge "posca system bandwidth dashboard"

7 years agoposca system bandwidth dashboard 01/25201/3
liyin [Wed, 30 Nov 2016 04:48:01 +0000 (12:48 +0800)]
posca system bandwidth dashboard

JIRA: BOTTLENECK-109

this patch provide a dashboard of system_bandwidth test case
when the test over this script would be run.
and you could login host:5601 to see the view of dashboard.

Change-Id: Ifb9717baa56a16fb2231a4e20d5688e34647d45b
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "POSCA test case complete"
Yu Yang (Gabriel) [Wed, 30 Nov 2016 09:19:26 +0000 (09:19 +0000)]
Merge "POSCA test case complete"

7 years agoAdd new CI docker build support 15/25215/1
yuyang [Wed, 30 Nov 2016 16:15:00 +0000 (00:15 +0800)]
Add new CI docker build support

JIRA: BOTTLENECK-108

Releng has updated the parameter input method. So the Docker file
need BRANCH argument to specify the docker image source.

Change-Id: I6c8eee3aaf7729964f0b810c209ccdcf9b75a233
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoPOSCA test case complete 99/25199/3
liyin [Wed, 30 Nov 2016 04:27:53 +0000 (12:27 +0800)]
POSCA test case complete

JIRA: BOTTLENECK-107

JIRA: BOTTLENECK-106

This patch has done the flowings:
1.Using the RESTful API form yardstick
2.Common function reuse.
3.If there is no test_ip it would use host ip and port as test_ip.
4.A little demo of dashboard. Now is can't work

Change-Id: I1063176c762c40238019c73f5359f23bc5aab19c
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd virtual enviroment support for cli 71/25071/1
yuyang [Tue, 29 Nov 2016 14:37:07 +0000 (22:37 +0800)]
Add virtual enviroment support for cli

JIRA: BOTTLENECK-65

Add installation of VIRTUALENV and deletion of it.

Change-Id: I4a339e8e87775fc2ea1e12d8fbf473850076bbd3
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add CLI framework for Bottlenecks"
Yu Yang (Gabriel) [Tue, 29 Nov 2016 02:04:11 +0000 (02:04 +0000)]
Merge "Add CLI framework for Bottlenecks"

7 years agoAdd CLI framework for Bottlenecks 27/24927/5
yuyang [Sat, 26 Nov 2016 15:07:41 +0000 (23:07 +0800)]
Add CLI framework for Bottlenecks

JIRA: BOTTLENECK-65

Adding cli framwork for Bottlenecks.

Usage:
bottlenecks testcase run <testcase>

Currently only the cli framwork and testcase command group is added.
run, list, etc., commands and openstack command group
will added afterwards.

Two setup entries are added. One is within the top directory and the
other is within the cli directory.

Change-Id: I304f6f2e9b29b9f582953c2739806c1fb3e87fed
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoPOSCA docker-compose adapting 13/24813/3
liyin [Thu, 24 Nov 2016 04:37:10 +0000 (12:37 +0800)]
POSCA docker-compose adapting

JIRA: BOTTLENECK-105

there are files which be need to support docker-compose.
some files are docker configure file.
some files are used to build docker image.
kibana docker is bottlenecks project dashboard.
elasticsearch docker is bottlenecks project database.
influxdb docker is yardstick project database.
yardstick docker is used to run test case.

Change-Id: I7f0927c940a400f9f66ac77174f06236a1f4f265
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd stack created judging logic 67/23967/1
yuyang [Fri, 4 Nov 2016 15:30:41 +0000 (23:30 +0800)]
Add stack created judging logic

JIRA: BOTTLENECK-103

The stack created judging logic in Rubbos testsuite is optimized
by replacing the wating method with judging from the stack created
return value.

Change-Id: Ie96476fbfb8baf995237f71b993cf9d381b94217
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoBugfix for random key generation 89/23889/1
yuyang [Wed, 2 Nov 2016 18:17:19 +0000 (02:17 +0800)]
Bugfix for random key generation

JIRA: BOTTLENECK-103

Fixing the bug when key generation within rubbos controller

Change-Id: Ib444b3a8fab14217bda75bee307ea18652e8b4e4
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add random key generation"
Yu Yang (Gabriel) [Tue, 1 Nov 2016 05:48:41 +0000 (05:48 +0000)]
Merge "Add random key generation"

7 years agoAdd random key generation 19/23819/2
Yang (Gabriel) Yu [Tue, 1 Nov 2016 02:46:15 +0000 (22:46 -0400)]
Add random key generation

JIRA: BOTTLENECK-103

Add random key generation in fixed directory path.

Changes:
1. Add random key generation method
2. Add logic to cleanup the used key

Change-Id: I405d1d670422b9381879d0e58cb9c9fc1370f954
Signed-off-by: Yang (Gabriel) Yu <Gabriel.yuyang@huawei.com>
7 years agoModify POSCA code into PEP8 style 49/23649/2
liyin [Tue, 25 Oct 2016 04:39:22 +0000 (00:39 -0400)]
Modify POSCA code into PEP8 style

JIRA: BOTTLENECK-102

Modify all the code in the testcase POSCA into PEP8 style.
Using more standard way to realize our function.

Change-Id: Ic014678db454b8a36b36395c32b4769f6cf700be
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd successful committer nominee INFO 49/23449/1
yuyang [Thu, 20 Oct 2016 23:22:17 +0000 (07:22 +0800)]
Add successful committer nominee INFO

Add election result for Yang throuth email:
https://lists.opnfv.org/pipermail/opnfv-tsc/2016-October/003088.html

Achievements/Conbributions include:
https://gerrit.opnfv.org/gerrit/#/q/owner:Gabriel.yuyang%2540huawei.com+project:bottlenecks

1. Adding POSCA test suite in Bottlenecks

a) POSCA testing framework

       i.  https://jira.opnfv.org/browse/BOTTLENECK-92

     ii.  https://gerrit.opnfv.org/gerrit/#/c/20837/

b) Adding Factor Test case System_Bandwidth

       i.  https://jira.opnfv.org/browse/BOTTLENECK-94

     ii.  https://gerrit.opnfv.org/gerrit/#/c/21351/

c) Adding Factor Test case CPU_Burden

       i.  https://jira.opnfv.org/browse/BOTTLENECK-95

     ii.  https://gerrit.opnfv.org/gerrit/#/c/21355/

d) Adding Factor Test case TX PKT Size

       i.  https://jira.opnfv.org/browse/BOTTLENECK-99

     ii.  https://gerrit.opnfv.org/gerrit/#/c/21563/

e) Adding Factor Test case RX_PKT_Size

       i.  https://jira.opnfv.org/browse/BOTTLENECK-97

     ii.  https://gerrit.opnfv.org/gerrit/#/c/21401/

f)  Adding Factor Test case TX_Cache_Size

       i.  https://jira.opnfv.org/browse/BOTTLENECK-98

     ii.  https://gerrit.opnfv.org/gerrit/#/c/21561/

g) Adding Factor Test case RX_Cache_Size

       i.  https://jira.opnfv.org/browse/BOTTLENECK-96

     ii.  https://gerrit.opnfv.org/gerrit/#/c/21379/

2. Refactoring Bottlenecks documentations

a) Correcting table format error in userguide docs

       i.  https://jira.opnfv.org/browse/BOTTLENECK-88

     ii.  https://gerrit.opnfv.org/gerrit/#/c/19043/

b) Adding framework illustration in Bottlenecks docs

       i.  https://jira.opnfv.org/browse/BOTTLENECK-88

     ii.  https://gerrit.opnfv.org/gerrit/#/c/19131/

c) Adding Release Notes Doc Framework

       i.  https://jira.opnfv.org/browse/BOTTLENECK-88

     ii.  https://gerrit.opnfv.org/gerrit/#/c/22309/

3. Flake8 fix for Bottlenecks project

a) https://jira.opnfv.org/browse/BOTTLENECK-101

b) https://gerrit.opnfv.org/gerrit/#/c/22593/

4. Organizing the Bottlenecks weekly meeting and maintaining WIKI

a) Meeting minutes and meterial

       i.  https://wiki.opnfv.org/pages/viewpage.action?pageId=6828202

     ii.  https://wiki.opnfv.org/download/attachments/2926187/Proposals%20in%20Bottlenecks.pdf?version=7&modificationDate=1472176386000&api=v2

b) Release Planning WIKI pages

5. Design and sharing the POSCA test suite

a) POSCA test suite in Bottlenecks D release

       i.  https://wiki.opnfv.org/download/attachments/2926187/POSCA%20in%20Bottlenecks%20D%20Release.pptx?version=1&modificationDate=1475983276813&api=v2

b) Sharing POSCA in Bottlenecks weekly meeting

       i.  https://wiki.opnfv.org/download/attachments/2926187/2016-09-22%20Sharing%20POSCA%20in%20Bottlenecks.mp4?version=1&modificationDate=1475993554550&api=v2

Change-Id: I59980f6e8ff378e845af1297cf294e058be56880
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add Factor Testcase CPU_Burden"
Jun Li [Sat, 8 Oct 2016 02:37:19 +0000 (02:37 +0000)]
Merge "Add Factor Testcase CPU_Burden"

7 years agoMerge "Add Factor Testcase RX_Cache_Size"
Jun Li [Sat, 8 Oct 2016 02:37:02 +0000 (02:37 +0000)]
Merge "Add Factor Testcase RX_Cache_Size"

7 years agoMerge "Add Factor Testcase RX_PKT_Size"
Jun Li [Sat, 8 Oct 2016 02:36:43 +0000 (02:36 +0000)]
Merge "Add Factor Testcase RX_PKT_Size"

7 years agoMerge "Add Factor Testcase System_Bandwidth"
Jun Li [Sat, 8 Oct 2016 02:36:24 +0000 (02:36 +0000)]
Merge "Add Factor Testcase System_Bandwidth"

7 years agoMerge "Add Factor Testcase TX_Cache_Size"
Jun Li [Sat, 8 Oct 2016 02:36:04 +0000 (02:36 +0000)]
Merge "Add Factor Testcase  TX_Cache_Size"

7 years agoMerge changes from topics 'add_factor_testcase_tx_pkt_size', 'add_posca_test_suite_fr...
Jun Li [Sat, 8 Oct 2016 02:35:22 +0000 (02:35 +0000)]
Merge changes from topics 'add_factor_testcase_tx_pkt_size', 'add_posca_test_suite_framework'

* changes:
  Add Factor Testcase TX PKT Size
  Adding Posca Testsuite in Bottlenecks

7 years agoMerge "autopep8 fix for flake8"
Jun Li [Sat, 8 Oct 2016 02:33:08 +0000 (02:33 +0000)]
Merge "autopep8 fix for flake8"

7 years agoautopep8 fix for flake8 93/22593/1
yuyang [Fri, 30 Sep 2016 18:21:36 +0000 (02:21 +0800)]
autopep8 fix for flake8

JIRA: BOTTLENECK-101

Using autopep8 to fix the python style scanned by flake8

Change-Id: I74bf28ed4d999dac3dd36e9101f099c9853a49b6
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoPropose common directory for Docker related files 69/22569/1
jose.lausuch [Thu, 29 Sep 2016 15:44:20 +0000 (17:44 +0200)]
Propose common directory for Docker related files

Proposal 3 from this wiki:
https://wiki.opnfv.org/display/INF/Docker+handling+in+CI#DockerhandlinginCI-3Dockerfilelocation

Do not merge before this:
https://gerrit.opnfv.org/gerrit/#/c/22565/

JIRA: RELENG-148

Change-Id: I07e1418ae06c59e6c4d495c8c87d28addbb98d03
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
7 years agoAdd Factor Testcase TX PKT Size 63/21563/2
yuyang [Sat, 17 Sep 2016 21:38:13 +0000 (05:38 +0800)]
Add Factor Testcase TX PKT Size

JIRA: BOTTLENECK-99

Add factor testcase to locate the bottleneck of tx pkt size.
A separated logic for determine if the tx pkt size is the system
bottleneck is provided.

Change-Id: I9ccbe19c88a72170b66fffd7f1bd7e5a45dbdc27
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoAdd Factor Testcase TX_Cache_Size 61/21561/3
yuyang [Sat, 17 Sep 2016 20:25:49 +0000 (04:25 +0800)]
Add Factor Testcase  TX_Cache_Size

JIRA: BOTTLENECK-98

Add factor testcase for locating tx cache size bottleneck.
A separate logic for determine if the bottlenecks is tx cache
size is provided.

Change-Id: Ie3e8a79bf55d6b3223b45c52fb4fbc9b047d38cb
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoAdd Factor Testcase System_Bandwidth 51/21351/6
yuyang [Sun, 18 Sep 2016 12:57:16 +0000 (20:57 +0800)]
Add Factor Testcase System_Bandwidth

JIRA: BOTTLENECK-94

Add factor test to find the bottleneck of system bandwidth.
A separate logic is provided to determine what is throughput for
a deployed system.

Changes:

1. Add testcase script

2. Delete whitespaces

3. Logic fix

Change-Id: I37ab9d40d90c585191619d4753eca285fee64dd4
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoAdd Factor Testcase RX_PKT_Size 01/21401/5
yuyang [Sat, 17 Sep 2016 22:02:53 +0000 (06:02 +0800)]
Add Factor Testcase RX_PKT_Size

JIRA: BOTTLENECK-97

Add factor testcase to locate bottleneck for rx pkt size.
A separated logic for determine if the system bottleneck is
rx pkt size is provided.

Change-Id: I478b4cf94b07eeb56e87a4825ff0a62367c05175
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoAdd Factor Testcase RX_Cache_Size 79/21379/4
yuyang [Sat, 17 Sep 2016 21:01:11 +0000 (05:01 +0800)]
Add Factor Testcase RX_Cache_Size

JIRA: BOTTLENECK-96

Add factor testcase for locating bottleneck of rx cache size.
A separate logic is provided to deterine if it is the bottleneck
of rx cache size.

Change-Id: I52652f73c512a829a3dde85e4cb36073327773e8
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>