bottlenecks.git
6 years agosystem bandwidth testcase frame rebuild 93/39093/1 stable/danube
liyin [Fri, 4 Aug 2017 09:09:00 +0000 (17:09 +0800)]
system bandwidth testcase frame rebuild

JIRA: BOTTLENECK-177

This patch will debug some error in system bandwidth testcase.
use the new docker way to test this testcase.
Bug fix about dashboard and test framework.

Change-Id: I7167ffd75efab9a7780407aa5b9a4337ebb9b4c7
Signed-off-by: liyin <liyin11@huawei.com>
(cherry picked from commit 205156554daf981d01c4f43c6a79f6519525916e)

6 years agoChange path to reporting db 55/38655/1
Yang Yu [Wed, 2 Aug 2017 08:32:02 +0000 (16:32 +0800)]
Change path to reporting db

JIRA: BOTTLENECK-158

Change the path env to align with CI pipeline

Change-Id: Ib5a7799c3eb3e5ba9056aa738c4c3b15995e3c11
Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
(cherry picked from commit b20de06b02a6eec449e5ac1e99226f35728b248d)

6 years agoAdd modify output file function 95/38595/1
liyin [Wed, 2 Aug 2017 08:30:16 +0000 (16:30 +0800)]
Add modify output file function

JIRA: BOTTLENECK-176

Add function which could modify outfile name.
Also a bug fix about yardstick docker version should be danube.3.1

Change-Id: I0e0bb5b26cae44358311d17932c698505560974c
Signed-off-by: liyin <liyin11@huawei.com>
6 years agoAdd yardstick danube3.1 support. 83/38583/1
Ace Lee [Wed, 2 Aug 2017 01:47:06 +0000 (01:47 +0000)]
Add yardstick danube3.1 support.

JIRA: BOTTLENECK-173

This patch will add a result handle for Yardstick danube
This is only for bottlenecks danube to use.
This will change time to 2 min to wait for Yardstick result back

Change-Id: Icbd9d89f3e3816df947eaf6f70a12c86f74a2812
Signed-off-by: Ace Lee <liyin11@huawei.com>
6 years agoBottlenecks testcase rebuild 81/38581/1
Ace Lee [Tue, 1 Aug 2017 10:48:21 +0000 (10:48 +0000)]
Bottlenecks testcase rebuild

JIRA: BOTTLENECK-175

After this patch,
Bottlenecks will try to find the stress of the openstack system.
we try to create 20 stacks one time.
And 20 stacks the other time.
we will try to find if openstack will pass threshhold twice.
This patch only affact latest version

Change-Id: I6146cf5c6fe0ac4968337cc36e07f715b64191d0
Signed-off-by: Ace Lee <liyin11@huawei.com>
(cherry picked from commit 904396874f08208bde66c953fcfe31906a6588d1)

6 years agoAdd support for arbitary DB reporting 65/38565/1
Yang Yu [Tue, 1 Aug 2017 07:01:49 +0000 (15:01 +0800)]
Add support for arbitary DB reporting

JIRA: BOTTLENECK-158

Support for arbitary DB reporting. TestperfDB and Dovetail DB are
within currently consideration.

Change-Id: I4373e5f295d26155e2b4fda59044cc4e922c3557
Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
(cherry picked from commit fd66a0466e931e28ebd1f0925e9c9a0c28912a02)

6 years agoBottlenecks Https support 05/38505/1
Ace Lee [Tue, 1 Aug 2017 03:10:27 +0000 (03:10 +0000)]
Bottlenecks Https support

JIRA: BOTTLENECK-174

Bottlenecks Https Support
After this patch, you could use https method to run Bottlenecks
Motion that if you want to use https, you need to write down the cacert
at Bottlenecks /tmp/ dir

Change-Id: I86fda57c76179d52e7d4c06c7289e2fcc15a4bc0
Signed-off-by: Ace Lee <liyin11@huawei.com>
(cherry picked from commit 0b47f013a0af6549cee590762bbd979729de0ead)

6 years agoBug fix: Bottlenecks sometimes deadlock 69/37969/1 danube.3.1
Ace Lee [Thu, 20 Jul 2017 08:48:47 +0000 (08:48 +0000)]
Bug fix: Bottlenecks sometimes deadlock

JIRA: BOTTLENECK-173

This patch will change the way to call multithreading.
And change some encoding error about Yardstick config

Change-Id: I04803bff6acaad1089d180b104652049f1f0a485
Signed-off-by: Ace Lee <liyin11@huawei.com>
(cherry picked from commit fe6c624370552e141cc80d1b697de7d9717763c9)

6 years agoBug fix: fit Yardstick 3.1 version. 77/37677/1
liyin [Tue, 18 Jul 2017 06:55:29 +0000 (14:55 +0800)]
Bug fix: fit Yardstick 3.1 version.

JIRA: BOTTLENECK-173

This patch will add a file to create some yardstick conf,
Yardstick will use this file to manage output file type.

Change-Id: I1d265af9f0b9b5132dc63c4d6d95d5bc194c7ff6
Signed-off-by: liyin <liyin11@huawei.com>
(cherry picked from commit 962b6269fdee0991251304a2b16cba78961d4b42)

6 years agoAdd docker container manage function 65/37665/1
liyin [Wed, 12 Jul 2017 02:57:13 +0000 (10:57 +0800)]
Add docker container manage function

JIRA: BOTTLENECK-171

This patch will add a file to create some function,
Bottlenecks will use those function to manage docker.
for example: docker ip address , create docker ,remove docker.

Change-Id: I60e70ed9c6c7805e85b183ea3b19295fce68f657
Signed-off-by: liyin <liyin11@huawei.com>
(cherry picked from commit c821b792db011dbbe1c70d256fadbe9c745570ff)

6 years agoBug fix of Bottlenecks can't use CLI 63/37663/1
liyin [Mon, 17 Jul 2017 09:45:38 +0000 (17:45 +0800)]
Bug fix of Bottlenecks can't use CLI

JIRA: BOTTLENECK-171

Bug fix of Bottlenecks can't use CLI to start test.
Some docker-compose function delete to fit elk docker support.
After this patch you could use bottlenecks testcase run
posca_factor_ping to start this test.
you also need to put the rc file to bottlenecks docker.

Change-Id: I340e31185a499c81f9595a902df89d8f0ddf0cd3
Signed-off-by: liyin <liyin11@huawei.com>
(cherry picked from commit 75f99aaeadada56dfc974746cd83fec275133a3c)

6 years agoAdd frame support of elk one docker support 61/37661/1
liyin [Thu, 13 Jul 2017 03:54:08 +0000 (11:54 +0800)]
Add frame support of elk one docker support

JIRA: BOTTLENECK-171

Add support of Bottlenecks docker frame refact,
After this patch we will provide the ability of several installer.
Add Yardstick_TAG to adjust yardstick docker version

Change-Id: Ib431f8acf4a76b59f9d5e8783bcc7d2e5be208ae
Signed-off-by: liyin <liyin11@huawei.com>
(cherry picked from commit bde702f95563cf953c32f9bfd0587083a3fea26d)

6 years agoDocs for Danube 3 85/36285/1 danube.3.0
yuyang [Mon, 19 Jun 2017 08:19:26 +0000 (16:19 +0800)]
Docs for Danube 3

JIRA: BOTTLENECKS-137

Documentation for Danube 3

Change-Id: Ic4b2611028fa45c0b731e998296e5000e35a33f6
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 38074a81bcb2a97bd59f274815dbfa67ab487c59)

6 years agoRemove redundant print functions 65/36165/1
yuyang [Mon, 5 Jun 2017 02:44:21 +0000 (10:44 +0800)]
Remove redundant print functions

JIRA: BOTTLENECK-158

Remove redundant print functions for report log

Change-Id: I35c43fd3e30090bc296823faca55b49c0431a1fb
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 6de46e9144ee0bc2962460c600e4b3a888d934ef)

6 years agoMerge "Bugfix: json format transform for report" into stable/danube
Yu Yang (Gabriel) [Mon, 5 Jun 2017 09:38:32 +0000 (09:38 +0000)]
Merge "Bugfix: json format transform for report" into stable/danube

6 years agoBugfix: json format transform for report 83/35783/1
yuyang [Fri, 26 May 2017 09:33:56 +0000 (17:33 +0800)]
Bugfix: json format transform for report

JIRA: BOTTLENECK-158

The details part of report is not json formatted.
This patch is to fix it.

Change-Id: I089dae0c12e14935e4b7a5e7bdbe69f00e003f98
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit e4a17446f0f02d6ea950278074d88db6c09c5bb6)

6 years agoBugfix: dockerfile does not support basename 81/35781/1
yuyang [Thu, 25 May 2017 07:46:55 +0000 (15:46 +0800)]
Bugfix: dockerfile does not support basename

JIRA: BOTTLENECK-158

Remove basename commond in docker-compose file

Change-Id: If06bac1903b2b830f9e5e4133f3315fb9f424c18
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fd9ae2109a6202c17a89cd544a3b74747c3b729b)

6 years agoAdd reporting to MongoDB 65/35765/1
yuyang [Mon, 22 May 2017 11:19:56 +0000 (19:19 +0800)]
Add reporting to MongoDB

JIRA: BOTTLENECK-158

Add reporting function to community MongoDB

Change-Id: Idebc191b20ad238dbdd129ce38131b79e7133e35
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 8fd28cfeaca4ac29f4357c51eb0c0374d0d0a409)

6 years agoAdd test name check function and cleanup 27/35627/3
yuyang [Mon, 22 May 2017 02:23:55 +0000 (10:23 +0800)]
Add test name check function and cleanup

JIRA: BOTTLENECK-158

Add test case/story name check and cleanup environment option.

Change-Id: I07609c089ca78b0d2760c09c0312d7d1106c815a
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 95748aca5de2e906b0f555e7dbf3829e397d6415)

6 years agoDelete testcase of rubbos and vstf. 37/35037/1
liyin [Mon, 8 May 2017 09:04:32 +0000 (09:04 +0000)]
Delete testcase of rubbos and vstf.

JIRA:BOTTLENECK-167

This patch will delete vstf and rubbos testcase code.
Include some testcase config file,
if there will be someone who want to use this testcase
maybe B or C version code will contain those testcase.
if you use the D version code to run this two testcase
we will info you that:
    Rubbos testsuite is not updating anymore.
    This entrance for running Rubbos within Bottlenecks is no longer supported.

Change-Id: I04e4042ff3998b3696df2ed47a9ffab6f1620ec3
Signed-off-by: liyin <liyin11@huawei.com>
(cherry picked from commit 6a8257127b3dce1f18a650afe6921a34b6c6f5b8)

6 years agoMerge "Add description of environment clean-up" into stable/danube danube.2.0
Yu Yang (Gabriel) [Thu, 4 May 2017 06:57:07 +0000 (06:57 +0000)]
Merge "Add description of environment clean-up" into stable/danube

6 years agoChange PTL informatin in INFO 03/34203/1
yuyang [Thu, 4 May 2017 06:33:17 +0000 (14:33 +0800)]
Change PTL informatin in INFO

Due to recent email voting results, change the PTL promotion
result in INFO. Detailed information could be found below.
https://lists.opnfv.org/pipermail/opnfv-tsc/2017-April/003422.html

Change-Id: I5c942668cbe03e697bd0865cc8aee1980afed104
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 1a3307f228055404930a7d53dc225270a70a174a)

6 years agoAdd description of environment clean-up 01/34201/1
yuyang [Tue, 2 May 2017 04:16:22 +0000 (12:16 +0800)]
Add description of environment clean-up

JIRA: BOTTLENECK-165

More details of the environment clean-up for ping test case

Change-Id: I4b12a219155400235ae2bcb970efb3ba237153d9
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 15355fd57080a7ac625549e9e9b98237164e46d2)

6 years agoDocs for Danube 2.0 81/33981/1
yuyang [Tue, 25 Apr 2017 03:17:25 +0000 (11:17 +0800)]
Docs for Danube 2.0

JIRA: BOTTLENECK-165

Documents adapted to Danube 2.0

Change-Id: Ic46cc0ad2f2706986b294f539bba1264ec6f8b0b
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit e2fd28497f0083099181a9b65696e5ea8c422007)

7 years agoAdd more information to Table for stress ping 41/33641/1
yuyang [Thu, 20 Apr 2017 16:01:56 +0000 (00:01 +0800)]
Add more information to Table for stress ping

JIRA: BOTTLENECK-164

Table for stress ping is showing results categories for different number of users.
It does not show the results for every testing round, just show uniquely
testing round with different success rates.
This patch is to make sure showing every results.

Change-Id: I3a33164024e3da23de31d546767f0fb29952983d
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoBugfix of docker-compose file for privileged 39/33639/1
yuyang [Thu, 20 Apr 2017 07:05:58 +0000 (15:05 +0800)]
Bugfix of docker-compose file for privileged

JIRA: BOTTLENECK-163

privileged option in docker-compose file should be true to avoid
"permission deny" error when accessing directories

Change-Id: I1a57146236efb5fe71405c5b7682af706a8814bf
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit c988d5fa114a659f19f0db1fd0db9f6abc5247dd)

7 years agoFix code style issues for specificed path 59/33259/1
yuyang [Tue, 11 Apr 2017 06:47:07 +0000 (14:47 +0800)]
Fix code style issues for specificed path

JIRA: BOTTLENECK-100

Fix code syle issues for the path flake8 specified before flake8
check merged into CI pipeline.

Change-Id: Iee59bada206fafd4740023e90d08a4b4a7a030db
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fc30c5208a680d0059cfa48891a1d97747f7f778)

7 years agoFinalize docs for Danube 1.0 53/32653/4 danube.1.0 danube.1.RC1
yuyang [Thu, 30 Mar 2017 16:26:31 +0000 (00:26 +0800)]
Finalize docs for Danube 1.0

JIRA: BOTTLENECK-145

Polishing docs and finalizing docs for Danube 1.0.

Change-Id: Iea5490785bce802aff37b7f52172d7f14ea358e0
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 529508e4be82ef3e329e9ca3bec6210fb5ef90e6)

7 years agobugfix: bottlenecks devguide in docs.opnfv.org 57/32157/1
yuyang [Wed, 29 Mar 2017 01:58:10 +0000 (09:58 +0800)]
bugfix: bottlenecks devguide in docs.opnfv.org

JIRA: BOTTLENECK-149

Adjust the directory structure to make Bottlenecks devguide
on docs.opnfv.org.

Change-Id: Ib773a26ca5f4eaee94834ff641ec45531ef3025c
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 3480c32bb5113a8a5f56b7e1db82c3a9236418fb)

7 years agobugfix: fix bugs for running 'teststory run' 51/32151/1
yuyang [Tue, 28 Mar 2017 02:40:35 +0000 (10:40 +0800)]
bugfix: fix bugs for running 'teststory run'

JIRA: BOTTLENECK-144

utils/parser.py:56 has incorrect var:cls which cause pass more
var to testcase_read function.

Change-Id: I2d4b93f95d19a205e537515529746f6d9e13fe2c
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 1760c89637ac71b877a17896e5768640a20360c3)

7 years agoAdd docker clean-up for run test 49/32149/1
yuyang [Mon, 27 Mar 2017 07:41:23 +0000 (15:41 +0800)]
Add docker clean-up for run test

JIRA: BOTTLENECK-148

Currently, only OPNFV CI includes env-cleanup for Bottlenecks.
It is preferable to also include the operation locally
for test automation and repeatability.

Changes:
1. Translate tab into 4 spaces

Change-Id: I9f4efb95c155e442afd3141c00f707421c61b2da
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fe83578bd2fe1a09f8334f85e30a0afbb68cc5cc)

7 years agoCLI acommadation to the current test case calling method 99/31899/1
yuyang [Sat, 25 Mar 2017 10:31:39 +0000 (18:31 +0800)]
CLI acommadation to the current test case calling method

JIRA: BOTTLENECK-144

Calling method of POSCA test case has changed. CLI for calling
the run test case script should also adjust.

Change-Id: Ia007b658903c8133c824358943f325b070d1e195
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 2bf5dbd9b63288e8ce77c7c4e42df8b1e4deb2ce)

7 years agoAdd task selection to test suite entrance file 97/31897/1
yuyang [Sat, 25 Mar 2017 08:40:19 +0000 (16:40 +0800)]
Add task selection to test suite entrance file

JIRA: BOTTLENECK-143

Add task selection to test suite entrance file

Change-Id: Ia21b3121d104a457a66e2c77e3caf091e102f388
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 15c3931fd723f565e847033bc6c1df818a761b4a)

7 years agoUpdate document according to Danube release plan 85/31885/1
yuyang [Fri, 24 Mar 2017 03:24:17 +0000 (11:24 +0800)]
Update document according to Danube release plan

JIRA: BOTTLENECK-145

Currently, the docs of Bottlenecks still follow the format
from Colorado. Some work need to be done regarding reorganizing
the contents according to the Danube release.

Change-Id: I4ece51abc558bb7128565125224b5e8579a198f7
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 566a7246d6a8e9451be511ddae84f7067bf013ea)

7 years agoBugfix: set docker api version to 1.24 65/31565/1
yuyang [Thu, 23 Mar 2017 11:59:29 +0000 (19:59 +0800)]
Bugfix: set docker api version to 1.24

JIRA: BOTTLENECK-146

Set docker api version to 1.24

Change-Id: Id05527e628c7fa6ff3382bd68741bd36fc706fe6
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 4b36a57727cad302976ee38ad0046a7595339849)

7 years agoBugfix: fix docker version to 2.1.0 43/31543/1
yuyang [Thu, 23 Mar 2017 09:40:27 +0000 (17:40 +0800)]
Bugfix: fix docker version to 2.1.0

JIRA: BOTTLENECK-146

Fix the docker API library to 2.1.0

Change-Id: I4cf2801db2adc28325a587411f802515176e8d03
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 3a3bb4df2db4f58d3e76dcdd41b3327bd2094eb3)

7 years agoBugfix: fix docker version instead of API version 37/31537/1
yuyang [Thu, 23 Mar 2017 09:23:35 +0000 (17:23 +0800)]
Bugfix: fix docker version instead of API version

JIRA: BOTTLENECK-146

In 31527, API version is 1.24, docker version should be 1.12

Change-Id: I529f16372aaa00b4fc802344b559453677b7b560
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 2f1f35479f0449d4b91eb5c28e94a50af202e18f)

7 years agobugfix: docker client version newer than docker server 27/31527/1
yuyang [Thu, 23 Mar 2017 08:59:52 +0000 (16:59 +0800)]
bugfix: docker client version newer than docker server

JIRA: BOTTLENECK-146

Docker client is needed in Bottlenecks docker for the purpose to
use docker command within docker.
The inconsistence of docker client version with
docker server version causing building falure.

Change-Id: Ib4ecf9c40db5492438b27550636413e5f3a69ea3
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 136b188b4713f4ec2a20d6a09b4284a02f520aa3)

7 years agoUpdate docs structure according to Danube agreement 05/31505/1
yuyang [Wed, 22 Mar 2017 10:24:46 +0000 (18:24 +0800)]
Update docs structure according to Danube agreement

JIRA: BOTTLENECK-141

docs.opnfv.org has trouble indexing all the testing docs.
So testing projects have to adjust the docs structure.

Change-Id: I586b2c1626ca4fb8e1980130e132e6079a0977a7
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit 3bc1b97e2a594959a9966c6f967e50fa33d2893b)

7 years agoUpdate test suite running entrance 71/31471/1
yuyang [Wed, 22 Mar 2017 11:57:59 +0000 (19:57 +0800)]
Update test suite running entrance

JIRA: BOTTLENECK-142

Update the entrance for POSCA test suite.Currently, test case
selection for POSCA is not support for this entrance.
The function will be added later.
For Rubbos and VSTF, after OPNFV Colorado release,
they are not updating anymore. This entrance for running them
within Bottlenecks is no longer supported.
These testsuites are also not in the release plan with Bottlenecks
since then. If you want to run Rubbos and VSTF,
please refer to ealier releases.

Change-Id: Idaf7da147489c6371e46ac3234179133762a05cd
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
(cherry picked from commit fc9a89857e121c2015a34e49c441cb234fa10c13)

7 years agoMerge "Add liscense to file headers"
Yu Yang (Gabriel) [Fri, 10 Mar 2017 08:24:57 +0000 (08:24 +0000)]
Merge "Add liscense to file headers"

7 years agoAdd liscense to file headers 41/29041/10
yuyang [Mon, 20 Feb 2017 03:28:17 +0000 (11:28 +0800)]
Add liscense to file headers

JIRA: BOTTLENECK-133

Some Yaml, XML and __init__.py file do not have liscense headers.
This patch is to add headers to those files or delete those are deprecated.

Change-Id: Ie059b1f1879eb420eec171f96985247510c74642
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoApply docs strucutre to Danube agreement 09/30009/5
yuyang [Wed, 8 Mar 2017 03:17:40 +0000 (11:17 +0800)]
Apply docs strucutre to Danube agreement

JIRA: BOTTLENECK-137

According to the agreement in Testperf meeting.
Change the structure of docs.

Change-Id: Ie370de1e7a24c918aedc8a2cdb2cca0508ef4257
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add Danube Document Framework"
Yu Yang (Gabriel) [Wed, 1 Mar 2017 06:33:22 +0000 (06:33 +0000)]
Merge "Add Danube Document Framework"

7 years agoAdd Danube Document Framework 19/28819/22
yuyang [Thu, 16 Feb 2017 12:44:47 +0000 (20:44 +0800)]
Add Danube Document Framework

JIRA: BOTTLENECK-137

Bottlenecks document framwork meeting Danube document requirement.

Changes:
1. Add POSCA testsuite document
2. Combine configuration and installation directory
  2.1 https://wiki.opnfv.org/display/DEV/Documentation+Toolchain
3. Change file names in /user_guide
4. Add requirements notes to release notes
5. Add stress test configuartion details

Change-Id: I8d9055097ddae280d985120d4501819d20ad1dcb
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoquota limit for posca_stress_ping 31/29131/1
liyin [Tue, 21 Feb 2017 09:20:28 +0000 (17:20 +0800)]
quota limit for posca_stress_ping

JIRA:BOTTLENECK-140

Those code will update an action of quota.
Before out test begin we will make quota no limit.
so we could do stress test.
Those quota limit will change openstack forever.
maybe will create damage for openstack.

Change-Id: I0a6a06c6c303589881cb2ab7b754213ecf1a845f
Signed-off-by: liyin <liyin11@huawei.com>
7 years agostress_test_dashboard_code 23/29023/2
liyin [Sat, 18 Feb 2017 14:24:18 +0000 (22:24 +0800)]
stress_test_dashboard_code

JIRA:BOTTLENECK-138

Those codes will create dashboard for stress test.
And we have fixed a bug, that we will increace env prepare in this patch
besides: we also add some code of how to yardstick api.

Change-Id: I64bb249ee0df9fe37e998a784ba346719bf25197
Signed-off-by: liyin <liyin11@huawei.com>
7 years agostress test of ping testcase 77/28777/6
liyin [Thu, 16 Feb 2017 04:30:12 +0000 (12:30 +0800)]
stress test of ping testcase

JIRA:BOTTLENECK-136

those code will add a new testcase: posca_stress_ping
This will use docker python client to realize the fountion of
calling yardstick to test.
And yardstick will create several VM pairs to test.
Because of the limites of quotas,
we now create 2,5,10 VM pairs.

Change-Id: I096250c547cd598c7c632a884b31d81c2be125f8
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoDashboard and output file code reconstruction 71/28571/1
liyin [Tue, 14 Feb 2017 02:42:07 +0000 (10:42 +0800)]
Dashboard and output file code reconstruction

JIRA:BOTTLENECK-134

Those code will change the way to create dashboard.
And dashboard as a spare function to show data.
And we add log system to dashboard creation.
The output file is created anyway.

Change-Id: Ia3c4d5a8ada27005702e3eed08757f61610da22f
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bug fix: yardstick result return no content"
Yu Yang (Gabriel) [Mon, 13 Feb 2017 07:05:05 +0000 (07:05 +0000)]
Merge "Bug fix: yardstick result return no content"

7 years agoBug fix: yardstick result return no content 57/28357/1
liyin [Thu, 9 Feb 2017 09:59:09 +0000 (17:59 +0800)]
Bug fix: yardstick result return no content

JIRA:BOTTLENECK-130

this patch will fix this bug:
we try to expect this error,
And we try to run it again.
if failed, then yardstick RestAPI or have some error.

Change-Id: I9fa63da637456a16c151f4fe7c566b3f5ff0e01d
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd POSCA jenkins job support 97/28097/5
yuyang [Mon, 6 Feb 2017 08:21:36 +0000 (16:21 +0800)]
Add POSCA jenkins job support

JIRA: BOTTLENECK-128

This patch is to make the POSCA testsuite could be built
automatically for OPNFV CI job.

Change-Id: I21d7fd553ce3591aea3391a33fe0a7b8579b57d4
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoLog_dir bug fix&Add function of test_ip init 77/28177/5
liyin [Tue, 7 Feb 2017 07:29:50 +0000 (15:29 +0800)]
Log_dir bug fix&Add function of test_ip init

JIRA:BOTTLENECK-129

This patch fix the error of log_dir can't be found.
And change several thing:
1.Add if config don't have test_ip, it will use local:8888 as test ip.
2.Fix the bug in setup.py.
3.Add parser init to logger file.

Change-Id: I808c69e2b2ff3c04f271cc7f3e14e1ab406a4d1b
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoBottlenecks stack config parser. 65/28165/1
liyin [Tue, 7 Feb 2017 03:26:14 +0000 (11:26 +0800)]
Bottlenecks stack config parser.

JIRA:BOTTLENECK-126

realize the function of parsering stack config.
include the function all the jira mationed.
it's important for stack creating.
this patch also include manager.py.
This file modify some file such like template intial.

Change-Id: Iaa6fdbde6bf9cb1ff9875d47268440dfe70ecc49
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks POSCA testing code reconstruction"
Yu Yang (Gabriel) [Tue, 7 Feb 2017 02:22:29 +0000 (02:22 +0000)]
Merge "Bottlenecks POSCA testing code reconstruction"

7 years agoBottlenecks POSCA testing code reconstruction 37/27437/5
liyin [Tue, 24 Jan 2017 09:26:21 +0000 (17:26 +0800)]
Bottlenecks POSCA testing code reconstruction

JIRA:BOTTLENECK-103

This is the foundation of adding stack samples.
This code change a lot code.
but it's a basic.
Those code will be changed in the furture.

Change-Id: I8d5bbb9cc401b1aaac54ec4dffc4c005a42d17ac
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "bottlenecks ssh to VM by python"
Yu Yang (Gabriel) [Fri, 3 Feb 2017 07:36:29 +0000 (07:36 +0000)]
Merge "bottlenecks ssh to VM by python"

7 years agoMerge "Add paths to flake8 style check"
Yu Yang (Gabriel) [Mon, 23 Jan 2017 01:27:07 +0000 (01:27 +0000)]
Merge "Add paths to flake8 style check"

7 years agobottlenecks ssh to VM by python 61/27261/1
liyin [Fri, 20 Jan 2017 01:22:20 +0000 (09:22 +0800)]
bottlenecks ssh to VM by python

JIRA:BOTTLENECK-127

This file is a copy of yardstick.
This file have been tested.
All function could be used in bottlenecks VM.
This include some function about how to excute commonds to VM.
This will be used in Bottlenecks functional testing.

Change-Id: I123a6753d0b7855948ae9bf7bedc245f90c4a3b6
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoModify utils/ code into PEP8 style 69/27069/1
liyin [Tue, 17 Jan 2017 02:56:19 +0000 (10:56 +0800)]
Modify utils/ code into PEP8 style

JIRA: BOTTLENECK-100

Modify all the code in the utils folder into PEP8 style.
Using more standard way to realize our function.

Change-Id: Ie75c57f7fdd2a9d03849c3cb240918a6779d6be9
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks stack environment prepare"
Yu Yang (Gabriel) [Tue, 17 Jan 2017 02:45:28 +0000 (02:45 +0000)]
Merge "Bottlenecks stack environment prepare"

7 years agoMerge "bottlenecks create stack image"
Yu Yang (Gabriel) [Tue, 17 Jan 2017 02:44:11 +0000 (02:44 +0000)]
Merge "bottlenecks create stack image"

7 years agobottlenecks create stack image 25/26925/2
liyin [Thu, 12 Jan 2017 08:09:29 +0000 (16:09 +0800)]
bottlenecks create stack image

JIRA:BOTTLENECK-125

This code incloud the actions below:
 1)download unbuntu image.
 2)modify this image bu mount it.
 3)pack all files into a new image.
those two files are copied from yardstick and slightly modified.

Change-Id: I99c1ab266202767717906aed544d7e96cfeaa1a3
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Modify utils/ code into PEP8 style"
Yu Yang (Gabriel) [Thu, 12 Jan 2017 08:42:52 +0000 (08:42 +0000)]
Merge "Modify utils/ code into PEP8 style"

7 years agoModify utils/ code into PEP8 style 19/26819/5
liyin [Tue, 10 Jan 2017 11:42:20 +0000 (19:42 +0800)]
Modify utils/ code into PEP8 style

JIRA: BOTTLENECK-100

Modify all the code in the utils folder into PEP8 style.
Using more standard way to realize our function.

Change-Id: I965c507390adcb4404d33710f783b22241542890
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoBottlenecks stack environment prepare 69/26869/4
liyin [Wed, 11 Jan 2017 11:10:57 +0000 (19:10 +0800)]
Bottlenecks stack environment prepare

JIRA: BOTTLENECK-124

This code is for Bottlenecks to have a common way to prepare stack
environment.
those action are divided into three part: fetch os file, source file
and adding ext-net to source file.
those function also need change other file like fetch_os_creds.sh.
And add some config to config file.
remove parser file logging function.

This code is relying on the patch:
Modify utils/ code into PEP8 style

Change-Id: I54405776b6dc3f5fb939e511c96963a9c1624938
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd paths to flake8 style check 21/26921/1
yuyang [Thu, 12 Jan 2017 07:55:00 +0000 (15:55 +0800)]
Add paths to flake8 style check

JIRA: BOTTLENECK-100

Add paths utils/ to flake8 style check and
change tests.sh->verify.sh to make it self-explanatory

Change-Id: I653dd4412633c026a47472abd25df021bcd093a4
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoBottlenecks frame support parser config 95/26795/2
liyin [Mon, 9 Jan 2017 10:28:35 +0000 (18:28 +0800)]
Bottlenecks frame support parser config

JIRA: BOTTLENECK-123

This code is for Bottlenecks to have a common way to parser config.
those config are divided into three part: common config, test config
and stack config.
those function could build a frame of config read.
we will modify it after a few times.

Change-Id: I7d3ddc2c8af3043dc9cd89b519e506eca6a03514
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks frame support log information"
Yu Yang (Gabriel) [Mon, 9 Jan 2017 09:03:36 +0000 (09:03 +0000)]
Merge "Bottlenecks frame support log information"

7 years agoBottlenecks frame support log information 01/26701/5
liyin [Thu, 5 Jan 2017 07:49:19 +0000 (15:49 +0800)]
Bottlenecks frame support log information

JIRA: BOTTLENECK-122

This code is for Bottlenecks to have a common way
to export log information
the way to use it is:
xxx = Logger.(__name__).getLogger()
xxx.info('xxxxxx')
It will only out info if you don't set DEBUG=true.
the default log file located '/tmp/bottlenecks.log'
we will add configuring log file  function when config funtion complate.

Change-Id: I11cdc8a27f657736c3ec0e0bc1195f0ce0a2fce4
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Bottlenecks frame support stack create"
Yu Yang (Gabriel) [Mon, 9 Jan 2017 02:02:44 +0000 (02:02 +0000)]
Merge "Bottlenecks frame support stack create"

7 years agoMerge "bottlenecks openstack Newton support"
Yu Yang (Gabriel) [Wed, 4 Jan 2017 06:36:33 +0000 (06:36 +0000)]
Merge "bottlenecks openstack Newton support"

7 years agoBottlenecks frame support stack create 55/26555/3
liyin [Wed, 28 Dec 2016 06:25:06 +0000 (14:25 +0800)]
Bottlenecks frame support stack create

JIRA: BOTTLENECK-120

add the common.py,manager.py,template.py,
could use the function
import utils.infra_setup.heat.x
then the code could import the package.

Change-Id: I7bbd115bd13d87c4f43b7e4bb35e6a6bf8465bc8
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobottlenecks openstack Newton support 07/26507/7
liyin [Tue, 27 Dec 2016 07:43:06 +0000 (15:43 +0800)]
bottlenecks openstack Newton support

JIRA: BOTTLENECK-119

Change the file of template.py manager.py and common.py file
This change helps Bottlenecks project support Newton.
template.py support stack operation.
manager.py support nova and glance operation.
common.py support some operations of openstack Newton.

Change-Id: Ibee110a2b7918c80b2651bb86a9fb7160414e842
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobugfix: remove timeField for Kibana index-pattern 87/26487/1
yuyang [Mon, 26 Dec 2016 16:10:43 +0000 (00:10 +0800)]
bugfix: remove timeField for Kibana index-pattern

JIRA: BOTTLENECK-121

Remove timeField item in index-pattern which causes kibana
no reading test results.

Change-Id: I855dba186cc0e0db8e5c9dbd7aa21df80722d70e
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add flake8 style config and for POSCA"
Yu Yang (Gabriel) [Thu, 22 Dec 2016 02:43:25 +0000 (02:43 +0000)]
Merge "Add flake8 style config and for POSCA"

7 years agoAdd flake8 style config and for POSCA 19/26219/3
yuyang [Mon, 19 Dec 2016 16:37:59 +0000 (00:37 +0800)]
Add flake8 style config and for POSCA

JIRA: BOTTLENECK-100

Adding flake8 configuration and fix for POSCA

Change-Id: Ib822d5abde535263a4473d67c15cc17995f1417b
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agobugfix: correct typo in Dockerfile 07/26207/1
yuyang [Mon, 19 Dec 2016 13:52:50 +0000 (21:52 +0800)]
bugfix: correct typo in Dockerfile

JIRA: BOTTLENECK-108

Typo in Dockerfile that causing $BRANCH var not effective

Change-Id: I1f156e5b554ebd6f9a1b2d689b1c23c783a4e8af
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agobugfix:enabling the repo branch choosing 05/26005/1
yuyang [Thu, 15 Dec 2016 10:25:34 +0000 (18:25 +0800)]
bugfix:enabling the repo branch choosing

JIRA: BOTTLENECK-108

Enabling the git repo branch choosing in dockerfile for Bottlenecks.

Change-Id: Id03c39e59cb1b38d198ec37f613c9660bcf335cd
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agobugfix:fix the version support problem of setuptools 99/25999/1
yuyang [Thu, 15 Dec 2016 10:19:03 +0000 (18:19 +0800)]
bugfix:fix the version support problem of setuptools

JIRA: BOTTLENECK-108

Due the version problem, docker build job fails each time.

Change-Id: I179ec56295f344fbd14ffeb8650c8d4625507379
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agocpu_burden script&configure 11/25611/1
liyin [Wed, 7 Dec 2016 09:24:29 +0000 (17:24 +0800)]
cpu_burden script&configure

JIRA: BOTTLENECK-118

This patch add a new function cpu_burden.
there are two things:
1.add configure file of cpu_burden, this default file could run test case
2.add script of cpu_burden, this script use the configure file could
use yardstick restful api call date.

Change-Id: Icd88b317fb97d8f12d81279eaffc2d3effc8ab65
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodocker-compose yardstick file change 19/25519/1
liyin [Tue, 6 Dec 2016 08:52:39 +0000 (16:52 +0800)]
docker-compose yardstick file change

JIRA: BOTTLENECK-117

This patch change the docker-compose file.
because of yardstick dockerfile.
so bottlenecks also need to change the style of docker-compose.

Change-Id: Idb82120c5b00ef8595a993886fa3fc0d6b6c4c32
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodashboard log info check 29/25429/1
liyin [Fri, 2 Dec 2016 14:52:55 +0000 (22:52 +0800)]
dashboard log info check

JIRA: BOTTLENECK-115

This patch change an error that last patch haven't covered.
so i need to correct it.

Change-Id: I1ab1fbe4e60463482728ec3ab58ec71c4e1d7049
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodashboard bug: can't deploy dashboard 15/25415/2
liyin [Fri, 2 Dec 2016 10:12:06 +0000 (18:12 +0800)]
dashboard bug: can't deploy dashboard

JIRA: BOTTLENECK-116

This patch fix the bug that bottlenecks project can't establish
dashboard, error message is elasticsearch is not install.
after install elasticsearch, the error message is can't get ip.
to fix this bug, change file requriment.txt and dashboard file.

Change-Id: Ibad0dc46ab44d500b799bbf67e169d76c59e7199
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoadd more debug info 03/25403/1
liyin [Fri, 2 Dec 2016 07:41:21 +0000 (15:41 +0800)]
add more debug info

JIRA: BOTTLENECK-115

This patch add some debug info to screen.
so test situation will be displayed to every one.
And it's could be easier to understand

Change-Id: Iecf767eedf42825a13dae59235ab99d1767e744e
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobug fix patch 97/25397/1
liyin [Fri, 2 Dec 2016 06:14:54 +0000 (14:14 +0800)]
bug fix patch

JIRA: BOTTLENECK-114

this patch fix a problem that docker can't run
because of lacking pyroute2.
the way to solve it is add return value judgement to avoid circle
return value error, is return relue when get into circle function

Change-Id: I3af9abdb417abc5cf04c0e4db7eed576222bb1ea
Signed-off-by: liyin <liyin11@huawei.com>
7 years agobug fix patch 27/25327/1
liyin [Thu, 1 Dec 2016 12:35:38 +0000 (20:35 +0800)]
bug fix patch

JIRA: BOTTLENECK-113

this patch fix a problem that docker can't run
because of lacking pyroute2.
the next is docker-compose file have some error that yardstick can't
pull inluxdb container.
the next is fix some bug incode.

Change-Id: I238b69b456d2810e84bae5c134e6b05a8fc5da63
Signed-off-by: liyin <liyin11@huawei.com>
7 years agodocker-compose dockerfile change 03/25303/1
liyin [Thu, 1 Dec 2016 07:32:13 +0000 (15:32 +0800)]
docker-compose dockerfile change

JIRA: BOTTLENECK-112

this patch change the yardstick and bottlenecks dockerfile
from stable to latest

Change-Id: I095957dc6aba25d76bb8e60be97c171c4a59ce57
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoposca test suite urls change 99/25299/2
liyin [Thu, 1 Dec 2016 04:38:38 +0000 (12:38 +0800)]
posca test suite urls change

JIRA: BOTTLENECK-111

This patch add two functions to bottlenecks project:
1.change yardstick urls and some return value.
2.bottlenecks project wait time change.

Change-Id: I1a7f98f69676cda8cb0dc62276704c2cfcf240d8
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "Add virtual enviroment support for cli"
Yu Yang (Gabriel) [Thu, 1 Dec 2016 02:20:00 +0000 (02:20 +0000)]
Merge "Add virtual enviroment support for cli"

7 years agoposca test suite support influxDB container 29/25229/1
liyin [Wed, 30 Nov 2016 09:42:14 +0000 (17:42 +0800)]
posca test suite support influxDB container

JIRA: BOTTLENECK-110

This patch support bottlenecks testsuites posca support use yardstick
rest api to pull InfluxDB container.
the yardstick use this container to store its test result.

Change-Id: I6ad6b5d7a9748c385787567b3d6d1dfe4cee167f
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "posca system bandwidth dashboard"
Yu Yang (Gabriel) [Wed, 30 Nov 2016 09:23:11 +0000 (09:23 +0000)]
Merge "posca system bandwidth dashboard"

7 years agoposca system bandwidth dashboard 01/25201/3
liyin [Wed, 30 Nov 2016 04:48:01 +0000 (12:48 +0800)]
posca system bandwidth dashboard

JIRA: BOTTLENECK-109

this patch provide a dashboard of system_bandwidth test case
when the test over this script would be run.
and you could login host:5601 to see the view of dashboard.

Change-Id: Ifb9717baa56a16fb2231a4e20d5688e34647d45b
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoMerge "POSCA test case complete"
Yu Yang (Gabriel) [Wed, 30 Nov 2016 09:19:26 +0000 (09:19 +0000)]
Merge "POSCA test case complete"

7 years agoAdd new CI docker build support 15/25215/1
yuyang [Wed, 30 Nov 2016 16:15:00 +0000 (00:15 +0800)]
Add new CI docker build support

JIRA: BOTTLENECK-108

Releng has updated the parameter input method. So the Docker file
need BRANCH argument to specify the docker image source.

Change-Id: I6c8eee3aaf7729964f0b810c209ccdcf9b75a233
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoPOSCA test case complete 99/25199/3
liyin [Wed, 30 Nov 2016 04:27:53 +0000 (12:27 +0800)]
POSCA test case complete

JIRA: BOTTLENECK-107

JIRA: BOTTLENECK-106

This patch has done the flowings:
1.Using the RESTful API form yardstick
2.Common function reuse.
3.If there is no test_ip it would use host ip and port as test_ip.
4.A little demo of dashboard. Now is can't work

Change-Id: I1063176c762c40238019c73f5359f23bc5aab19c
Signed-off-by: liyin <liyin11@huawei.com>
7 years agoAdd virtual enviroment support for cli 71/25071/1
yuyang [Tue, 29 Nov 2016 14:37:07 +0000 (22:37 +0800)]
Add virtual enviroment support for cli

JIRA: BOTTLENECK-65

Add installation of VIRTUALENV and deletion of it.

Change-Id: I4a339e8e87775fc2ea1e12d8fbf473850076bbd3
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoMerge "Add CLI framework for Bottlenecks"
Yu Yang (Gabriel) [Tue, 29 Nov 2016 02:04:11 +0000 (02:04 +0000)]
Merge "Add CLI framework for Bottlenecks"

7 years agoAdd CLI framework for Bottlenecks 27/24927/5
yuyang [Sat, 26 Nov 2016 15:07:41 +0000 (23:07 +0800)]
Add CLI framework for Bottlenecks

JIRA: BOTTLENECK-65

Adding cli framwork for Bottlenecks.

Usage:
bottlenecks testcase run <testcase>

Currently only the cli framwork and testcase command group is added.
run, list, etc., commands and openstack command group
will added afterwards.

Two setup entries are added. One is within the top directory and the
other is within the cli directory.

Change-Id: I304f6f2e9b29b9f582953c2739806c1fb3e87fed
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
7 years agoPOSCA docker-compose adapting 13/24813/3
liyin [Thu, 24 Nov 2016 04:37:10 +0000 (12:37 +0800)]
POSCA docker-compose adapting

JIRA: BOTTLENECK-105

there are files which be need to support docker-compose.
some files are docker configure file.
some files are used to build docker image.
kibana docker is bottlenecks project dashboard.
elasticsearch docker is bottlenecks project database.
influxdb docker is yardstick project database.
yardstick docker is used to run test case.

Change-Id: I7f0927c940a400f9f66ac77174f06236a1f4f265
Signed-off-by: liyin <liyin11@huawei.com>