Merge "Add developer guide outline"

Merge "Add module skeletons"

Requesting to join qtip-reviewers group

Change-Id: Icf9da0984511177c97f3dbb3f2a0b2560773bf4b
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Add developer guide outline

JIRA: QTIP-115
Change-Id: I16c7919b1e97a098767ca567ce9b8026a1f754e2
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Retire `qtip-desk` server to save cost"

Merge "Rework Cli."

modify deprecated imports

Add description for the api specs

flask.ext.xx is deprecated. need to use flask_xx instead

https://github.com/pallets/flask/issues/1135

Change-Id: I9960dd44d03243bde73df8633c45ec3a1f437cea
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Rework Cli.

Allows global arguments to be passed to each group.

References:
https://github.com/pallets/click/blob/master/examples/complex/complex/cli.py

Change-Id: Ifed191add867b35ddfff92de0c7db4a03d67d091
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Retire `qtip-desk` server to save cost

info: this AWS instance hasn't been used much but costing 40$/month

Change-Id: I50045eef42eadd656a54e4a0fa2a65f9a9c0c557
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add module skeletons

- Remove `suite` and `case` which seems redundant at the moment
- Rename `qtip.spec` to `qtip.loader` since the class loads spec
- Add driver `sample` which will generate random performance data
- Add collector `logfile` which will collect result from log files
- Add reporter `console` which will print report to console
- Add exception classes

See updated class diagram in https://wiki.opnfv.org/display/qtip/Design

JIRA: QTIP-148
JIRA: QTIP-193
Change-Id: Idf751d33428176a26224e4443100a142feda6f32
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Delete Ansible module. No longer required.

JIRA: QTIP-150

Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Implment https://wiki.opnfv.org/display/qtip/Design"

Implment https://wiki.opnfv.org/display/qtip/Design

Note that some obsolete test cases are marked expected failure, will
be deprecated after architecture evolution.

JIRA: QTIP-148
Change-Id: I52bc9391569d516e298d9e659517161b4dce794a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "rename qtip-server to qtip-api"

rename qtip-server to qtip-api

JIRA: QTIP-191

Change-Id: I54f8f0884fa92e41b619e25e4a241be2eb8fd087
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Merge "All unit tests."

Merge "Add skeletons of drivers, collector and reporter"

All unit tests.

JIRA: QTIP-184

Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Exception handling for wrong testplan

JIRA: QTIP-184

Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
Change-Id: I0b989b52561526963c127fc03818cf41d67af35f

Add skeletons of drivers, collector and reporter

Change-Id: I22a021800bbc813d7c5309d075fcbb8a19946e3f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Basic testplan layout JIRA: QTIP-184"

Merge "Unit Test for Ansible Module"

Minor fix of compute QPI spec

- align terminology with project FAQ[1]
- use different weight in sections

[1]: https://wiki.opnfv.org/display/qtip/FAQ#FAQ-Algorithm

Change-Id: I1161c333584952dfa9d23be3010f572d4b315b60
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Add unit test for `describe` method"

Merge "add ssh public key to users/files/"

create a new suite file for compute QPI

- use yaml format to describe suite
- define the details of compute QPI suite

Change-Id: I2d8793a4e4c1b690210e63954199c6c2c18f8c48
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Unit Test for Ansible Module

JIRA: QTIP-188

Change-Id: I10b3fb979f52d10e8dedf956831f8320c04a36ea
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Add more comments to clarify runner prototype"

Merge "Convert contributing guide to markdown to get it embedded in wiki"

make qtip-server installable

JIRA: QTIP-189

Change-Id: I8de0fa1ff3033fd37c499e75f35a5387f5345f8f
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "bugfix: solve upgrade setuptools failed problem"

bugfix: solve upgrade setuptools failed problem

Change-Id: Id699224c35992a9f203b2ca5ad57300211e1b1eb
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Basic testplan layout
JIRA: QTIP-184

Change-Id: I605f81fce9c4c59b75d286a6262995ea2fa2e21e
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Add unit test for `describe` method

Change-Id: I6d37ab283d7fcfb0c15dd8065121b706dd80392b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add more comments to clarify runner prototype

Change-Id: I25540985f425ee4ebd209c1708b5d25be582e746
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Convert contributing guide to markdown to get it embedded in wiki

Change-Id: I969f97fea0bf9daca8816eefcf94fb7978bd51d9
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

refactor qtip-server structure

JIRA: QTIP-186

Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

bugfix: qtip install failed in docker mode

error message:
ImportError: <module 'setuptools.dist' from '/usr/lib/python2.7/dist-packages/setuptools/dist.pyc'> has no 'check_specifier' attribute

Change-Id: I3dea0ea87b20556e286bc52315148d7376911803
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "Fix role name error"

add ssh public key to users/files/

request user access on server

Change-Id: I2b100a63c9a4de52d8494d4b0ad527cf6f5b3f71
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Fix role name error

JIRA: QTIP-159

Change-Id: Idb4d43accaf0186f53c338624513e172dc54b9a8
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Fix relative path in test case

Use abspath for fixture files to make tests independent from cwd

Change-Id: Ie965899c5311e26ad708f44463b1992d9b8e697b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Fix bugs in `runner/benchmark`"

Merge "Implement PerfTest prototype"

Fix bugs in `runner/benchmark`

- should inherit `object` for common methods
- should use instance class in abstract method

Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

correct the path in push_db.sh

See link
https://build.opnfv.org/ci/view/qtip/job/qtip-fuel-zte-pod3-daily-master/52/console
for details.

Change-Id: If8ab7763e669e5f9184455a0e65173fd95428d27
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Implement PerfTest prototype

Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Implement TestPlan prototype"

Merge "Implement __init__ and list_all in Suite"

Implement TestPlan prototype

Refactor common part of Suite to Benchmark since both TestPlan
and Suite are organized by files

Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Implement __init__ and list_all in Suite

Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Skip unstable test `tests.unit.utils.create_zones_test`"

Skip unstable test `tests.unit.utils.create_zones_test`

JIRA: QTIP-175

Change-Id: Ib4891c8f37445285f2ea414d5988e55ca71cf10f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

[QTIP-157]fix docker build job

Bugfix task QTIP-157.
Add agrument BRANCH in Dockerfile.

JIRA: QTIP-157

Change-Id: I5558c23dde948e28f9c989bee7f4a42dc886f5a1
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "bugfix in run_qtip.sh"

Merge "Committer retirement: Wenjing CHU"

bugfix in run_qtip.sh

Forgot to set ${QTIP} to qtip/run.py

Change-Id: If57e58cc21d2ecfb32070bbeedab9aa3cc76551d
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Remove dell's directories under testplan/"

Merge "correct the path of transform/ in ansible scripts"

Remove dell's directories under testplan/

Since dell's pod is offline for a long time, dell's directories
are removed.

JIRA: QTIP-174

Change-Id: I5c93edd2f182b87cf6f7ea6d5713483d316c7fe9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Enable all unit tests except two failed cases"

correct module path in qtip.py

See https://build.opnfv.org/ci/job/qtip-fuel-zte-pod3-daily-master/43/console
for details.

Change-Id: Ic12c4143bd29e7d56ac68e8a3317c8b3f36a274f
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

correct the path of transform/ in ansible scripts

Due to reorganize qtip directory, it need to correct the path
of transform/ in ansible scripts

Change-Id: I9eb9cb194419b9eeb71ece6764335ee238db1481
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Enable all unit tests except two failed cases

- `test_ping` in `env_setup_test` still halts
- `test_prepare_and_run_benchmark_successful` in `args_handler_test` fails
- excluded `pep8` since already coverred by opnfv-lint task

Change-Id: Ib5ea20c37a27e356aea6d8eed3750b3269bd67f4
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Committer retirement: Wenjing CHU

Change-Id: I027d5771871394d5f6a390c644638deb6abcc202
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "bugfix: recovery qtip CI"

Merge "Entry point should be a calling a module function. Explained in [1] under entry_points."

Merge "Fix test failing"

Merge "Bugfix: fix the qtip restful server unit test problem."

bugfix: recovery qtip CI

https://build.opnfv.org/ci/job/qtip-fuel-zte-pod3-daily-master/40/console

- move qtip.py to qtip/
- modifity docker/run_qtip.sh

Change-Id: I9ec155c125f4be41e794142d0545d5cc54a1c6b3
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Entry point should be a calling a module function.
Explained in [1] under entry_points.

[1]. http://docs.openstack.org/developer/pbr/

Change-Id: Id231f397f348dd256b442dc69fe90c5cca5defd4
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Bugfix: fix the qtip restful server unit test problem.

JIRA:QTIP-158

Change-Id: I0ed1d3eb6959bb36615734ef757fa95560cb3baf
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>

Fix test failing

- skip several failure cases, to be fixed in future
- rename `test_plan` to hide from test discovering
- add pep8 check by default
- fix errors in pep8 check

Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Fix exception caused by missing log folder

Change-Id: I3a73cc0366e2c1a9c5965367ea68138f36ff1d63
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Reorganize the inventory"

Merge "Bugfix in new setup file."

Merge "Write how is compute QPI calculated."

Bugfix in new setup file.

Change-Id: I02a9620ce92680fdab469117e67894dba16d8b11
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Write how is compute QPI calculated.

JIRA: QTIP-127

Change-Id: I2c5f3c3b2b968a9c2bb0a772a38924af60890a67
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>

Use `pbr` for setup configuration

- `pbr` does a bunch of things[1] and is used widely in OpenStack
- moved legacy `qtip.py` to scripts in order to keep the project folder clean

[1]: http://docs.openstack.org/developer/pbr/#what-it-does

Change-Id: I6a9b83883283eaa527e2c3d4cd8d221ee6efca41
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Update review guidelines"

Allow select test case to run

- remove hardcoded argument `tests` from tox.ini
- use command like `tox tests/unit/runner` for selective running
- `tox` without argument will run all test in `tests` folder

Change-Id: I3916dc571e85c785f83813aa30c5bb0ef9a65cd6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Update review guidelines

Change-Id: Ia3e2a67762abb6369f75935c2d891f73a32e533a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Reorganize the inventory

- update server name and spec
- group servers by usage
- assign roles for each group
- rename role ssh to user

Change-Id: Ibc0a599adfabee296510f140319889775d9ae6cc
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Architecture evolution skeleton"

Merge "Additional server test.qtip.io"

Merge "adapt testapi running script to use mongo container as TESTDB"

Merge "push test results to qtip dashboard server"

Merge "Cli list related fixes"

adapt testapi running script to use mongo container as TESTDB

JIRA: QTIP-166

Change-Id: Icae8ab2a8760138ef10e9b353f6027bc5179ab5e
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Cli list related fixes

JIRA: QTIP-154

Change-Id: I95ab04fab35ff599c338ce07870602b58635e833
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

push test results to qtip dashboard server

JIRA: QTIP-166

Change-Id: Ic9b06c5dc0065850f8d766ecb66b74835b8677df
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

deploy mongodb to qtip dashboard server

add ansible code to deploy mongodb in qtip dashboard server

JIRA: QTIP-166

Change-Id: Icce4ac10b00ecf7679ff89204cb8a95cd1919151
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

deploy testapi to qtip dashboard server

add ansible code to deploy testapi in qtip dashboard server

JIRA: QTIP-166

Change-Id: I09111ea762d2677061c010e85208105f3f556fc6
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Architecture evolution skeleton

- benchmarks will be driven by qtip.runner
- qtip.runner is used by both qtip.cli and qtip.api
- unit test for each module will be placed under tests/unit
- functional tests will be moved to tests/functional
- data as testing sample will be moved to tests/data

NOTE: this patch moves files only, it may fails many tests. To be
followed up in next step.

JIRA: QTIP-148

Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge changes from topics 'fix', 'cli'

* changes:
  Bugfix: Correct the path in setup and entry points
  Ansible related commands in its own module.

Merge "Need to go one level up to reach project/root directory for listing purposes."

Bugfix: Correct the path in setup and entry points

JIRA: QTIP-154

Change-Id: I00320818e2d2e633c901b126775cbeb5a721f6fd
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Additional server test.qtip.io

- Located in Aliyun HK
- 1 CPU, 1GiB Mem, 100Mbps

Change-Id: I93241648f5721c04305cd74e1668de8ce5317604
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Ansible related commands in its own module.

JIRA: QTIP-154
JIRA: QTIP-150

Change-Id: I1bdd8d74d8978fd86ea659dae914f12874b6687d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>