Merge "add logger's unittest"

Merge "refactor logger to make unittest possible"

Merge "guides for openssl issue in macOS"

add logger's unittest

Change-Id: I9a7d3c6afeff5432017f5bfd4a961a719c93c086
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

guides for openssl issue in macOS

Change-Id: I61454e35db30050a4473ab9058ddcd9c7b44fcbe
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

refactor logger to make unittest possible

Change-Id: Ibb630ea34701e454aabf78821f4c40781d2607ed
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "bugfix for grep"

Merge "Cover also tests folder"

Merge "Add Api Basic framework skeleton"

bugfix for grep

Change-Id: I1474a4e4f5884f17cbf3e6d62fae7e743921aae1
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Add Api Basic framework skeleton

- Requirements updated to remove flask and include connexion
- Api specifications will be added to specs file in swagger/
- controllers module will handle all requests and responses

JIRA: QTIP-213

Change-Id: Icfec15ddeff7d53c53ce64910ae2bddd4fc0f260
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Merge "Refactoring qtip.base.error"

Merge "Implement the collector regex for system info logfile."

Merge "Include third party script for license checking and amending"

Refactoring qtip.base.error

- move method make_tbd to qtip.util.dev
- add suffix Error to follow the Python naming convention
- rename arguments of NotFoundError to make it generic

Change-Id: I81e406b7fa10c3b40004434f6a9c2e7bbf7603ee
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Cover also tests folder

This is to ensure all test code is reached to detect bugs like #28955 [1].
The loop of in the tests were not reached before the fix.

[1]: https://gerrit.opnfv.org/gerrit/#/c/28955/

Change-Id: I2f9e52cf7df1b94c9412f6edb6ce6f9e137d9b54
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Move coverage config to .coveragerc"

Implement the collector regex for system info logfile.

I commented sone lines. Because these part can't be supported
well by grep_in_file().

Change-Id: Ifc0ab1b6f40180e40c150b2c80eeaa6c72274ac9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move coverage config to .coveragerc

.coveragerc will be used by tox, pytest, PyCharm and etc

Change-Id: I1f128231cda5f3ebffff9e99b1de9134c78fcc00
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

support multi-line search in grep parser

use finditer with multiline mode

JIRA: QTIP-211

Change-Id: Ib8854f749a0258f6b6775be9b80573f6ac8e47db
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Include third party script for license checking and amending

The following commit message are generated automatically by git-subrepo
-----------------------------------------------------------------------------
git subrepo clone git@github.com:openzero-zte/License.git third-party/License

subrepo:
  subdir:   "third-party/License"
  merged:   "61489da"
upstream:
  origin:   "git@github.com:openzero-zte/License.git"
  branch:   "master"
  commit:   "61489da"
git-subrepo:
  version:  "0.3.0"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "988f8c8"
-----------------------------------------------------------------------------
Change-Id: I8eab86a8ce3f26995af3e3535f31f361b4826a8b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add licence header according to OPNFV contribution guidelines[1] by script[2]

[1]: https://wiki.opnfv.org/display/DEV/Contribution+Guidelines
[2]: https://github.com/Justin-chi/Lab/blob/master/add_license.sh

Change-Id: I5b77394a104857bb4ee9addbe973ed239b7a59f3
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Migrate to Danube document guide"

Merge "Fix error in loader test"

Merge "Clean up tests folder"

Merge "Move api server to legacy code."

Merge "Deprecate options not sourceable to environment via Python. JIRA: QTIP-205"

Merge "code refactor: ansible playbook about system info"

code refactor: ansible playbook about system info

- use module yum and apt instead of shell command
- break sys_info_pbook.yaml into some small playbooks

Change-Id: I33b36fa826c0e668e4a74846ad4da7f4a245a33f
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move api server to legacy code.

Change-Id: Idda8a48bc8cecac5aff4a1f99b8e4e0b58855fff
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Fix error in loader test

Change-Id: Idac7d0ec77941974a5f93108fd5f450eef05a5ad
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Clean up tests folder

- remove __init__.py as recommended in pytest docs[1]
- rename cli test files for a consistent naming style
- remove empty test files

[1]: http://docs.pytest.org/en/latest/goodpractices.html#choosing-a-test-layout-import-rules

Change-Id: Idfb5d8a8fb7a590ef988a761991b8e313089e9bc
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Migrate to Danube document guide

https://wiki.opnfv.org/display/DOC

Change-Id: I85535f158022fe0aeb7c888273dc81fbbf4ddeda
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Deprecate options not sourceable to environment via Python.
JIRA: QTIP-205

Change-Id: I991ba64e95227fd61b5809393439ef5e7fe05be2
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Implement logfile collector and grep parser

JIRA: QTIP-207
JIRA: QTIP-208
Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactoring collector initialization in plan loader

- move ClassProps to module
- collectors should be array in plan definition

Change-Id: I37d85dbc977c91aa1bb81de45b5e1c41660e6d1f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test for yaml_file loader

Change-Id: I997ceeed17bd35889f6b0f3465bbe75df256b71e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Add test coverage to contributing guide"

Add unit test for BaseTransformer

Change-Id: Ia379af759d9442f5b53f5052682e6218acef8a1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test coverage to contributing guide

JIRA: QTIP-204
Change-Id: I0ff8a00f287544d82628e940ee530b5e9150a1e0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test coverage

Change-Id: I9bff5fb1be3edc57d27cfe44f210a2814efd2274
JIRA: QTIP-204
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Fix bug that metric test is not collected

Change-Id: I2e05891a89745712274757ba9af928b03fb5edf6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add missing dependenency for test

Change-Id: I2c27fe3f852dbaf3cf7daa926228a14f039bbe67
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Removed unused deps"

Removed unused deps

Change-Id: I7215c0c3f2957e88b2a048c45a5b99739707f15b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactor loader classes

- rename BaseLoader to YamlFileLoader as base class of QTIP specs loader
- create an abstract BaseLoader
- create FileLoader for logfile collector

Change-Id: I0c992cd847fc0dce4fdd73a13c1cdbc406c84532
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Code refactoring about doctor QPI"

Merge "refactor useful legacy code about preparing test enviroment"

Merge "Click's built in support for version option"

Merge "Small corrections"

Merge "Plan module draft"

Merge "Formalize constants for property names"

Click's built in support for version option

Change-Id: I62ffde066fe2fcb5be7af9a29686a7d380353670
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "QPI Module Outline"

Code refactoring about doctor QPI

- Move sample log files to test data
- Move configuration from plugin to plan

Change-Id: Iaaf36ab3ce29c2eafe2d75f3524e7a302cc3836d
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Formalize constants for property names

Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

refactor useful legacy code about preparing test enviroment

- move useful scripts to qtip/scripts
- refactor some functions which belong to env_setup.py and
add them to qtip/runner/env.py

Change-Id: Ibf6c27103dfc45016920f4b602cd72d703c1f636
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Small corrections

JIRA: QTIP-188

Change-Id: I5820403527fe4df5e23472923e34660c72195d50
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Plan module draft

JIRA: QTIP-205
JIRA: QTIP-188

Change-Id: Ia871191851d25e1986834f8a7efdbeb8a8d87ec3
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

QPI Module Outline

Change-Id: I19b666dfdb3e3c10622397bda00460d6fb5c269d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Enable pep8 in tox test by default

Check it locally before submit for verification by opnfv-lint task

Change-Id: I2736d53e82a87d39a7316036aa97105bb13fec2f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Metric module outline"

Merge "Yardstick integration design specification"

Metric module outline

Change-Id: Id95b07f1c0821ae0883c761fdf8f507afba4e5c0
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Update Dockerfile"

Update Dockerfile

- update OS version to 16.04
- update pip version

JIRA: QTIP-202

Change-Id: Iba90e4b354f2ddb9e1cbc1da191be6b1b6f6a042
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move redundant files to legacy

Change-Id: Iede9d0f72f857b48e8fe5b48c9ae6169870e0b7a
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Reorganize the project folders

Code from Brahmaputra is no longer maintained, including:

- docker
- playbooks
- scripts
- utils

They are moved to legacy folder to avoid unnecessary confusion to new developers.

Change-Id: Ia50383ca5c3bd82571eb7b2184e7f83e264ff8a7
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

sample QPI for doctor performance measured in verification job

The doctor benchmark plan produces a performance profile consist of
timestamp at each checkpoint and time cost of each phase.[1]

It collects data from log files and render a timeline diagram in console

Current progress

- skeleton created
- method to be implemented

[1]: http://artifacts.opnfv.org/doctor/docs/design/index.html#document-performance-profiler

JIRA: QTIP-199
Change-Id: I60fbbd37d04a5724841bd85cb3bfed9eabd3741a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Yardstick integration design specification

Refer to https://etherpad.opnfv.org/p/qtip-yardstick, I
write this design specification.

JIRA: QTIP-147

Change-Id: I651c6ffd898fa22c237b788edab7e0a43828ae7c
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Add proposal of Fast Track review rule"

Merge "Implement plan, qpi and metric constructors"

Merge "Ignore AUTHORS and ChangeLog"

Merge "Add developer guide outline"

Merge "Add module skeletons"

Add proposal of Fast Track review rule

Change-Id: Ia0a95a5ee16547870eef49905db8adfd3b342ae0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Requesting to join qtip-reviewers group

Change-Id: Icf9da0984511177c97f3dbb3f2a0b2560773bf4b
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Add developer guide outline

JIRA: QTIP-115
Change-Id: I16c7919b1e97a098767ca567ce9b8026a1f754e2
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Retire `qtip-desk` server to save cost"

Merge "Rework Cli."

modify deprecated imports

Add description for the api specs

flask.ext.xx is deprecated. need to use flask_xx instead

https://github.com/pallets/flask/issues/1135

Change-Id: I9960dd44d03243bde73df8633c45ec3a1f437cea
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Ignore AUTHORS and ChangeLog

Change-Id: I45130f89057aa91d035edae91f4250394f9876c3
Signed-off-by: srisankethu <iamjustice443@gmail.com>

Rework Cli.

Allows global arguments to be passed to each group.

References:
https://github.com/pallets/click/blob/master/examples/complex/complex/cli.py

Change-Id: Ifed191add867b35ddfff92de0c7db4a03d67d091
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Retire `qtip-desk` server to save cost

info: this AWS instance hasn't been used much but costing 40$/month

Change-Id: I50045eef42eadd656a54e4a0fa2a65f9a9c0c557
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Implement plan, qpi and metric constructors

- separate runner from `plan` and move `plan` to `loader`
- rename `algorithm` to `formula`
- use `numpy` for formulas
- update sample qpi and metrics

Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add module skeletons

- Remove `suite` and `case` which seems redundant at the moment
- Rename `qtip.spec` to `qtip.loader` since the class loads spec
- Add driver `sample` which will generate random performance data
- Add collector `logfile` which will collect result from log files
- Add reporter `console` which will print report to console
- Add exception classes

See updated class diagram in https://wiki.opnfv.org/display/qtip/Design

JIRA: QTIP-148
JIRA: QTIP-193
Change-Id: Idf751d33428176a26224e4443100a142feda6f32
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Delete Ansible module. No longer required.

JIRA: QTIP-150

Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Implment https://wiki.opnfv.org/display/qtip/Design"

Implment https://wiki.opnfv.org/display/qtip/Design

Note that some obsolete test cases are marked expected failure, will
be deprecated after architecture evolution.

JIRA: QTIP-148
Change-Id: I52bc9391569d516e298d9e659517161b4dce794a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "rename qtip-server to qtip-api"

rename qtip-server to qtip-api

JIRA: QTIP-191

Change-Id: I54f8f0884fa92e41b619e25e4a241be2eb8fd087
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Merge "All unit tests."

Merge "Add skeletons of drivers, collector and reporter"

All unit tests.

JIRA: QTIP-184

Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Exception handling for wrong testplan

JIRA: QTIP-184

Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
Change-Id: I0b989b52561526963c127fc03818cf41d67af35f

Add skeletons of drivers, collector and reporter

Change-Id: I22a021800bbc813d7c5309d075fcbb8a19946e3f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Basic testplan layout JIRA: QTIP-184"

Merge "Unit Test for Ansible Module"

Minor fix of compute QPI spec

- align terminology with project FAQ[1]
- use different weight in sections

[1]: https://wiki.opnfv.org/display/qtip/FAQ#FAQ-Algorithm

Change-Id: I1161c333584952dfa9d23be3010f572d4b315b60
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Add unit test for `describe` method"