Merge "Refactor openssl playbook"

Merge "Remove hardcode from some playbooks"

Merge "Refactor dpi playbook"

Refactor openssl playbook

Local test is ok.

Change-Id: I2800e364320697d436ed7b9202cc1baa3a893503
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Refactor dpi playbook

Local test is ok.

Change-Id: I22a333eae940433a1ca228e6ee7f570b8d0c0fc9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Remove hardcode from some playbooks

Remove hardcode ($HOME/qtip_result) from these three
playbooks.

Change-Id: Iefcf0d4c6caf6be6b6888ff6abe4c36621666129
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "rework env.py"

Merge "Add `subrepo` basic usage in developer guide."

Merge "Qtip command completion."

Merge "Implement debug option"

Merge "Implement reporter module."

Merge "Create draft of report template in console"

Add `subrepo` basic usage in developer guide.

Change-Id: I4e066d91c9d0775ba698584f561cce997d60ad6b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Switch License tool to develop branch"

rework env.py

Create a new class AnsibleEnvSetup for setuping
test environment for ansible driver.

Change-Id: I5d2385b33e5666acb7bbac1a6d960a805d846a32
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "bugfix on bash scripts"

Merge "Refactor dhrystone playbook"

Implement debug option

Show traceback only when debug flag specified.

JIRA: QTIP-201

Change-Id: I9cc4b4ed5a2cb2d2efabd9c0eb3aac216321ebac
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Add missing license headers"

Implement reporter module.

- Add cli module
- Implement timeline outline

JIRA: QTIP-199

Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
Change-Id: I487b76123a785731c356143d1ae7f3123c11f398

Add missing license headers

Change-Id: I33cdd3b1304c695b81d2e23434a70acfcc9a21f8
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Switch License tool to develop branch

The default branch in the remote repository has been changed to develop.

-----------auto-generated by git-subrepo-------------
git subrepo pull --branch=develop third-party/License

subrepo:
  subdir:   "third-party/License"
  merged:   "88b1440"
upstream:
  origin:   "git@github.com:openzero-zte/License.git"
  branch:   "develop"
  commit:   "88b1440"
git-subrepo:
  version:  "0.3.0"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "988f8c8"
-------------------------------------------------------

Change-Id: I6efbee7217e1f04febeaf5b5079ee3e7eda797cd
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

bugfix on bash scripts

When debugging on real environment, I found these two bugs.
Local test is ok.

Change-Id: I799afe6a4c24fcdf370d761c83376ca3f2ce43d2
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Restructure docs

- Following the changes as in functest[1] since the guide[2] in wiki is a bit
  out of date
- Some folders are empty for now as a placeholder

Now:
 - release
    - release notes

 - testing
    - developer
       - design
       - overview
       - requirement

    - user
       - config guide
       - user guide
       - installation
       - scenarios

[1]: https://gerrit.opnfv.org/gerrit/#/c/29151/
[2]: https://wiki.opnfv.org/display/DOC/Documentation+Guide

Change-Id: I81b4597536c8bf02a925641d71d0969f6f5537f4
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Create draft of report template in console

Change-Id: Ie6e626753c6562c361542c45e8504d177d624d2a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactor dhrystone playbook

- Break previous one playbook into three playbooks:
    setup.yaml: setup test environment.
    run.yaml: execute test steps
    clean.yaml: cleanup test environment to restore
    environment
  The advantage is cleaning part will never be blocked by another.
- Just do testing on remote hosts, parse logfile on localhost.
- Use ansible module instead of shell command.
- Move up all files under /ansible and remove ansible directory.
  Under /ansible, ansible package cann't be imported.

Change-Id: I43c65be23869b7d42ca769994d4decb9a012d196
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Install latest requirment packages

When I debug code in qtip container, I found
the version of paramiko(1.16.0) is outdated.
There is a bug based on this version.[1]

Solution:
1. Pip install qtip requirment packages with -U.
2. Update dependent packages.[2][3]

And docker image is built successfully on local.

[1] http://stackoverflow.com/questions/42029415/
paramiko-futurewarning-ctr-mode-needs-counter-parameter
[2] http://www.paramiko.org/installing.html
[3] https://cryptography.io/en/latest/installation/

Change-Id: I9d90c49f7cf3048f4717a76ffcb19dab68a687d4
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Qtip command completion.

Change-Id: I164150acd05eacf5ccdb182280b747495d34347d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "refactor code related with setup env"

refactor code related with setup env

- modify env.py and scripts
- add unit test

Change-Id: I416cd517bdddfeb907675705009d83ecada7f87c
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Rename test case to avoid possible name conflict

pytest does not allow two test file have same name despite they are in
different folder.

Change-Id: I568fe042f6dbe99df336d0ce4d6ed9c78305fe74
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Deprecate unused drivers sample and yardstick

- yardstick driver will not be implemented in Danube release
- sample driver is no longer continued

Change-Id: I22a86fe22b08c85b2a18ef70443d725bc4a25246
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Fix bug when no paths is given for Plan constructor"

Merge "Add reporter PoC"

Merge "Refactoring qtip.runner"

Fix bug when no paths is given for Plan constructor

FileLoader was trying to initialize abspath by finding a matched
name from abspath which will lead to an exception. Use default
paths of class instead.

Change-Id: I8ca2122e97edd734aa68b4c6b12196960842313b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Addition of detail viewing command."

Merge "Update tox to produce coverage report"

Merge "add logger's unittest"

Merge "refactor logger to make unittest possible"

Merge "guides for openssl issue in macOS"

add logger's unittest

Change-Id: I9a7d3c6afeff5432017f5bfd4a961a719c93c086
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

guides for openssl issue in macOS

Change-Id: I61454e35db30050a4473ab9058ddcd9c7b44fcbe
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

refactor logger to make unittest possible

Change-Id: Ibb630ea34701e454aabf78821f4c40781d2607ed
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "bugfix for grep"

Add reporter PoC

Change-Id: I5134a0d95d75fcb3a75267a5f20b4ace8638156a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Cover also tests folder"

Merge "Add Api Basic framework skeleton"

bugfix for grep

Change-Id: I1474a4e4f5884f17cbf3e6d62fae7e743921aae1
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Update tox to produce coverage report

JIRA:QTIP-204

Change-Id: If77558ed2f6e454b4abebdbb185755925d91c963
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

Add Api Basic framework skeleton

- Requirements updated to remove flask and include connexion
- Api specifications will be added to specs file in swagger/
- controllers module will handle all requests and responses

JIRA: QTIP-213

Change-Id: Icfec15ddeff7d53c53ce64910ae2bddd4fc0f260
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Refactoring qtip.runner

- deprecate current PoC
- cover it with test

Change-Id: Ia1a43c195781fdd09e7d925ed3bf4509f226916f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Refactoring qtip.base.error"

Addition of detail viewing command.

Change-Id: Ia9ad825f20b279db1852587540a2ad6cb3815e1d
Signed-off-by:Taseer Ahmed <taseer94@gmail.com>

Merge "Implement the collector regex for system info logfile."

Merge "Include third party script for license checking and amending"

Refactoring qtip.base.error

- move method make_tbd to qtip.util.dev
- add suffix Error to follow the Python naming convention
- rename arguments of NotFoundError to make it generic

Change-Id: I81e406b7fa10c3b40004434f6a9c2e7bbf7603ee
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Cover also tests folder

This is to ensure all test code is reached to detect bugs like #28955 [1].
The loop of in the tests were not reached before the fix.

[1]: https://gerrit.opnfv.org/gerrit/#/c/28955/

Change-Id: I2f9e52cf7df1b94c9412f6edb6ce6f9e137d9b54
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Move coverage config to .coveragerc"

Implement the collector regex for system info logfile.

I commented sone lines. Because these part can't be supported
well by grep_in_file().

Change-Id: Ifc0ab1b6f40180e40c150b2c80eeaa6c72274ac9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move coverage config to .coveragerc

.coveragerc will be used by tox, pytest, PyCharm and etc

Change-Id: I1f128231cda5f3ebffff9e99b1de9134c78fcc00
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

support multi-line search in grep parser

use finditer with multiline mode

JIRA: QTIP-211

Change-Id: Ib8854f749a0258f6b6775be9b80573f6ac8e47db
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Include third party script for license checking and amending

The following commit message are generated automatically by git-subrepo
-----------------------------------------------------------------------------
git subrepo clone git@github.com:openzero-zte/License.git third-party/License

subrepo:
  subdir:   "third-party/License"
  merged:   "61489da"
upstream:
  origin:   "git@github.com:openzero-zte/License.git"
  branch:   "master"
  commit:   "61489da"
git-subrepo:
  version:  "0.3.0"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "988f8c8"
-----------------------------------------------------------------------------
Change-Id: I8eab86a8ce3f26995af3e3535f31f361b4826a8b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add licence header according to OPNFV contribution guidelines[1] by script[2]

[1]: https://wiki.opnfv.org/display/DEV/Contribution+Guidelines
[2]: https://github.com/Justin-chi/Lab/blob/master/add_license.sh

Change-Id: I5b77394a104857bb4ee9addbe973ed239b7a59f3
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Migrate to Danube document guide"

Merge "Fix error in loader test"

Merge "Clean up tests folder"

Merge "Move api server to legacy code."

Merge "Deprecate options not sourceable to environment via Python. JIRA: QTIP-205"

Merge "code refactor: ansible playbook about system info"

code refactor: ansible playbook about system info

- use module yum and apt instead of shell command
- break sys_info_pbook.yaml into some small playbooks

Change-Id: I33b36fa826c0e668e4a74846ad4da7f4a245a33f
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move api server to legacy code.

Change-Id: Idda8a48bc8cecac5aff4a1f99b8e4e0b58855fff
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Fix error in loader test

Change-Id: Idac7d0ec77941974a5f93108fd5f450eef05a5ad
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Clean up tests folder

- remove __init__.py as recommended in pytest docs[1]
- rename cli test files for a consistent naming style
- remove empty test files

[1]: http://docs.pytest.org/en/latest/goodpractices.html#choosing-a-test-layout-import-rules

Change-Id: Idfb5d8a8fb7a590ef988a761991b8e313089e9bc
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Migrate to Danube document guide

https://wiki.opnfv.org/display/DOC

Change-Id: I85535f158022fe0aeb7c888273dc81fbbf4ddeda
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Deprecate options not sourceable to environment via Python.
JIRA: QTIP-205

Change-Id: I991ba64e95227fd61b5809393439ef5e7fe05be2
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Implement logfile collector and grep parser

JIRA: QTIP-207
JIRA: QTIP-208
Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactoring collector initialization in plan loader

- move ClassProps to module
- collectors should be array in plan definition

Change-Id: I37d85dbc977c91aa1bb81de45b5e1c41660e6d1f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test for yaml_file loader

Change-Id: I997ceeed17bd35889f6b0f3465bbe75df256b71e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Add test coverage to contributing guide"

Add unit test for BaseTransformer

Change-Id: Ia379af759d9442f5b53f5052682e6218acef8a1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test coverage to contributing guide

JIRA: QTIP-204
Change-Id: I0ff8a00f287544d82628e940ee530b5e9150a1e0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test coverage

Change-Id: I9bff5fb1be3edc57d27cfe44f210a2814efd2274
JIRA: QTIP-204
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Fix bug that metric test is not collected

Change-Id: I2e05891a89745712274757ba9af928b03fb5edf6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add missing dependenency for test

Change-Id: I2c27fe3f852dbaf3cf7daa926228a14f039bbe67
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Removed unused deps"

Removed unused deps

Change-Id: I7215c0c3f2957e88b2a048c45a5b99739707f15b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactor loader classes

- rename BaseLoader to YamlFileLoader as base class of QTIP specs loader
- create an abstract BaseLoader
- create FileLoader for logfile collector

Change-Id: I0c992cd847fc0dce4fdd73a13c1cdbc406c84532
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Code refactoring about doctor QPI"

Merge "refactor useful legacy code about preparing test enviroment"

Merge "Click's built in support for version option"

Merge "Small corrections"

Merge "Plan module draft"

Merge "Formalize constants for property names"

Click's built in support for version option

Change-Id: I62ffde066fe2fcb5be7af9a29686a7d380353670
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "QPI Module Outline"

Code refactoring about doctor QPI

- Move sample log files to test data
- Move configuration from plugin to plan

Change-Id: Iaaf36ab3ce29c2eafe2d75f3524e7a302cc3836d
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Formalize constants for property names

Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

refactor useful legacy code about preparing test enviroment

- move useful scripts to qtip/scripts
- refactor some functions which belong to env_setup.py and
add them to qtip/runner/env.py

Change-Id: Ibf6c27103dfc45016920f4b602cd72d703c1f636
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Small corrections

JIRA: QTIP-188

Change-Id: I5820403527fe4df5e23472923e34660c72195d50
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>