Implement Retrieval of plans, QPIs, and metrics

- All specs can be listed
- All specs can be individually retrieved
- API can be installed alongside qtip
- API can be hosted using command `qtip-api`

JIRA: QTIP-221
JIRA: QTIP-222

Change-Id: I1e80e6609cae1252cb2fcdc38c71b4bf6d02e8c9
Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
(cherry picked from commit 15fceada86ad0d5dabe26365451aae9c95b36be1)

Merge "fill benchmarks"

Merge "bugfix benchmarks cannot be found"

fill benchmarks

Change-Id: I7ad5f504058b20db72c0878cf9618e6bff186b33
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

bugfix benchmarks cannot be found

OSError: [Errno 2] No such file or directory:
'/Users/fengxiaowei/opnfv/qtip/.venv/lib/python2.7/
site-packages/qtip/cli/../../tests/data/benchmarks/plan'

Change-Id: I510a2beb215b3e5c93cfa5870fd892b0c7720f01
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "Add missing softwares"

Merge "modify logfile directory structure"

Add missing softwares

Install iputils-ping for ping and rsync for synchronizing
files and directories.

Change-Id: I93ba44bcb04948bbe846fb179dc673aa86a6a92a
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Add basic swagger specifications and corresponding controllers"

Merge "Adding Labels"

modify logfile directory structure

After one qtip test execution, the logfiles will be stored like this:

`-- 2017-03-09-17-40
    `-- node-41
        |-- dhrystone
        |   |-- inxi.log
        |   |-- node-41.zte.com.cn-2017-03-09-01
        |   |-- node-41.zte.com.cn-2017-03-09-01.html
        |   |-- node-41.zte.com.cn-2017-03-09-01.log
        |   `-- top.log
        |-- dpi
        |   |-- dpi_dump.txt
        |   |-- inxi.log
        |   `-- top.log
        |-- ramspeed
        |   |-- Floatmem
        |   |-- Intmem
        |   |-- inxi.log
        |   `-- top.log
        |-- ssl
        |   |-- AES-128-CBC_dump
        |   |-- RSA_dump
        |   |-- inxi.log
        |   `-- top.log
        `-- whetstone
            |-- inxi.log
            |-- node-41.zte.com.cn-2017-03-09-01
            |-- node-41.zte.com.cn-2017-03-09-01.html
            |-- node-41.zte.com.cn-2017-03-09-01.log
            `-- top.log

Change-Id: I5889a0e5dbe99f28212d6e0cdf69b9c03d89a9fe
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Add basic swagger specifications and corresponding controllers

- Update specifications as per requirements
- map specifications with controllers
- make api installable

JIRA: QTIP-220

Change-Id: Id149fdcf68e869e31a00cf16d7e725e368d2b25f
Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>

Merge "Implement ansible driver"

Merge "Playbooks for unixbench"

regexes for dpi/ramspeed/ssl

- Add dpi/ramspeed/ssl logfiles
- update regexes for dpi/ramspeed/ssl

result sample:
dpi: {
    "bps": "4.57",
    "pps": "1.55"
}
ramspeed:{
    "float_add": "9967.13",
    "float_copy": "7908.64",
    "float_scale": "7870.16",
    "float_triad": "10073.43",
    "float_average": "8954.84",
    "integer_add": "11649.55",
    "integer_copy": "11562.63",
    "integer_scale": "11563.77",
    "integer_triad": "11671.22",
    "integer_average": "11611.79"
}
ssl:{
    "aes_128_cbc_1024_bytes": "584568.83k",
    "aes_128_cbc_16_bytes": "533103.05k",
    "aes_128_cbc_256_bytes": "580021.25k",
    "aes_128_cbc_64_bytes": "570042.22k",
    "aes_128_cbc_8192_bytes": "599470.83k"
    "rsa_sign_1024": "3.9",
    "rsa_sign_2048": "1.4",
    "rsa_sign_4096": "0.8",
    "rsa_sign_512": "8.4",
    "rsa_verify_1024": "88397.9",
    "rsa_verify_2048": "26951.3",
    "rsa_verify_4096": "7633.7",
    "rsa_verify_512": "222903.5"
}

Change-Id: I6db22a699111dd55d9dc48c6e8c2cf148b345563
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "playbook for ramspeed"

Merge "Refactor openssl playbook"

Merge "Remove hardcode from some playbooks"

Merge "Refactor dpi playbook"

Implement ansible driver

- According to inputs parameters, setup test environment. If failed
during setupping, qtip will exited. If successful, execute metric
tests.
- Parameters(optional):
* keypair: the keypair to login/execute commands to the remote
  hosts. They can be automatically generated.
* hostfile: a inventory file. If not give, it can be
  automatically generated via installer.
* args: the parameters passed to playbook
- Use ansible python api to trigger ansible-playbook.

Unit test will be in a new patch.

Change-Id: I7470d348308f7cb6cb669bcc49063cf0f4da2111
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Refactor openssl playbook

Local test is ok.

Change-Id: I2800e364320697d436ed7b9202cc1baa3a893503
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Playbooks for unixbench

Actually, both dhrystone and whether use unixbench tool
to get metric. Their playbook are too smiliar.
The playbooks under /unixbench can be used to measure
both of them.

Change-Id: I26e31c2b4ac4de35ff8b7ec6dea26b676d5078de
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Adding Labels

Labels serve as anchors/ refs when referenced from other documents
This patch adds labels to docs/*/*/index.rst

Change-Id: Id23477c82231a1d02463802d60ee9d88a7fabc41
Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>

playbook for ramspeed

These playbooks are successfully executed on Local.

Change-Id: Ie22ecb9b66364e6edf6ae0f59d0524603c4d46a9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Refactor dpi playbook

Local test is ok.

Change-Id: I22a333eae940433a1ca228e6ee7f570b8d0c0fc9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Remove hardcode from some playbooks

Remove hardcode ($HOME/qtip_result) from these three
playbooks.

Change-Id: Iefcf0d4c6caf6be6b6888ff6abe4c36621666129
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "rework env.py"

Merge "Add `subrepo` basic usage in developer guide."

Merge "Qtip command completion."

Merge "Implement debug option"

Merge "Implement reporter module."

Merge "Create draft of report template in console"

Add `subrepo` basic usage in developer guide.

Change-Id: I4e066d91c9d0775ba698584f561cce997d60ad6b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Switch License tool to develop branch"

rework env.py

Create a new class AnsibleEnvSetup for setuping
test environment for ansible driver.

Change-Id: I5d2385b33e5666acb7bbac1a6d960a805d846a32
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "bugfix on bash scripts"

Merge "Refactor dhrystone playbook"

Implement debug option

Show traceback only when debug flag specified.

JIRA: QTIP-201

Change-Id: I9cc4b4ed5a2cb2d2efabd9c0eb3aac216321ebac
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Add missing license headers"

Implement reporter module.

- Add cli module
- Implement timeline outline

JIRA: QTIP-199

Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
Change-Id: I487b76123a785731c356143d1ae7f3123c11f398

Add missing license headers

Change-Id: I33cdd3b1304c695b81d2e23434a70acfcc9a21f8
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Switch License tool to develop branch

The default branch in the remote repository has been changed to develop.

-----------auto-generated by git-subrepo-------------
git subrepo pull --branch=develop third-party/License

subrepo:
  subdir:   "third-party/License"
  merged:   "88b1440"
upstream:
  origin:   "git@github.com:openzero-zte/License.git"
  branch:   "develop"
  commit:   "88b1440"
git-subrepo:
  version:  "0.3.0"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "988f8c8"
-------------------------------------------------------

Change-Id: I6efbee7217e1f04febeaf5b5079ee3e7eda797cd
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

bugfix on bash scripts

When debugging on real environment, I found these two bugs.
Local test is ok.

Change-Id: I799afe6a4c24fcdf370d761c83376ca3f2ce43d2
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Restructure docs

- Following the changes as in functest[1] since the guide[2] in wiki is a bit
  out of date
- Some folders are empty for now as a placeholder

Now:
 - release
    - release notes

 - testing
    - developer
       - design
       - overview
       - requirement

    - user
       - config guide
       - user guide
       - installation
       - scenarios

[1]: https://gerrit.opnfv.org/gerrit/#/c/29151/
[2]: https://wiki.opnfv.org/display/DOC/Documentation+Guide

Change-Id: I81b4597536c8bf02a925641d71d0969f6f5537f4
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Create draft of report template in console

Change-Id: Ie6e626753c6562c361542c45e8504d177d624d2a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactor dhrystone playbook

- Break previous one playbook into three playbooks:
    setup.yaml: setup test environment.
    run.yaml: execute test steps
    clean.yaml: cleanup test environment to restore
    environment
  The advantage is cleaning part will never be blocked by another.
- Just do testing on remote hosts, parse logfile on localhost.
- Use ansible module instead of shell command.
- Move up all files under /ansible and remove ansible directory.
  Under /ansible, ansible package cann't be imported.

Change-Id: I43c65be23869b7d42ca769994d4decb9a012d196
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Install latest requirment packages

When I debug code in qtip container, I found
the version of paramiko(1.16.0) is outdated.
There is a bug based on this version.[1]

Solution:
1. Pip install qtip requirment packages with -U.
2. Update dependent packages.[2][3]

And docker image is built successfully on local.

[1] http://stackoverflow.com/questions/42029415/
paramiko-futurewarning-ctr-mode-needs-counter-parameter
[2] http://www.paramiko.org/installing.html
[3] https://cryptography.io/en/latest/installation/

Change-Id: I9d90c49f7cf3048f4717a76ffcb19dab68a687d4
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Qtip command completion.

Change-Id: I164150acd05eacf5ccdb182280b747495d34347d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "refactor code related with setup env"

refactor code related with setup env

- modify env.py and scripts
- add unit test

Change-Id: I416cd517bdddfeb907675705009d83ecada7f87c
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Rename test case to avoid possible name conflict

pytest does not allow two test file have same name despite they are in
different folder.

Change-Id: I568fe042f6dbe99df336d0ce4d6ed9c78305fe74
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Deprecate unused drivers sample and yardstick

- yardstick driver will not be implemented in Danube release
- sample driver is no longer continued

Change-Id: I22a86fe22b08c85b2a18ef70443d725bc4a25246
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Fix bug when no paths is given for Plan constructor"

Merge "Add reporter PoC"

Merge "Refactoring qtip.runner"

Fix bug when no paths is given for Plan constructor

FileLoader was trying to initialize abspath by finding a matched
name from abspath which will lead to an exception. Use default
paths of class instead.

Change-Id: I8ca2122e97edd734aa68b4c6b12196960842313b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Addition of detail viewing command."

Merge "Update tox to produce coverage report"

Merge "add logger's unittest"

Merge "refactor logger to make unittest possible"

Merge "guides for openssl issue in macOS"

add logger's unittest

Change-Id: I9a7d3c6afeff5432017f5bfd4a961a719c93c086
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

guides for openssl issue in macOS

Change-Id: I61454e35db30050a4473ab9058ddcd9c7b44fcbe
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

refactor logger to make unittest possible

Change-Id: Ibb630ea34701e454aabf78821f4c40781d2607ed
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "bugfix for grep"

Add reporter PoC

Change-Id: I5134a0d95d75fcb3a75267a5f20b4ace8638156a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Cover also tests folder"

Merge "Add Api Basic framework skeleton"

bugfix for grep

Change-Id: I1474a4e4f5884f17cbf3e6d62fae7e743921aae1
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Update tox to produce coverage report

JIRA:QTIP-204

Change-Id: If77558ed2f6e454b4abebdbb185755925d91c963
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

Add Api Basic framework skeleton

- Requirements updated to remove flask and include connexion
- Api specifications will be added to specs file in swagger/
- controllers module will handle all requests and responses

JIRA: QTIP-213

Change-Id: Icfec15ddeff7d53c53ce64910ae2bddd4fc0f260
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Refactoring qtip.runner

- deprecate current PoC
- cover it with test

Change-Id: Ia1a43c195781fdd09e7d925ed3bf4509f226916f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Refactoring qtip.base.error"

Addition of detail viewing command.

Change-Id: Ia9ad825f20b279db1852587540a2ad6cb3815e1d
Signed-off-by:Taseer Ahmed <taseer94@gmail.com>

Merge "Implement the collector regex for system info logfile."

Merge "Include third party script for license checking and amending"

Refactoring qtip.base.error

- move method make_tbd to qtip.util.dev
- add suffix Error to follow the Python naming convention
- rename arguments of NotFoundError to make it generic

Change-Id: I81e406b7fa10c3b40004434f6a9c2e7bbf7603ee
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Cover also tests folder

This is to ensure all test code is reached to detect bugs like #28955 [1].
The loop of in the tests were not reached before the fix.

[1]: https://gerrit.opnfv.org/gerrit/#/c/28955/

Change-Id: I2f9e52cf7df1b94c9412f6edb6ce6f9e137d9b54
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Move coverage config to .coveragerc"

Implement the collector regex for system info logfile.

I commented sone lines. Because these part can't be supported
well by grep_in_file().

Change-Id: Ifc0ab1b6f40180e40c150b2c80eeaa6c72274ac9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move coverage config to .coveragerc

.coveragerc will be used by tox, pytest, PyCharm and etc

Change-Id: I1f128231cda5f3ebffff9e99b1de9134c78fcc00
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

support multi-line search in grep parser

use finditer with multiline mode

JIRA: QTIP-211

Change-Id: Ib8854f749a0258f6b6775be9b80573f6ac8e47db
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Include third party script for license checking and amending

The following commit message are generated automatically by git-subrepo
-----------------------------------------------------------------------------
git subrepo clone git@github.com:openzero-zte/License.git third-party/License

subrepo:
  subdir:   "third-party/License"
  merged:   "61489da"
upstream:
  origin:   "git@github.com:openzero-zte/License.git"
  branch:   "master"
  commit:   "61489da"
git-subrepo:
  version:  "0.3.0"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "988f8c8"
-----------------------------------------------------------------------------
Change-Id: I8eab86a8ce3f26995af3e3535f31f361b4826a8b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add licence header according to OPNFV contribution guidelines[1] by script[2]

[1]: https://wiki.opnfv.org/display/DEV/Contribution+Guidelines
[2]: https://github.com/Justin-chi/Lab/blob/master/add_license.sh

Change-Id: I5b77394a104857bb4ee9addbe973ed239b7a59f3
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Migrate to Danube document guide"

Merge "Fix error in loader test"

Merge "Clean up tests folder"

Merge "Move api server to legacy code."

Merge "Deprecate options not sourceable to environment via Python. JIRA: QTIP-205"

Merge "code refactor: ansible playbook about system info"

code refactor: ansible playbook about system info

- use module yum and apt instead of shell command
- break sys_info_pbook.yaml into some small playbooks

Change-Id: I33b36fa826c0e668e4a74846ad4da7f4a245a33f
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Move api server to legacy code.

Change-Id: Idda8a48bc8cecac5aff4a1f99b8e4e0b58855fff
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Fix error in loader test

Change-Id: Idac7d0ec77941974a5f93108fd5f450eef05a5ad
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Clean up tests folder

- remove __init__.py as recommended in pytest docs[1]
- rename cli test files for a consistent naming style
- remove empty test files

[1]: http://docs.pytest.org/en/latest/goodpractices.html#choosing-a-test-layout-import-rules

Change-Id: Idfb5d8a8fb7a590ef988a761991b8e313089e9bc
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Migrate to Danube document guide

https://wiki.opnfv.org/display/DOC

Change-Id: I85535f158022fe0aeb7c888273dc81fbbf4ddeda
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Deprecate options not sourceable to environment via Python.
JIRA: QTIP-205

Change-Id: I991ba64e95227fd61b5809393439ef5e7fe05be2
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Implement logfile collector and grep parser

JIRA: QTIP-207
JIRA: QTIP-208
Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactoring collector initialization in plan loader

- move ClassProps to module
- collectors should be array in plan definition

Change-Id: I37d85dbc977c91aa1bb81de45b5e1c41660e6d1f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Add test for yaml_file loader

Change-Id: I997ceeed17bd35889f6b0f3465bbe75df256b71e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Add test coverage to contributing guide"