Merge "mistaken delete usefuel public key"

mistaken delete usefuel public key

Previously, cleanup_creds.sh will delete public keys which of
comment info is "root@$hostname". It could delete useful keys
by accident. In this patch, cleanup_creds.sh will only delete
the key which matches the key's content.

JIRA: QTIP-228

Change-Id: I1095de656570b816b7e170688acd01c27b98e74c
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Refactor reporter module"

Refactor reporter module

- Create templates for report format specific to each metric.
- Outputs the details of the specified metric across all the nodes
  in cluster.
- Timeline to be covered in a separate patch

JIRA: QTIP-199

Change-Id: Ic83749725b0c9cc5bd9a7f24f21b2cd113abe0e1
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "provide get_one_exceptions to unify get_xx process"

Merge "correct a mistake for os.getenv()"

Merge "Implement 'show' command."

correct a mistake for os.getenv()

os.getenv returns a string not a boolean.
Although you set environment variable 'CI_DEBUG=false',
the cleanup will not be executed.

Change-Id: I077b602069f026a4b9ef6019869ac6c29c401c21
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Add aarch64 patch"

provide get_one_exceptions to unify get_xx process

add refactor get_metric()

Change-Id: I972c77e63a654eeb286c573d75efe842b2887c1d
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "add the cleanup step in runner.py"

Implement 'show' command.

- Render the description via templates

JIRA: QTIP-205

Change-Id: I10523f85f80350e901a4a701bb65ca4833f8ff7c
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Add aarch64 patch

This commit adds a patch that can be applied to the Dockerfile to adapt
it for aarch64. When applied from releng, a new Dockerfile.aarch64 is
created and an aarch64 qtip image is created.

The aarch64 qtip image will be build with the releng fix
https://gerrit.opnfv.org/gerrit/30181

JIRA: ARMBAND-219

Change-Id: I551ae7fa1d7fc23c6e5f6381d605b0b22dbec695
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>

add the cleanup step in runner.py

Add the cleanup step in runner.py

Change-Id: I0016986485eab5d7ab45d4a7a393bea5fb6f96b5
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

optimize console info

- use QtipLogger instead of print
- delete useless print

Change-Id: I1e08382a5d78ce53cf455496363bce3762b81dd2
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Implement the workflow of compute qpi"

Merge "parse benchmark result from logfile"

Miss \ in Dockerfile

https://build.opnfv.org/ci/view/qtip/job/qtip-docker-build-push-master/250/console

Change-Id: If6d76c6a27cc61a1b3d468751932e21d32dff277
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Implement the workflow of compute qpi

Local test is ok.
The result will be written to report.json.

usage: runner.py [-h] -d DEST -b BENCHMARK

optional arguments:
  -d DEST, --dest DEST  the destination where results will be stored.
  -b BENCHMARK, --benchmark BENCHMARK
                        the benchmark you want to execute.

Change-Id: Ic3a70c65a5aa045bf9df34ce4d14957a7a1b3dcf
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

parse benchmark result from logfile

- Put all the regex rules in regex.yaml.
- According to benchmark name, we can find related regexes.

Change-Id: Ic15bd1c77b525be3751011fa94d582da077b0345
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "env cleanup"

Merge "Some modifications for ansible playbook"

Merge "Implement 'list' command."

env cleanup

If IF_DEBUG is True, there is not cleanup step.
If IF_DEBUG is False, host file and keypair will be
deleted on local  and public key will be removed from
remote nodes in the end of test.

Change-Id: I4a88acc2d428e41e4abaedacb011e27468b2cb57
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Some modifications for ansible playbook

- typo in ramspeed/run.yaml
- fix result logfile name for dhrystone and whetstone

Change-Id: Ic8456174a14d04c2207990eccb16601762c5a880
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Implement 'list' command.

- Loads Qtip components from the default path.

JIRA: QTIP-205

Change-Id: Id87993d65c5cd6a23c199cf1049d75a0971b6354
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Implement Retrieval of plans, QPIs, and metrics

- All specs can be listed
- All specs can be individually retrieved
- API can be installed alongside qtip
- API can be hosted using command `qtip-api`

JIRA: QTIP-221
JIRA: QTIP-222

Change-Id: I1e80e6609cae1252cb2fcdc38c71b4bf6d02e8c9
Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>

Merge "fill benchmarks"

Merge "bugfix benchmarks cannot be found"

fill benchmarks

Change-Id: I7ad5f504058b20db72c0878cf9618e6bff186b33
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

bugfix benchmarks cannot be found

OSError: [Errno 2] No such file or directory:
'/Users/fengxiaowei/opnfv/qtip/.venv/lib/python2.7/
site-packages/qtip/cli/../../tests/data/benchmarks/plan'

Change-Id: I510a2beb215b3e5c93cfa5870fd892b0c7720f01
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "Add missing softwares"

Merge "modify logfile directory structure"

Add missing softwares

Install iputils-ping for ping and rsync for synchronizing
files and directories.

Change-Id: I93ba44bcb04948bbe846fb179dc673aa86a6a92a
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "Add basic swagger specifications and corresponding controllers"

Merge "Adding Labels"

modify logfile directory structure

After one qtip test execution, the logfiles will be stored like this:

`-- 2017-03-09-17-40
    `-- node-41
        |-- dhrystone
        |   |-- inxi.log
        |   |-- node-41.zte.com.cn-2017-03-09-01
        |   |-- node-41.zte.com.cn-2017-03-09-01.html
        |   |-- node-41.zte.com.cn-2017-03-09-01.log
        |   `-- top.log
        |-- dpi
        |   |-- dpi_dump.txt
        |   |-- inxi.log
        |   `-- top.log
        |-- ramspeed
        |   |-- Floatmem
        |   |-- Intmem
        |   |-- inxi.log
        |   `-- top.log
        |-- ssl
        |   |-- AES-128-CBC_dump
        |   |-- RSA_dump
        |   |-- inxi.log
        |   `-- top.log
        `-- whetstone
            |-- inxi.log
            |-- node-41.zte.com.cn-2017-03-09-01
            |-- node-41.zte.com.cn-2017-03-09-01.html
            |-- node-41.zte.com.cn-2017-03-09-01.log
            `-- top.log

Change-Id: I5889a0e5dbe99f28212d6e0cdf69b9c03d89a9fe
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Add basic swagger specifications and corresponding controllers

- Update specifications as per requirements
- map specifications with controllers
- make api installable

JIRA: QTIP-220

Change-Id: Id149fdcf68e869e31a00cf16d7e725e368d2b25f
Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>

Merge "Implement ansible driver"

Merge "Playbooks for unixbench"

regexes for dpi/ramspeed/ssl

- Add dpi/ramspeed/ssl logfiles
- update regexes for dpi/ramspeed/ssl

result sample:
dpi: {
    "bps": "4.57",
    "pps": "1.55"
}
ramspeed:{
    "float_add": "9967.13",
    "float_copy": "7908.64",
    "float_scale": "7870.16",
    "float_triad": "10073.43",
    "float_average": "8954.84",
    "integer_add": "11649.55",
    "integer_copy": "11562.63",
    "integer_scale": "11563.77",
    "integer_triad": "11671.22",
    "integer_average": "11611.79"
}
ssl:{
    "aes_128_cbc_1024_bytes": "584568.83k",
    "aes_128_cbc_16_bytes": "533103.05k",
    "aes_128_cbc_256_bytes": "580021.25k",
    "aes_128_cbc_64_bytes": "570042.22k",
    "aes_128_cbc_8192_bytes": "599470.83k"
    "rsa_sign_1024": "3.9",
    "rsa_sign_2048": "1.4",
    "rsa_sign_4096": "0.8",
    "rsa_sign_512": "8.4",
    "rsa_verify_1024": "88397.9",
    "rsa_verify_2048": "26951.3",
    "rsa_verify_4096": "7633.7",
    "rsa_verify_512": "222903.5"
}

Change-Id: I6db22a699111dd55d9dc48c6e8c2cf148b345563
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "playbook for ramspeed"

Merge "Refactor openssl playbook"

Merge "Remove hardcode from some playbooks"

Merge "Refactor dpi playbook"

Implement ansible driver

- According to inputs parameters, setup test environment. If failed
during setupping, qtip will exited. If successful, execute metric
tests.
- Parameters(optional):
* keypair: the keypair to login/execute commands to the remote
  hosts. They can be automatically generated.
* hostfile: a inventory file. If not give, it can be
  automatically generated via installer.
* args: the parameters passed to playbook
- Use ansible python api to trigger ansible-playbook.

Unit test will be in a new patch.

Change-Id: I7470d348308f7cb6cb669bcc49063cf0f4da2111
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Refactor openssl playbook

Local test is ok.

Change-Id: I2800e364320697d436ed7b9202cc1baa3a893503
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Playbooks for unixbench

Actually, both dhrystone and whether use unixbench tool
to get metric. Their playbook are too smiliar.
The playbooks under /unixbench can be used to measure
both of them.

Change-Id: I26e31c2b4ac4de35ff8b7ec6dea26b676d5078de
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Adding Labels

Labels serve as anchors/ refs when referenced from other documents
This patch adds labels to docs/*/*/index.rst

Change-Id: Id23477c82231a1d02463802d60ee9d88a7fabc41
Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>

playbook for ramspeed

These playbooks are successfully executed on Local.

Change-Id: Ie22ecb9b66364e6edf6ae0f59d0524603c4d46a9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Refactor dpi playbook

Local test is ok.

Change-Id: I22a333eae940433a1ca228e6ee7f570b8d0c0fc9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Remove hardcode from some playbooks

Remove hardcode ($HOME/qtip_result) from these three
playbooks.

Change-Id: Iefcf0d4c6caf6be6b6888ff6abe4c36621666129
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "rework env.py"

Merge "Add `subrepo` basic usage in developer guide."

Merge "Qtip command completion."

Merge "Implement debug option"

Merge "Implement reporter module."

Merge "Create draft of report template in console"

Add `subrepo` basic usage in developer guide.

Change-Id: I4e066d91c9d0775ba698584f561cce997d60ad6b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Switch License tool to develop branch"

rework env.py

Create a new class AnsibleEnvSetup for setuping
test environment for ansible driver.

Change-Id: I5d2385b33e5666acb7bbac1a6d960a805d846a32
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Merge "bugfix on bash scripts"

Merge "Refactor dhrystone playbook"

Implement debug option

Show traceback only when debug flag specified.

JIRA: QTIP-201

Change-Id: I9cc4b4ed5a2cb2d2efabd9c0eb3aac216321ebac
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "Add missing license headers"

Implement reporter module.

- Add cli module
- Implement timeline outline

JIRA: QTIP-199

Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
Change-Id: I487b76123a785731c356143d1ae7f3123c11f398

Add missing license headers

Change-Id: I33cdd3b1304c695b81d2e23434a70acfcc9a21f8
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Switch License tool to develop branch

The default branch in the remote repository has been changed to develop.

-----------auto-generated by git-subrepo-------------
git subrepo pull --branch=develop third-party/License

subrepo:
  subdir:   "third-party/License"
  merged:   "88b1440"
upstream:
  origin:   "git@github.com:openzero-zte/License.git"
  branch:   "develop"
  commit:   "88b1440"
git-subrepo:
  version:  "0.3.0"
  origin:   "https://github.com/ingydotnet/git-subrepo"
  commit:   "988f8c8"
-------------------------------------------------------

Change-Id: I6efbee7217e1f04febeaf5b5079ee3e7eda797cd
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

bugfix on bash scripts

When debugging on real environment, I found these two bugs.
Local test is ok.

Change-Id: I799afe6a4c24fcdf370d761c83376ca3f2ce43d2
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Restructure docs

- Following the changes as in functest[1] since the guide[2] in wiki is a bit
  out of date
- Some folders are empty for now as a placeholder

Now:
 - release
    - release notes

 - testing
    - developer
       - design
       - overview
       - requirement

    - user
       - config guide
       - user guide
       - installation
       - scenarios

[1]: https://gerrit.opnfv.org/gerrit/#/c/29151/
[2]: https://wiki.opnfv.org/display/DOC/Documentation+Guide

Change-Id: I81b4597536c8bf02a925641d71d0969f6f5537f4
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Create draft of report template in console

Change-Id: Ie6e626753c6562c361542c45e8504d177d624d2a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Refactor dhrystone playbook

- Break previous one playbook into three playbooks:
    setup.yaml: setup test environment.
    run.yaml: execute test steps
    clean.yaml: cleanup test environment to restore
    environment
  The advantage is cleaning part will never be blocked by another.
- Just do testing on remote hosts, parse logfile on localhost.
- Use ansible module instead of shell command.
- Move up all files under /ansible and remove ansible directory.
  Under /ansible, ansible package cann't be imported.

Change-Id: I43c65be23869b7d42ca769994d4decb9a012d196
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Install latest requirment packages

When I debug code in qtip container, I found
the version of paramiko(1.16.0) is outdated.
There is a bug based on this version.[1]

Solution:
1. Pip install qtip requirment packages with -U.
2. Update dependent packages.[2][3]

And docker image is built successfully on local.

[1] http://stackoverflow.com/questions/42029415/
paramiko-futurewarning-ctr-mode-needs-counter-parameter
[2] http://www.paramiko.org/installing.html
[3] https://cryptography.io/en/latest/installation/

Change-Id: I9d90c49f7cf3048f4717a76ffcb19dab68a687d4
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Qtip command completion.

Change-Id: I164150acd05eacf5ccdb182280b747495d34347d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>

Merge "refactor code related with setup env"

refactor code related with setup env

- modify env.py and scripts
- add unit test

Change-Id: I416cd517bdddfeb907675705009d83ecada7f87c
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Rename test case to avoid possible name conflict

pytest does not allow two test file have same name despite they are in
different folder.

Change-Id: I568fe042f6dbe99df336d0ce4d6ed9c78305fe74
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Deprecate unused drivers sample and yardstick

- yardstick driver will not be implemented in Danube release
- sample driver is no longer continued

Change-Id: I22a86fe22b08c85b2a18ef70443d725bc4a25246
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Fix bug when no paths is given for Plan constructor"

Merge "Add reporter PoC"

Merge "Refactoring qtip.runner"

Fix bug when no paths is given for Plan constructor

FileLoader was trying to initialize abspath by finding a matched
name from abspath which will lead to an exception. Use default
paths of class instead.

Change-Id: I8ca2122e97edd734aa68b4c6b12196960842313b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Addition of detail viewing command."

Merge "Update tox to produce coverage report"

Merge "add logger's unittest"

Merge "refactor logger to make unittest possible"

Merge "guides for openssl issue in macOS"

add logger's unittest

Change-Id: I9a7d3c6afeff5432017f5bfd4a961a719c93c086
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

guides for openssl issue in macOS

Change-Id: I61454e35db30050a4473ab9058ddcd9c7b44fcbe
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

refactor logger to make unittest possible

Change-Id: Ibb630ea34701e454aabf78821f4c40781d2607ed
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>

Merge "bugfix for grep"

Add reporter PoC

Change-Id: I5134a0d95d75fcb3a75267a5f20b4ace8638156a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Cover also tests folder"

Merge "Add Api Basic framework skeleton"

bugfix for grep

Change-Id: I1474a4e4f5884f17cbf3e6d62fae7e743921aae1
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>

Update tox to produce coverage report

JIRA:QTIP-204

Change-Id: If77558ed2f6e454b4abebdbb185755925d91c963
Signed-off-by: Julien <zhang.jun3g@zte.com.cn>

Add Api Basic framework skeleton

- Requirements updated to remove flask and include connexion
- Api specifications will be added to specs file in swagger/
- controllers module will handle all requests and responses

JIRA: QTIP-213

Change-Id: Icfec15ddeff7d53c53ce64910ae2bddd4fc0f260
Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>

Refactoring qtip.runner

- deprecate current PoC
- cover it with test

Change-Id: Ia1a43c195781fdd09e7d925ed3bf4509f226916f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

Merge "Refactoring qtip.base.error"

Addition of detail viewing command.

Change-Id: Ia9ad825f20b279db1852587540a2ad6cb3815e1d
Signed-off-by:Taseer Ahmed <taseer94@gmail.com>