xudan [Fri, 23 Dec 2016 01:53:31 +0000 (01:53 +0000)]
dovetail tool: bugfix CI job dovetail-merge-master fail
JIRA: DOVETAIL-156
Change-Id: I3453571568494850049eb7956387ee7e275934af
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 23 Dec 2016 01:03:55 +0000 (01:03 +0000)]
Merge "dovetail tool: flake8 support in tox"
hongbo tian [Fri, 23 Dec 2016 00:58:36 +0000 (00:58 +0000)]
Merge "dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'"
Leo Wang [Wed, 21 Dec 2016 07:34:44 +0000 (02:34 -0500)]
[dovetail tool]check and get results for each cmd
JIRA: DOVETAIL-166
Check the results of each cmds executed in test case
1. the results of pre_condition, post_condition, cmds need to be checked,
so it can get a quick fail, dont need to go through the next step
2. it's more accurate to show where error occurred as early as possible
3. get results from shell scripts
Change-Id: I5c1e59839c55b92de0e83e7e1eb552aa364b3f80
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Thu, 22 Dec 2016 01:00:04 +0000 (20:00 -0500)]
dovetail tool: flake8 support in tox
JIRA: DOVETAIL-168
Change-Id: I1659e906c8ec810b6e21cc13da4e54a06d5ab80b
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Tue, 20 Dec 2016 10:20:08 +0000 (05:20 -0500)]
dovetail tool: fully tox supported
JIRA: DOVETAIL-165
1, fully tox supported
2, previous easy setup abandoned
3, CI verify job changed accordingly
4, unittest bug fix
this should merge after
https://gerrit.opnfv.org/gerrit/#/c/26297/
results see
https://etherpad.opnfv.org/p/dovetail_report
Change-Id: I52ce3999fcde7e817854e4a39f4111eef081bc78
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 21 Dec 2016 07:07:04 +0000 (07:07 +0000)]
Merge "updated the process flow of function exec_cmd"
xudan [Wed, 21 Dec 2016 06:54:00 +0000 (06:54 +0000)]
dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'
JIRA: DOVETAIL-167
Change-Id: Ieb35f6aa2a6868af7d6dad5727bb3b345709275a
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Tue, 20 Dec 2016 11:27:28 +0000 (11:27 +0000)]
Merge "bugfix for duration missed"
MatthewLi [Tue, 20 Dec 2016 10:52:12 +0000 (05:52 -0500)]
dovetail tool: .cache added in gitignore
please see
https://gerrit.opnfv.org/gerrit/#/c/26299/
patch set 3
Change-Id: I32dd107e0e8704482e1cdb659a02b774cb7d8482
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Mon, 19 Dec 2016 01:48:56 +0000 (20:48 -0500)]
bugfix for duration missed
JIRA: DOVETAIL-162
Change-Id: Idc78790e49ab3e3552d45b902cfdf8cc37fd2847
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Mon, 19 Dec 2016 03:01:05 +0000 (03:01 +0000)]
Merge "dovetail tool: bugfix about setup dovetail"
hongbo tian [Mon, 19 Dec 2016 03:00:56 +0000 (03:00 +0000)]
Merge "dovetail tool: move conf/dovetail_config.py into utils/"
Leo Wang [Fri, 16 Dec 2016 07:19:28 +0000 (02:19 -0500)]
[dovetail tool] fetch openstack rc files without installer info
JIRA: DOVETAIL-157
dovetail tool must not depend on any installers or any SUT, so openstack rc files need to be provided to eliminate this dependency.
1. input parameters "SUT_IP"/"SUT_TYPE" must be optional, may be finally will be removed
2. new parameter "creds" to specify the file used to get access to openstack of SUT
Change-Id: I877efb2a6abc198c32ed6d52b9418a35597d5867
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
Ryan.RCS [Fri, 16 Dec 2016 10:06:19 +0000 (10:06 +0000)]
updated the process flow of function exec_cmd
separate the log expressions to other functions
removed statements that not necessary
output error detail info in exception
Change-Id: I721611d61dee83eb5f40ee954d433073114e231a
JIRA: DOVETAIL-161
Signed-off-by: Ryan.RCS <lihainong@huawei.com>
hongbo tian [Fri, 16 Dec 2016 03:25:34 +0000 (03:25 +0000)]
Merge "dovetail tool: document for dovetail CLI"
xudan [Fri, 16 Dec 2016 00:41:25 +0000 (00:41 +0000)]
dovetail tool: show progress during executing test cases
1. the utils exec_cmd() will take a long time for some cmds such as executing
test cases and pull images.
2. if the time is longer than 3 seconds, progress bar will be shown on the
screen.
JIRA: DOVETAIL-159
Change-Id: I4ae04d6e884853d843baf8f547394247f4165377
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 15 Dec 2016 02:09:35 +0000 (02:09 +0000)]
dovetail tool: bugfix about setup dovetail
1. change the entry_points of setup.cfg into dovetail.run:main
2. after setup the command 'dovetail -d true --testsuite debug' can just be
successfully executed under folder dovetail/dovetail. That is mainly because
of the load functions of testcase.py using relative paths.
3. using absolute path instead of relative path can support the command
successfully executed under any path.
JIRA: DOVETAIL-154
Change-Id: I4a2ad39a1a60e7e63efc55515781d27b823aa894
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Thu, 15 Dec 2016 01:14:06 +0000 (01:14 +0000)]
Merge "add example test area"
hongbo tian [Thu, 15 Dec 2016 01:10:19 +0000 (01:10 +0000)]
Merge "dovetail tool: fix docker version of client mismatches with server in Docker image"
Leo Wang [Thu, 15 Dec 2016 01:04:37 +0000 (20:04 -0500)]
add example test area
1. use this config to support example test case
Change-Id: I3fda73c408ed4b2bfb75aac52e0292fa4de9161b
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
xudan [Wed, 14 Dec 2016 09:18:10 +0000 (09:18 +0000)]
dovetail tool: move conf/dovetail_config.py into utils/
1. move conf/dovetail_config.py into utils/
2. change the open file path in dovetail_config.py
3. do some modification about all 'from conf.dovetail_config import ***'
JIRA: DOVETAIL-158
Change-Id: I7670e6de993899e4e2a604cbc501dc3339896ef1
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Wed, 14 Dec 2016 09:24:15 +0000 (09:24 +0000)]
Merge "[dovetail tool] support shell scripts for testcase validation"
Leo Wang [Wed, 14 Dec 2016 09:20:09 +0000 (04:20 -0500)]
[dovetail tool] support shell scripts for testcase validation
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I5c049a71f11cca71a7914f8af704c1983aba3dca
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
hongbo tian [Wed, 14 Dec 2016 08:16:05 +0000 (08:16 +0000)]
Merge "dovetail tool: improve cli to update non-envs automatically"
Leo Wang [Wed, 14 Dec 2016 07:48:16 +0000 (02:48 -0500)]
[dovetail tool] support shell scripts for testcase validation
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I60c1b54335b94e0cb150232432adb958b8f5a143
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Wed, 14 Dec 2016 02:57:38 +0000 (21:57 -0500)]
dovetail tool: fix docker version of client mismatches with server in Docker image
JIRA: DOVETAIL-160
errors see
https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-arm-pod3-debug-master/4/console
Change-Id: I812453fa7ac26cfdf66609c1ca4ac96e29ca7e02
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
xudan [Fri, 2 Dec 2016 08:58:16 +0000 (08:58 +0000)]
dovetail tool: improve cli to update non-envs automatically
1. modify cmd_config.yml
a. change 'env' and 'non-env' into 'config' and 'control'
b. add subsection 'path' for each block in 'config'
c. delete 'DEPLOY_SCENARIO' and 'DEPLOY_TYPE'
d. use 'func_tag' and 'yard_tag' to control container's tag
2. if cmd in config
a. if its path is envs, it will be used to update envs in dovetail_config
b. if its path is non_envs, it will be used to update other value in the dict
JIRA: DOVETAIL-70
Change-Id: I1cf9bfcd1a19294a390a85bce6e458ce50672b7f
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Wed, 14 Dec 2016 01:23:19 +0000 (01:23 +0000)]
Merge "bugfix of document error"
MatthewLi [Mon, 12 Dec 2016 09:19:24 +0000 (04:19 -0500)]
bugfix of document error
JIRA: DOVETAIL-155
errors can refer to
https://build.opnfv.org/ci/job/opnfv-docs-verify-master/3727/console
Change-Id: I19e96239c8183bafca731477723615caff71388b
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Leo Wang [Tue, 29 Nov 2016 09:21:40 +0000 (04:21 -0500)]
[dovetail tool] support shell scripts for testcase validation
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I45dca6b8dbd888757da163189d261f6e4dba5034
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Tue, 13 Dec 2016 06:23:11 +0000 (01:23 -0500)]
bugfix for flake8 format
error log see https://build.opnfv.org/ci/view/dovetail/job/dovetail-merge-master/58/console
Change-Id: I7f5a7f290d82e79249561322259aa5e72186e126
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Tue, 13 Dec 2016 06:14:07 +0000 (06:14 +0000)]
Merge "[WIP] Migrate to tox based environment"
Leif Madsen [Fri, 28 Oct 2016 09:59:53 +0000 (05:59 -0400)]
[WIP] Migrate to tox based environment
Migrate the custom setup.py to a more formal setup
environment using tox, in the same way that OpenStack
configures their projects.
Adds metadata to tox.ini from the setup.py file, and breaks
out the dependencies from setup.py into requirements.txt
and test-requirements.txt.
Executes flake8 testing for pep8 coverage.
Defaults to using Python 2 for the environment.
Change-Id: Ieaea7d9f3dc227febd8fb1dc9142d478ba197a92
Signed-off-by: Leif Madsen <lmadsen@redhat.com>
Signed-off-by: zshi <zshi@redhat.com>
hongbo tian [Tue, 13 Dec 2016 01:54:06 +0000 (01:54 +0000)]
Merge "Add more document and fix dockerfile for CentOS"
hongbo tian [Tue, 13 Dec 2016 01:53:21 +0000 (01:53 +0000)]
Merge "dovetail tool: add debug option to control the log level showing in screen"
MatthewLi [Fri, 9 Dec 2016 08:31:28 +0000 (03:31 -0500)]
[dovetail tool]: move config info from .py to config .yml file
JIRA: DOVETAIL-145
Change-Id: Ia9b3c678f1a491e5daf2d280f05904ead3b0a296
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Tomofumi Hayashi [Wed, 7 Dec 2016 15:19:46 +0000 (00:19 +0900)]
Add more document and fix dockerfile for CentOS
Add how to build container from dockerfile and add missing config
for CentOS dockerfile. This fix is verified that functest/yeardstick
are called successfully under debug/proposed_tests testsuite.
Change-Id: Icb31331ecd78b8fccd69ac960c24340b605e54bf
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
MatthewLi [Thu, 10 Nov 2016 02:44:51 +0000 (21:44 -0500)]
2 config files description documents
JIRA: DOVETAIL-50
Change-Id: I65c618ce3de78677b9e66a1c2d7f0af705e80cfb
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 7 Dec 2016 13:58:23 +0000 (13:58 +0000)]
Merge "[RFC]Add dockerfile to support dovetail in CentOS"
hongbo tian [Wed, 7 Dec 2016 13:53:00 +0000 (13:53 +0000)]
Merge "Copy the jumphost ssh key into the container"
xudan [Wed, 7 Dec 2016 06:21:58 +0000 (06:21 +0000)]
dovetail tool: document for dovetail CLI
1. document for developers about how to add or delete commands by modifying
cmd_config.yml file.
2. document for users about how to run dovetail tool with CLI
JIRA: DOVETAIL-25
Change-Id: Iecf9d7a230e694bdda5634a87f7e5ddf7b7a57fd
Signed-off-by: xudan <xudan16@huawei.com>
Dan Radez [Tue, 6 Dec 2016 14:17:17 +0000 (09:17 -0500)]
Copy the jumphost ssh key into the container
When functest runs against Apex it needs to ssh from the container
to the undercloud to get the keystonerc file so it can authenticate
to the overcloud.
Change-Id: Iea3273d4d1611733f167ffab0b2a75330c413edc
Signed-off-by: Dan Radez <dradez@redhat.com>
Tomofumi Hayashi [Wed, 30 Nov 2016 02:44:44 +0000 (11:44 +0900)]
[RFC]Add dockerfile to support dovetail in CentOS
JIRA: DOVETAIL-151
This diff introduces an optional dovetail dockerfile based on CentOS.
It provides users to have an alternative way to execute dovetail.
It should be just a optional, so we should keep docker/Dockerfile
as official one with dockerhub's image and we do not build docker images
in CI phase for now.
Change-Id: Ia694bcd49f65ff2bc175c1da3b42fbfa19b022a1
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
Signed-off-by: Zenghui Shi <zshi@redhat.com>
xudan [Mon, 5 Dec 2016 08:28:20 +0000 (08:28 +0000)]
dovetail tool: add unit test into script unittest.sh
1. Since JIRA: DOVETAIL-55 has been merged, unit tests can't pass without
load_config_files().
2. Fix the bug by adding load_config_files().
3. Add run_tests() into script unittest.sh to include all unit tests in
tests/unit.
JIRA: DOVETAIL-149
Change-Id: I7bdb0732fefde3a3f3b82441b4cc7e46ece66a1e
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 1 Dec 2016 06:38:51 +0000 (06:38 +0000)]
dovetail tool: add debug option to control the log level showing in screen
1. add debug option in cmd_config.yml for controling log showing in screen.
2. rename existent DEBUG as CON_DEBUG because it is used for functest/yardstick
container to control the log level.
3. fix the bug in function update_config_envs(). If one key is not in system's
envs, os.environ[key] get an error with ErrorKey.
JIRA: DOVETAIL-148
Change-Id: If3d75109f51e2e91743b8f1134a76da42e57383a
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 2 Dec 2016 17:43:00 +0000 (17:43 +0000)]
Merge "dovetail tool: reorganize statements in class DovetailConfig"
hongbo tian [Fri, 2 Dec 2016 17:42:46 +0000 (17:42 +0000)]
Merge "dovetail tool: add brackets to print message for consistency"
hongbo tian [Fri, 2 Dec 2016 17:42:10 +0000 (17:42 +0000)]
Merge "dovetail tool: fix unittest bugs"
hongbo tian [Fri, 2 Dec 2016 17:41:37 +0000 (17:41 +0000)]
Merge "[WIP] dovetail report improvement"
MatthewLi [Fri, 2 Dec 2016 03:29:26 +0000 (22:29 -0500)]
[WIP] dovetail report improvement
JIRA: DOVETAIL-49
1)details please refer to
https://wiki.opnfv.org/display/dovetail/Dovetail+Reports
2)results please refer to one example
https://etherpad.opnfv.org/p/dovetail_report
Change-Id: I63a1ba3b6aa1ffe5fa043a11cd3777dd0e8d52d9
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Thu, 1 Dec 2016 01:53:22 +0000 (20:53 -0500)]
bugfix: Add BRANCH Argument in the Dockerfile
JIRA: DOVETAIL-147
1) BRANCH argument added to fix bug in CI
2) docker to use latest version, since BRANCH added not works with old version
Change-Id: Icb0144896389b0cb7ac80e1fb0338825be50d5b1
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
zshi [Wed, 30 Nov 2016 07:12:28 +0000 (15:12 +0800)]
dovetail tool: fix unittest bugs
JIRA: DOVETAIL-143
1) fix unittest import module path
2) add create_log in setup
Change-Id: Ic894fa971b4a5091affb36e8e6aac05e0e8623fb
Signed-off-by: zshi <zshi@redhat.com>
hongbo tian [Wed, 30 Nov 2016 03:03:09 +0000 (03:03 +0000)]
Merge "dovetail tool: run.py execution always wipes of results files"
wu.zhihui [Tue, 29 Nov 2016 10:02:15 +0000 (18:02 +0800)]
dovetail: modify process flow in function update_envs()
bugfix task DOVETAIL-144
1. If run command "python run.py" without options, e.g. --SUT_TYPE, --SUT_IP,
env values will be updated by os enviromental parameter.
2. If run command "python run.py" with options, no update from os enviromental
parameter.
JIRA: DOVETAIL-144
Change-Id: Id3bde7546722a5f4defe52d4f00609d7049a288b
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
hongbo tian [Wed, 30 Nov 2016 01:23:40 +0000 (01:23 +0000)]
Merge "fix flake8 test error for ez_setup.py"
xudan [Sat, 26 Nov 2016 08:19:21 +0000 (08:19 +0000)]
dovetail tool: run.py execution always wipes of results files
1. move function clean_results_dir() into run.py
2. call this function at the beginning of function main()
3. this can only work correctly after all log initializations packaged,
see JIRA: DOVETAIL-56 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24059/
JIRA: DOVETAIL-80
Change-Id: I1cdda8f6d43f21c45c0537868cb7ed10d14ea9df
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Sat, 26 Nov 2016 08:43:47 +0000 (08:43 +0000)]
dovetail tool: reorganize statements in class DovetailConfig
1. move some statements in class DovetailConfig into function
load_config_files()
2. call load_config_files() in run.py
3. this can only work correctly after moving clean_results_dir() into run.py,
see JIRA:DOVETAIL-80 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24929/
JIRA: DOVETAIL-55
Change-Id: I217c1c21dc6ba8849da7c00564f62d3c22cdc391
Signed-off-by: xudan <xudan16@huawei.com>
MatthewLi [Tue, 29 Nov 2016 02:25:35 +0000 (21:25 -0500)]
dovetail tool: To exec testsuite loading after command line arguments is True
JIRA: DOVETAIL-142
Change-Id: I1d8a444580755b4f4d9a0f7098b4b17ea66d6f58
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Tue, 29 Nov 2016 02:22:49 +0000 (02:22 +0000)]
Merge "dovetail tool: change CI_DEBUG to DEBUG"
xudan [Tue, 8 Nov 2016 11:43:28 +0000 (11:43 +0000)]
dovetail tool: package all logger initialization
1. For container.py, parser.py, report.py and testcase.py, they use functions
in classes to create loggers. So each class will have its own logger.
2. run.py will create all the loggers by create_logs() function before the use
of them. So logs will not be initialized until the call of create_logs().
3. Move logger in run.py into function main().
JIRA: DOVETAIL-56
Change-Id: I53de090df270cc7a34762ff99cbc9115cfb09465
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Tue, 29 Nov 2016 01:31:04 +0000 (01:31 +0000)]
Merge "dovetail tool: testarea argument added"
hongbo tian [Mon, 28 Nov 2016 08:27:25 +0000 (08:27 +0000)]
Merge "Backend rest api mechanism"
zshi [Mon, 28 Nov 2016 05:26:20 +0000 (13:26 +0800)]
dovetail tool: add brackets to print message for consistency
Change-Id: I74c0aefb7ada960aac55aed15aab6b7b9984154e
Signed-off-by: zshi <zshi@redhat.com>
zshi [Mon, 28 Nov 2016 04:49:19 +0000 (12:49 +0800)]
fix flake8 test error for ez_setup.py
Change-Id: Ibb764a41bac05599645d283c5fe3dbe409b2b006
Signed-off-by: zshi <zshi@redhat.com>
zshi [Mon, 28 Nov 2016 03:00:35 +0000 (11:00 +0800)]
dovetail tool: change CI_DEBUG to DEBUG
JIRA: DOVETAIL-42
1) change 'CI_DEBUG' to 'DEBUG' in cmd_config.yml
and dovetail_logger.py
2) assign 'DEBUG' env value to 'CI_DEBUG' when
updating functest and yardstick parameter 'envs'
Change-Id: I6d6130e394fddf11d83be619f2c9684bf8c859f9
Signed-off-by: zshi <zshi@redhat.com>
MatthewLi [Thu, 24 Nov 2016 06:56:41 +0000 (01:56 -0500)]
dovetail tool: testarea argument added
JIRA: DOVETAIL-71
1) argument testarea is added
2) terminology "scenario" change to "testsuite"
3) related documents amended
4) all word "certification" changed to "compliance"
Change-Id: I038a9e04bf83cfdac20f0c59adb1841bf5470584
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Fri, 25 Nov 2016 08:00:12 +0000 (08:00 +0000)]
Merge "dovetail tool: reorganize dovetail_config.py and modify related files"
Leo Wang [Thu, 24 Nov 2016 08:10:14 +0000 (03:10 -0500)]
[Dovetail Tool] Prepare env fail due to dependency on pyyaml
JIRA:DOVETAIL-92
root cause:
1. import dovetail_logger while it depends on dovetail_config
2. dovetail_config import yaml
3. yaml is not installed yet
action:
1. remove dovetail_logger
Change-Id: I51f5e8bab2451639a4a9ebf1978fe8a292df1704
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
Leo Wang [Thu, 17 Nov 2016 03:44:23 +0000 (22:44 -0500)]
Backend rest api mechanism
JIRA:DOVETAIL-63
provide rest api as the dashboard backend
1. using gunicorn as rest api server
2. using flask as rest api framework
3. using sqlalchemy as mysql database driver
4. implement basic report CRUD operations
5. implement basic session management in database operations
Change-Id: Ifbd251462396c2cb414b1ae9150cfc1e2e2d00c0
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
xudan [Thu, 17 Nov 2016 02:11:30 +0000 (02:11 +0000)]
dovetail tool: upstream functest env preparation and CLI adaption
1. Functest has changed it's directory structure, so cmds in
functest_config.yml cannot run successfully.
2. Use functest CLI to prepare and run test cases instead of running
prepare_env.py or run_tests.py.
JIRA: DOVETAIL-40
Change-Id: I7907dd70fd671efbed5f4132c0d76d6eb90b63eb
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Wed, 9 Nov 2016 06:26:11 +0000 (06:26 +0000)]
dovetail tool: reorganize dovetail_config.py and modify related files
1. move all sentencs and functions into class DovetailConfig
2. delete dict container_config for it has been replaced by dovetail_config
2. modify files that import dovetail_config, including container.py, parser.py,
report.py, run.py, dovetail_logger.py and testcase.py
JIRA: DOVETAIL-55
Change-Id: Ib5ca3cadd751075c879f39e8cb2eb2e0adcef6aa
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Wed, 16 Nov 2016 08:00:54 +0000 (08:00 +0000)]
Merge "Fix option handling in case of no '--tag' option."
hongbo tian [Wed, 16 Nov 2016 08:00:31 +0000 (08:00 +0000)]
Merge "dovetail tool: cleanup the result directory before running"
xudan [Wed, 16 Nov 2016 02:33:49 +0000 (02:33 +0000)]
dovetail tool: cleanup the result directory before running
1. Jenkins will fail with error
rm: cannot remove '/home/opnfv/dovetail/results': Device or resource busy
2. The reason is that Jenkins will mount this directory before running
3. The effective solution is removing all contents in this directory rather
than removing this mounted directory
JIRA: DOVETAIL-38
Change-Id: Ic32ea19341ad2048322ec11a4abc48e13019a7bb
Signed-off-by: xudan <xudan16@huawei.com>
Linghui Zeng [Mon, 14 Nov 2016 02:29:21 +0000 (10:29 +0800)]
dovetail tool: replace the hard-coded "Tescase" and modify some classmethod
JIRA: DOVETAIL-45
1. In the testcase.py file, we replace the hard-coded "Tesecase" with "cls" or "self" based on
the specific contexts.
2. For all the four committed files, we modify some classmethod into staticmethod because each
method is basically just a function, called syntactically like a method, but without access
to the object and its' internals (attributes and other methods).
Change-Id: Ieb452f476a2d33ae9aca4c904ae7d2c92b68689e
Signed-off-by: Linghui Zeng <linghui.zeng@huawei.com>
Tomofumi Hayashi [Tue, 15 Nov 2016 09:26:29 +0000 (18:26 +0900)]
Fix option handling in case of no '--tag' option.
In case of default, 'None' is in kwargs['tag'] so need to
check it in option handling. The code is to fix it.
Change-Id: Iaadf7e6f0f064dda819970346a810a6a8b47c74c
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
hongbo tian [Tue, 15 Nov 2016 08:45:06 +0000 (08:45 +0000)]
Merge "dovetail tool: reorganize prepare_env.py"
hongbo tian [Tue, 15 Nov 2016 08:44:17 +0000 (08:44 +0000)]
Merge "generate report data for reuse"
hongbo tian [Tue, 15 Nov 2016 08:43:55 +0000 (08:43 +0000)]
Merge "Add "docker tag" option for each testcase containers."
Leo Wang [Thu, 10 Nov 2016 09:29:07 +0000 (04:29 -0500)]
generate report data for reuse
JIRA: DOVETAIL-22
1. report text is string, can not be reused by other module,
2. generate report data first, then this data can be uploaded
to database or be translated to report text
Change-Id: Ieecd87c827537c825c87a0db4ff170ae490d75ae
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
xudan [Thu, 10 Nov 2016 07:30:15 +0000 (07:30 +0000)]
dovetail tool: reorganize prepare_env.py
1. add main function and move statements into it
JIRA: DOVETAIL-57
Change-Id: I69158fa64ffc10668fc39835de434f0b44b8754a
Signed-off-by: xudan <xudan16@huawei.com>
Tomofumi Hayashi [Thu, 10 Nov 2016 05:49:46 +0000 (14:49 +0900)]
Add "docker tag" option for each testcase containers.
JIRA: DOVETAIL-69
This commit is to add new option to specify docker tags for
each test containers, such as '--TAG "functest:stable"'.
Change-Id: Ica11e16abfb21649a3eea9c7d7d5cd31502d2e21
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
MatthewLi [Tue, 1 Nov 2016 12:01:51 +0000 (08:01 -0400)]
dovetail tool: 2 config files, compliance_set and proposed_tests
JIRA: DOVETAIL-50
1)'proposed_tests.yml' is added, which runs as the total tests run.
The 'compliance_set.yml' will run as dovetail certification tests;
2)ipv6 test cases added accroding to 'docs/testsuites/ipv6/ipv6_all_testcases',
tc026 missed temporarily,yardstick ipv6tc026 only supports 2 installers by now
according to https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases
3)vimops001-006 added for VIM images operation test cases
4)nfvi001-002 added for vping ssh/userdata in fucntest
5)more test cases can be added in future in proposed_tests.yml,
besides, the test cases can be adjusted in future in proposed_tests.yml
Change-Id: I8a8634583549a802f6f64fbea651e7be4efa361c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 9 Nov 2016 07:16:29 +0000 (07:16 +0000)]
Merge "dovetail tool: ensure sub_testcase_list and testcase are not None"
hongbo tian [Wed, 9 Nov 2016 07:15:50 +0000 (07:15 +0000)]
Merge "dovetail tool: os name bugfix"
hongbo tian [Wed, 9 Nov 2016 07:15:18 +0000 (07:15 +0000)]
Merge "dovetail tool: cleanup result directory before running"
MatthewLi [Mon, 7 Nov 2016 08:03:06 +0000 (03:03 -0500)]
dovetail tool: os name bugfix
JIRA: DOVETAIL-54
bug: in some envs, return value platform_os is Ubuntu rather than ubuntu.
Change-Id: I6a2aa964d00eff9f336f8204071a05a6b5f11134
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
zshi [Thu, 3 Nov 2016 08:46:19 +0000 (16:46 +0800)]
dovetail tool: ensure sub_testcase_list and testcase are not None
JIRA: DOVETAIL-52
1) save return value of testcase.sub_testcase() in sub_testcase_list
for multiple calls later
2) ensure sub_testcase_list is not called with None value
3) ensure testcase is not called with None value
4) identify None testcase with 'Undefined' in dovetail_report.txt
Change-Id: Ifcf0c0846dc788575310f29932a4757752f1e3a3
Signed-off-by: zshi <zshi@redhat.com>
hongbo tian [Thu, 3 Nov 2016 07:40:28 +0000 (07:40 +0000)]
Merge "dovetail tool: Add cli mechanism for changing envs at run-time"
hongbo tian [Thu, 3 Nov 2016 07:40:15 +0000 (07:40 +0000)]
Merge "dovetail tool: rename report_file_path variable"
hongbo tian [Thu, 3 Nov 2016 07:40:04 +0000 (07:40 +0000)]
Merge "dovetail tool: Cleanup functest_conf.yml"
hongbo tian [Thu, 3 Nov 2016 07:39:52 +0000 (07:39 +0000)]
Merge "Add more distro support when preparing environment"
hongbo tian [Thu, 3 Nov 2016 07:39:35 +0000 (07:39 +0000)]
Merge "dovetail tool: ignore file amended"
xudan [Wed, 26 Oct 2016 02:27:12 +0000 (02:27 +0000)]
dovetail tool: cleanup result directory before running
JIRA: DOVETAIL-38
1. Do cleaning at the beginning of each run.
2. Since some files and folders have the 'root root' privilege,
no command except cmd 'sudo rm -rf <results_dir>' can work.
Change-Id: If8cd5c8c9c35434af2a5fa38575c06f83f0afc4d
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Fri, 21 Oct 2016 08:03:43 +0000 (08:03 +0000)]
dovetail tool: Add cli mechanism for changing envs at run-time
JIRA: DOVETAIL-23
1. Add file cmd_config.yml for defining arguments and options.
2. Using python click module to add and parse cmds in cmd_config.yml
3. Using envs options to update envs in yardstick/functest config file
Change-Id: Ie513c0f0a1ed76f29408419a4bcbbcf21334bb3f
Signed-off-by: xudan <xudan16@huawei.com>
MatthewLi [Thu, 20 Oct 2016 03:49:49 +0000 (23:49 -0400)]
dovetail tool: ignore file amended
JIRA: DOVETAIL-37
1)as much as possible to stay the same
2)*.mo deleted since no C used in this repo
3)unittest-log.txt added, it can be produced by using unittest.sh -f
4)document related added, including *.sw?, CI related /docs_build/ /docs_ouput/, results dir
5)other personal habit will not included in this
Change-Id: I1e3c95d74f99c212838a987f1705af3902f6f58d
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
mathsyouth [Sat, 29 Oct 2016 08:53:47 +0000 (16:53 +0800)]
dovetail tool: Add unit tests for 'parser' module
JIRA: DOVETAIL-45
1. Add two '__init__.py' files for packages
2. Add two test functions in 'test_parser.py' to verify the function
of the method 'parser_cmd'
3. 'test_testcase.yaml' is used in 'test_parser.py'
Change-Id: Ic3e2e6e67bcac3276fe47ec5584c0d9632b5286a
Signed-off-by: mathsyouth <linghui.zeng@huawei.com>
zshi [Fri, 28 Oct 2016 04:57:46 +0000 (12:57 +0800)]
dovetail tool: Cleanup functest_conf.yml
JIRA: DOVETAIL-43
JIRA: DOVETAIL-44
1) remove result_dir
2) remove pre_cmd, exec_cmd, post_cmd
Change-Id: Iea8173026b1f467011a40c6954581f25cd5e1912
Signed-off-by: zshi <zshi@redhat.com>
hongbo tian [Fri, 28 Oct 2016 05:54:43 +0000 (05:54 +0000)]
Merge "dovetail tool: developer userguide document"