MatthewLi [Mon, 27 Mar 2017 12:17:55 +0000 (08:17 -0400)]
dovetail tool: offline support
JIRA: DOVETAIL-164
usage:
dovetail run --testsuite <testsuite> --offline
1,if --offline given, can run offline by using local docker images
(if there is no images, will get an error in log, images can be
pulled from dockerhub or downloaded from artifacts.opnfv.org )
2,if --offline not given, will run online, which means
pull docker image from dockerhub
Change-Id: I87ab35c82e59fb13a7a88c38d233e89285efc4d3
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
xudan [Wed, 22 Mar 2017 07:51:37 +0000 (07:51 +0000)]
dovetail tool: Add an option cmd for pushing results into DB
JIRA: DOVETAIL-373
1. add an option --report/-r to choose the report type.
2. "-r file" will store results with files.
3. "-r http://192.168.135.2:8000/api/v1" will push results into DB.
The DB url can replaced by user's local DB or official DB.
4. Default report type is defined as "report_dest" in dovetail_config.yml.
5. Yardstick can't push results of one testcase into DB now, so both "-r file"
and "-r http://..." will be regarded as "file".
Change-Id: Ieaa017ab59c5b15235bf306ef57cdc56beb22af8
Signed-off-by: xudan <xudan16@huawei.com>
Leo Wang [Thu, 23 Mar 2017 01:40:58 +0000 (21:40 -0400)]
Launch a local TESTAPI DB instance
JIRA: DOVETAIL-374
User may want to dry run the test, and does not intend to upload test results to OPNFV DB.
So dovetail provide a way to launch a local TESTAPI DB instance, then user can upload test results to this local db, and browse test results locally.
Change-Id: I17b6153c9a308bd3cd59a2450c415200496cb855
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Thu, 23 Mar 2017 07:34:27 +0000 (03:34 -0400)]
bugfix of package error
JIRA: DOVETAIL-376
Change-Id: I91e0efff01d445e3f74718d730c8ff48c6413b26
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 22 Mar 2017 09:18:57 +0000 (09:18 +0000)]
Merge "dovetail tool: Bugfix about the prepare_env of yardstick and get the yardstick.log"
xudan [Fri, 17 Mar 2017 09:23:45 +0000 (09:23 +0000)]
dovetail tool: remove installer and CI related variables
JIRA: DOVETAIL-371
1. remove all the envs in functest_config.yml and yardstick_config.yml
2. remove all relative cmds in cmd_config.yml
3. remove all the envs when running a new functest/yardstick container
4. add some variables just for functest pushing results to db
5. get the external network name for yardstick
6. make --debug/-d just control the log level shown on the screen
7. set requests=2.10.0 since python-openstackclient needs
'requests!=2.12.2,!=2.13.0,>=2.10.0'
Change-Id: I9f941e09d067fc95a14c3c9be1374f41df4a9a16
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Fri, 3 Mar 2017 03:48:11 +0000 (03:48 +0000)]
dovetail tool: Bugfix about the prepare_env of yardstick and get the yardstick.log
1. For Fuel, yardstick prepare_env.sh will fail when
pwd != /home/opnfv/repos/yardstick
2. Modify yardstick_config.yml in Dovetail to change pwd to that path.
3. Use log file /tmp/yardstick/yardstick.log created by cmd "yardstick task start"
rather than redirecting the console output to yardstick.log.
JIRA: DOVETAIL-363
Change-Id: Ie0475cfabc66e342be868f0924a5fccd6fa74b58
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Wed, 15 Mar 2017 10:17:08 +0000 (10:17 +0000)]
dovetail tool: change name of credentials from creds to openrc
1. change file name from openstack.creds to openrc.sh
2. change the cmd --creds to --openrc/-o
3. now the path of --openrc can be relative path no restrict to abspath
4. remove the useless "work_dir" in dovetail_config.yml
JIRA: DOVETAIL-369
JIRA: DOVETAIL-367
Change-Id: I2592438eef060f84132ff7fa226aea93ea947362
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 24 Feb 2017 07:51:43 +0000 (07:51 +0000)]
Merge "dovetail tool: bugfix for dovetail report and docker build"
xudan [Tue, 21 Feb 2017 01:57:36 +0000 (01:57 +0000)]
dovetail tool: Bugfix about the creds path in yardstick conf file
JIRA: DOVETAIL-355
Change-Id: I04a74caa080e0fd2ea11648f8085947ef8d556b1
Signed-off-by: xudan <xudan16@huawei.com>
MatthewLi [Mon, 20 Feb 2017 06:28:24 +0000 (01:28 -0500)]
dovetail tool: bugfix for dovetail report and docker build
JIRA: DOVETAIL-353
JIRA: DOVETAIL-354
related patch: https://gerrit.opnfv.org/gerrit/#/c/29049/
Change-Id: Ic871abbda62dead7cf5e23e6117c9885d637c7fb
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Sat, 18 Feb 2017 03:01:05 +0000 (03:01 +0000)]
Merge "dovetail tool: skip testcase status added"
xudan [Fri, 17 Feb 2017 09:49:16 +0000 (09:49 +0000)]
dovetail tool: change the way to get the functest result file
Functest has changed it's way to generate the local result file.
see Gerrit: https://gerrit.opnfv.org/gerrit/#/c/28513/
Dovetail needs to do some adaptions to fit this change.
JIRA: DOVETAIL-350
Change-Id: I681f74832f582f26c8874f7d2726c8588f430612
Signed-off-by: xudan <xudan16@huawei.com>
MatthewLi [Wed, 8 Feb 2017 07:52:27 +0000 (02:52 -0500)]
dovetail tool: skip testcase status added
JIRA: DOVETAIL-344
1) testcase status, True/False --> PASS/SKIP/FAIL,
so skipped testcase in tempest can be figured out
details can be seen in
https://etherpad.opnfv.org/p/dovetail_report
2) some variable name changed more readable, such as
passed-->testcase_passed failed--> prepare_failed
3) "dovetail report" minor amend according to 1)
Change-Id: Ibe8e50693fc474d78e7d0fb89257f34703248579
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 8 Feb 2017 03:11:00 +0000 (03:11 +0000)]
Merge "dovetail tool: use python new-style classes which inherit from object"
hongbo tian [Tue, 7 Feb 2017 11:37:33 +0000 (11:37 +0000)]
Merge "bugfix of dovetail tool userguide document"
hongbo tian [Tue, 7 Feb 2017 11:35:53 +0000 (11:35 +0000)]
Merge "dovetail tool: report.py bugfix and tempest skipped testcase added"
MatthewLi [Sat, 4 Feb 2017 06:32:43 +0000 (01:32 -0500)]
dovetail tool: report.py bugfix and tempest skipped testcase added
JIRA: DOVETAIL-343
1, bugfix
https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-debug-master/lastSuccessfulBuild/artifact/results/dovetail_report.txt
test result error
2, skipped testcase in tempest added
3, two testcase in tempest full testsuite added in debug.yml to debug
Change-Id: I6bf371d3384e3755d6a41d951cfc9d1a55e00ab3
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Tue, 7 Feb 2017 08:00:46 +0000 (03:00 -0500)]
bugfix of dovetail tool userguide document
Change-Id: I33eea93ca0db018a5f79041152516fa48b94ba46
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
xudan [Fri, 3 Feb 2017 03:52:11 +0000 (03:52 +0000)]
dovetail tool: bugfix: cannot load pre/post condition from config file
JIRA: DOVETAIL-342
Change-Id: If98905b6724c0a990d789a7ce914aeecac72d7c4
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Thu, 26 Jan 2017 04:42:48 +0000 (04:42 +0000)]
Merge "Change to use "pip install -r requirements.txt" to install deps."
MatthewLi [Thu, 19 Jan 2017 07:07:16 +0000 (02:07 -0500)]
dovetail tool: functest different testsuite support and yardstick testcase added
JIRA: DOVETAIL-186
Change-Id: Id0eec6652c9595c660436dec89a309a77b16bc03
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Tomofumi Hayashi [Fri, 20 Jan 2017 04:10:50 +0000 (13:10 +0900)]
Change to use "pip install -r requirements.txt" to install deps.
At the change of DOVETAIL-183, dovetail uses requirements.txt to
install python dependency file so this change is following it.
Change-Id: I6cb2420274f385224b517950ddfdf1cf0e764350
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
hongbo tian [Mon, 23 Jan 2017 07:52:38 +0000 (07:52 +0000)]
Merge "dovetail tool userguide document"
xudan [Fri, 20 Jan 2017 06:46:57 +0000 (06:46 +0000)]
dovetail tool: use python new-style classes which inherit from object
JIRA: DOVETAIL-187
Change-Id: Id6fa50a3a3cec7a18d27ca8feb383b53836a339b
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Sat, 14 Jan 2017 01:27:09 +0000 (01:27 +0000)]
dovetail tool: modify function exec_cmd to force it to flush the buffer
1. force to flush the buffer line by line
2. remove the progress bar since it will stay in the screen if using the cli
command JIRA: DOVETAIL-173, which will be ugly.
JIRA: DOVETAIL-172
Change-Id: I47b823c7e0bce955a50086613a656c83ab7707e3
Signed-off-by: xudan <xudan16@huawei.com>
MatthewLi [Sat, 14 Jan 2017 09:08:13 +0000 (04:08 -0500)]
dovetail tool userguide document
JIRA: DOVETAIL-182
Change-Id: Icbfa347dda3840520484d10b9d539da9c8f1d31c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Tue, 17 Jan 2017 11:49:06 +0000 (06:49 -0500)]
bugfix for delete unnecessary file
Change-Id: I14b1556eb117d2111ebe85e73b8c33820db39a3e
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Tue, 17 Jan 2017 11:44:12 +0000 (11:44 +0000)]
Merge "dovetail tool: format improvement"
MatthewLi [Tue, 17 Jan 2017 11:12:53 +0000 (06:12 -0500)]
dovetail tool: change to git repo then pbr.version can be get inside docker
JIRA: DOVETAIL-184
Change-Id: I6d466dc34de027faab1aa74f66cc6c8e453111d1
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Mon, 16 Jan 2017 09:32:55 +0000 (04:32 -0500)]
dovetail tool: format improvement
Change-Id: Ibf0bb781c0f0b6be73526bf45231040e68510f76
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Mon, 16 Jan 2017 07:54:44 +0000 (02:54 -0500)]
dovetail tool: bugfix for pip install
JIRA: DOVETAIL-183
1)pip install [options] [-e] <local project path> ...
pip install [options] <archive url/path> ...
2)vim added in Dockerfile, which is convinience for offline usage
Change-Id: I986dc7cd3e872cf026d2e69f7298028a6cbfe9a6
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Mon, 16 Jan 2017 03:10:16 +0000 (03:10 +0000)]
Merge "dovetail tool: delete unnecessary prepare_env.py"
MatthewLi [Sat, 14 Jan 2017 06:26:00 +0000 (01:26 -0500)]
dovetail tool: delete unnecessary prepare_env.py
JIRA: DOVETAIL-181
Change-Id: I6e79467b829b4ae1d815bdb9ead0b930f0338cd2
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
wu.zhihui [Sat, 14 Jan 2017 03:52:01 +0000 (11:52 +0800)]
Update Dockerfile
- Update pip version. The version of pip which is installed
by apt-get is too low.
- use "pip install -r reuirements.txt" to install requirements
package.
Change-Id: I94f94cab58cdb0d8e926c5dfbdbf9c9a66545dac
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
hongbo tian [Sat, 14 Jan 2017 01:52:26 +0000 (01:52 +0000)]
Merge "dovetail tool: switch logging to proper usage"
MatthewLi [Thu, 5 Jan 2017 07:02:13 +0000 (02:02 -0500)]
dovetail tool: command line
JIRA: DOVETAIL-173
details please see https://wiki.opnfv.org/display/dovetail/Dovetail+Command+Line
Change-Id: Iff04b0df8c4e6310d35a45b9c8ba3c7b3b5e1105
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Wed, 11 Jan 2017 12:55:14 +0000 (07:55 -0500)]
dovetail tool: switch logging to proper usage
JIRA: DOVETAIL-178
Change-Id: Ica814d4ff634c9159e4ecca888b8cc0f6c16e624
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Tue, 10 Jan 2017 12:10:05 +0000 (12:10 +0000)]
Merge "dovetail tool: remove old image when pulling new one successfully"
MatthewLi [Mon, 9 Jan 2017 02:00:27 +0000 (21:00 -0500)]
dovetail tool: bugfix of pbr installation in requirements.txt and Dockerfile
JIRA: DOVETAIL-175
Change-Id: I1f16742a59d5b016dcef6b574df45486c244c751
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
xudan [Thu, 29 Dec 2016 07:31:32 +0000 (07:31 +0000)]
dovetail tool: remove old image when pulling new one successfully
1. split function pull_image into four functions, get_image_id, pull_image_only,
remove_image and pull_image.
2. after pulling new version of the image, remove the old one with tag <none>.
JIRA: DOVETAIL-171
Change-Id: I2d2a9d6a8bc2308d434d0a3c76aa24bf5b39bfd7
Signed-off-by: xudan <xudan16@huawei.com>
MatthewLi [Thu, 22 Dec 2016 10:59:08 +0000 (05:59 -0500)]
release tag support
JIRA: DOVETAIL-170
Change-Id: Id56e30fdb3fb5b652e2145dd406b71986997f200
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 28 Dec 2016 03:08:49 +0000 (03:08 +0000)]
Merge "dovetail tool: reorganize function prepare_cmd in testcase.py"
xudan [Wed, 21 Dec 2016 02:41:09 +0000 (02:41 +0000)]
dovetail tool: reorganize function prepare_cmd in testcase.py
1. move the common statements in prepare_cmd of class FunctestTestcase and
Testcase into parse_cmd.
JIRA: DOVETAIL-163
Change-Id: I61a0a24b47cfc9e8d49ca9c62fafbac7cce21111
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Mon, 26 Dec 2016 06:32:55 +0000 (06:32 +0000)]
Merge "dovetail tool: bugfix CI job dovetail-merge-master fail"
hongbo tian [Mon, 26 Dec 2016 06:32:31 +0000 (06:32 +0000)]
Merge "dovetail tool: bugfix functest prepare_env fail"
xudan [Fri, 23 Dec 2016 01:53:31 +0000 (01:53 +0000)]
dovetail tool: bugfix CI job dovetail-merge-master fail
JIRA: DOVETAIL-156
Change-Id: I3453571568494850049eb7956387ee7e275934af
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 23 Dec 2016 01:03:55 +0000 (01:03 +0000)]
Merge "dovetail tool: flake8 support in tox"
hongbo tian [Fri, 23 Dec 2016 00:58:36 +0000 (00:58 +0000)]
Merge "dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'"
xudan [Thu, 22 Dec 2016 05:46:10 +0000 (05:46 +0000)]
dovetail tool: bugfix functest prepare_env fail
JIRA: DOVETAIL-169
Change-Id: I7ede8713c16b084255f691505a39db122fdbe8ea
Signed-off-by: xudan <xudan16@huawei.com>
Leo Wang [Wed, 21 Dec 2016 07:34:44 +0000 (02:34 -0500)]
[dovetail tool]check and get results for each cmd
JIRA: DOVETAIL-166
Check the results of each cmds executed in test case
1. the results of pre_condition, post_condition, cmds need to be checked,
so it can get a quick fail, dont need to go through the next step
2. it's more accurate to show where error occurred as early as possible
3. get results from shell scripts
Change-Id: I5c1e59839c55b92de0e83e7e1eb552aa364b3f80
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Thu, 22 Dec 2016 01:00:04 +0000 (20:00 -0500)]
dovetail tool: flake8 support in tox
JIRA: DOVETAIL-168
Change-Id: I1659e906c8ec810b6e21cc13da4e54a06d5ab80b
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Tue, 20 Dec 2016 10:20:08 +0000 (05:20 -0500)]
dovetail tool: fully tox supported
JIRA: DOVETAIL-165
1, fully tox supported
2, previous easy setup abandoned
3, CI verify job changed accordingly
4, unittest bug fix
this should merge after
https://gerrit.opnfv.org/gerrit/#/c/26297/
results see
https://etherpad.opnfv.org/p/dovetail_report
Change-Id: I52ce3999fcde7e817854e4a39f4111eef081bc78
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 21 Dec 2016 07:07:04 +0000 (07:07 +0000)]
Merge "updated the process flow of function exec_cmd"
xudan [Wed, 21 Dec 2016 06:54:00 +0000 (06:54 +0000)]
dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'
JIRA: DOVETAIL-167
Change-Id: Ieb35f6aa2a6868af7d6dad5727bb3b345709275a
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Tue, 20 Dec 2016 11:27:28 +0000 (11:27 +0000)]
Merge "bugfix for duration missed"
MatthewLi [Tue, 20 Dec 2016 10:52:12 +0000 (05:52 -0500)]
dovetail tool: .cache added in gitignore
please see
https://gerrit.opnfv.org/gerrit/#/c/26299/
patch set 3
Change-Id: I32dd107e0e8704482e1cdb659a02b774cb7d8482
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Mon, 19 Dec 2016 01:48:56 +0000 (20:48 -0500)]
bugfix for duration missed
JIRA: DOVETAIL-162
Change-Id: Idc78790e49ab3e3552d45b902cfdf8cc37fd2847
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Mon, 19 Dec 2016 03:01:05 +0000 (03:01 +0000)]
Merge "dovetail tool: bugfix about setup dovetail"
hongbo tian [Mon, 19 Dec 2016 03:00:56 +0000 (03:00 +0000)]
Merge "dovetail tool: move conf/dovetail_config.py into utils/"
Leo Wang [Fri, 16 Dec 2016 07:19:28 +0000 (02:19 -0500)]
[dovetail tool] fetch openstack rc files without installer info
JIRA: DOVETAIL-157
dovetail tool must not depend on any installers or any SUT, so openstack rc files need to be provided to eliminate this dependency.
1. input parameters "SUT_IP"/"SUT_TYPE" must be optional, may be finally will be removed
2. new parameter "creds" to specify the file used to get access to openstack of SUT
Change-Id: I877efb2a6abc198c32ed6d52b9418a35597d5867
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
Ryan.RCS [Fri, 16 Dec 2016 10:06:19 +0000 (10:06 +0000)]
updated the process flow of function exec_cmd
separate the log expressions to other functions
removed statements that not necessary
output error detail info in exception
Change-Id: I721611d61dee83eb5f40ee954d433073114e231a
JIRA: DOVETAIL-161
Signed-off-by: Ryan.RCS <lihainong@huawei.com>
hongbo tian [Fri, 16 Dec 2016 03:25:34 +0000 (03:25 +0000)]
Merge "dovetail tool: document for dovetail CLI"
xudan [Fri, 16 Dec 2016 00:41:25 +0000 (00:41 +0000)]
dovetail tool: show progress during executing test cases
1. the utils exec_cmd() will take a long time for some cmds such as executing
test cases and pull images.
2. if the time is longer than 3 seconds, progress bar will be shown on the
screen.
JIRA: DOVETAIL-159
Change-Id: I4ae04d6e884853d843baf8f547394247f4165377
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 15 Dec 2016 02:09:35 +0000 (02:09 +0000)]
dovetail tool: bugfix about setup dovetail
1. change the entry_points of setup.cfg into dovetail.run:main
2. after setup the command 'dovetail -d true --testsuite debug' can just be
successfully executed under folder dovetail/dovetail. That is mainly because
of the load functions of testcase.py using relative paths.
3. using absolute path instead of relative path can support the command
successfully executed under any path.
JIRA: DOVETAIL-154
Change-Id: I4a2ad39a1a60e7e63efc55515781d27b823aa894
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Thu, 15 Dec 2016 01:14:06 +0000 (01:14 +0000)]
Merge "add example test area"
hongbo tian [Thu, 15 Dec 2016 01:10:19 +0000 (01:10 +0000)]
Merge "dovetail tool: fix docker version of client mismatches with server in Docker image"
Leo Wang [Thu, 15 Dec 2016 01:04:37 +0000 (20:04 -0500)]
add example test area
1. use this config to support example test case
Change-Id: I3fda73c408ed4b2bfb75aac52e0292fa4de9161b
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
xudan [Wed, 14 Dec 2016 09:18:10 +0000 (09:18 +0000)]
dovetail tool: move conf/dovetail_config.py into utils/
1. move conf/dovetail_config.py into utils/
2. change the open file path in dovetail_config.py
3. do some modification about all 'from conf.dovetail_config import ***'
JIRA: DOVETAIL-158
Change-Id: I7670e6de993899e4e2a604cbc501dc3339896ef1
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Wed, 14 Dec 2016 09:24:15 +0000 (09:24 +0000)]
Merge "[dovetail tool] support shell scripts for testcase validation"
Leo Wang [Wed, 14 Dec 2016 09:20:09 +0000 (04:20 -0500)]
[dovetail tool] support shell scripts for testcase validation
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I5c049a71f11cca71a7914f8af704c1983aba3dca
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
hongbo tian [Wed, 14 Dec 2016 08:16:05 +0000 (08:16 +0000)]
Merge "dovetail tool: improve cli to update non-envs automatically"
Leo Wang [Wed, 14 Dec 2016 07:48:16 +0000 (02:48 -0500)]
[dovetail tool] support shell scripts for testcase validation
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I60c1b54335b94e0cb150232432adb958b8f5a143
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Wed, 14 Dec 2016 02:57:38 +0000 (21:57 -0500)]
dovetail tool: fix docker version of client mismatches with server in Docker image
JIRA: DOVETAIL-160
errors see
https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-arm-pod3-debug-master/4/console
Change-Id: I812453fa7ac26cfdf66609c1ca4ac96e29ca7e02
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
xudan [Fri, 2 Dec 2016 08:58:16 +0000 (08:58 +0000)]
dovetail tool: improve cli to update non-envs automatically
1. modify cmd_config.yml
a. change 'env' and 'non-env' into 'config' and 'control'
b. add subsection 'path' for each block in 'config'
c. delete 'DEPLOY_SCENARIO' and 'DEPLOY_TYPE'
d. use 'func_tag' and 'yard_tag' to control container's tag
2. if cmd in config
a. if its path is envs, it will be used to update envs in dovetail_config
b. if its path is non_envs, it will be used to update other value in the dict
JIRA: DOVETAIL-70
Change-Id: I1cf9bfcd1a19294a390a85bce6e458ce50672b7f
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Wed, 14 Dec 2016 01:23:19 +0000 (01:23 +0000)]
Merge "bugfix of document error"
MatthewLi [Mon, 12 Dec 2016 09:19:24 +0000 (04:19 -0500)]
bugfix of document error
JIRA: DOVETAIL-155
errors can refer to
https://build.opnfv.org/ci/job/opnfv-docs-verify-master/3727/console
Change-Id: I19e96239c8183bafca731477723615caff71388b
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Leo Wang [Tue, 29 Nov 2016 09:21:40 +0000 (04:21 -0500)]
[dovetail tool] support shell scripts for testcase validation
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I45dca6b8dbd888757da163189d261f6e4dba5034
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
MatthewLi [Tue, 13 Dec 2016 06:23:11 +0000 (01:23 -0500)]
bugfix for flake8 format
error log see https://build.opnfv.org/ci/view/dovetail/job/dovetail-merge-master/58/console
Change-Id: I7f5a7f290d82e79249561322259aa5e72186e126
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Tue, 13 Dec 2016 06:14:07 +0000 (06:14 +0000)]
Merge "[WIP] Migrate to tox based environment"
Leif Madsen [Fri, 28 Oct 2016 09:59:53 +0000 (05:59 -0400)]
[WIP] Migrate to tox based environment
Migrate the custom setup.py to a more formal setup
environment using tox, in the same way that OpenStack
configures their projects.
Adds metadata to tox.ini from the setup.py file, and breaks
out the dependencies from setup.py into requirements.txt
and test-requirements.txt.
Executes flake8 testing for pep8 coverage.
Defaults to using Python 2 for the environment.
Change-Id: Ieaea7d9f3dc227febd8fb1dc9142d478ba197a92
Signed-off-by: Leif Madsen <lmadsen@redhat.com>
Signed-off-by: zshi <zshi@redhat.com>
hongbo tian [Tue, 13 Dec 2016 01:54:06 +0000 (01:54 +0000)]
Merge "Add more document and fix dockerfile for CentOS"
hongbo tian [Tue, 13 Dec 2016 01:53:21 +0000 (01:53 +0000)]
Merge "dovetail tool: add debug option to control the log level showing in screen"
MatthewLi [Fri, 9 Dec 2016 08:31:28 +0000 (03:31 -0500)]
[dovetail tool]: move config info from .py to config .yml file
JIRA: DOVETAIL-145
Change-Id: Ia9b3c678f1a491e5daf2d280f05904ead3b0a296
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Tomofumi Hayashi [Wed, 7 Dec 2016 15:19:46 +0000 (00:19 +0900)]
Add more document and fix dockerfile for CentOS
Add how to build container from dockerfile and add missing config
for CentOS dockerfile. This fix is verified that functest/yeardstick
are called successfully under debug/proposed_tests testsuite.
Change-Id: Icb31331ecd78b8fccd69ac960c24340b605e54bf
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
MatthewLi [Thu, 10 Nov 2016 02:44:51 +0000 (21:44 -0500)]
2 config files description documents
JIRA: DOVETAIL-50
Change-Id: I65c618ce3de78677b9e66a1c2d7f0af705e80cfb
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
hongbo tian [Wed, 7 Dec 2016 13:58:23 +0000 (13:58 +0000)]
Merge "[RFC]Add dockerfile to support dovetail in CentOS"
hongbo tian [Wed, 7 Dec 2016 13:53:00 +0000 (13:53 +0000)]
Merge "Copy the jumphost ssh key into the container"
xudan [Wed, 7 Dec 2016 06:21:58 +0000 (06:21 +0000)]
dovetail tool: document for dovetail CLI
1. document for developers about how to add or delete commands by modifying
cmd_config.yml file.
2. document for users about how to run dovetail tool with CLI
JIRA: DOVETAIL-25
Change-Id: Iecf9d7a230e694bdda5634a87f7e5ddf7b7a57fd
Signed-off-by: xudan <xudan16@huawei.com>
Dan Radez [Tue, 6 Dec 2016 14:17:17 +0000 (09:17 -0500)]
Copy the jumphost ssh key into the container
When functest runs against Apex it needs to ssh from the container
to the undercloud to get the keystonerc file so it can authenticate
to the overcloud.
Change-Id: Iea3273d4d1611733f167ffab0b2a75330c413edc
Signed-off-by: Dan Radez <dradez@redhat.com>
Tomofumi Hayashi [Wed, 30 Nov 2016 02:44:44 +0000 (11:44 +0900)]
[RFC]Add dockerfile to support dovetail in CentOS
JIRA: DOVETAIL-151
This diff introduces an optional dovetail dockerfile based on CentOS.
It provides users to have an alternative way to execute dovetail.
It should be just a optional, so we should keep docker/Dockerfile
as official one with dockerhub's image and we do not build docker images
in CI phase for now.
Change-Id: Ia694bcd49f65ff2bc175c1da3b42fbfa19b022a1
Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
Signed-off-by: Zenghui Shi <zshi@redhat.com>
xudan [Mon, 5 Dec 2016 08:28:20 +0000 (08:28 +0000)]
dovetail tool: add unit test into script unittest.sh
1. Since JIRA: DOVETAIL-55 has been merged, unit tests can't pass without
load_config_files().
2. Fix the bug by adding load_config_files().
3. Add run_tests() into script unittest.sh to include all unit tests in
tests/unit.
JIRA: DOVETAIL-149
Change-Id: I7bdb0732fefde3a3f3b82441b4cc7e46ece66a1e
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 1 Dec 2016 06:38:51 +0000 (06:38 +0000)]
dovetail tool: add debug option to control the log level showing in screen
1. add debug option in cmd_config.yml for controling log showing in screen.
2. rename existent DEBUG as CON_DEBUG because it is used for functest/yardstick
container to control the log level.
3. fix the bug in function update_config_envs(). If one key is not in system's
envs, os.environ[key] get an error with ErrorKey.
JIRA: DOVETAIL-148
Change-Id: If3d75109f51e2e91743b8f1134a76da42e57383a
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 2 Dec 2016 17:43:00 +0000 (17:43 +0000)]
Merge "dovetail tool: reorganize statements in class DovetailConfig"
hongbo tian [Fri, 2 Dec 2016 17:42:46 +0000 (17:42 +0000)]
Merge "dovetail tool: add brackets to print message for consistency"
hongbo tian [Fri, 2 Dec 2016 17:42:10 +0000 (17:42 +0000)]
Merge "dovetail tool: fix unittest bugs"
hongbo tian [Fri, 2 Dec 2016 17:41:37 +0000 (17:41 +0000)]
Merge "[WIP] dovetail report improvement"
MatthewLi [Fri, 2 Dec 2016 03:29:26 +0000 (22:29 -0500)]
[WIP] dovetail report improvement
JIRA: DOVETAIL-49
1)details please refer to
https://wiki.opnfv.org/display/dovetail/Dovetail+Reports
2)results please refer to one example
https://etherpad.opnfv.org/p/dovetail_report
Change-Id: I63a1ba3b6aa1ffe5fa043a11cd3777dd0e8d52d9
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
MatthewLi [Thu, 1 Dec 2016 01:53:22 +0000 (20:53 -0500)]
bugfix: Add BRANCH Argument in the Dockerfile
JIRA: DOVETAIL-147
1) BRANCH argument added to fix bug in CI
2) docker to use latest version, since BRANCH added not works with old version
Change-Id: Icb0144896389b0cb7ac80e1fb0338825be50d5b1
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
zshi [Wed, 30 Nov 2016 07:12:28 +0000 (15:12 +0800)]
dovetail tool: fix unittest bugs
JIRA: DOVETAIL-143
1) fix unittest import module path
2) add create_log in setup
Change-Id: Ic894fa971b4a5091affb36e8e6aac05e0e8623fb
Signed-off-by: zshi <zshi@redhat.com>