dovetail.git
7 years agoAdd test area 'filtering packets based on security rules and port security' 25/39225/1
xudan [Mon, 14 Aug 2017 04:14:31 +0000 (00:14 -0400)]
Add test area 'filtering packets based on security rules and port security'

JIRA: DOVETAIL-473

According to Dovetail addendum doc, add one test area about basic cloud
capability 'filtering packets based on security rules and port security
in data path'.

Add the test specification about this test area.

Change-Id: I814204f16b79bc06d9bfb54d5a90692d8b8c7bfa
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "create a tar file for logs"
Leo wang [Fri, 11 Aug 2017 01:42:36 +0000 (01:42 +0000)]
Merge "create a tar file for logs"

7 years agoMerge "Add Tempest test cases to Dovetail CI daily jobs"
Leo wang [Fri, 11 Aug 2017 01:42:03 +0000 (01:42 +0000)]
Merge "Add Tempest test cases to Dovetail CI daily jobs"

7 years agocreate a tar file for logs 13/39013/1
grakiss [Thu, 10 Aug 2017 02:03:13 +0000 (10:03 +0800)]
create a tar file for logs

JIRA: DOVETAIL-479

User may want to upload all logs along with the results,
so others may check the running logs to make sure what' s going on during the test.

Change-Id: Ice906264bbdf091d3353d6d2e146653aeb057f5f
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agocreate a tar file for logs 91/38891/1
grakiss [Tue, 8 Aug 2017 09:04:23 +0000 (17:04 +0800)]
create a tar file for logs

JIRA: DOVETAIL-479

User may want to upload all logs along with the results,
so others may check the running logs to make sure what' s going on during the test.

Change-Id: Ia5862f99c129b8207aa91a391567ffdd5ee0829a
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoAdd Tempest test cases to Dovetail CI daily jobs 35/38835/2
xudan [Mon, 7 Aug 2017 11:28:16 +0000 (07:28 -0400)]
Add Tempest test cases to Dovetail CI daily jobs

JIRA: DOVETAIL-478

JIRA: DOVETAIL-473 adds 6 test areas:
- forwarding packets through virtual networks in data path
- filtering packets based on security rules and port security in data path
- dynamic network runtime operations through the life of a VNF
- correct behavior after common virtual machine life cycles events
- simple virtual machine resource scheduling on multiple nodes
- storage security

Add Tempest test cases belong to this 6 test areas to Dovetail CI daily jobs.

Change-Id: I1535d96f3a85cdd8ac4f0c4375c68ce47bd9df93
Signed-off-by: xudan <xudan16@huawei.com>
7 years agofix base_url for public url 23/38823/1
grakiss [Mon, 7 Aug 2017 06:53:15 +0000 (14:53 +0800)]
fix base_url for public url

Change-Id: I171e9b0bce1891594bf7ef577809e73f05556810
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoMerge "add user guide for results operations on web"
hongbo tian [Fri, 4 Aug 2017 08:39:38 +0000 (08:39 +0000)]
Merge "add user guide for results operations on web"

7 years agoMerge "Tag dovetail with cvp.0.4.0"
hongbo tian [Fri, 4 Aug 2017 07:05:42 +0000 (07:05 +0000)]
Merge "Tag dovetail with cvp.0.4.0"

7 years agoTag dovetail with cvp.0.4.0 45/38745/2
xudan [Fri, 4 Aug 2017 06:23:17 +0000 (02:23 -0400)]
Tag dovetail with cvp.0.4.0

JIRA: DOVETAIL-476

1. docker image used
   yardstick: danube.3.1
   functest: cvp.0.2.0
   bottlenecks: cvp.0.4.0
   testapi: cvp.0.4.0
   dovetail: cvp.0.4.0
2. main changes
   Add docs about vping test cases (test scope and test specification)
   Add 2 vping test cases into proposed_tests
   Bugfix: Build docker image failed because of lacking of packages
   Add resiliency.tc001 into proposed_tests
3. For more information, refer to
   https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoadd user guide for results operations on web 65/38065/6
grakiss [Tue, 25 Jul 2017 09:44:16 +0000 (17:44 +0800)]
add user guide for results operations on web

JIRA: dovetail-471

User can access results through the web page
browser the public results uploaded by others or himself
upload the results, and set this results as public or private to others

Change-Id: I9834a670f5dff6412a0290d9a5dd729bcece2933
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoAdd resiliency test caes into proposed_tests 13/38713/2
xudan [Fri, 4 Aug 2017 01:28:03 +0000 (21:28 -0400)]
Add resiliency test caes into proposed_tests

JIRA: DOVETAIL-474

Add Bottlenecks resiliency test case "posca_factor_ping" into proposed_tests.

Change-Id: I76aea651014fb4722ddae07559f417d3f840eee2
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoBugfix: Build docker image failed because of lacking of packages 73/38573/1
xudan [Wed, 2 Aug 2017 02:52:58 +0000 (22:52 -0400)]
Bugfix: Build docker image failed because of lacking of packages

JIRA: DOVETAIL-475

1. Dovetail fails to build Docker image.
Link: https://build.opnfv.org/ci/view/dovetail/job/dovetail-docker-build-push-master/162/console
   Traceback: Running setup.py install for cryptography
              c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
2. Refer to https://cryptography.io/en/latest/installation/
   For Debian and Ubuntu, the following command will ensure that the required
   dependencies are installed:
   sudo apt-get install build-essential libssl-dev libffi-dev python-dev

Change-Id: Icb705823c58d8a557175d48b00745119c0a6b3b9
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "mandatory vping test case added to proposed_tests"
hongbo tian [Wed, 2 Aug 2017 01:55:38 +0000 (01:55 +0000)]
Merge "mandatory vping test case added to proposed_tests"

7 years agoMerge "WIP: Test case description for vping test cases"
hongbo tian [Wed, 2 Aug 2017 01:12:28 +0000 (01:12 +0000)]
Merge "WIP: Test case description for vping test cases"

7 years agoWIP: Test case description for vping test cases 53/36253/15
Georg Kunz [Tue, 20 Jun 2017 15:43:05 +0000 (17:43 +0200)]
WIP: Test case description for vping test cases

Adding test case descriptions for both vping test cases implemented in
Functest. Test case 1 makes use of the config drive mechanism of
Nova to pass a test script. Test case 2 uses SSH to transfer and execute
a script on one VM.

Change-Id: Ic8be6ad4dfd4b0e7661064506b0ae92db2fc1463
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
7 years agoMerge "Use uuid1 to replace uuid4"
hongbo tian [Fri, 21 Jul 2017 08:13:04 +0000 (08:13 +0000)]
Merge "Use uuid1 to replace uuid4"

7 years agoTag dovetail with cvp.0.3.0 87/37887/3
xudan [Fri, 21 Jul 2017 02:06:51 +0000 (22:06 -0400)]
Tag dovetail with cvp.0.3.0

JIRA: DOVETAIL-468

1. docker image used
   yardstick: danube.3.1
   functest: cvp.0.2.0
   testapi: cvp.0.3.0
   dovetail: cvp.0.3.0
2. main changes
   fix dovetail docker version to be 17.03.0-ce
   adapt yardstick danube.3.1
   For more information, refer to
   https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Draft dovetail user guide first cut"
Leo wang [Fri, 21 Jul 2017 07:44:25 +0000 (07:44 +0000)]
Merge "Draft dovetail user guide first cut"

7 years agoUse uuid1 to replace uuid4 01/37901/1
xudan [Fri, 21 Jul 2017 06:44:58 +0000 (02:44 -0400)]
Use uuid1 to replace uuid4

JIRA: DOVETAIL-469

uuid1 is more unique than uuid4

Change-Id: Ic29ec7586ba518e67cb1750df1001cd390fcf313
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Delete the ERROR log when it is not https"
Leo wang [Fri, 21 Jul 2017 01:19:03 +0000 (01:19 +0000)]
Merge "Delete the ERROR log when it is not https"

7 years agoMerge "Adapt Yardstick to copy yardstick.conf to /etc/yardstick"
Leo wang [Fri, 21 Jul 2017 01:18:39 +0000 (01:18 +0000)]
Merge "Adapt Yardstick to copy yardstick.conf to /etc/yardstick"

7 years agoMerge "Fix the docker version to be 17.03.0-ce rather than the latest one"
Leo wang [Fri, 21 Jul 2017 01:18:19 +0000 (01:18 +0000)]
Merge "Fix the docker version to be 17.03.0-ce rather than the latest one"

7 years agomandatory vping test case added to proposed_tests 53/37853/1
MatthewLi [Thu, 20 Jul 2017 10:59:13 +0000 (06:59 -0400)]
mandatory vping test case added to proposed_tests

JIRA: DOVETAIL-446

1.add vping to proposed_tests
2.delete out-dated nfvi test cases

Change-Id: I181b00b02abe6fed4ff51e947576c1b71321cdd2
Signed-off-by: MatthewLi <lijun_1203@126.com>
7 years agoFix the docker version to be 17.03.0-ce rather than the latest one 13/37813/1
xudan [Thu, 20 Jul 2017 02:14:07 +0000 (22:14 -0400)]
Fix the docker version to be 17.03.0-ce rather than the latest one

JIRA: DOVETAIL-467

1. Since the script getting with "wget qO https://get.docker.com/" has been
   changed and it can just install docker-ce rather than docker-engine now.
2. Dovetail validates with Docker 17.03 CE, so the docker installed in the
   dovetail container can be 17.03.0-ce.

Change-Id: If64204ba3dcf5a38d7a124a0cc716f8375808999
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoAdapt Yardstick to copy yardstick.conf to /etc/yardstick 37/37737/1
xudan [Wed, 19 Jul 2017 07:19:52 +0000 (03:19 -0400)]
Adapt Yardstick to copy yardstick.conf to /etc/yardstick

JIRA: DOVETAIL-466

1. Yardstick danube.3.1 needs a yardstick.conf file in /etc/yardstick
2. Copy the file /home/opnfv/repos/yardstick/etc/yardstick/yardstick.conf.sample
   to /etc/yardstick/yardstick.conf
3. If user wants to store the results in the local file, set the dispatcher to
   be 'file'.
4. If user wants to push the results into the DB, set the dispatcher to be 'http'
   and target to be the api url getting from the user.

Change-Id: I39c30883b471ab7cb29ed6d63ba8c232da39c135
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoDelete the ERROR log when it is not https 49/37449/2
xudan [Fri, 14 Jul 2017 02:03:27 +0000 (22:03 -0400)]
Delete the ERROR log when it is not https

JIRA: DOVETAIL-462

1. If it is not https, Dovetail will give a error log
   2017-07-13 21:58:30,409 - container.Container - ERROR - The command
   'openstack catalog show identity |awk '/public/ {print $4}'| grep 'https'' failed.
2. Remove this error log becuase it is not an error.

Change-Id: I5791b1925cad8606d70eefd4940dd9bf46956305
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoUpdate the IPv6 for the remain comments 29/37229/2
hongbotian [Wed, 12 Jul 2017 02:51:35 +0000 (03:51 +0100)]
Update the IPv6 for the remain comments

JIRA: DOVETAIL-461

1. Lincoln’s comments about tc018-tc021: change “using DHCPv6” to “using DHCPv6 stateless”
2. Update tc018-tc025: give more details and modify some misunderstanding about these test cases.
For more detail, please refer to jira or this patch.

Change-Id: Ieb7ee9d0b8a31826c7f2f69cb5f209055fd7b928
Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
7 years agoDraft dovetail user guide first cut 85/34285/8
Wenjing Chu [Thu, 4 May 2017 06:09:57 +0000 (23:09 -0700)]
Draft dovetail user guide first cut

Fixing comment issues and updating to new version of dovetail.

Change-Id: Iaa9243d0a835f1d050fb925fa75b2a770168a8f4
Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
7 years agotag dovetail with 0.2.0 75/36775/3
MatthewLi [Fri, 30 Jun 2017 03:49:50 +0000 (23:49 -0400)]
tag dovetail with 0.2.0

JIRA: DOVETAIL-447

docker images used

yardstick danube.3.0
functest cvp.0.2.0
testapi cvp.0.2.0
dovetail cvp.0.2.0

main changes

1, fix yardstick HA bugs
2, fix functest sdnvpn offlinebugs
3, fix dovetail https bugs, etc.
for more info, refer to
https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: I4edb61b84ed80d8d7624f69db372fec60d73aa38
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
7 years agoMerge "Modify Dovetail logs"
Leo wang [Fri, 30 Jun 2017 08:12:58 +0000 (08:12 +0000)]
Merge "Modify Dovetail logs"

7 years agoChange sdnvpn testcases file path 85/36785/1
xudan [Fri, 30 Jun 2017 06:45:00 +0000 (02:45 -0400)]
Change sdnvpn testcases file path

JIRA: DOVETAIL-458

1. Functest has changed the repo of sdnvpn.
2. Currently Dovetail will copy the testcase yaml file to
   /home/opnfv/repos/sdnvpn/sdnvpn/test/functest/config.yaml in Functest container.
3. The path needed to be replaced by
   /usr/local/lib/python2.7/dist-packages/sdnvpn/test/functest/config.yaml

Change-Id: I1badba4120e96e2c9ed5a07db3189967cf24c564
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoModify Dovetail logs 15/36615/2
xudan [Wed, 28 Jun 2017 03:51:19 +0000 (23:51 -0400)]
Modify Dovetail logs

JIRA: DOVETAIL-450

Change-Id: I795679c9559d1bead3aecefff28d21b6567aac2f
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "https enabled checking"
hongbo tian [Wed, 28 Jun 2017 09:09:14 +0000 (09:09 +0000)]
Merge "https enabled checking"

8 years agohttps enabled checking 41/36541/2
MatthewLi [Tue, 27 Jun 2017 04:14:24 +0000 (00:14 -0400)]
https enabled checking

JIRA: DOVETAIL-456

before to check OS_CACERT and OS_INSECURE when using
https + credential or + no credential,
there's a need to check if https enabled.
error log
https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/37/console

Change-Id: Icdf17541fe6cf64b2f000d424c8d4dcc28cfd371
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoMerge "Use official Docker images to build local DB"
hongbo tian [Tue, 27 Jun 2017 11:42:56 +0000 (11:42 +0000)]
Merge "Use official Docker images to build local DB"

8 years agoMerge "delete old ipv6 files"
hongbo tian [Tue, 27 Jun 2017 11:40:58 +0000 (11:40 +0000)]
Merge "delete old ipv6 files"

8 years agodelete unused dashboard backend packages 59/36459/1
MatthewLi [Mon, 26 Jun 2017 02:36:01 +0000 (22:36 -0400)]
delete unused dashboard backend packages

JIRA: DOVETAIL-452

since testapi/mongoDB/openstack 3rd paty dahsboard packages
are used for dovetail now in releng repo. the out-dated mysql-based
dashboard backend packages are deleted

Change-Id: I304c6c40b47e2fac513dd2de873644b749c3275d
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agodelete old ipv6 files 55/36455/2
MatthewLi [Mon, 26 Jun 2017 02:04:42 +0000 (22:04 -0400)]
delete old ipv6 files

JIRA: DOVETAIL-452

since https://gerrit.opnfv.org/gerrit/#/c/34577/ merged
new ipv6 C&C documents are there, delete the old ones.

Change-Id: Ic16cf03b3febd7cca158555e11ecd817ffc61139
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoMerge "HA testcases"
hongbo tian [Sat, 24 Jun 2017 01:17:02 +0000 (01:17 +0000)]
Merge "HA testcases"

8 years agoMerge "IPv6 Test Cases"
hongbo tian [Sat, 24 Jun 2017 01:15:33 +0000 (01:15 +0000)]
Merge "IPv6 Test Cases"

8 years agoUse official Docker images to build local DB 07/36407/2
xudan [Fri, 23 Jun 2017 06:36:50 +0000 (02:36 -0400)]
Use official Docker images to build local DB

JIRA: DOVETAIL-422

1. Use official Docker images, mongo:3.2.1 and opnfv/testapi:cvp.0.1.0,
   to build local database and testapi service.
2. Use the stable Docker tag in offline config file.

Change-Id: I446a4248effc95f6f5aa6a6d90c0d31ef2f60b39
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoHA testcases 41/34441/13
fuqiao [Mon, 8 May 2017 15:31:05 +0000 (23:31 +0800)]
HA testcases

Modify HA testcases.rst file to include detail discribtion of the 8
testcases. Rename the original rst file into HA testcases outline.rst.
Please review and see if you need two of these file, or you prefer a
single one, or maybe merge these two.

as discussed,propose 8 HA testcases for mandatory  test cases.

JIRA:

Change-Id: Ie6cd5a68897bb0208932d2e1fec65cc59bfa25b4
Signed-off-by: fuqiao@chinamobile.com
8 years agoBugfix: Move userconfig directory into dovetail/dovetail 45/36345/1
xudan [Thu, 22 Jun 2017 04:04:51 +0000 (00:04 -0400)]
Bugfix: Move userconfig directory into dovetail/dovetail

JITA: DOVETAIL-449

1. Dovetail cvp.0.1.0 link dovetail/dovetail to
   /usr/local/lib/python2.7/dist-packages/dovetail/
2. The directory dovetail/userconfig is lost in this image
3. Move dovetail/userconfig into dovetail/dovetail/userconfig

Change-Id: I9da8389e02d92f35879ff5c6a1db1b7d984dd862
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "fix judgement for https+no credential case"
hongbo tian [Wed, 21 Jun 2017 08:55:22 +0000 (08:55 +0000)]
Merge "fix judgement for https+no credential case"

8 years agobugfix of dockerfile 89/36289/1
MatthewLi [Wed, 21 Jun 2017 08:52:34 +0000 (04:52 -0400)]
bugfix of dockerfile

Change-Id: I45b317e6feb4f889bd136b5d9f6a0f1e26db988f
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoMerge "Docker version misalignment and move some irrelevant messages"
Leo wang [Wed, 21 Jun 2017 01:26:11 +0000 (01:26 +0000)]
Merge "Docker version misalignment and move some irrelevant messages"

8 years agofix judgement for https+no credential case 27/36227/1
MatthewLi [Tue, 20 Jun 2017 09:07:25 +0000 (05:07 -0400)]
fix judgement for https+no credential case

Change-Id: Id3d4e9af04f1882f69b8c9fe588355d76ad001c4
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agobranch supported in Dockerfile and use functest/yardstick danube.2.0 19/36219/1
MatthewLi [Tue, 20 Jun 2017 06:43:32 +0000 (02:43 -0400)]
branch supported in Dockerfile and use functest/yardstick danube.2.0

JIRA: DOVETAIL-447

Change-Id: Id49d6ded8188900b58349e1983ac3fc8b40b6059
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoMerge "Remove the committer for stepping down"
hongbo tian [Mon, 19 Jun 2017 06:06:18 +0000 (06:06 +0000)]
Merge "Remove the committer for stepping down"

8 years agoMerge "Bugfix: KeyError when Functest fails to store results into file"
Leo wang [Tue, 13 Jun 2017 06:05:38 +0000 (06:05 +0000)]
Merge "Bugfix: KeyError when Functest fails to store results into file"

8 years agoMerge "https + no credential support"
hongbo tian [Fri, 9 Jun 2017 09:29:49 +0000 (09:29 +0000)]
Merge "https + no credential support"

8 years agohttps + no credential support 03/35903/5
MatthewLi [Thu, 8 Jun 2017 01:21:48 +0000 (21:21 -0400)]
https + no credential support

JIRA: DOVETAIL-440

Change-Id: I2bb430de040127dea493e8bb5423ad8204f799e2
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoIPv6 Test Cases 77/34577/11
Bin Hu [Thu, 11 May 2017 06:07:00 +0000 (23:07 -0700)]
IPv6 Test Cases

Change-Id: Icdb2786076aa6a263449eca5db4a07d14f1e2adf
Signed-off-by: Bin Hu <bh526r@att.com>
8 years agoMerge "Fix the docker version to be 1.12.3 in Dovetail docker image"
hongbo tian [Fri, 9 Jun 2017 08:23:22 +0000 (08:23 +0000)]
Merge "Fix the docker version to be 1.12.3 in Dovetail docker image"

8 years agoMerge "https+credential support"
hongbo tian [Fri, 9 Jun 2017 07:32:14 +0000 (07:32 +0000)]
Merge "https+credential support"

8 years agoRemove the committer for stepping down 33/35933/2
hongbotian [Fri, 9 Jun 2017 01:28:27 +0000 (09:28 +0800)]
Remove the committer for stepping down

Thanks Christopher Price for his great job for dovetail
He created the dovetial and made great contribution.
Based on his Intention, the INFO is updated

Change-Id: I8fc1e552062cb7e429d42b6d4af41a7cd620c4f6
Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
8 years agohttps+credential support 53/35853/2
MatthewLi [Wed, 7 Jun 2017 03:46:21 +0000 (23:46 -0400)]
https+credential support

JIRA: DOVETAIL-440

Change-Id: I69fb96673755545e8e0d78d940870195dbf20a0b
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoDocker version misalignment and move some irrelevant messages 59/35859/2
xudan [Wed, 7 Jun 2017 06:23:21 +0000 (02:23 -0400)]
Docker version misalignment and move some irrelevant messages

JIRA: DOVETAIL-437
JIRA: DOVETAIL-444

1. Docker client version and server version should be 1.12.3 or later.
2. If any of them is older than 1.12.3, there will be an ERROR message.
3. Delete the “rm -rf results” message.

Change-Id: I0c10cf256ef139cac4d43f36108bf5f3f9da8398
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "Adding SDNVPN test cases to the Optional Test areas of the CVP."
Georg Kunz [Wed, 7 Jun 2017 06:46:07 +0000 (06:46 +0000)]
Merge "Adding SDNVPN test cases to the Optional Test areas of the CVP."

8 years agoBugfix: KeyError when Functest fails to store results into file 45/35845/1
xudan [Wed, 7 Jun 2017 02:13:07 +0000 (22:13 -0400)]
Bugfix: KeyError when Functest fails to store results into file

JIRA: DOVETAIL-445

https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-danube/19/console

Change-Id: If933156bb3931e7bfc8ec31eb03ca5a3cb0bf8b0
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoFix the docker version to be 1.12.3 in Dovetail docker image 17/35817/1
xudan [Tue, 6 Jun 2017 08:48:55 +0000 (04:48 -0400)]
Fix the docker version to be 1.12.3 in Dovetail docker image

JIRA: DOVETAIL-442

Change-Id: I476c2dabf5b23ed42a0004d8d3a9e17727051eca
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "Support Yardstick to push results to database"
Leo wang [Tue, 6 Jun 2017 06:39:04 +0000 (06:39 +0000)]
Merge "Support Yardstick to push results to database"

8 years agoMerge "change the name of Yardstick results file and some log msg"
Leo wang [Tue, 6 Jun 2017 06:38:09 +0000 (06:38 +0000)]
Merge "change the name of Yardstick results file and some log msg"

8 years agoAdding SDNVPN test cases to the Optional Test areas of the CVP. 43/34343/14
Georg Kunz [Fri, 5 May 2017 08:55:15 +0000 (10:55 +0200)]
Adding SDNVPN test cases to the Optional Test areas of the CVP.

Included the tests for SDNVPN in the docetail scope document
Performed spell checking of the committed test area document and included
the section around test suite structure.  This patch should be reviewed
and approved by the SDNVPN team prior to being merged.

Change-Id: Ia2f9a1bddb02b9191da1239a73f121dce6687af1
Co-Authored-By: Georg Kunz <georg.kunz@ericsson.com>
Co-Authored-By: ChristopherPrice <christopher.price@ericsson.com>
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
8 years agosdnvpn offline support in dovetail 87/35387/4
MatthewLi [Fri, 26 May 2017 06:35:03 +0000 (02:35 -0400)]
sdnvpn offline support in dovetail

JIRA: DOVETAIL-441

Change-Id: I709c62a36c65ef0b4da69c5508f7a8273e68dc2b
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agochange the name of Yardstick results file and some log msg 77/35177/4
xudan [Tue, 23 May 2017 06:22:05 +0000 (02:22 -0400)]
change the name of Yardstick results file and some log msg

JIRA: DOVETAIL-428

1. Change the name of Yardstick result file from opnfv_yardstick_tc019.out to
   dovetail.ha.tc001.out. Because opnfv_yardstick_tc019 is the name defined in
   Yardstick and dovetail.ha.tc001 is the name defined in Dovetail.
2. Check whether the file exists before reporting the results are stored in file.
3. Delete test cases vping_ssh, vping_userdata and sdnvpn.tc003 from the testsuite
   proposed_tests.

Change-Id: I4cb16947729479616a03abd9e91b76f9a41a949c
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoChange the directories of results and some files to DOVETAIL_HOME 25/35325/3
xudan [Thu, 25 May 2017 08:35:18 +0000 (04:35 -0400)]
Change the directories of results and some files to DOVETAIL_HOME

JIRA: DOVETAIL-438

1. Need an env variable DOVETAIL_HOME in env_config.sh
2. env_config.sh, pod.yaml and id_rsa should be put in path DOVETAIL_HOME/pre_config
3. the results will also be put in this path
4. no need to give the path of openstack credential file while running a testsuite
5. if running with the code, source the env_config.sh file before running
      source $DOVETAIL_HOME/env_config.sh
      dovetail run --testsuite <testsuite_name>
6. if running with Dovetail docker image
      docker run -it --privileged=true -e DOVETAIL_HOME=<dovetail_home_path>
             -v <dovetail_home_path>:<dovetail_home_path>
             -v /var/run/docker.sock:/var/run/docker.sock
             opnfv/dovetail:latest /bin/bash

Change-Id: Ia23078f27a34e293d0075e49c673930f41069cb6
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoSDNVPN test cases failed in CI 07/35207/2
xudan [Tue, 23 May 2017 12:28:58 +0000 (08:28 -0400)]
SDNVPN test cases failed in CI

JIRA: DOVETAIL-439

1. SDNVPN test cases run in CI failed, because the file
  /home/opnfv/repos/sdnvpn/sdnvpn/test/functest/config.yaml is empty.
2. copy the file userconfig/sdnvpn_config_testcase1/2/4/8.yaml
  to /home/opnfv/repos/sdnvpn/sdnvpn/test/functest/config.yaml in Functest container

Change-Id: Ie904f83c755efc0d9e0abe5dcd44fe4a5056123e
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "Add test case tempest_custom into the local database"
hongbo tian [Tue, 23 May 2017 03:44:31 +0000 (03:44 +0000)]
Merge "Add test case tempest_custom into the local database"

8 years agohosts info config in container 47/35047/3
MatthewLi [Fri, 19 May 2017 09:22:34 +0000 (05:22 -0400)]
hosts info config in container

JIRA: DOVETAIL-435

in some SUT, there's a need to config hosts <domain name>:<ip> info
in container /etc/hosts, ortherwise, SUT service will not be used.

usage:

1,for dovetail directly running, cd ${DOVETAIL_HOME}/userconfig
  vim hosts.yaml
  sth like
  hosts_info:
    - domain_nameA:192.168.33.101
    - domain_nameB:<some IP>
2,for dovetail container running, first get inside the container,
  cd /home/opnfv/dovetail/userconfig
  vim hosts.yaml
  same as 1.

Change-Id: Ic5d87df3d78c0fa1d08c4e972c0fc97e61b906e9
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoupdate the IRC in INFO file for IRC channel error 21/35021/1
hongbotian [Fri, 19 May 2017 02:20:15 +0000 (10:20 +0800)]
update the IRC in INFO file for IRC channel error

JIRA: DOVETAIL-434

revise the error.change opnfv-testperf to opnfv-meeting

Change-Id: I70820b202929bbfbdbff2ee104dcbc5601d53357
Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
8 years agoI would like to nominate Georg Kunz to become a committer in the Dovetail 67/34867/1
Wenjing Chu [Tue, 16 May 2017 23:34:43 +0000 (16:34 -0700)]
I would like to nominate Georg Kunz to become a committer in the Dovetail
project. Georg's nomination is motivated by his commitment to the project
and his high quality work in helping the Dovetail sdnvpn test suite development,
test doc patch review and meeting participations.

I would like to nominate Zenghui to become a committer in the Dovetail
project. Zenghui's nomination is motivated by his commitment to the
project and his contributions in dovetail tool and multi-SUT testing.

I would like to nominate Wanglei to become a committer in the Dovetail
project. Wanglei's nomination is motivated by his commitment to the project
and his consistent long time contribution to the Dovetail test framework
development, test suite patch review and meeting participations.

I would like to nominate Lincoln to become a committer in the Dovetail
project. Lincoln's nomination is motivated by his commitment to the project
and his expertise in multi-vendor testing, compliance testing and test doc
patch review and meeting participations.

I would like to nominate Trevor Cooper to become a committer in the Dovetail
project. Trevor's nomination is motivated by his commitment to the project
and his experiences in the testing working group, performance testing and
consistent contributions in reviews and meeting participations.

I would like to nominate Fuqiao to become a committer in the Dovetail project.
Fuqiao's nomination is motivated by her commitment to the project and her
contributions in developing the high availability test area, her experiences
in bringing service provider requirements and perspective, and her
contributions in reviews and meeting participations.

Change-Id: Ia8a4ed3af7219c5376e0dd281ed11a51059c6fd4
Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
8 years agoFix AArch64 nested Docker install 53/34453/11
Alexandru Nemes [Mon, 8 May 2017 16:43:37 +0000 (19:43 +0300)]
Fix AArch64 nested Docker install

Due to recent changes in official Dovetail Dockerfile,
which is running on Ubuntu 14.04, we need some changes
in our patch file for aarch64 in order to keep it working
on 16.04.

JIRA: ARMBAND-258

Change-Id: Icff8c5a16d90ec4b67204a5b525a7896c796ca11
Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
8 years agoMerge "bugfix of wrong testcase name"
hongbo tian [Mon, 15 May 2017 04:26:34 +0000 (04:26 +0000)]
Merge "bugfix of wrong testcase name"

8 years agoAdd test case tempest_custom into the local database 47/34647/1
xudan [Fri, 12 May 2017 01:54:16 +0000 (21:54 -0400)]
Add test case tempest_custom into the local database

JIRA: DOVETAIL-429

Test case tempst_custom is not in the initial local database. Add this test case
into local database.

Change-Id: I53d3f6ebdde7ff680e33faf8296551d81f3c0496
Signed-off-by: xudan <xudan16@huawei.com>
8 years agobugfix of wrong testcase name 25/34625/1
MatthewLi [Thu, 11 May 2017 12:31:21 +0000 (08:31 -0400)]
bugfix of wrong testcase name

JIRA: DOVETAIL-430

this is wrong before(ipv6.tc023 same to ipv6.tc019),
fixed according to https://gerrit.opnfv.org/gerrit/#/c/34577/

Change-Id: I3d996a7c2adffc305b0f8fa6bcd87e4e6e4c5b7e
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoAdd three HA test cases into test suite proposed_tests 85/34585/2
xudan [Thu, 11 May 2017 06:33:29 +0000 (02:33 -0400)]
Add three HA test cases into test suite proposed_tests

JIRA: DOVETAIL-427

There are another three HA test cases which are stable now for adding into
test suite proposed_tests for CI daily run.

Change-Id: I86ed38d2e3a2bcfda29af50164aadd0da89e6aaa
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "store/load offline docker images"
hongbo tian [Thu, 11 May 2017 02:03:33 +0000 (02:03 +0000)]
Merge "store/load offline docker images"

8 years agoSupport Yardstick to push results to database 97/34397/4
xudan [Sat, 6 May 2017 08:46:17 +0000 (04:46 -0400)]
Support Yardstick to push results to database

JIRA: DOVETAIL-421

1. Yardstick is working on supporting push results to mongoDB.
   see https://gerrit.opnfv.org/gerrit/#/c/34091/
2. make Dovetail supporting push results to database too when
   user choose to report to database.

Change-Id: Iee06ad6be59dad62ac4f985f4a982fb5ff93a592
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "fix ha testcase PASS/FAIL judgement"
hongbo tian [Tue, 9 May 2017 01:24:02 +0000 (01:24 +0000)]
Merge "fix ha testcase PASS/FAIL judgement"

8 years agoMerge "vpn testcases added in proposed_tests"
hongbo tian [Tue, 9 May 2017 01:23:42 +0000 (01:23 +0000)]
Merge "vpn testcases added in proposed_tests"

8 years agostore/load offline docker images 27/34427/2
MatthewLi [Mon, 8 May 2017 09:28:15 +0000 (05:28 -0400)]
store/load offline docker images

JIRA: DOVETAIL-423

usage:
1.cd ${DOVETAIL_HOME}/dovetail/utils/offline
2.edit config.yaml as needed
3.on onsite host, <python download.py>  --> save docker images to defined path
4.on offline host, <python load.py> ---> load docker images to offline env
5.this can be easily extended to other images beside docker images

Change-Id: I97d843e154ecf8d66cafb9ea9594fe73343ee591
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agofix ha testcase PASS/FAIL judgement 37/34337/4
MatthewLi [Fri, 5 May 2017 07:46:12 +0000 (03:46 -0400)]
fix ha testcase PASS/FAIL judgement

JIRA: DOVETAIL-425

Change-Id: Ifee2473956e0a1a3ad9c98beff92d94327251614
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agovpn testcases added in proposed_tests 93/34193/3
MatthewLi [Thu, 4 May 2017 03:12:53 +0000 (23:12 -0400)]
vpn testcases added in proposed_tests

JIRA: DOVETAIL-212

after communicating with Tim/jose, help to add vpn testcase into proposed_tests

reference: https://wiki.opnfv.org/display/sdnvpn/SDNVPN+Testing#SDNVPNTesting-TestcompliancetemplateforDovetail

Change-Id: Id34a2cadba625abbdbc59ef11affeccba24fa10c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoProposing to move "post conditions" as an optional topic for a test case. 05/34405/1
ChristopherPrice [Sun, 7 May 2017 11:44:39 +0000 (13:44 +0200)]
Proposing to move "post conditions" as an optional topic for a test case.

It is not clear that there are post conditions to be documented for all test cases.
In the case a test cse creates an image and deletes it, there is littöe need for
a post condition to be documented.  If a test case establishes a network to be
used for a subsequent test ina  sequence this information should be clearly dcumented.

Change-Id: Ifb4bb45f240921c180077ab7273988d973417f6f
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
8 years agoMerge "Get results json data from database"
hongbo tian [Fri, 5 May 2017 08:56:30 +0000 (08:56 +0000)]
Merge "Get results json data from database"

8 years agoMerge "Uploading the initial draft of the first VPN test case "
hongbo tian [Fri, 5 May 2017 01:20:31 +0000 (01:20 +0000)]
Merge "Uploading the initial draft of the first VPN test case "

8 years agoMerge "Drafting the first "refstack" version of the test scope document."
hongbo tian [Thu, 4 May 2017 03:41:29 +0000 (03:41 +0000)]
Merge "Drafting the first "refstack" version of the test scope document."

8 years agoGet results json data from database 99/34099/3
xudan [Wed, 3 May 2017 06:11:51 +0000 (06:11 +0000)]
Get results json data from database

JIRA: DOVETAIL-417

1. If report results with files, all results will be stored in local files.
2. If report to database, will get results from database and stored with file results.json

Change-Id: Ic30037bd66cd37042f82b75fac2043a876e21c6f
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoMerge "local db support offline mode"
hongbo tian [Wed, 3 May 2017 17:27:38 +0000 (17:27 +0000)]
Merge "local db support offline mode"

8 years agolocal db support offline mode 85/34085/6
Leo Wang [Tue, 2 May 2017 23:50:02 +0000 (16:50 -0700)]
local db support offline mode

JIRA: DOVETAIL-415

The local db also need to support offline, move all the git clone/apt/yum/pip/wget/curl into the Dockerfile

Change-Id: I2392dc9f4a6bd6f6a5a3f4849625a576c51a44f8
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
8 years agoDrafting the first "refstack" version of the test scope document. 85/33885/5
Georg Kunz [Wed, 26 Apr 2017 15:31:37 +0000 (17:31 +0200)]
Drafting the first "refstack" version of the test scope document.

To be aligned with the committers and agreed as the "foundation" list of
test scope for moving forward with DoveTail test selection.
Requires a majority of committer approvals prior to merging.

Change-Id: I5fb091d2190a183d24ba9e766d19aba9e6a7c094
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
8 years agoMerge "xipv6 testcase adjustment"
hongbo tian [Wed, 3 May 2017 09:08:36 +0000 (09:08 +0000)]
Merge "xipv6 testcase adjustment"

8 years agoxipv6 testcase adjustment 35/34035/3
MatthewLi [Tue, 2 May 2017 06:34:02 +0000 (02:34 -0400)]
xipv6 testcase adjustment

JIRA: DOVETAIL-418

1) ipv6 tc002-tc005 error fix, delete wrong testcases
2) ipv6 tc018-tc025 os-nosdn-nofeature scenario dependent, make
   it known to the users

Change-Id: I8e63131b795403ee63566ae59bf46782524acd5a
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
8 years agoUploading the initial draft of the first VPN test case 45/33945/4
ChristopherPrice [Thu, 27 Apr 2017 11:11:59 +0000 (13:11 +0200)]
Uploading the initial draft of the first VPN test case

This should be considered in the danube CVP phase as an
optional test area for OPNFV compliance

Change-Id: I99494cf2246e1cf079b87414ef1bb34d9b26e6b3
Co-Authored-By: Tim Irnich <tim.irnich@ericsson.com>
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
8 years agoTips on update docker to right version, > 1.8 27/34027/1
grkiss [Mon, 1 May 2017 22:50:20 +0000 (15:50 -0700)]
Tips on update docker to right version, > 1.8

JIRA: DOVETAIL-414

Dovetail requires docker at version > 1.8, so add some validation in code, and also versions of client and server should match
with each other, or there will be unpredictable errors.

Gives a notice to user to decide whether to update the docker to the latest version(1.17)

Change-Id: I1331f5c19943a73e8fe25f76bd21628233e556f3
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
8 years agosupport HA test cases to run with key 63/33963/2
xudan [Thu, 27 Apr 2017 14:16:12 +0000 (14:16 +0000)]
support HA test cases to run with key

JIRA: DOVETAIL-409

1. HA test cases need a file pod.yaml, in this file it can use the password or the key.
2. If use key, Dovetail need to pass the key file $DOVETAIL_HOME/dovetail/userconfig/id_rsa
   to yardstick Container.
3. Add a directory $DOVETAIL_HOME/dovetail/userconfig and a sample_pod.yaml
4. ha.tc001 tc003 tc005 tc006 tc009 are ready.

Change-Id: I391cc211dba2cf0740dd0dcaee8a5c2d712eaee1
Signed-off-by: xudan <xudan16@huawei.com>
8 years agoSetting the document directory structure according to the Plugfest outcome. 65/33865/5
ChristopherPrice [Wed, 26 Apr 2017 13:25:55 +0000 (15:25 +0200)]
Setting the document directory structure according to the Plugfest outcome.

Implemented a directory and file structure that supports the requirements defined
in the plugfest etherpad: https://etherpad.opnfv.org/p/cvp_tooling_sketch

Change-Id: Icb7d2db4b0132f2039c680883e173ff5d7fc0120
Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
8 years agoAdding a stub document for a CVP reviewer guide 51/33851/3
Georg Kunz [Wed, 26 Apr 2017 11:50:29 +0000 (13:50 +0200)]
Adding a stub document for a CVP reviewer guide

This document shall describe guidelines and evaluation criteria for
reviewers on how to handle the review process of results.

DOVETAIL-408

Change-Id: I78e669544bc172b74f94443176a48082a4c28a2f
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>