dovetail.git
7 years agoTag dovetail with cvp.0.7.0 75/43575/2
xudan [Fri, 29 Sep 2017 08:08:41 +0000 (04:08 -0400)]
Tag dovetail with cvp.0.7.0

docker image used
1. opnfv/yardstick: danube.3.2
2. opnfv/functest: cvp.0.5.0
3. opnfv/bottlenecks: cvp.0.4.0
4. opnfv/testapi: cvp.0.5.0
5. opnfv/dovetail:web.cvp.0.7.0
6. opnfv/dovetail:api.cvp.0.7.0
7. opnfv/dovetail: cvp.0.7.0

main changes
1. [cvp-web]correct dockerfile
2. [cvp-web]remove useless docker-compose yaml
3. Bugfix: sdnvpn test cases failed due to wrong module name
4. Support to run mandatory or optional test cases separately
5. [cvp-web]remove workflow on homepage
6. add api&web services for cvp
7. Don't generate tar file when run without pushing results to DB
8. Make Yardstick log level can be set by CLI
9. Update the script for building local DB and testapi
10. Bugfix: tar results dir cannot be parsed by web portal
11. Replacing references to "DefCore"
12. Updating the test specification document with iterative inprovements
13. Dovetail tool replaces defcore with osinterop
14. Clearer structuring current and future test scope of CVP addendum
15. Adding a stub document for a CVP reviewer guide
16. Clarify criteria for testcase inclusion as running in Functest/CI
17. And additional clarifications.
18. add more information for the Identity testcases in the refstack
19. Doc: update user guide due to add new test cases and features

For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

JIRA: DOVETAIL-516

Change-Id: Ic65073fd749c1bcdbd0946d081ba2d2fe9105057
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "[cvp-web]correct dockerfile"
Leo wang [Fri, 29 Sep 2017 06:18:32 +0000 (06:18 +0000)]
Merge "[cvp-web]correct dockerfile"

7 years agoMerge "[cvp-web]remove useless docker-compose yaml"
Leo wang [Fri, 29 Sep 2017 06:15:08 +0000 (06:15 +0000)]
Merge "[cvp-web]remove useless docker-compose yaml"

7 years ago[cvp-web]correct dockerfile 55/43555/1
grakiss [Fri, 29 Sep 2017 06:10:51 +0000 (02:10 -0400)]
[cvp-web]correct dockerfile

JIRA: DOVETAIL-515

correct dockerfile, git clone from dovetail

Change-Id: I1dee7f8ae5278f55bcf5928bbf88cdb079388494
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoMerge "Bugfix: sdnvpn test cases failed due to wrong module name"
Leo wang [Fri, 29 Sep 2017 04:07:45 +0000 (04:07 +0000)]
Merge "Bugfix: sdnvpn test cases failed due to wrong module name"

7 years agoBugfix: sdnvpn test cases failed due to wrong module name 93/43393/4
xudan [Thu, 28 Sep 2017 06:28:51 +0000 (02:28 -0400)]
Bugfix: sdnvpn test cases failed due to wrong module name

SDNVPN test cases failed due to wrong module name.
The module name needs to be changed into "sdnvpn.test.functest.testcase_1"
Refer to patch https://gerrit.opnfv.org/gerrit/#/c/41385/
Currently Dovetail uses functest:cvp.0.5.0 which uses module name "testcase_1".

JIRA: DOVETAIL-510

Change-Id: I3232760d3af34125c7da71a5d2c62ca32693c82b
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Support to run mandatory or optional test cases separately"
Leo wang [Fri, 29 Sep 2017 03:34:16 +0000 (03:34 +0000)]
Merge "Support to run mandatory or optional test cases separately"

7 years ago[cvp-web]remove useless docker-compose yaml 29/43529/1
grakiss [Fri, 29 Sep 2017 02:46:53 +0000 (22:46 -0400)]
[cvp-web]remove useless docker-compose yaml

JIRA: DOVETAIL-514

remove useless docker-compose yaml

Change-Id: Ic754488611571c3464515772680ad94bbe5651ea
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years ago[cvp-web]remove workflow on homepage 27/43527/1
grakiss [Fri, 29 Sep 2017 02:22:35 +0000 (22:22 -0400)]
[cvp-web]remove workflow on homepage

JIRA: DOVETAIL-513

remove workflow on homepage, add a link to workflow instead

Change-Id: Id8e551d4c593a2104c7cc8eb55468e9c29b5052a
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoMerge "add api&web services for cvp"
hongbo tian [Thu, 28 Sep 2017 09:28:41 +0000 (09:28 +0000)]
Merge "add api&web services for cvp"

7 years agoadd api&web services for cvp 11/43411/4
grakiss [Thu, 28 Sep 2017 07:47:54 +0000 (03:47 -0400)]
add api&web services for cvp

JIRA: DOVETAIL-512

add api&web services for cvp

Change-Id: I9ef9525e980fe61dc3108035ef9a3ff8783b2697
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoMerge "Don't generate tar file when run without pushing results to DB"
Leo wang [Thu, 28 Sep 2017 08:34:50 +0000 (08:34 +0000)]
Merge "Don't generate tar file when run without pushing results to DB"

7 years agoMerge "Make Yardstick log level can be set by CLI"
Leo wang [Thu, 28 Sep 2017 07:36:57 +0000 (07:36 +0000)]
Merge "Make Yardstick log level can be set by CLI"

7 years agoDon't generate tar file when run without pushing results to DB 07/43407/1
xudan [Thu, 28 Sep 2017 07:36:55 +0000 (03:36 -0400)]
Don't generate tar file when run without pushing results to DB

1. Dovetail generate a tar file for uploading results to CVP web portal.
2. If users don't run with option --report, it shouldn't generate the tar file.
   Because users can not upload results to CVP if they don't run with --report.
3. If it generates the tar file when user run dovetail without --report,
   the tar file is invalid because it lacks of results.json.

JIRA: DOVETAIL-511

Change-Id: I4d21f21f0b278962564d810369df03100b38f003
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Update the script for building local DB and testapi"
Leo wang [Wed, 27 Sep 2017 07:02:19 +0000 (07:02 +0000)]
Merge "Update the script for building local DB and testapi"

7 years agoUpdate the script for building local DB and testapi 31/43231/1
xudan [Wed, 27 Sep 2017 00:54:15 +0000 (20:54 -0400)]
Update the script for building local DB and testapi

1. When test dovetail, users can build local DB and testapi to store and
   report the results.
2. The script for building local DB and testapi needs some updates.

JIRA: DOVETAIL-507

Change-Id: I8bc96bfea27f424468cafaa2e05894065ef44ad9
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoBugfix: tar results dir cannot be parsed by web portal 31/43131/2
xudan [Tue, 26 Sep 2017 07:44:13 +0000 (03:44 -0400)]
Bugfix: tar results dir cannot be parsed by web portal

The directory tree of results tar file is wrong, so web portal cannot parse it.
Reset the tar file.

JIRA: DOVETAIL-508

Change-Id: I8475323294e84ca51242b700570926d5c0177390
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMake Yardstick log level can be set by CLI 81/42981/3
xudan [Mon, 25 Sep 2017 08:44:38 +0000 (04:44 -0400)]
Make Yardstick log level can be set by CLI

1. Currently, the log level of yardstick is DEBUG and cannot be modified.
2. Make it can be changed from CLI.
3. When use dovetail run --debug, can see all Yardstick logs (including DEBUG)
   in dovetail.log.
4. When run without debug option, cannot see Yardstick debug logs in
   dovetail.logs.
5. yardstick.log always doesn't include debug logs.

JIRA: DOVETAIL-506

Change-Id: Iaafb61232a22e16fff2fa4605bf7e262b022085e
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoSupport to run mandatory or optional test cases separately 09/43109/1
xudan [Tue, 26 Sep 2017 03:30:08 +0000 (23:30 -0400)]
Support to run mandatory or optional test cases separately

1. Currently, dovetail can run a test suite or a test area in that test suite.
2. The test areas in one test suite are not divided into optional and mandatory.
3. Split them and support to run just mandatory or optional.
4. Support to run multiple test areas.

JIRA: DOVETAIL-505

Change-Id: I42cd7b4e11c3e3674c806e9bc999b782bf5c85c6
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Replacing references to "DefCore""
hongbo tian [Mon, 25 Sep 2017 03:56:07 +0000 (03:56 +0000)]
Merge "Replacing references to "DefCore""

7 years agoDovetail tool replaces defcore with osinterop 05/42205/1
xudan [Mon, 18 Sep 2017 07:31:14 +0000 (03:31 -0400)]
Dovetail tool replaces defcore with osinterop

Rename the "defcore" test area to "osinterop".
The DefCore working group has been
renamed OpenStack InterOp Working Group some time ago.

JIRA: DOVETAIL-499

Change-Id: I144af767632c8fb83859e5e04b6427bb1a538348
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoClearer structuring current and future test scope of CVP addendum 41/41241/5
Georg Kunz [Wed, 6 Sep 2017 23:11:14 +0000 (01:11 +0200)]
Clearer structuring current and future test scope of CVP addendum

This patchset attempts to more clearly structure the outcome of the
scope analysis by having dedicated "in scope" and "future scope"
sections

Change-Id: I6a42a8ac4495fa4e2e5e773a7f594704d9cc1e28
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
7 years agoReplacing references to "DefCore" 01/41601/2
Georg Kunz [Mon, 11 Sep 2017 21:50:15 +0000 (23:50 +0200)]
Replacing references to "DefCore"

This patch removes all references to the outdated term "DefCore"
in the Dovetail documentation. The DefCore working group has been
renamed OpenStack InterOp Working Group some time ago.

This patch also proposes renaming the "defcore" test area to
"osinterop".

JIRA: DOVETAIL-499

Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
7 years agoMerge "Clarify criteria for testcase inclusion as running in Functest/CI And addition...
hongbo tian [Mon, 11 Sep 2017 02:08:58 +0000 (02:08 +0000)]
Merge "Clarify criteria for testcase inclusion as running in Functest/CI And additional clarifications."

7 years agoMerge "add more information for the Identity testcases in the refstack"
hongbo tian [Fri, 8 Sep 2017 07:46:34 +0000 (07:46 +0000)]
Merge "add more information for the Identity testcases in the refstack"

7 years agoMerge "Doc: update user guide due to add new test cases and features"
hongbo tian [Fri, 8 Sep 2017 07:45:33 +0000 (07:45 +0000)]
Merge "Doc: update user guide due to add new test cases and features"

7 years agotag dovetail with 0.6.0 71/41371/2
xudan [Fri, 8 Sep 2017 06:53:31 +0000 (02:53 -0400)]
tag dovetail with 0.6.0

docker image used
opnfv/yardstick: danube.3.2
opnfv/functest: cvp.0.5.0
opnfv/bottlenecks: cvp.0.4.0
opnfv/testapi: cvp.0.6.0
opnfv/dovetail:web.cvp.0.6.0
opnfv/dovetail:api.cvp.0.6.0
opnfv/dovetail: cvp.0.6.0
main changes
Merge all test specification docs about test area tempest and defcore
Merge addendum doc and workflow doc
Remake aarch64 patch for Dovetail container
Remove some tempest test cases that are not too common
Add additional Tempest API test cases into test case tempest.tc005
persist db file in host for mongo container
add nginx to host static files
add a sample tempest_conf.yaml file into userconfig
Add a patch to set ha SLA to be 30 seconds
Modify logs
Bugfix: the config files in useeconfig will cover user's config
Bugfix: functest only keeps the last test case's log
Bugfix: pre_condition cmds is just executed once
For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

JIRA: DOVETAIL-497

Change-Id: I74626bbf65ce0121cc7b53394c85694e15df8484
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Add a patch to set ha SLA to be 30 seconds"
Leo wang [Fri, 8 Sep 2017 01:40:16 +0000 (01:40 +0000)]
Merge "Add a patch to set ha SLA to be 30 seconds"

7 years agoModify logs 85/41285/1
xudan [Thu, 7 Sep 2017 08:49:50 +0000 (04:49 -0400)]
Modify logs

JIRA: DOVETAIL-498

Change-Id: Ie98fc89cc840b557aa4186c6c2bee2d610432af0
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Add test area 'forwarding packets through virtual networks in data path'"
hongbo tian [Thu, 7 Sep 2017 04:06:14 +0000 (04:06 +0000)]
Merge "Add test area 'forwarding packets through virtual networks in data path'"

7 years agoAdd a patch to set ha SLA to be 30 seconds 51/41251/2
xudan [Thu, 7 Sep 2017 01:49:26 +0000 (21:49 -0400)]
Add a patch to set ha SLA to be 30 seconds

1. According to ha test specification doc, the SLA of process recover time
   is 30 seconds.
2. However, the SLA in Yardstick test cases are all 20 seconds.
3. Add a patch to change the SLA in yardstick test cases.

JIRA: DOVETAIL-496

Change-Id: Ib8f229fdfbb3289bf70d6ee900132b3db3a21b17
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Test case specification for VIM Network"
hongbo tian [Thu, 7 Sep 2017 01:47:32 +0000 (01:47 +0000)]
Merge "Test case specification for VIM Network"

7 years agoDoc: update user guide due to add new test cases and features 69/40369/5
xudan [Mon, 28 Aug 2017 09:30:39 +0000 (05:30 -0400)]
Doc: update user guide due to add new test cases and features

There has been added some new test cases and features, so user guide should be
updated according to the latest dovetail version.
- Add introduction about https (with cacert and without cacert)
- Add introduction about adding hosts' info
- Add introduction about downloading cirros images
- Add introduction about special configurations for running defcore and
  tempest test cases
- Add introduction about how to check defcore and tempest failed test cases

JIRA: DOVETAIL-493

Change-Id: I13aca4ee433056bd21590743a412d5d95f45fec4
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Remake aarch64 patch for Dovetail container"
Leo wang [Wed, 6 Sep 2017 07:49:46 +0000 (07:49 +0000)]
Merge "Remake aarch64 patch for Dovetail container"

7 years agoAdd test area 'forwarding packets through virtual networks in data path' 23/39223/7
xudan [Mon, 14 Aug 2017 03:59:09 +0000 (23:59 -0400)]
Add test area 'forwarding packets through virtual networks in data path'

JIRA: DOVETAIL-473

According to Dovetail addendum doc, add one test area about basic cloud
capability 'forwarding packets through virtual networks in data path'.

Add the test specification about this test area.

Change-Id: I26416ecca6b89a94cf48ba0f55308df0fa6e1677
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoAdd test area 'simple virtual machine resource scheduling on multiple nodes' 29/39229/5
xudan [Mon, 14 Aug 2017 05:12:00 +0000 (01:12 -0400)]
Add test area 'simple virtual machine resource scheduling on multiple nodes'

JIRA: DOVETAIL-473

According to Dovetail addendum doc, add one test area about basic cloud
capability 'simple virtual machine resource scheduling on multiple nodes'.

Add the test specification about this test area.

Change-Id: I7a5ff426442424dbc364a68296facb0bac6401ca
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Add test area 'correct behavior after common virtual machine life cycles events'"
hongbo tian [Wed, 6 Sep 2017 02:35:09 +0000 (02:35 +0000)]
Merge "Add test area 'correct behavior after common virtual machine life cycles events'"

7 years agoMerge "Test case specification for VIM Image"
hongbo tian [Wed, 6 Sep 2017 01:55:00 +0000 (01:55 +0000)]
Merge "Test case specification for VIM Image"

7 years agoMerge "Bugfix: the config files in useeconfig will cover user's config"
Leo wang [Wed, 6 Sep 2017 01:34:19 +0000 (01:34 +0000)]
Merge "Bugfix: the config files in useeconfig will cover user's config"

7 years agoAdd test area 'correct behavior after common virtual machine life cycles events' 27/39227/4
xudan [Mon, 14 Aug 2017 05:06:27 +0000 (01:06 -0400)]
Add test area 'correct behavior after common virtual machine life cycles events'

JIRA: DOVETAIL-473

According to Dovetail addendum doc, add one test area about basic cloud
capability 'correct behavior after common virtual machine life cycles events'.

Add the test specification about this test area.

Change-Id: I051b3c5b501ed833a613ea6a6601125c4fa80c3e
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Remove some tempest test cases that are not too common"
hongbo tian [Tue, 5 Sep 2017 08:15:11 +0000 (08:15 +0000)]
Merge "Remove some tempest test cases that are not too common"

7 years agoMerge "Add test area 'dynamic network runtime operations'"
hongbo tian [Tue, 5 Sep 2017 06:24:51 +0000 (06:24 +0000)]
Merge "Add test area 'dynamic network runtime operations'"

7 years agoMerge "Test case specification for VIM Compute"
hongbo tian [Mon, 4 Sep 2017 06:54:39 +0000 (06:54 +0000)]
Merge "Test case specification for VIM Compute"

7 years agoRemove some tempest test cases that are not too common 63/40963/1
xudan [Mon, 4 Sep 2017 03:11:40 +0000 (23:11 -0400)]
Remove some tempest test cases that are not too common

Change-Id: I2a19b9f3e6c44bedef5d3cb20f480405e4d6d5e2
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Test case specification for VIM Volume"
hongbo tian [Fri, 1 Sep 2017 12:29:11 +0000 (12:29 +0000)]
Merge "Test case specification for VIM Volume"

7 years agoAdd test area 'dynamic network runtime operations' 79/38379/14
xudan [Sat, 29 Jul 2017 04:59:07 +0000 (00:59 -0400)]
Add test area 'dynamic network runtime operations'

JIRA: DOVETAIL-473

According to Dovetail addendum doc, add one test area about basic cloud
capability 'dynamic network runtime operations through the life of a VNF'.

Add the test specification about this test area.

Change-Id: I59706bc4a5765cf779a03fc3c493e5a8d184c1dc
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Add test area 'filtering packets based on security rules and port security'"
hongbo tian [Fri, 1 Sep 2017 09:18:26 +0000 (09:18 +0000)]
Merge "Add test area 'filtering packets based on security rules and port security'"

7 years agoAdd additional Tempest API test cases into test case tempest.tc005 45/40745/2
xudan [Thu, 31 Aug 2017 08:48:41 +0000 (04:48 -0400)]
Add additional Tempest API test cases into test case tempest.tc005

1. According to the latest dovetail test case specification document,
   there are 5 new Tempest api test cases.
2. Add them into tempest.tc005 so they can be tested in CI.

JIRA: DOVETAIL-495

Change-Id: Ib8057d01b99472aeb91cf564d09b67407c572235
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoTest case specification for VIM Compute 59/39459/4
xudan [Thu, 17 Aug 2017 01:59:56 +0000 (21:59 -0400)]
Test case specification for VIM Compute

1. Add the alias VIM Compute test cases into testscope.
2. Add test case specification for VIM Compute.

Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoBugfix: the config files in useeconfig will cover user's config 33/40733/1
xudan [Thu, 31 Aug 2017 06:20:25 +0000 (02:20 -0400)]
Bugfix: the config files in useeconfig will cover user's config

1. Now there are 2 sample files tempest_conf.yaml and hosts.yaml in userconfig,
   and thet will cover user's tempest_conf.yaml and hosts.yaml
   in $DOVETAIL_HOME/pre_config.
2. Rename the files in userconfig to be tempest_conf.yaml.sample
   and hosts.yaml.sample.
3. Add the hosts info in file /etc/hosts in Dovetail Container.

JIRA: DOVETAIL-492

Change-Id: I2b5694a8058b864b510925eec595d6f2bd1062ff
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Bugfix: functest only keeps the last test case's log"
Leo wang [Mon, 28 Aug 2017 07:26:58 +0000 (07:26 +0000)]
Merge "Bugfix: functest only keeps the last test case's log"

7 years agoBugfix: functest only keeps the last test case's log 51/40051/3
xudan [Thu, 24 Aug 2017 02:18:31 +0000 (22:18 -0400)]
Bugfix: functest only keeps the last test case's log

JIRA: DOVETAIL-490

1. Dovetail just keeps the last tempest/defcore/ipv6/bgpvpn test's log file.
2. All log files should be kept, so users and developers can know the reason
   of failed test cases.
3. tempest logs will be stored in directory tempest_logs/
4. defcore logs will be stored in directory defcore_logs/
5. IPv6 logs will be stored in directory ipv6_logs/
6. bgpvpn logs will be stored in directory bgpvpn_logs/
7. All vping logs are in functest.log

Change-Id: I79eae79cb32d65ce1ada3dd6f4c6dfd3945fc512
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Bugfix: pre_condition cmds is just executed once"
Leo wang [Mon, 28 Aug 2017 03:48:40 +0000 (03:48 +0000)]
Merge "Bugfix: pre_condition cmds is just executed once"

7 years agoAdded top-down scope analysis based on cvp objectives and end-user expectations.... 61/35161/17
Trevor Cooper [Mon, 22 May 2017 20:24:59 +0000 (13:24 -0700)]
Added top-down scope analysis based on cvp objectives and end-user expectations. Also simplified to focus on scope only.

Change-Id: Ibde9fdacfd026f7859bd6fd239d79fdbdeccad01
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
7 years agoMerge "Draft a workflow that will work with the CVP web portal and test API. Also...
hongbo tian [Fri, 25 Aug 2017 06:35:36 +0000 (06:35 +0000)]
Merge "Draft a workflow that will work with the CVP web portal and test API. Also made simplifications for the first release."

7 years agoBugfix: pre_condition cmds is just executed once 25/39925/2
xudan [Wed, 23 Aug 2017 01:24:09 +0000 (21:24 -0400)]
Bugfix: pre_condition cmds is just executed once

JIRA: DOVETAIL-489

1. All the cmds defined in pre_condition is just executed once for each type
   i.e. functest, yardstick, bottlenecks...
2. The copy cmds defined in each functest test cases are just executed for the
   first test case rather than all test cases.
3. Make the cmds to be executed for each test case.

Change-Id: I571f0eb9dd3cab77fc8597e5a9b5246398804d3e
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoClarify criteria for testcase inclusion as running in Functest/CI 63/38763/4
Bryan Sullivan [Fri, 4 Aug 2017 13:36:53 +0000 (06:36 -0700)]
Clarify criteria for testcase inclusion as running in Functest/CI
And additional clarifications.

JIRA: DOVETAIL-477
Replace tabs.
Further clarify testing programs and optionality criteria.

Change-Id: I8eebdf215fb7cc75a6da9748629b1a73d0b71d19
Signed-off-by: Bryan Sullivan <bryan.sullivan@att.com>
7 years agopersist db file in host for mongo container 51/39851/1
grakiss [Tue, 22 Aug 2017 08:06:22 +0000 (16:06 +0800)]
persist db file in host for mongo container

JIRA: DOVETAIL-488

Keep db file in host to avoid data lost

Change-Id: If039789eabfb8847ea344c016cb74e226be43f73
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoDraft a workflow that will work with the CVP web portal and test API. Also made simpl... 43/34643/12
Trevor Cooper [Wed, 17 May 2017 04:29:40 +0000 (21:29 -0700)]
Draft a workflow that will work with the CVP web portal and test API. Also made simplifications for the first release.

Change-Id: Ief92a7e71c546883fdf472346646a43c9ae26c94
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
7 years agoTest case specification for VIM Volume 85/39585/2
xudan [Fri, 18 Aug 2017 10:19:39 +0000 (06:19 -0400)]
Test case specification for VIM Volume

1. Add the alias VIM Volume test cases into testscope.
2. Add test case specification for VIM Volume.

Change-Id: I715a69aad380466659365cc554351efb4d6eb053
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoadd nginx to host static files 89/39489/2
grakiss [Thu, 17 Aug 2017 09:14:56 +0000 (17:14 +0800)]
add nginx to host static files

JIRA: DOVETAIL-485

Tornado does not support directory listing, so add nginx to host static files, and support log file browsing

Change-Id: Ic1427ab9c64661b3993ac60943f470b125a0fbe7
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoAdd a sample tempest_conf.yaml file into userconfig 63/39463/1
xudan [Thu, 17 Aug 2017 02:32:26 +0000 (22:32 -0400)]
Add a sample tempest_conf.yaml file into userconfig

1. Functest cvp.0.5.0 supports to config tempest.conf file when running
   tempest test cases.
2. Dovetail provides a sample tempest_conf.yaml file, and user can edit
   this file before running tempest test cases.
3. All the values in this file will be used to update tempest.conf file.

Change-Id: I1afb50f1405c6cef992132899e0549396f587872
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoTest case specification for VIM Network 89/39389/3
xudan [Wed, 16 Aug 2017 05:32:06 +0000 (01:32 -0400)]
Test case specification for VIM Network

1. Add the alias VIM Network test cases into testscope.
2. Add test case specification for VIM Network.

Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoTag dovetail with cvp.0.5.0 17/39417/1
xudan [Wed, 16 Aug 2017 10:25:31 +0000 (06:25 -0400)]
Tag dovetail with cvp.0.5.0

JIRA: DOVETAIL-483

1. docker image used
   yardstick: danube.3.2
   functest: cvp.0.5.0
   bottlenecks: cvp.0.4.0
   testapi: cvp.0.5.0
   dovetail: cvp.0.5.0
2. main changes
   Bugfix: wrong command in function 'check_https_enabled'
   Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool
   Create a tar file for all logs
   Add tempest test cases into proposed_tests
   Fix testapi base_url for public_url
   Add user guide for results operations on web
3. For more information, refer to
   https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoBugfix: wrong command in function 'check_https_enabled' 93/39393/1
xudan [Wed, 16 Aug 2017 07:05:56 +0000 (03:05 -0400)]
Bugfix: wrong command in function 'check_https_enabled'

JIRA: DOVETAIL-482

1. In function check_https_enabled, it will use cmd
   "openstack catalog show identity |awk '/public/ {print $4}'"
   to check if it is https.

2. However, this command will not work if it is https.

3. Check https via OS_AUTH_URL rather than "openstack catalog show identity".

Change-Id: If40ffa8e9b33c38123ff4b834198a8eaaedc1c9c
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoAdapt Functest cvp.0.5.0 docker image 21/39221/5
xudan [Mon, 14 Aug 2017 03:36:42 +0000 (23:36 -0400)]
Adapt Functest cvp.0.5.0 docker image

In order to use functest cvp.0.5.0, Dovetail tool needs some adaptions.

Change-Id: I9d0a23791c246a6c4961f229eaeb1f52f9b4995a
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoAdd test area 'filtering packets based on security rules and port security' 25/39225/1
xudan [Mon, 14 Aug 2017 04:14:31 +0000 (00:14 -0400)]
Add test area 'filtering packets based on security rules and port security'

JIRA: DOVETAIL-473

According to Dovetail addendum doc, add one test area about basic cloud
capability 'filtering packets based on security rules and port security
in data path'.

Add the test specification about this test area.

Change-Id: I814204f16b79bc06d9bfb54d5a90692d8b8c7bfa
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "create a tar file for logs"
Leo wang [Fri, 11 Aug 2017 01:42:36 +0000 (01:42 +0000)]
Merge "create a tar file for logs"

7 years agoMerge "Add Tempest test cases to Dovetail CI daily jobs"
Leo wang [Fri, 11 Aug 2017 01:42:03 +0000 (01:42 +0000)]
Merge "Add Tempest test cases to Dovetail CI daily jobs"

7 years agoRemake aarch64 patch for Dovetail container 73/39073/6
Alexandru Nemes [Thu, 10 Aug 2017 14:52:56 +0000 (17:52 +0300)]
Remake aarch64 patch for Dovetail container

JIRA: ARMBAND-286

Change-Id: Ided665488c7240943f62c65df0535d8b0178459f
Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
7 years agoTest case specification for VIM Image 89/37989/3
hongbotian [Mon, 24 Jul 2017 07:52:52 +0000 (07:52 +0000)]
Test case specification for VIM Image

1. Adding the alias VIM image test cases into testscope.
2. Adding test case specification for VIM Image.

Change-Id: Ifa7aa5ddea22d2862ee5d8ad465523d450a78fde
Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
7 years agocreate a tar file for logs 13/39013/1
grakiss [Thu, 10 Aug 2017 02:03:13 +0000 (10:03 +0800)]
create a tar file for logs

JIRA: DOVETAIL-479

User may want to upload all logs along with the results,
so others may check the running logs to make sure what' s going on during the test.

Change-Id: Ice906264bbdf091d3353d6d2e146653aeb057f5f
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agocreate a tar file for logs 91/38891/1
grakiss [Tue, 8 Aug 2017 09:04:23 +0000 (17:04 +0800)]
create a tar file for logs

JIRA: DOVETAIL-479

User may want to upload all logs along with the results,
so others may check the running logs to make sure what' s going on during the test.

Change-Id: Ia5862f99c129b8207aa91a391567ffdd5ee0829a
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoAdd Tempest test cases to Dovetail CI daily jobs 35/38835/2
xudan [Mon, 7 Aug 2017 11:28:16 +0000 (07:28 -0400)]
Add Tempest test cases to Dovetail CI daily jobs

JIRA: DOVETAIL-478

JIRA: DOVETAIL-473 adds 6 test areas:
- forwarding packets through virtual networks in data path
- filtering packets based on security rules and port security in data path
- dynamic network runtime operations through the life of a VNF
- correct behavior after common virtual machine life cycles events
- simple virtual machine resource scheduling on multiple nodes
- storage security

Add Tempest test cases belong to this 6 test areas to Dovetail CI daily jobs.

Change-Id: I1535d96f3a85cdd8ac4f0c4375c68ce47bd9df93
Signed-off-by: xudan <xudan16@huawei.com>
7 years agofix base_url for public url 23/38823/1
grakiss [Mon, 7 Aug 2017 06:53:15 +0000 (14:53 +0800)]
fix base_url for public url

Change-Id: I171e9b0bce1891594bf7ef577809e73f05556810
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoMerge "add user guide for results operations on web"
hongbo tian [Fri, 4 Aug 2017 08:39:38 +0000 (08:39 +0000)]
Merge "add user guide for results operations on web"

7 years agoMerge "Tag dovetail with cvp.0.4.0"
hongbo tian [Fri, 4 Aug 2017 07:05:42 +0000 (07:05 +0000)]
Merge "Tag dovetail with cvp.0.4.0"

7 years agoTag dovetail with cvp.0.4.0 45/38745/2
xudan [Fri, 4 Aug 2017 06:23:17 +0000 (02:23 -0400)]
Tag dovetail with cvp.0.4.0

JIRA: DOVETAIL-476

1. docker image used
   yardstick: danube.3.1
   functest: cvp.0.2.0
   bottlenecks: cvp.0.4.0
   testapi: cvp.0.4.0
   dovetail: cvp.0.4.0
2. main changes
   Add docs about vping test cases (test scope and test specification)
   Add 2 vping test cases into proposed_tests
   Bugfix: Build docker image failed because of lacking of packages
   Add resiliency.tc001 into proposed_tests
3. For more information, refer to
   https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoadd user guide for results operations on web 65/38065/6
grakiss [Tue, 25 Jul 2017 09:44:16 +0000 (17:44 +0800)]
add user guide for results operations on web

JIRA: dovetail-471

User can access results through the web page
browser the public results uploaded by others or himself
upload the results, and set this results as public or private to others

Change-Id: I9834a670f5dff6412a0290d9a5dd729bcece2933
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
7 years agoAdd resiliency test caes into proposed_tests 13/38713/2
xudan [Fri, 4 Aug 2017 01:28:03 +0000 (21:28 -0400)]
Add resiliency test caes into proposed_tests

JIRA: DOVETAIL-474

Add Bottlenecks resiliency test case "posca_factor_ping" into proposed_tests.

Change-Id: I76aea651014fb4722ddae07559f417d3f840eee2
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoBugfix: Build docker image failed because of lacking of packages 73/38573/1
xudan [Wed, 2 Aug 2017 02:52:58 +0000 (22:52 -0400)]
Bugfix: Build docker image failed because of lacking of packages

JIRA: DOVETAIL-475

1. Dovetail fails to build Docker image.
Link: https://build.opnfv.org/ci/view/dovetail/job/dovetail-docker-build-push-master/162/console
   Traceback: Running setup.py install for cryptography
              c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
2. Refer to https://cryptography.io/en/latest/installation/
   For Debian and Ubuntu, the following command will ensure that the required
   dependencies are installed:
   sudo apt-get install build-essential libssl-dev libffi-dev python-dev

Change-Id: Icb705823c58d8a557175d48b00745119c0a6b3b9
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "mandatory vping test case added to proposed_tests"
hongbo tian [Wed, 2 Aug 2017 01:55:38 +0000 (01:55 +0000)]
Merge "mandatory vping test case added to proposed_tests"

7 years agoMerge "WIP: Test case description for vping test cases"
hongbo tian [Wed, 2 Aug 2017 01:12:28 +0000 (01:12 +0000)]
Merge "WIP: Test case description for vping test cases"

7 years agoWIP: Test case description for vping test cases 53/36253/15
Georg Kunz [Tue, 20 Jun 2017 15:43:05 +0000 (17:43 +0200)]
WIP: Test case description for vping test cases

Adding test case descriptions for both vping test cases implemented in
Functest. Test case 1 makes use of the config drive mechanism of
Nova to pass a test script. Test case 2 uses SSH to transfer and execute
a script on one VM.

Change-Id: Ic8be6ad4dfd4b0e7661064506b0ae92db2fc1463
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
7 years agoMerge "Use uuid1 to replace uuid4"
hongbo tian [Fri, 21 Jul 2017 08:13:04 +0000 (08:13 +0000)]
Merge "Use uuid1 to replace uuid4"

7 years agoTag dovetail with cvp.0.3.0 87/37887/3
xudan [Fri, 21 Jul 2017 02:06:51 +0000 (22:06 -0400)]
Tag dovetail with cvp.0.3.0

JIRA: DOVETAIL-468

1. docker image used
   yardstick: danube.3.1
   functest: cvp.0.2.0
   testapi: cvp.0.3.0
   dovetail: cvp.0.3.0
2. main changes
   fix dovetail docker version to be 17.03.0-ce
   adapt yardstick danube.3.1
   For more information, refer to
   https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Draft dovetail user guide first cut"
Leo wang [Fri, 21 Jul 2017 07:44:25 +0000 (07:44 +0000)]
Merge "Draft dovetail user guide first cut"

7 years agoUse uuid1 to replace uuid4 01/37901/1
xudan [Fri, 21 Jul 2017 06:44:58 +0000 (02:44 -0400)]
Use uuid1 to replace uuid4

JIRA: DOVETAIL-469

uuid1 is more unique than uuid4

Change-Id: Ic29ec7586ba518e67cb1750df1001cd390fcf313
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoMerge "Delete the ERROR log when it is not https"
Leo wang [Fri, 21 Jul 2017 01:19:03 +0000 (01:19 +0000)]
Merge "Delete the ERROR log when it is not https"

7 years agoMerge "Adapt Yardstick to copy yardstick.conf to /etc/yardstick"
Leo wang [Fri, 21 Jul 2017 01:18:39 +0000 (01:18 +0000)]
Merge "Adapt Yardstick to copy yardstick.conf to /etc/yardstick"

7 years agoMerge "Fix the docker version to be 17.03.0-ce rather than the latest one"
Leo wang [Fri, 21 Jul 2017 01:18:19 +0000 (01:18 +0000)]
Merge "Fix the docker version to be 17.03.0-ce rather than the latest one"

7 years agomandatory vping test case added to proposed_tests 53/37853/1
MatthewLi [Thu, 20 Jul 2017 10:59:13 +0000 (06:59 -0400)]
mandatory vping test case added to proposed_tests

JIRA: DOVETAIL-446

1.add vping to proposed_tests
2.delete out-dated nfvi test cases

Change-Id: I181b00b02abe6fed4ff51e947576c1b71321cdd2
Signed-off-by: MatthewLi <lijun_1203@126.com>
7 years agoFix the docker version to be 17.03.0-ce rather than the latest one 13/37813/1
xudan [Thu, 20 Jul 2017 02:14:07 +0000 (22:14 -0400)]
Fix the docker version to be 17.03.0-ce rather than the latest one

JIRA: DOVETAIL-467

1. Since the script getting with "wget qO https://get.docker.com/" has been
   changed and it can just install docker-ce rather than docker-engine now.
2. Dovetail validates with Docker 17.03 CE, so the docker installed in the
   dovetail container can be 17.03.0-ce.

Change-Id: If64204ba3dcf5a38d7a124a0cc716f8375808999
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoAdapt Yardstick to copy yardstick.conf to /etc/yardstick 37/37737/1
xudan [Wed, 19 Jul 2017 07:19:52 +0000 (03:19 -0400)]
Adapt Yardstick to copy yardstick.conf to /etc/yardstick

JIRA: DOVETAIL-466

1. Yardstick danube.3.1 needs a yardstick.conf file in /etc/yardstick
2. Copy the file /home/opnfv/repos/yardstick/etc/yardstick/yardstick.conf.sample
   to /etc/yardstick/yardstick.conf
3. If user wants to store the results in the local file, set the dispatcher to
   be 'file'.
4. If user wants to push the results into the DB, set the dispatcher to be 'http'
   and target to be the api url getting from the user.

Change-Id: I39c30883b471ab7cb29ed6d63ba8c232da39c135
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoDelete the ERROR log when it is not https 49/37449/2
xudan [Fri, 14 Jul 2017 02:03:27 +0000 (22:03 -0400)]
Delete the ERROR log when it is not https

JIRA: DOVETAIL-462

1. If it is not https, Dovetail will give a error log
   2017-07-13 21:58:30,409 - container.Container - ERROR - The command
   'openstack catalog show identity |awk '/public/ {print $4}'| grep 'https'' failed.
2. Remove this error log becuase it is not an error.

Change-Id: I5791b1925cad8606d70eefd4940dd9bf46956305
Signed-off-by: xudan <xudan16@huawei.com>
7 years agoUpdate the IPv6 for the remain comments 29/37229/2
hongbotian [Wed, 12 Jul 2017 02:51:35 +0000 (03:51 +0100)]
Update the IPv6 for the remain comments

JIRA: DOVETAIL-461

1. Lincoln’s comments about tc018-tc021: change “using DHCPv6” to “using DHCPv6 stateless”
2. Update tc018-tc025: give more details and modify some misunderstanding about these test cases.
For more detail, please refer to jira or this patch.

Change-Id: Ieb7ee9d0b8a31826c7f2f69cb5f209055fd7b928
Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
7 years agoDraft dovetail user guide first cut 85/34285/8
Wenjing Chu [Thu, 4 May 2017 06:09:57 +0000 (23:09 -0700)]
Draft dovetail user guide first cut

Fixing comment issues and updating to new version of dovetail.

Change-Id: Iaa9243d0a835f1d050fb925fa75b2a770168a8f4
Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
7 years agotag dovetail with 0.2.0 75/36775/3
MatthewLi [Fri, 30 Jun 2017 03:49:50 +0000 (23:49 -0400)]
tag dovetail with 0.2.0

JIRA: DOVETAIL-447

docker images used

yardstick danube.3.0
functest cvp.0.2.0
testapi cvp.0.2.0
dovetail cvp.0.2.0

main changes

1, fix yardstick HA bugs
2, fix functest sdnvpn offlinebugs
3, fix dovetail https bugs, etc.
for more info, refer to
https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool

Change-Id: I4edb61b84ed80d8d7624f69db372fec60d73aa38
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
7 years agoMerge "Modify Dovetail logs"
Leo wang [Fri, 30 Jun 2017 08:12:58 +0000 (08:12 +0000)]
Merge "Modify Dovetail logs"

7 years agoChange sdnvpn testcases file path 85/36785/1
xudan [Fri, 30 Jun 2017 06:45:00 +0000 (02:45 -0400)]
Change sdnvpn testcases file path

JIRA: DOVETAIL-458

1. Functest has changed the repo of sdnvpn.
2. Currently Dovetail will copy the testcase yaml file to
   /home/opnfv/repos/sdnvpn/sdnvpn/test/functest/config.yaml in Functest container.
3. The path needed to be replaced by
   /usr/local/lib/python2.7/dist-packages/sdnvpn/test/functest/config.yaml

Change-Id: I1badba4120e96e2c9ed5a07db3189967cf24c564
Signed-off-by: xudan <xudan16@huawei.com>