grakiss [Mon, 30 Oct 2017 07:26:37 +0000 (07:26 +0000)]
[cvp-web] Show some SUT hardware info in 'My Results'
[cvp-web] Show SUT endpoint in web page
JIRA: DOVETAIL-541
JIRA: DOVETAIL-547
Show some SUT hardware info that dovetail concern in 'My Results' web page.
Show the info of all endpoints get from Dovetail tool in the web page.
Change-Id: Ibc465396e17b7c22678e3948fa2f659cbff6f323
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
grakiss [Sat, 28 Oct 2017 01:53:51 +0000 (21:53 -0400)]
[web-cvp] Trigger an email when admin submit an application form
JIRA: DOVETAIL-542
Trigger an email to cvp@opnfv.org when admin submit an application form.
Change-Id: Ie73d5a6380b5f5d1b0507564dc1f067047284f99
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
xudan [Wed, 25 Oct 2017 03:36:16 +0000 (23:36 -0400)]
Add test case name into tempest testspecification docs
1. All test cases' testspecification docs have no info about test case names.
2. User don't know which test case to run when they just want to run
one special test case.
3. Add the info into testspecification docs.
JIRA: DOVETAIL-530
Change-Id: I0ebe1b3b98be5609503814ea2a0cf71aefd06d35
Signed-off-by: xudan <xudan16@huawei.com>
Eddie Arrage [Wed, 25 Oct 2017 23:06:14 +0000 (16:06 -0700)]
Remove obsolete developer documents
Some developer documents are now old and suggested to be removed.
Change-Id: Ifa26a1535d57a560a0525eafa300ae087feb3191
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
xudan [Tue, 24 Oct 2017 08:41:48 +0000 (04:41 -0400)]
Tag dovetail with cvp.0.8.0
JIRA: DOVETAIL-536
Change-Id: I7a947b1aa57728e6add1d0ca881a6a62a46c0913
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Tue, 24 Oct 2017 10:43:46 +0000 (06:43 -0400)]
Ignore Tox Error E722
1. After updating tox from 2.5 to 2.9, pep8 failed.
2. https://build.opnfv.org/ci/job/dovetail-verify-master/1018/console
3. The Error is 'E722 do not use bare except'.
4. It needs to change all 'except:' into 'except Exception:'.
5. This won't affect Dovetail, so just ignore this Error.
6. Dovetail next release will consider to fix this error.
JIRA: DOVETAIL-537
Change-Id: Ic3c7be4667685fc94025a47c3b17d07a087565da
Signed-off-by: xudan <xudan16@huawei.com>
Wenjing Chu [Fri, 22 Sep 2017 05:28:54 +0000 (22:28 -0700)]
System preparation guide
Change-Id: I4fc982d7037466b48424b7ce97d6207fbe44a09b
Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
Georg Kunz [Fri, 6 Oct 2017 14:07:17 +0000 (16:07 +0200)]
Fixing references and layout in the docs
This patchset introduces labels for documentation-internal references
and replaces footnote-style citations with inline hyperlinks.
Additional minor changes for a nicer rendering of bullet lists.
JIRA: DOVETAIL-521
Change-Id: Ic847fc05d546d673dadc7b8efee86fcb688133f5
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
xudan [Tue, 17 Oct 2017 09:27:10 +0000 (05:27 -0400)]
Use functest clean module to do the sdnvpn resources cleanup
1. If there throw an exception during the test of one sdnvpn test case,
it will not do the clean.
2. Then there are many resources left, such as network, subnet, server...
3. This is a bug of sdnvpn see JIRA: SDNVPN-184
4. The patch for fixing this bug https://gerrit.opnfv.org/gerrit/#/c/44777/
5. Currently, use functest module "functest openstack clean" to clean the SUT.
JIRA: DOVETAIL-524
Change-Id: I629fc6fdc9e4c95960f6122358ff219a467d441b
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Mon, 23 Oct 2017 06:50:05 +0000 (02:50 -0400)]
Bugfix: the sdnvpn DB initialization information lacks two test cases
1. The SDNVPN DB initialization information lacks two test cases,
functest_testcase_4 and functest_testcase_8.
2. So the results of these 2 test cases cannot be pushed into DB.
3. Add these 2 test cases info to DB.
JIRA: DOVETAIL-535
Change-Id: I1c6d049b942806924f15dd106452fd9b4d554454
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Mon, 23 Oct 2017 03:37:50 +0000 (23:37 -0400)]
Bugfix: build docker image failed
1. When build Dovetail docker image, the job failed.
2. https://build.opnfv.org/ci/view/dovetail/job/dovetail-docker-build-push-master/279/console
3. That's because the setuptools version is old.
4. It needs to upgrade setuptools in the Dockerfile.
JIRA: DOVETAIL-534
Change-Id: If37a4d7c3b57ea79903565fd880c5447da97b13b
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Wed, 18 Oct 2017 08:12:00 +0000 (04:12 -0400)]
Add testsuite cvp.0.8.0 for Beta tests
1. Now there is a testsuite proposed_tests for beta tests which may
cause some confusions.
2. Copy all test cases to testsuite cvp.0.8.0 for beta testers to use.
3. Update userguide with testsuite cvp.0.8.0
JIRA: DOVETAIL-528
Change-Id: I35bc7dee6e07a9125a4c1991b0049f6e2d705cc5
Signed-off-by: xudan <xudan16@huawei.com>
grakiss [Fri, 20 Oct 2017 03:50:18 +0000 (23:50 -0400)]
[web-cvp]Additional columns in ‘My Results’
JIRA: DOVETAIL-532
1. original filename
2. user editable label
Change-Id: I1566cecb3d8ceacc14167bb2fb7fa41508f293be
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
grakiss [Thu, 19 Oct 2017 02:15:32 +0000 (22:15 -0400)]
[web-cvp]share result by email
JIRA: DOVETAIL-529
It may be easier to get other people's email than his user id
Change-Id: Ia5f9aa72d3c79bd3f5e69dad98b3f188cdaafc3d
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
grakiss [Thu, 19 Oct 2017 07:36:04 +0000 (03:36 -0400)]
[web-cvp]Direct drill-down for failed tests
JIRA: DOVETAIL-531
people may want to directly drill-down to the exact log file of each results, instead of searching in piles of log files.
Change-Id: I6e18b8d57739fd695e20ee29147e796de5c9e404
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Georg Kunz [Mon, 18 Sep 2017 14:59:32 +0000 (16:59 +0200)]
Updating test case requirements document
This patchset addresses review comments which were not incorporated in
the previous version of the test case requirements description.
Additionally, the text has been wrapped to 80 character lines.
Change-Id: If817f6c44d94870d915791a1a11916ffe4871f06
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
xudan [Thu, 12 Oct 2017 02:24:42 +0000 (22:24 -0400)]
Term refstack is mentioned in dovetail Testing User Guide
Remove refstack.log from the userguide because the refstack.log has been
renamed dovetail.osinterop.tc00X.log
JIRA: DOVETAIL-519
Change-Id: Icd0bd82ef78437ab96201e58b93e0a6997f9618a
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 12 Oct 2017 10:34:06 +0000 (06:34 -0400)]
Add dovetail tool CLI document
According to the wiki page, add the CLI document.
https://wiki.opnfv.org/display/dovetail/Dovetail+Command+Line
JIRA: DOVETAIL-509
Change-Id: I6a32446cd4c1bcad83465b1f2e12d5c1487e954e
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Tue, 17 Oct 2017 02:34:45 +0000 (22:34 -0400)]
SDNVPN test cases resources left may effect the next test cases
Move SDNVPN test cases after tempest test cases, then the resources left will
not effect tempest test cases.
JIRA: DOVETAIL-524
Change-Id: I815ae7f3a3be0225be1e9695f13d4552946bffb5
Signed-off-by: xudan <xudan16@huawei.com>
grakiss [Thu, 12 Oct 2017 10:30:00 +0000 (06:30 -0400)]
[web-cvp]failed to build docker image due to setuptools version
JIRA: DOVETAIL-526
error on docker build, upgrade the setuptools:
error in cryptography setup command: Invalid environment marker: python_version < '3'
Change-Id: If3b2b2ecd3a3e23f66cacb6a2048f15f1715dcd4
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
grakiss [Thu, 12 Oct 2017 09:34:50 +0000 (05:34 -0400)]
[web-cvp]add a api to fecth logs of backend api
JIRA: DOVETAIL-525
provide a easy way to fetch logs of backend apis
Change-Id: I72054a6e155e6970254ed391dfa8b25943eceb35
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Leo wang [Tue, 10 Oct 2017 01:53:01 +0000 (01:53 +0000)]
Merge "[web-cvp]fix api&web service in dockerfiles"
grakiss [Mon, 9 Oct 2017 09:23:15 +0000 (05:23 -0400)]
[web-cvp]fix api&web service in dockerfiles
JIRA: DOVETAIL-523
api&web services is not running due to packages installation errors
Change-Id: I5175d987dfda3cefe28a3a37754acc9fc8d7bc13
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Leo wang [Mon, 9 Oct 2017 09:02:19 +0000 (09:02 +0000)]
Merge "[web-cvp]missing files in web sites"
grakiss [Mon, 9 Oct 2017 08:58:59 +0000 (04:58 -0400)]
[web-cvp]missing files in web sites
JIRA: DOVETAIL-522
some files missing due to incorrect .gitignore settings
Change-Id: I4d81842afcb6f2734abeebbdcde56ec5b3e1655b
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Wenjing Chu [Mon, 9 Oct 2017 06:37:56 +0000 (06:37 +0000)]
Merge "Cvp application form"
Leo wang [Mon, 9 Oct 2017 02:10:15 +0000 (02:10 +0000)]
Merge "[web-cvp]osinteros is counted as optional test case"
Leo wang [Mon, 9 Oct 2017 02:10:02 +0000 (02:10 +0000)]
Merge "[web-cvp]failed to expand test results"
Wenjing Chu [Tue, 19 Sep 2017 21:36:13 +0000 (14:36 -0700)]
Cvp application form
Change-Id: I4bb0cea49179c7171ce766c52814f765e05ce9f8
Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
hongbo tian [Sat, 30 Sep 2017 07:49:41 +0000 (07:49 +0000)]
Merge "Update user guide with the local DB operations"
grakiss [Sat, 30 Sep 2017 07:03:46 +0000 (03:03 -0400)]
[web-cvp]osinteros is counted as optional test case
JIRA: DOVETAIL-518
'defcore' is changed to 'osinterop', counted as optional test case
Change-Id: Ic5322c498869dcef9597530e343b053aebc376cf
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
grakiss [Sat, 30 Sep 2017 06:48:30 +0000 (02:48 -0400)]
[web-cvp]failed to expand test results
JIRA: DOVETAIL-517
When click on the "expand" button, nothing happens.
Change-Id: Ibe1554baf047d56fa07e27e936c15b2664326382
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
xudan [Thu, 28 Sep 2017 02:00:03 +0000 (22:00 -0400)]
Update user guide with the local DB operations
If users want to store results or upload results to CVP web portal, they
need to build local DB adn testapi service.
Should add more introduction about the local DB and testapi in the user guide.
JIRA: DOVETAIL-504
Change-Id: I6493169b54104af8d7207d28fad93afedeae0b1b
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 29 Sep 2017 08:33:25 +0000 (08:33 +0000)]
Merge "Tag dovetail with cvp.0.7.0"
xudan [Fri, 29 Sep 2017 08:08:41 +0000 (04:08 -0400)]
Tag dovetail with cvp.0.7.0
docker image used
1. opnfv/yardstick: danube.3.2
2. opnfv/functest: cvp.0.5.0
3. opnfv/bottlenecks: cvp.0.4.0
4. opnfv/testapi: cvp.0.5.0
5. opnfv/dovetail:web.cvp.0.7.0
6. opnfv/dovetail:api.cvp.0.7.0
7. opnfv/dovetail: cvp.0.7.0
main changes
1. [cvp-web]correct dockerfile
2. [cvp-web]remove useless docker-compose yaml
3. Bugfix: sdnvpn test cases failed due to wrong module name
4. Support to run mandatory or optional test cases separately
5. [cvp-web]remove workflow on homepage
6. add api&web services for cvp
7. Don't generate tar file when run without pushing results to DB
8. Make Yardstick log level can be set by CLI
9. Update the script for building local DB and testapi
10. Bugfix: tar results dir cannot be parsed by web portal
11. Replacing references to "DefCore"
12. Updating the test specification document with iterative inprovements
13. Dovetail tool replaces defcore with osinterop
14. Clearer structuring current and future test scope of CVP addendum
15. Adding a stub document for a CVP reviewer guide
16. Clarify criteria for testcase inclusion as running in Functest/CI
17. And additional clarifications.
18. add more information for the Identity testcases in the refstack
19. Doc: update user guide due to add new test cases and features
For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool
JIRA: DOVETAIL-516
Change-Id: Ic65073fd749c1bcdbd0946d081ba2d2fe9105057
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Fri, 29 Sep 2017 07:02:55 +0000 (03:02 -0400)]
Disable get DB schema in Dockerfile
Dovetail provides files for init local DB.
No need to get schema from opnfv DB when building docker image.
Change-Id: I05fbf4f65f3a94bb3a36fe3c140ad7bff58a4f15
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Fri, 29 Sep 2017 06:18:32 +0000 (06:18 +0000)]
Merge "[cvp-web]correct dockerfile"
Leo wang [Fri, 29 Sep 2017 06:15:08 +0000 (06:15 +0000)]
Merge "[cvp-web]remove useless docker-compose yaml"
grakiss [Fri, 29 Sep 2017 06:10:51 +0000 (02:10 -0400)]
[cvp-web]correct dockerfile
JIRA: DOVETAIL-515
correct dockerfile, git clone from dovetail
Change-Id: I1dee7f8ae5278f55bcf5928bbf88cdb079388494
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Leo wang [Fri, 29 Sep 2017 04:07:45 +0000 (04:07 +0000)]
Merge "Bugfix: sdnvpn test cases failed due to wrong module name"
xudan [Thu, 28 Sep 2017 06:28:51 +0000 (02:28 -0400)]
Bugfix: sdnvpn test cases failed due to wrong module name
SDNVPN test cases failed due to wrong module name.
The module name needs to be changed into "sdnvpn.test.functest.testcase_1"
Refer to patch https://gerrit.opnfv.org/gerrit/#/c/41385/
Currently Dovetail uses functest:cvp.0.5.0 which uses module name "testcase_1".
JIRA: DOVETAIL-510
Change-Id: I3232760d3af34125c7da71a5d2c62ca32693c82b
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Fri, 29 Sep 2017 03:34:16 +0000 (03:34 +0000)]
Merge "Support to run mandatory or optional test cases separately"
grakiss [Fri, 29 Sep 2017 02:46:53 +0000 (22:46 -0400)]
[cvp-web]remove useless docker-compose yaml
JIRA: DOVETAIL-514
remove useless docker-compose yaml
Change-Id: Ic754488611571c3464515772680ad94bbe5651ea
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
grakiss [Fri, 29 Sep 2017 02:22:35 +0000 (22:22 -0400)]
[cvp-web]remove workflow on homepage
JIRA: DOVETAIL-513
remove workflow on homepage, add a link to workflow instead
Change-Id: Id8e551d4c593a2104c7cc8eb55468e9c29b5052a
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
hongbo tian [Thu, 28 Sep 2017 09:28:41 +0000 (09:28 +0000)]
Merge "add api&web services for cvp"
grakiss [Thu, 28 Sep 2017 07:47:54 +0000 (03:47 -0400)]
add api&web services for cvp
JIRA: DOVETAIL-512
add api&web services for cvp
Change-Id: I9ef9525e980fe61dc3108035ef9a3ff8783b2697
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Leo wang [Thu, 28 Sep 2017 08:34:50 +0000 (08:34 +0000)]
Merge "Don't generate tar file when run without pushing results to DB"
Leo wang [Thu, 28 Sep 2017 07:36:57 +0000 (07:36 +0000)]
Merge "Make Yardstick log level can be set by CLI"
xudan [Thu, 28 Sep 2017 07:36:55 +0000 (03:36 -0400)]
Don't generate tar file when run without pushing results to DB
1. Dovetail generate a tar file for uploading results to CVP web portal.
2. If users don't run with option --report, it shouldn't generate the tar file.
Because users can not upload results to CVP if they don't run with --report.
3. If it generates the tar file when user run dovetail without --report,
the tar file is invalid because it lacks of results.json.
JIRA: DOVETAIL-511
Change-Id: I4d21f21f0b278962564d810369df03100b38f003
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Wed, 27 Sep 2017 07:02:19 +0000 (07:02 +0000)]
Merge "Update the script for building local DB and testapi"
xudan [Wed, 27 Sep 2017 00:54:15 +0000 (20:54 -0400)]
Update the script for building local DB and testapi
1. When test dovetail, users can build local DB and testapi to store and
report the results.
2. The script for building local DB and testapi needs some updates.
JIRA: DOVETAIL-507
Change-Id: I8bc96bfea27f424468cafaa2e05894065ef44ad9
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Tue, 26 Sep 2017 07:44:13 +0000 (03:44 -0400)]
Bugfix: tar results dir cannot be parsed by web portal
The directory tree of results tar file is wrong, so web portal cannot parse it.
Reset the tar file.
JIRA: DOVETAIL-508
Change-Id: I8475323294e84ca51242b700570926d5c0177390
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Mon, 25 Sep 2017 08:44:38 +0000 (04:44 -0400)]
Make Yardstick log level can be set by CLI
1. Currently, the log level of yardstick is DEBUG and cannot be modified.
2. Make it can be changed from CLI.
3. When use dovetail run --debug, can see all Yardstick logs (including DEBUG)
in dovetail.log.
4. When run without debug option, cannot see Yardstick debug logs in
dovetail.logs.
5. yardstick.log always doesn't include debug logs.
JIRA: DOVETAIL-506
Change-Id: Iaafb61232a22e16fff2fa4605bf7e262b022085e
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Tue, 26 Sep 2017 03:30:08 +0000 (23:30 -0400)]
Support to run mandatory or optional test cases separately
1. Currently, dovetail can run a test suite or a test area in that test suite.
2. The test areas in one test suite are not divided into optional and mandatory.
3. Split them and support to run just mandatory or optional.
4. Support to run multiple test areas.
JIRA: DOVETAIL-505
Change-Id: I42cd7b4e11c3e3674c806e9bc999b782bf5c85c6
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Mon, 25 Sep 2017 03:56:07 +0000 (03:56 +0000)]
Merge "Replacing references to "DefCore""
xudan [Mon, 18 Sep 2017 07:31:14 +0000 (03:31 -0400)]
Dovetail tool replaces defcore with osinterop
Rename the "defcore" test area to "osinterop".
The DefCore working group has been
renamed OpenStack InterOp Working Group some time ago.
JIRA: DOVETAIL-499
Change-Id: I144af767632c8fb83859e5e04b6427bb1a538348
Signed-off-by: xudan <xudan16@huawei.com>
Georg Kunz [Wed, 6 Sep 2017 23:11:14 +0000 (01:11 +0200)]
Clearer structuring current and future test scope of CVP addendum
This patchset attempts to more clearly structure the outcome of the
scope analysis by having dedicated "in scope" and "future scope"
sections
Change-Id: I6a42a8ac4495fa4e2e5e773a7f594704d9cc1e28
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
Georg Kunz [Mon, 11 Sep 2017 21:50:15 +0000 (23:50 +0200)]
Replacing references to "DefCore"
This patch removes all references to the outdated term "DefCore"
in the Dovetail documentation. The DefCore working group has been
renamed OpenStack InterOp Working Group some time ago.
This patch also proposes renaming the "defcore" test area to
"osinterop".
JIRA: DOVETAIL-499
Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
hongbo tian [Mon, 11 Sep 2017 02:08:58 +0000 (02:08 +0000)]
Merge "Clarify criteria for testcase inclusion as running in Functest/CI And additional clarifications."
hongbo tian [Fri, 8 Sep 2017 07:46:34 +0000 (07:46 +0000)]
Merge "add more information for the Identity testcases in the refstack"
hongbo tian [Fri, 8 Sep 2017 07:45:33 +0000 (07:45 +0000)]
Merge "Doc: update user guide due to add new test cases and features"
xudan [Fri, 8 Sep 2017 06:53:31 +0000 (02:53 -0400)]
tag dovetail with 0.6.0
docker image used
opnfv/yardstick: danube.3.2
opnfv/functest: cvp.0.5.0
opnfv/bottlenecks: cvp.0.4.0
opnfv/testapi: cvp.0.6.0
opnfv/dovetail:web.cvp.0.6.0
opnfv/dovetail:api.cvp.0.6.0
opnfv/dovetail: cvp.0.6.0
main changes
Merge all test specification docs about test area tempest and defcore
Merge addendum doc and workflow doc
Remake aarch64 patch for Dovetail container
Remove some tempest test cases that are not too common
Add additional Tempest API test cases into test case tempest.tc005
persist db file in host for mongo container
add nginx to host static files
add a sample tempest_conf.yaml file into userconfig
Add a patch to set ha SLA to be 30 seconds
Modify logs
Bugfix: the config files in useeconfig will cover user's config
Bugfix: functest only keeps the last test case's log
Bugfix: pre_condition cmds is just executed once
For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool
JIRA: DOVETAIL-497
Change-Id: I74626bbf65ce0121cc7b53394c85694e15df8484
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Fri, 8 Sep 2017 01:40:16 +0000 (01:40 +0000)]
Merge "Add a patch to set ha SLA to be 30 seconds"
xudan [Thu, 7 Sep 2017 08:49:50 +0000 (04:49 -0400)]
Modify logs
JIRA: DOVETAIL-498
Change-Id: Ie98fc89cc840b557aa4186c6c2bee2d610432af0
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Thu, 7 Sep 2017 04:06:14 +0000 (04:06 +0000)]
Merge "Add test area 'forwarding packets through virtual networks in data path'"
xudan [Thu, 7 Sep 2017 01:49:26 +0000 (21:49 -0400)]
Add a patch to set ha SLA to be 30 seconds
1. According to ha test specification doc, the SLA of process recover time
is 30 seconds.
2. However, the SLA in Yardstick test cases are all 20 seconds.
3. Add a patch to change the SLA in yardstick test cases.
JIRA: DOVETAIL-496
Change-Id: Ib8f229fdfbb3289bf70d6ee900132b3db3a21b17
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Thu, 7 Sep 2017 01:47:32 +0000 (01:47 +0000)]
Merge "Test case specification for VIM Network"
xudan [Mon, 28 Aug 2017 09:30:39 +0000 (05:30 -0400)]
Doc: update user guide due to add new test cases and features
There has been added some new test cases and features, so user guide should be
updated according to the latest dovetail version.
- Add introduction about https (with cacert and without cacert)
- Add introduction about adding hosts' info
- Add introduction about downloading cirros images
- Add introduction about special configurations for running defcore and
tempest test cases
- Add introduction about how to check defcore and tempest failed test cases
JIRA: DOVETAIL-493
Change-Id: I13aca4ee433056bd21590743a412d5d95f45fec4
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Wed, 6 Sep 2017 07:49:46 +0000 (07:49 +0000)]
Merge "Remake aarch64 patch for Dovetail container"
xudan [Mon, 14 Aug 2017 03:59:09 +0000 (23:59 -0400)]
Add test area 'forwarding packets through virtual networks in data path'
JIRA: DOVETAIL-473
According to Dovetail addendum doc, add one test area about basic cloud
capability 'forwarding packets through virtual networks in data path'.
Add the test specification about this test area.
Change-Id: I26416ecca6b89a94cf48ba0f55308df0fa6e1677
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Mon, 14 Aug 2017 05:12:00 +0000 (01:12 -0400)]
Add test area 'simple virtual machine resource scheduling on multiple nodes'
JIRA: DOVETAIL-473
According to Dovetail addendum doc, add one test area about basic cloud
capability 'simple virtual machine resource scheduling on multiple nodes'.
Add the test specification about this test area.
Change-Id: I7a5ff426442424dbc364a68296facb0bac6401ca
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Wed, 6 Sep 2017 02:35:09 +0000 (02:35 +0000)]
Merge "Add test area 'correct behavior after common virtual machine life cycles events'"
hongbo tian [Wed, 6 Sep 2017 01:55:00 +0000 (01:55 +0000)]
Merge "Test case specification for VIM Image"
Leo wang [Wed, 6 Sep 2017 01:34:19 +0000 (01:34 +0000)]
Merge "Bugfix: the config files in useeconfig will cover user's config"
xudan [Mon, 14 Aug 2017 05:06:27 +0000 (01:06 -0400)]
Add test area 'correct behavior after common virtual machine life cycles events'
JIRA: DOVETAIL-473
According to Dovetail addendum doc, add one test area about basic cloud
capability 'correct behavior after common virtual machine life cycles events'.
Add the test specification about this test area.
Change-Id: I051b3c5b501ed833a613ea6a6601125c4fa80c3e
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Tue, 5 Sep 2017 08:15:11 +0000 (08:15 +0000)]
Merge "Remove some tempest test cases that are not too common"
hongbo tian [Tue, 5 Sep 2017 06:24:51 +0000 (06:24 +0000)]
Merge "Add test area 'dynamic network runtime operations'"
hongbo tian [Mon, 4 Sep 2017 06:54:39 +0000 (06:54 +0000)]
Merge "Test case specification for VIM Compute"
xudan [Mon, 4 Sep 2017 03:11:40 +0000 (23:11 -0400)]
Remove some tempest test cases that are not too common
Change-Id: I2a19b9f3e6c44bedef5d3cb20f480405e4d6d5e2
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 1 Sep 2017 12:29:11 +0000 (12:29 +0000)]
Merge "Test case specification for VIM Volume"
xudan [Sat, 29 Jul 2017 04:59:07 +0000 (00:59 -0400)]
Add test area 'dynamic network runtime operations'
JIRA: DOVETAIL-473
According to Dovetail addendum doc, add one test area about basic cloud
capability 'dynamic network runtime operations through the life of a VNF'.
Add the test specification about this test area.
Change-Id: I59706bc4a5765cf779a03fc3c493e5a8d184c1dc
Signed-off-by: xudan <xudan16@huawei.com>
hongbo tian [Fri, 1 Sep 2017 09:18:26 +0000 (09:18 +0000)]
Merge "Add test area 'filtering packets based on security rules and port security'"
xudan [Thu, 31 Aug 2017 08:48:41 +0000 (04:48 -0400)]
Add additional Tempest API test cases into test case tempest.tc005
1. According to the latest dovetail test case specification document,
there are 5 new Tempest api test cases.
2. Add them into tempest.tc005 so they can be tested in CI.
JIRA: DOVETAIL-495
Change-Id: Ib8057d01b99472aeb91cf564d09b67407c572235
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 17 Aug 2017 01:59:56 +0000 (21:59 -0400)]
Test case specification for VIM Compute
1. Add the alias VIM Compute test cases into testscope.
2. Add test case specification for VIM Compute.
Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Thu, 31 Aug 2017 06:20:25 +0000 (02:20 -0400)]
Bugfix: the config files in useeconfig will cover user's config
1. Now there are 2 sample files tempest_conf.yaml and hosts.yaml in userconfig,
and thet will cover user's tempest_conf.yaml and hosts.yaml
in $DOVETAIL_HOME/pre_config.
2. Rename the files in userconfig to be tempest_conf.yaml.sample
and hosts.yaml.sample.
3. Add the hosts info in file /etc/hosts in Dovetail Container.
JIRA: DOVETAIL-492
Change-Id: I2b5694a8058b864b510925eec595d6f2bd1062ff
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Mon, 28 Aug 2017 07:26:58 +0000 (07:26 +0000)]
Merge "Bugfix: functest only keeps the last test case's log"
xudan [Thu, 24 Aug 2017 02:18:31 +0000 (22:18 -0400)]
Bugfix: functest only keeps the last test case's log
JIRA: DOVETAIL-490
1. Dovetail just keeps the last tempest/defcore/ipv6/bgpvpn test's log file.
2. All log files should be kept, so users and developers can know the reason
of failed test cases.
3. tempest logs will be stored in directory tempest_logs/
4. defcore logs will be stored in directory defcore_logs/
5. IPv6 logs will be stored in directory ipv6_logs/
6. bgpvpn logs will be stored in directory bgpvpn_logs/
7. All vping logs are in functest.log
Change-Id: I79eae79cb32d65ce1ada3dd6f4c6dfd3945fc512
Signed-off-by: xudan <xudan16@huawei.com>
Leo wang [Mon, 28 Aug 2017 03:48:40 +0000 (03:48 +0000)]
Merge "Bugfix: pre_condition cmds is just executed once"
Trevor Cooper [Mon, 22 May 2017 20:24:59 +0000 (13:24 -0700)]
Added top-down scope analysis based on cvp objectives and end-user expectations. Also simplified to focus on scope only.
Change-Id: Ibde9fdacfd026f7859bd6fd239d79fdbdeccad01
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
hongbo tian [Fri, 25 Aug 2017 06:35:36 +0000 (06:35 +0000)]
Merge "Draft a workflow that will work with the CVP web portal and test API. Also made simplifications for the first release."
xudan [Wed, 23 Aug 2017 01:24:09 +0000 (21:24 -0400)]
Bugfix: pre_condition cmds is just executed once
JIRA: DOVETAIL-489
1. All the cmds defined in pre_condition is just executed once for each type
i.e. functest, yardstick, bottlenecks...
2. The copy cmds defined in each functest test cases are just executed for the
first test case rather than all test cases.
3. Make the cmds to be executed for each test case.
Change-Id: I571f0eb9dd3cab77fc8597e5a9b5246398804d3e
Signed-off-by: xudan <xudan16@huawei.com>
Bryan Sullivan [Fri, 4 Aug 2017 13:36:53 +0000 (06:36 -0700)]
Clarify criteria for testcase inclusion as running in Functest/CI
And additional clarifications.
JIRA: DOVETAIL-477
Replace tabs.
Further clarify testing programs and optionality criteria.
Change-Id: I8eebdf215fb7cc75a6da9748629b1a73d0b71d19
Signed-off-by: Bryan Sullivan <bryan.sullivan@att.com>
grakiss [Tue, 22 Aug 2017 08:06:22 +0000 (16:06 +0800)]
persist db file in host for mongo container
JIRA: DOVETAIL-488
Keep db file in host to avoid data lost
Change-Id: If039789eabfb8847ea344c016cb74e226be43f73
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
Trevor Cooper [Wed, 17 May 2017 04:29:40 +0000 (21:29 -0700)]
Draft a workflow that will work with the CVP web portal and test API. Also made simplifications for the first release.
Change-Id: Ief92a7e71c546883fdf472346646a43c9ae26c94
Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
xudan [Fri, 18 Aug 2017 10:19:39 +0000 (06:19 -0400)]
Test case specification for VIM Volume
1. Add the alias VIM Volume test cases into testscope.
2. Add test case specification for VIM Volume.
Change-Id: I715a69aad380466659365cc554351efb4d6eb053
Signed-off-by: xudan <xudan16@huawei.com>
grakiss [Thu, 17 Aug 2017 09:14:56 +0000 (17:14 +0800)]
add nginx to host static files
JIRA: DOVETAIL-485
Tornado does not support directory listing, so add nginx to host static files, and support log file browsing
Change-Id: Ic1427ab9c64661b3993ac60943f470b125a0fbe7
Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
xudan [Thu, 17 Aug 2017 02:32:26 +0000 (22:32 -0400)]
Add a sample tempest_conf.yaml file into userconfig
1. Functest cvp.0.5.0 supports to config tempest.conf file when running
tempest test cases.
2. Dovetail provides a sample tempest_conf.yaml file, and user can edit
this file before running tempest test cases.
3. All the values in this file will be used to update tempest.conf file.
Change-Id: I1afb50f1405c6cef992132899e0549396f587872
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Wed, 16 Aug 2017 05:32:06 +0000 (01:32 -0400)]
Test case specification for VIM Network
1. Add the alias VIM Network test cases into testscope.
2. Add test case specification for VIM Network.
Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Wed, 16 Aug 2017 10:25:31 +0000 (06:25 -0400)]
Tag dovetail with cvp.0.5.0
JIRA: DOVETAIL-483
1. docker image used
yardstick: danube.3.2
functest: cvp.0.5.0
bottlenecks: cvp.0.4.0
testapi: cvp.0.5.0
dovetail: cvp.0.5.0
2. main changes
Bugfix: wrong command in function 'check_https_enabled'
Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool
Create a tar file for all logs
Add tempest test cases into proposed_tests
Fix testapi base_url for public_url
Add user guide for results operations on web
3. For more information, refer to
https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool
Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd
Signed-off-by: xudan <xudan16@huawei.com>
xudan [Wed, 16 Aug 2017 07:05:56 +0000 (03:05 -0400)]
Bugfix: wrong command in function 'check_https_enabled'
JIRA: DOVETAIL-482
1. In function check_https_enabled, it will use cmd
"openstack catalog show identity |awk '/public/ {print $4}'"
to check if it is https.
2. However, this command will not work if it is https.
3. Check https via OS_AUTH_URL rather than "openstack catalog show identity".
Change-Id: If40ffa8e9b33c38123ff4b834198a8eaaedc1c9c
Signed-off-by: xudan <xudan16@huawei.com>
Code Review / dovetail.git / log