[dovetail tool] support shell scripts for testcase validation 85/25085/15
authorLeo Wang <grakiss.wanglei@huawei.com>
Tue, 29 Nov 2016 09:21:40 +0000 (04:21 -0500)
committerLeo Wang <grakiss.wanglei@huawei.com>
Tue, 13 Dec 2016 07:40:02 +0000 (02:40 -0500)
commit1c0f19209637572d0bd50c1a3691bc18ee6fb9ee
treec8bda462d8ca8e830bb4843e46d48c1aa0a657fd
parent0a90987741fe2b0a2cc81c5b8ffef46a8111f250
[dovetail tool] support shell scripts for testcase validation

JIRA: DOVETAIL-46

1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.

Change-Id: I45dca6b8dbd888757da163189d261f6e4dba5034
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
47 files changed:
dovetail/compliance/debug.yml
dovetail/compliance/example_set.yml [new file with mode: 0644]
dovetail/conf/dovetail_config.py
dovetail/conf/dovetail_config.yml
dovetail/conf/functest_config.yml
dovetail/conf/yardstick_config.yml
dovetail/report.py
dovetail/run.py
dovetail/test_runner.py [new file with mode: 0644]
dovetail/testcase.py
dovetail/testcase/example.tc001.yml [new file with mode: 0644]
dovetail/testcase/example.tc002.yml [new file with mode: 0644]
dovetail/testcase/ipv6.tc001.yml
dovetail/testcase/ipv6.tc002.yml
dovetail/testcase/ipv6.tc003.yml
dovetail/testcase/ipv6.tc004.yml
dovetail/testcase/ipv6.tc005.yml
dovetail/testcase/ipv6.tc006.yml
dovetail/testcase/ipv6.tc007.yml
dovetail/testcase/ipv6.tc008.yml
dovetail/testcase/ipv6.tc009.yml
dovetail/testcase/ipv6.tc010.yml
dovetail/testcase/ipv6.tc011.yml
dovetail/testcase/ipv6.tc012.yml
dovetail/testcase/ipv6.tc013.yml
dovetail/testcase/ipv6.tc014.yml
dovetail/testcase/ipv6.tc015.yml
dovetail/testcase/ipv6.tc016.yml
dovetail/testcase/ipv6.tc017.yml
dovetail/testcase/ipv6.tc018.yml
dovetail/testcase/ipv6.tc019.yml
dovetail/testcase/ipv6.tc020.yml
dovetail/testcase/ipv6.tc021.yml
dovetail/testcase/ipv6.tc022.yml
dovetail/testcase/ipv6.tc023.yml
dovetail/testcase/ipv6.tc024.yml
dovetail/testcase/ipv6.tc025.yml
dovetail/testcase/nfvi.tc001.yml
dovetail/testcase/nfvi.tc002.yml
dovetail/testcase/vimops.tc001.yml
dovetail/testcase/vimops.tc002.yml
dovetail/testcase/vimops.tc003.yml
dovetail/testcase/vimops.tc004.yml
dovetail/testcase/vimops.tc005.yml
dovetail/testcase/vimops.tc006.yml
dovetail/tests/unit/test_parser.py
dovetail/tests/unit/test_testcase.yaml