Jose Lausuch [Fri, 5 May 2017 13:50:10 +0000 (13:50 +0000)]
Merge "Extended the timeout for Opera"
Jose Lausuch [Fri, 5 May 2017 12:49:00 +0000 (12:49 +0000)]
Merge "Add iniparse to requirements.txt"
Jose Lausuch [Fri, 5 May 2017 12:22:20 +0000 (12:22 +0000)]
Merge "Check open args in test_odl"
Morgan Richomme [Fri, 5 May 2017 11:35:44 +0000 (11:35 +0000)]
Merge "Replace project_name by case_name in result file name"
Cédric Ollivier [Fri, 5 May 2017 11:01:20 +0000 (13:01 +0200)]
Replace project_name by case_name in result file name
It avoids erasing functest.log when project_name = functest.
Change-Id: Icae898abb8b51c89b79bb1124adfadab8b0b3b99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Linda Wang [Fri, 5 May 2017 10:11:50 +0000 (10:11 +0000)]
Add iniparse to requirements.txt
Package iniparse is absent for functest, while it is required by
rally.py
Change-Id: Ia50216cfebdc9033f6a5f4abc6338951aaa2e8ab
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Cédric Ollivier [Fri, 5 May 2017 09:23:18 +0000 (11:23 +0200)]
Check open args in test_odl
Change-Id: I4b0060502621c7491820b9aa42d8f2f63b06a9ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Morgan Richomme [Fri, 5 May 2017 09:19:15 +0000 (11:19 +0200)]
Add Danube 2.0 reporting status
Change-Id: Icc09b824a4e7906dfab031b679ba3d0aa86ab0cd
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Jose Lausuch [Fri, 5 May 2017 07:51:39 +0000 (07:51 +0000)]
Merge "Forbid calling generate_report from cmdline"
Jose Lausuch [Fri, 5 May 2017 07:51:35 +0000 (07:51 +0000)]
Merge "Define loggers as class-private members"
Jose Lausuch [Fri, 5 May 2017 07:50:31 +0000 (07:50 +0000)]
Merge "Delete functest.utils.functest_logger"
Cédric Ollivier [Wed, 3 May 2017 13:58:23 +0000 (15:58 +0200)]
Forbid calling generate_report from cmdline
Change-Id: Ic9ea7507dc5f1f781b57c4573e971a2c8a8ca9ef
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 2 May 2017 18:57:08 +0000 (20:57 +0200)]
Define loggers as class-private members
This mangling ensures that all info messages printed from core packages
are shown in console. It also avoids sphinx to print them.
Change-Id: I07db9f33060c195bce3b48b06a6640eb6c56c2eb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 30 Apr 2017 06:52:55 +0000 (08:52 +0200)]
Delete functest.utils.functest_logger
It deletes functest.utils.functest_logger and the related unit tests.
Then it modifies all functest modules to get all loggers via
logging.getLogger(). __name__ is mainly used as getLogger arg as
proposed by logging [1].
All loggers and handlers are now defined via functest/ci/logging.ini
instead of a dict loaded by an external json file.
Now only warn messages and info messages from ci and core packages are
printed in console.
[1] https://docs.python.org/2/library/logging.html
Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Jose Lausuch [Thu, 4 May 2017 12:13:08 +0000 (12:13 +0000)]
Merge "Update tempest.conf to enable tempest from external server"
Jose Lausuch [Thu, 4 May 2017 12:12:38 +0000 (12:12 +0000)]
Merge "Update rally_conf.json for creating deployment"
Jose Lausuch [Thu, 4 May 2017 12:11:59 +0000 (12:11 +0000)]
Merge "Add the choice of interface for keystoneclient"
Cedric Ollivier [Thu, 4 May 2017 07:45:56 +0000 (07:45 +0000)]
Merge "Publish framework presentation"
Morgan Richomme [Thu, 4 May 2017 07:23:17 +0000 (07:23 +0000)]
Merge changes from topic 'remove_openstack_dir'
* changes:
Remove openstack directory
Remove create_instance_and_ip.py
Morgan Richomme [Thu, 4 May 2017 07:22:41 +0000 (07:22 +0000)]
Merge "refstack-client userguide"
helenyao [Thu, 4 May 2017 02:05:29 +0000 (10:05 +0800)]
Extended the timeout for Opera
Change-Id: Ifeb4aecf66d75c9bb98d5dafdbe20be78423565e
Signed-off-by: helenyao <yaohelan@huawei.com>
Jose Lausuch [Wed, 3 May 2017 10:34:56 +0000 (10:34 +0000)]
Merge "Update INFO file for Euphrates"
jose.lausuch [Wed, 3 May 2017 10:32:49 +0000 (12:32 +0200)]
Remove openstack directory
It is useles right now and won't be used in the future.
Change-Id: I9aa121544051f49f7e7e794ae3b2c4a9ea516e47
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Linda Wang [Wed, 3 May 2017 07:08:03 +0000 (07:08 +0000)]
Update tempest.conf to enable tempest from external server
1. The endpoint type to use for OpenStack Identity API v3
"v3_endpoint_type" is set to be "adminURL" by default, which should
be updated to the env OS_ENDPOINT_TYPE with the value "publicURL"
2. Reset the identity region name to "RegionOne"
3. For keystone api v3 in Newton, 5 testcases aimming at identity admin
v2 test should be omitted.
JIRA: FUNCTEST-801
Change-Id: I47ae41a80de0a52d32d25c9783860955f465099c
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Jose Lausuch [Wed, 3 May 2017 07:54:16 +0000 (07:54 +0000)]
Merge "Updated basic attributes for opera testcase"
MatthewLi [Thu, 6 Apr 2017 08:26:37 +0000 (04:26 -0400)]
refstack-client userguide
JIRA: FUNCTEST-758
container setup steps are skipped, since they already
included in the functest userguide documents.
Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
helenyao [Tue, 2 May 2017 07:03:22 +0000 (15:03 +0800)]
Updated basic attributes for opera testcase
The original value as unknown is not reasonable.
Change-Id: I23672ea70fff9b3badb2d2cf4f32dc3e038d7bb3
Signed-off-by: helenyao <yaohelan@huawei.com>
Jose Lausuch [Tue, 2 May 2017 21:06:17 +0000 (21:06 +0000)]
Merge "Remove missing statements in test_odl"
Jose Lausuch [Tue, 2 May 2017 21:05:49 +0000 (21:05 +0000)]
Merge "Restrict coverage output to all functest packages"
Jose Lausuch [Tue, 2 May 2017 14:29:51 +0000 (14:29 +0000)]
Merge "Fix pylint warnings in snaps"
jose.lausuch [Tue, 2 May 2017 11:58:51 +0000 (13:58 +0200)]
Remove create_instance_and_ip.py
JIRA: FUNCTEST-817
Change-Id: Ib297ec656a19c9ea4e06c6f2e133ed514a1dbf35
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Jose Lausuch [Tue, 2 May 2017 11:50:20 +0000 (11:50 +0000)]
Merge "rename tempest.conf to refstack_tempest.conf"
Cédric Ollivier [Thu, 20 Apr 2017 14:58:41 +0000 (16:58 +0200)]
Publish framework presentation
This is the first version prepared before merging "Switch TestCase
attribute criteria to result" [1].
It will also be updated to integrate VNF classes as soon as they are
ready (UT, pylint, docstrings...).
[1] https://gerrit.opnfv.org/gerrit/#/c/33695/
Change-Id: I2fc8f4ae377afee70e083cd51e5725eccda15431
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Linda Wang [Thu, 27 Apr 2017 07:01:24 +0000 (07:01 +0000)]
Add the choice of interface for keystoneclient
1. When functest is running on external host not jumpserver,
keystoneclient is used to retrieve or create projects/tenants
and users, which would fail to establish connection to the admin
endpoint.
2. Keystoneclient will connect to the public endpoint by setting the
env OS_INTERFACE to be public.
3. Remove the admin endpoint check in check_os.sh.
JIRA: FUNCTEST-801
Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Cédric Ollivier [Sun, 30 Apr 2017 08:29:29 +0000 (10:29 +0200)]
Remove missing statements in test_odl
It mainly removes _fake_url_for() which is useless since get_endpoint()
is not called for identity.
Coverage for functest/tests/unit/odl/test_odl.py : 100%
Change-Id: I5809c5eac4021c44113e70379621ab311187c669
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 30 Apr 2017 07:38:55 +0000 (09:38 +0200)]
Restrict coverage output to all functest packages
The next packages/modules are not yet covered:
- functest/cli/setup.py
- functest/core/pytest_suite_runner.py
- functest/opnfv_tests/mano
- functest/opnfv_tests/openstack/examples
- functest/opnfv_tests/openstack/snaps
- functest/opnfv_tests/openstack/vping
- functest/opnfv_tests/sdn/onos
- functest/opnfv_tests/vnf/aaa
- functest/opnfv_tests/vnf/ims
- functest/opnfv_tests/vnf/router
- functest/utils/openstack
Change-Id: Id62749796864537615f0ca8b162ce77b6c1a3309
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 30 Apr 2017 07:35:05 +0000 (09:35 +0200)]
Fix pylint warnings in snaps
Pylint only warns about missing module docstrings now.
Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Linda Wang [Thu, 27 Apr 2017 07:36:32 +0000 (07:36 +0000)]
Update rally_conf.json for creating deployment
1. The rally_conf.json is obtained via def get_credentials_for_rally(),
where the parameter endpoint_type is supposed to get from the env
OS_ENDPOINT_TYPE or OS_INTERFACE, just as the def
get_creds_from_env_vars() in rally project [1].
[1] https://github.com/openstack/rally/blob/master/rally/cli/envutils.py
JIRA: FUNCTEST-801
Change-Id: I6b6be82b9ff7f04948b47c4fca836d415fe13f8b
Signed-off-by: Linda Wang <wangwulin@huawei.com>
helenyao [Wed, 26 Apr 2017 09:10:47 +0000 (17:10 +0800)]
Fix the instance initialization error for OnosSfc
Change-Id: I1820bed1bbb7dbddd3923ea6439f58592595f5c8
Signed-off-by: helenyao <yaohelan@huawei.com>
Cédric Ollivier [Wed, 26 Apr 2017 13:31:19 +0000 (15:31 +0200)]
Logger must be a singleton
It avoids creating a python object for every message printed.
Change-Id: Ia42b59db9f7ce4eadc7e91da4d193db646b54d85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 Apr 2017 12:33:41 +0000 (14:33 +0200)]
Fix false positives in test_tempest
It fixes the return values and the side effects expected from the next
methods:
- configure_tempest
- create_tempest_resources
- generate_test_list
- apply_tempest_blacklist
- run_verifier_tests
- parse_verifier_result
JIRA: FUNCTEST-803
Change-Id: Ib7dbd28e003cf0f27f497ad8e63cf7ae5ce564de
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 Apr 2017 07:18:04 +0000 (09:18 +0200)]
Catch os.makedirs() exceptions in tempest.py
It can raise an error exception if the leaf directory already exists or
cannot be created [1].
[1] https://docs.python.org/2/library/os.html
JIRA: FUNCTEST-804
Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 24 Apr 2017 06:58:20 +0000 (08:58 +0200)]
Manage criteria in TestCase
It converts all criteria values to the corresponding percent in
functest/ci/testcases.yaml.
Result is expected to be equal or greater than criteria. If both are 0,
result is considered as false.
It is compatible with the old behavior but warns to update.
It will allow a safer remove.
It also fixes a bug in test_tempest to allow merging [1] and
tier_handler.py which required that type criteria was str.
[1] https://gerrit.opnfv.org/gerrit/#/c/27949/
Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 23 Apr 2017 06:59:43 +0000 (08:59 +0200)]
Switch TestCase attribute criteria to result
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Wed, 26 Apr 2017 07:32:47 +0000 (07:32 +0000)]
Merge "Remove the useless opnfv_tests dir in tests"
Cédric Ollivier [Mon, 24 Apr 2017 13:34:10 +0000 (15:34 +0200)]
Remove the useless opnfv_tests dir in tests
Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 24 Apr 2017 12:35:04 +0000 (14:35 +0200)]
Remove useless lines of code in barometer.py
Change-Id: Ie312dbd296a85a35096294331c28a45f8dc10d0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
MatthewLi [Sat, 22 Apr 2017 09:30:51 +0000 (05:30 -0400)]
rename tempest.conf to refstack_tempest.conf
since for tempest smoke/full, etc, will also use a file named
tempest.conf this wil cover the refstack tempest.conf,
rename it to refstack_tempest.conf, then easily for users to
debug to check if the configure file is correct or not.
Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Cédric Ollivier [Fri, 21 Apr 2017 09:55:36 +0000 (11:55 +0200)]
Switch testcase to test case in docstrings
Change-Id: Iea64673788a3d5ab5eb3028522f659de183440ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Serena Feng [Fri, 21 Apr 2017 09:05:15 +0000 (09:05 +0000)]
Merge "Minor changes in docstrings"
Jose Lausuch [Fri, 21 Apr 2017 09:03:48 +0000 (09:03 +0000)]
Merge "Ignore _build (sphinx output dir)"
Cedric Ollivier [Fri, 21 Apr 2017 07:42:16 +0000 (07:42 +0000)]
Merge "Remove exec right for ci config files"
Cedric Ollivier [Fri, 21 Apr 2017 07:42:03 +0000 (07:42 +0000)]
Merge "Fix pylint warnings in decorators.py"
Cedric Ollivier [Fri, 21 Apr 2017 07:41:56 +0000 (07:41 +0000)]
Merge "Stop hardcoding results suffix in push_to_db"
boucherv [Thu, 20 Apr 2017 14:20:57 +0000 (16:20 +0200)]
[VNF_base] Support existing tenant and user
Support existing tenant and user with a get_or_create_tenant method.
If the tenant and user already exist it only get the id of those
JIRA: FUNCTEST-799
Change-Id: Id5daf2904592e42199471bdd3547e861e6db6e32
Signed-off-by: boucherv <valentin.boucher@orange.com>
Cédric Ollivier [Thu, 20 Apr 2017 15:07:50 +0000 (17:07 +0200)]
Remove exec right for ci config files
Change-Id: Ibf7e549252234fb69dd6e0cc7920b66759469aea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Apr 2017 15:04:46 +0000 (17:04 +0200)]
Ignore _build (sphinx output dir)
Change-Id: I8afb00fb2942d2144968896981532324ac8e322d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Apr 2017 13:24:47 +0000 (15:24 +0200)]
Fix pylint warnings in decorators.py
Change-Id: Ie6c53feb97053248c909d641753b44b5f51c8719
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Apr 2017 12:52:47 +0000 (14:52 +0200)]
Minor changes in docstrings
It removes case_name from the list of attributes that run() must set
because it's now managed by run_tests.py (see __init__())
Change-Id: Id6228880257d0e9fb27483c56aa9985197feb04e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
MatthewLi [Wed, 19 Apr 2017 06:21:14 +0000 (02:21 -0400)]
Stop hardcoding results suffix in push_to_db
Adding results in url is useless as it is defined in results
section in config_functest.yaml.
It allows defining the full name in case of dumping to file (see
decorator.py). The commented local file is the value required by
dovetail.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I35ba9b34d99e138292f099934e28585ee8b85604
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Linda Wang [Wed, 19 Apr 2017 02:18:26 +0000 (02:18 +0000)]
Add mock to requirements.txt
Package mock is absent for functest, while it is required by
decorators.py.
Change-Id: I0d042def0335e369c4e22a349e3068829e1d2c59
Signed-off-by: Linda Wang <wangwulin@huawei.com>
jose.lausuch [Tue, 18 Apr 2017 19:56:15 +0000 (21:56 +0200)]
Update INFO file for Euphrates
Change-Id: Iddc36c0c9d3ce897c15393479e7ccb2d2a3230c9
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Cédric Ollivier [Tue, 18 Apr 2017 07:39:52 +0000 (09:39 +0200)]
Add docstings in feature.py
It also modifies the testcase module docstring.
Now features.py is rated 10/10 by pylint.
Change-Id: I83f2ac385b2a713d116c1ae4b49ba9cc9b26a83c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 18 Apr 2017 07:03:02 +0000 (09:03 +0200)]
Remove former cmd instance attribute
It's now useless as it's passed as run() args.
Change-Id: I97e14bd431a8844cd90905bf2050c48fb00f1cc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 Apr 2017 09:26:02 +0000 (11:26 +0200)]
Fix Sphinx warnings/errors
It takes into account the following warnings/errors:
- Inline strong start-string without end-string
- Unexpected indentation
Change-Id: Idb05c7b04ba98ef8f3ef65e6ec7c9bb5b7571cad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 Apr 2017 08:42:28 +0000 (10:42 +0200)]
Use Sphinx to create API documentation
The packages/modules which are part of Functest framework are parsed.
It also generates ODL TestCase API as it's well commented.
The content is simply referring to modules.
Change-Id: I873ae1535fc05c9d7e426f5fb54f9579eb01e6d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 Apr 2017 08:58:25 +0000 (10:58 +0200)]
Fix the irc channel
Change-Id: Idb446213274b7dfb03b0ee072717a35e03428609
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Mon, 17 Apr 2017 08:49:43 +0000 (08:49 +0000)]
Merge "Add class attribute docstrings in testcase.py"
Cedric Ollivier [Mon, 17 Apr 2017 08:49:26 +0000 (08:49 +0000)]
Merge "Fix typos in vnf_base.py"
Jose Lausuch [Sat, 15 Apr 2017 12:16:47 +0000 (12:16 +0000)]
Merge "Add copper section in testcases.yaml"
Cédric Ollivier [Fri, 14 Apr 2017 13:27:42 +0000 (15:27 +0200)]
Add class attribute docstrings in testcase.py
Change-Id: I91a5c6fb14f7c76a348bb4329d023bab53a3804c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Fri, 14 Apr 2017 08:51:57 +0000 (08:51 +0000)]
Merge "Updated method calls to SNAPS tests."
Cédric Ollivier [Fri, 14 Apr 2017 08:38:47 +0000 (10:38 +0200)]
Fix typos in vnf_base.py
Change-Id: Idf0380930e97e1aa4584ba000f32d742a87d9486
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Fri, 14 Apr 2017 08:22:01 +0000 (08:22 +0000)]
Merge "Set image and flavor id in tempest config file"
Aimee Ukasick [Mon, 27 Mar 2017 19:02:42 +0000 (14:02 -0500)]
Add copper section in testcases.yaml
JIRA: COPPER-34
Change-Id: I7301745718b9c035493c2e5c162e2a4e117982db
Signed-off-by: Aimee Ukasick <aimeeu.opensource@gmail.com>
SerenaFeng [Fri, 14 Apr 2017 06:45:36 +0000 (14:45 +0800)]
Add license in feature.py
Change-Id: I75f51f216dcbf0db1c563cf381c28efc47241d3c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
Cédric Ollivier [Thu, 13 Apr 2017 14:52:16 +0000 (16:52 +0200)]
Remove deprecated feature modules
All features running bash programs are now simply defined in
testcases.yaml. All deprecated modules and unit tests are removed.
Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Thu, 13 Apr 2017 15:28:43 +0000 (15:28 +0000)]
Merge "update check_os.sh admin port seds to match public"
Dan Radez [Wed, 12 Apr 2017 14:04:55 +0000 (10:04 -0400)]
update check_os.sh admin port seds to match public
If there's not a / on the end of the admin url then port is not found
public already handled this correctly. updating admin to match public
JIRA: FUNCTEST-793
Change-Id: I01d654dfe247c6102a90ba7ea3921a9f15991789
Signed-off-by: Dan Radez <dradez@redhat.com>
Juha Kosonen [Thu, 13 Apr 2017 11:22:21 +0000 (14:22 +0300)]
Set image and flavor id in tempest config file
Kingbird tests require that image and flavor are defined in tempest
configuration file.
JIRA: FUNCTEST-783
Change-Id: If96ef8e38e3f1a5946b687f1e5c8c0a6c3a90d54
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
spisarski [Wed, 22 Mar 2017 22:04:25 +0000 (16:04 -0600)]
Updated method calls to SNAPS tests.
Due to the refactoring performed in gerrit patch
31435, the calls to the SNAPS tests needed to be
updated.
JIRA: SNAPS-23
Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29
Signed-off-by: spisarski <s.pisarski@cablelabs.com>
Cédric Ollivier [Mon, 10 Apr 2017 13:10:11 +0000 (15:10 +0200)]
Refactor the Feature framework
run() returns the expected status code (see following JIRA tickets).
repo, pre() and post() are removed as they were quite useless.
A dedicated class is proposed for bash programs.
Unit tests have been added to fully cover this module.
All features have been modified to conform with these modifications.
It also removes the decorators which skipped several unit tests.
JIRA: FUNCTEST-778
JIRA: FUNCTEST-779
JIRA: FUNCTEST-780
JIRA: FUNCTEST-781
Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 8 Apr 2017 11:38:45 +0000 (13:38 +0200)]
Modify TestCase constructor attributes
Every feature/testcase now allows receiving the data defined in
testcases.yaml as args (name is renamed to case_name).
From the time being, only project and case names are handled. Next
pending patches will add criteria, cmd and repo to this list.
It keeps the default values for case names except for features which
will be aggregated into Feature.
Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 8 Apr 2017 10:05:58 +0000 (12:05 +0200)]
Rename test_ims_base.by to test_ims_base.py
It fixes errors when importing modules too.
It completes the review "Added test case for opera vims" [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/30681
Change-Id: Ib3cf9c66eb9a2c25ff4fb58d48e4b15a44556f7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Linda Wang [Fri, 7 Apr 2017 03:24:26 +0000 (03:24 +0000)]
Write feature case names in testcases.yaml
It replaces some project names by the corresponding case names.
Else some feature projects results failed to be pushed to DB.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
JIRA: FUNCTEST-792
Change-Id: Id81644406bafb361da46e397a92e60b4da2ec068
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 8 Apr 2017 09:30:58 +0000 (11:30 +0200)]
Add unit tests for parser
It also fixes the corresponding case name in testcases.yaml.
Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Nikolas Hermanns [Fri, 7 Apr 2017 08:55:26 +0000 (10:55 +0200)]
Bugfixing the testcases execusion
tempest.api.compute.servers.test_server_actions\
.ServerActionsTestJSON.test_reboot_server_hard
is working in fuel so do test it.
The "-" was missing so
tempest.scenario.test_server_basic_ops
.TestServerBasicOps.test_server_basic_ops
was executed on fuel which is known to be
not working since metadata service is not
available. That was added already long
ago but through the not adding
of the "-" it got added again.
Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
Helen Yao [Fri, 7 Apr 2017 08:04:37 +0000 (08:04 +0000)]
Merge "Enable the deployment info print for compass"
Morgan Richomme [Fri, 7 Apr 2017 06:47:28 +0000 (06:47 +0000)]
Merge "Increase ram for tempest tests (aarch64)"
Linda Wang [Thu, 6 Apr 2017 01:50:31 +0000 (01:50 +0000)]
Bugfix: Add case_name as constructor arg for snaps_smoke
JIRA: FUNCTEST-791
When running snaps_smoke, it complains " __init__() got
an unexpected keyword argument 'case_name'"
Change-Id: I4a59828ba735ba14a286d000d1d061be14878d1c
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Cristina Pauna [Wed, 5 Apr 2017 14:13:49 +0000 (17:13 +0300)]
Increase ram for tempest tests (aarch64)
The following tests fail on armband because the VM cannot boot.
tempest.api.compute.servers.test_server_actions.
ServerActionsTestJSON.test_reboot_server_hard
tempest.scenario.test_network_basic_ops.
TestNetworkBasicOps.test_network_basic_ops
tempest.scenario.test_volume_boot_pattern.
TestVolumeBootPattern.test_volume_boot_pattern
tempest.scenario.test_volume_boot_pattern.
TestVolumeBootPatternV2.test_volume_boot_pattern
The reason for the failure is that the 128 ram is insufficient for the
image to boot. The fix consists in increasing the ram to 256
JIRA: ARMBAND-61
Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
Cédric Ollivier [Wed, 5 Apr 2017 13:32:58 +0000 (15:32 +0200)]
Add case_name as args in all features
Now run_tests.py forces case_name as arg of every TestCase or Feature.
It also updates the related unit tests.
Change-Id: I4d70005b53730f36785f0ac95f4f0f6a04455794
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Wed, 5 Apr 2017 12:36:32 +0000 (12:36 +0000)]
Merge "refstack client: improvement and fix of TestCase usage"
Cedric Ollivier [Wed, 5 Apr 2017 08:27:59 +0000 (08:27 +0000)]
Merge "Bugfix: Add case_name as constructor arg for snaps and rally"
Linda Wang [Wed, 5 Apr 2017 02:08:54 +0000 (02:08 +0000)]
Bugfix: Add case_name as constructor arg for snaps and rally
When running healthcheck tier and rally, it complains " __init__() got
an unexpected keyword argument 'case_name'"
Change-Id: I078094921f08b457b88beabee60eabf40b657411
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Michael Pauls [Tue, 4 Apr 2017 17:19:08 +0000 (19:19 +0200)]
Fix VIM onboarding and ims deployment
VIM onboarding: check for API version of OpenStack -> support of v2 and v3
ims deployment: fix userdata in order to wait for EMS registration
Change-Id: Id0932232ddb1f1163ef3c37460bc88b71b9c0bdd
Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
MatthewLi [Thu, 30 Mar 2017 03:24:05 +0000 (23:24 -0400)]
refstack client: improvement and fix of TestCase usage
JIRA: FUNCTEST-772
1, RefstackClientParser should not be a subclass of TestCase
2, tempest_conf.py used for generating reference tempest.conf file
not related to functest cmd, use logger is enough
Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Cédric Ollivier [Sun, 2 Apr 2017 08:29:51 +0000 (10:29 +0200)]
Add unit tests for feature
They partially cover feature but already highlight bugs.
Several tests are skipped to allow merging. Their decorators could be
removed as soon as feature is fixed.
I think bad-continuation is false positive so it's disabled (pep8 and
flake8 return ok).
JIRA: FUNCTEST-779
Change-Id: I89b9e2ec0388eea2471d941b2c653deca7fbddf6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 1 Apr 2017 15:26:49 +0000 (17:26 +0200)]
Add unit tests for security_scan
Change-Id: Idda799c01408aa9afd09d573e23f42e011f3fafb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 1 Apr 2017 15:15:09 +0000 (17:15 +0200)]
Add unit tests for sdnvpn
Change-Id: Ie4ebc4e2bc6f2e66f5f567f45f44c073cd9d313d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>