Cédric Ollivier [Tue, 31 May 2016 15:49:49 +0000 (17:49 +0200)]
Avoid tuples when printing multiple strings
It fixes bugs induced by [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/12623
Change-Id: I0232b14bed767b3ff857192146551a7963699bb9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 31 May 2016 13:41:59 +0000 (15:41 +0200)]
Write login correctly
Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 31 May 2016 12:34:07 +0000 (14:34 +0200)]
Remove unused CI_DEBUG
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
SerenaFeng [Sat, 28 May 2016 14:18:45 +0000 (22:18 +0800)]
Bugfix: can not find tempest.log
JIRA: FUNCTEST-269
Remove dependency on CI_DEBUG and use subprocess.call to
redirect stdout to tempest.log in any case.
Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
Morgan Richomme [Fri, 27 May 2016 12:54:57 +0000 (12:54 +0000)]
Merge "bug fix: if all tests passed failed could be empty"
Morgan Richomme [Fri, 27 May 2016 08:24:31 +0000 (10:24 +0200)]
bug fix: if all tests passed failed could be empty
consider failed only if regex match
JIRA: FUNCTEST-234
Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 27 May 2016 07:41:56 +0000 (07:41 +0000)]
Merge "Use flavor name instead of flavor id"
Morgan Richomme [Fri, 27 May 2016 07:40:40 +0000 (07:40 +0000)]
Merge "Add simple error logs in result DB"
Cédric Ollivier [Thu, 26 May 2016 11:40:05 +0000 (13:40 +0200)]
Take report arg into account
$report is now tested before calling odlreport2db.py
Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Morgan Richomme [Thu, 26 May 2016 09:41:01 +0000 (11:41 +0200)]
Add simple error logs in result DB
Used afterwards for the reporting to identify quickly
which case(s) are failing
Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Cédric Ollivier [Thu, 26 May 2016 09:05:15 +0000 (11:05 +0200)]
Use flavor name instead of flavor id
Default flavor id changes if its attributes have been modified.
Flavor name is used instead of flavor id.
Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Morgan Richomme [Wed, 25 May 2016 15:51:36 +0000 (17:51 +0200)]
Add security_scan in Functest CI pipeline
JIRA: FUNCTEST-258
Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Jose Lausuch [Wed, 25 May 2016 15:26:49 +0000 (15:26 +0000)]
Merge "Added 60 sec delay before launching instances in healthcheck"
Cédric Ollivier [Wed, 25 May 2016 09:22:31 +0000 (11:22 +0200)]
Push results if INSTALLER_TYPE and NODE_NAME are defined
INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL
results in DB
Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 25 May 2016 08:19:12 +0000 (10:19 +0200)]
Allow unknown ci_installer or ci_scenario in is_compatible
ci_installer and ci_scenario are only tested if they are set. At least one of
theses variables must be set to get dependencies
It modifies the previous logic introduced by the first implementation of
tier_handler.py [1]
[1] https://gerrit.opnfv.org/gerrit/#/c/12579/
Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
vitikkan [Wed, 25 May 2016 12:03:52 +0000 (15:03 +0300)]
Added 60 sec delay before launching instances in healthcheck
This delay should be removed after resolving Jira case APEX-149.
The purpose is to give some time to populate openflow rules
by SDN controller in case of odl_l2 scenario.
Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
jose.lausuch [Tue, 24 May 2016 08:23:09 +0000 (10:23 +0200)]
Join Rally_full and Tempest_full in the same Tier
JIRA: FUNCTEST-190
Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Morgan Richomme [Fri, 20 May 2016 12:29:51 +0000 (14:29 +0200)]
Push bgpvpn_api results into Test DB
JIRA: FUNCTEST-234
Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
vitikkan [Thu, 19 May 2016 11:08:47 +0000 (14:08 +0300)]
Preserving Nova instances from os_defaults.yaml
Previously clean_openstack deleted all the existing instances
even if they were included into os_defaults.yaml.
Change-Id: Id7c17ec86a5616c44bd2965844a4a8545054358b
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
jose.lausuch [Thu, 19 May 2016 11:24:35 +0000 (13:24 +0200)]
Fix path for vping.sh and exit if SCP fails
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Morgan Richomme [Thu, 19 May 2016 06:25:36 +0000 (08:25 +0200)]
fix vPing paths post refactoring effect
Change-Id: I24e961965db5103af1625418e7f5ae977bcabf54
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
jose.lausuch [Tue, 17 May 2016 19:36:56 +0000 (21:36 +0200)]
Change 'testcases' directory structure
JIRA: FUNCTEST-226
- Remove all 'CI' subdirs
- Remove VIM dir and have OpenStack dir within /testcases/
- Split rally and tempest in 2 different dirs
Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Morgan Richomme [Tue, 17 May 2016 13:27:40 +0000 (13:27 +0000)]
Merge "BGPVPN test case refactored"
Jose Lausuch [Tue, 17 May 2016 08:19:49 +0000 (08:19 +0000)]
Merge "Catch TypeError exceptions in ci/tier_handler.py"
vitikkan [Mon, 16 May 2016 05:05:45 +0000 (08:05 +0300)]
BGPVPN test case refactored
BGPVPN test case is refactored and moved into bgpvpn.py module.
JIRA: FUNCTEST-234
Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Cédric Ollivier [Fri, 13 May 2016 12:41:00 +0000 (14:41 +0200)]
Refactor ODL vars in ci/exec_test.sh
neutron_ip is set equal to neutron public endpoint and odl_ip to
neutron_ip or SDN_CONTROLLER according to INSTALLER_TYPE.
It also doesn't exit if INSTALLER_TYPE is unset.
Change-Id: I9ffa9f2837216ba88645d9bdfeeedd7a86a50b84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 13 May 2016 12:02:14 +0000 (14:02 +0200)]
Replace error in ci/exec_test.sh
error undefined in ci/exec_test.sh is now replaced by echo $msg >&2
Change-Id: I90fc44d94680206a2b0e85f9dfa5c48dadf6ac04
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 13 May 2016 09:01:52 +0000 (11:01 +0200)]
Catch TypeError exceptions in ci/tier_handler.py
If INSTALLER_TYPE is unset, is_compatible returns False instead of
raising an ErrorType exception.
Change-Id: I55c219808851907a19e2aa0124eb13d53a5e685d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Jose Lausuch [Fri, 13 May 2016 08:48:07 +0000 (08:48 +0000)]
Merge "Added handling of blacklist for tempest"
vitikkan [Fri, 13 May 2016 06:57:21 +0000 (09:57 +0300)]
Added handling of blacklist for tempest
It is now possible to exclude some specific test cases ("black list")
from the test case suites.
JIRA: FUNCTEST-197
Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Cédric Ollivier [Thu, 12 May 2016 15:05:42 +0000 (17:05 +0200)]
Add protections if INSTALLER_TYPE is unset
It avoids unary operator expected errors.
Change-Id: Ie717631b651b258d9bf62706f09c6f6b7c534620
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Jose Lausuch [Thu, 12 May 2016 13:46:11 +0000 (13:46 +0000)]
Merge "Fix typos in testcases.yaml"
Cédric Ollivier [Wed, 11 May 2016 15:34:57 +0000 (17:34 +0200)]
Fix typos in testcases.yaml
Change-Id: I7b014c55b626a06c0b4aaba006691f726f88acac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 May 2016 12:58:56 +0000 (14:58 +0200)]
Respect multiline syntax in Dockerfile
It fixes errors in /home/opnfv/.bashrc induced by [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/13699/
Change-Id: I07ff6504ee8fee7428b700553419d1208e639379
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
jose.lausuch [Wed, 11 May 2016 10:15:20 +0000 (12:15 +0200)]
Fix a few nits in prepare_env and dockerfile
Change-Id: Idb407ab80a41be0838c35d79819f8953885ba668
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Cédric Ollivier [Wed, 11 May 2016 09:52:08 +0000 (11:52 +0200)]
Specify the field id in neutron arguments
It fixes the parsing error when 2 subnets are created on a specific
network.
Change-Id: I46154a65d0e916387faea5b506ae6a93240c6726
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
vitikkan [Wed, 11 May 2016 09:48:10 +0000 (12:48 +0300)]
Removed obsolete modules
testcases/VIM/OpenStack/CI/libraries/check_os.sh
testcases/VIM/OpenStack/CI/libraries/os_defaults.yaml
Change-Id: I835bfbdc9aa43903ca2ad6041a38216fd68263a5
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
vitikkan [Wed, 11 May 2016 07:28:18 +0000 (10:28 +0300)]
Split tempest into smoke and full modes
"tempest_smoke_serial" and "tempest_full_parallel" test cases
replace the original "tempest" case.
Corrected fetching tempest results from "rally verify list"
output (last result is taken instead of the first one). This
correction is needed when "rally verify start" is run multiple
times.
JIRA: FUNCTEST-242
Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Juha Kosonen [Tue, 10 May 2016 14:25:38 +0000 (14:25 +0000)]
Enable sanity mode of Rally test for the CI runs
JIRA: FUNCTEST-241
Change-Id: Ie37657bf9e8c01ae4126c1c45146d8aadb2c5775
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
jose.lausuch [Mon, 9 May 2016 13:08:41 +0000 (15:08 +0200)]
Adapt tiers to run depending on WEEKLY/DAILY
JIRA: FUNCTEST-244
Change-Id: I11bf28baff52b75b0f6c58845edc22f266dfcbe8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Tue, 10 May 2016 11:51:18 +0000 (11:51 +0000)]
Merge "CLI implementation"
Juha Kosonen [Tue, 10 May 2016 07:24:26 +0000 (07:24 +0000)]
Create a private shared network for Rally
Since functest-net will be obsolete, own private network, subnet and
router is created for Rally tests.
JIRA: FUNCTEST-240
Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
vitikkan [Tue, 10 May 2016 05:58:00 +0000 (08:58 +0300)]
Creating private network for Tempest
Since functest-net will be obsolete, own private network,
subnet and router is taken into use for Tempest test.
JIRA: FUNCTEST-239
Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
jose.lausuch [Thu, 5 May 2016 23:36:30 +0000 (01:36 +0200)]
CLI implementation
JIRA: FUNCTEST-243
Change-Id: Ibf0ef9bcc5f3aeda96b050827b954ce060317613
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Mon, 9 May 2016 09:30:21 +0000 (11:30 +0200)]
Generic Function to create a private network
This is to be used by all the tests which need a private network to work,
for example Tempest, Rally, vPing, ssh..
Added example for vPing and promise scripts.
Change-Id: I5d79e7b60b81b0f34230ea3ef2f3076697a1958c
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Juha Kosonen [Mon, 9 May 2016 08:10:00 +0000 (08:10 +0000)]
Fix shebang of python scripts
Change-Id: I8a05fd6fbb0d392a27f354a6b8cacf33073bf17f
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
jose.lausuch [Thu, 5 May 2016 17:48:21 +0000 (19:48 +0200)]
Add results dir to Dockerfile
This will allow to create the functest.log used by logger in
/home/opnfv/functest/results/functest.log
Change-Id: Iebc1130942c4e4a5f592cfa247e7ba7403559a59
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Thu, 5 May 2016 12:36:03 +0000 (14:36 +0200)]
Don't exit on error when destroying rally deployment
Also, some improvements in execute_command function
Change-Id: I8271d55202b8859701275d5f7322a7bd4894e475
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Thu, 5 May 2016 10:18:33 +0000 (12:18 +0200)]
Fix bug config_functest.yaml location
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Wed, 4 May 2016 14:57:36 +0000 (16:57 +0200)]
Refactor, add logger handler to collect all the logs to a file as well
JIRA: FUNCTEST-190
Also:
- remove old code that are not used any more
- improve execute_command function
- fix logger output for run_tempest
Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Wed, 4 May 2016 09:47:40 +0000 (11:47 +0200)]
Refactor improvements
JIRA: FUNCTEST-190
- Deleted unnecessary old scripts
- Fixed healtcheck logging
- Moved config_functest.yaml to /ci/
- Created env var CONFIG_FUNCTEST_YAML pointing to that new location
- Modified all scripts which open config_functest.yaml using the new env var
Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Morgan Richomme [Tue, 3 May 2016 09:56:22 +0000 (09:56 +0000)]
Merge "Create CLI template for Functest"
jose.lausuch [Mon, 2 May 2016 17:05:54 +0000 (19:05 +0200)]
Add command to execute the actual tests
JIRA: FUNCTEST-190
Run_tests was generating the tests cases to be executed, but
not actually running them.
This patch also includes a small enhancement to avoid too much
output when showing which tiers to be tested.
Change-Id: Id70cfe44a8263ce7f598386668a33c67a8961b42
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Mon, 2 May 2016 07:01:50 +0000 (09:01 +0200)]
Enhance output when showing tiers and testcases info
JIRA: FUNCTEST-190
Change-Id: I43e26700ee3c92be64d79243c6762a3ccd5d42d3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Fri, 29 Apr 2016 15:58:37 +0000 (17:58 +0200)]
Create CLI template for Functest
JIRA: FUNCTEST-235
Change-Id: I235a53781fbcde91ccf15d15ea52c96ee2ee9433
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Mon, 2 May 2016 09:21:34 +0000 (11:21 +0200)]
Source the credentials in run_tests.py
JIRA: FUNCTEST-227
JIRA: FUNCTEST-190
OpenStack clean was failing due to this.
Change-Id: Ia4dcf084becb532f157c0924baf44bb2441f6379
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
David Blaisonneau [Fri, 29 Apr 2016 14:58:25 +0000 (16:58 +0200)]
Functest - documentation small corrections
Signed-off-by: David Blaisonneau <david.blaisonneau@orange.com>
Morgan Richomme [Fri, 29 Apr 2016 14:45:23 +0000 (14:45 +0000)]
Merge "Add a step to enable docker run without sudo"
Juha Kosonen [Fri, 29 Apr 2016 13:23:12 +0000 (13:23 +0000)]
Execute successive scenarios after task failure
Log the result of task validation and proceed executing next rally
scenario when the current task start-up fails.
JIRA: FUNCTEST-230
Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
jose.lausuch [Fri, 29 Apr 2016 09:20:34 +0000 (09:20 +0000)]
Merge "Create run_test.py using the tier mechanism to run the tests"
David Blaisonneau [Fri, 29 Apr 2016 08:00:43 +0000 (10:00 +0200)]
Add a step to enable docker run without sudo
Signed-off-by: David Blaisonneau <david.blaisonneau@orange.com>
jose.lausuch [Wed, 27 Apr 2016 22:08:26 +0000 (00:08 +0200)]
Create run_test.py using the tier mechanism to run the tests
JIRA: FUNCTEST-227
JIRA: FUNCTEST-190
Change-Id: I5445ad36ec65e62d48c8f5b16352caea2e51e3c9
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Morgan Richomme [Wed, 27 Apr 2016 16:15:37 +0000 (16:15 +0000)]
Merge "Replace all the loggers by the functest logger module"
Morgan Richomme [Wed, 27 Apr 2016 15:59:03 +0000 (15:59 +0000)]
Merge "Prepare Brahmaputra 3.0 release"
Morgan Richomme [Tue, 26 Apr 2016 16:35:16 +0000 (18:35 +0200)]
Prepare Brahmaputra 3.0 release
Change-Id: I12530573ff6cac7764e169225e130d46455ce54f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
jose.lausuch [Wed, 27 Apr 2016 14:28:55 +0000 (16:28 +0200)]
Replace all the loggers by the functest logger module
JIRA: FUNCTEST-228
Change-Id: If7a3c8cb08e9fbdf155fc5eff5330f79e5f8d234
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Mon, 25 Apr 2016 16:08:22 +0000 (18:08 +0200)]
Create prepare_env.py from prepare_env.sh and config_functest.py
JIRA: FUNCTEST-227
Change-Id: I1aa890b9f91ec524c766ba3c460666ed227f2126
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
vitikkan [Wed, 27 Apr 2016 11:15:08 +0000 (14:15 +0300)]
Corrected path for clean_openstack.py
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
jose.lausuch [Tue, 26 Apr 2016 11:35:00 +0000 (13:35 +0200)]
Move functest_utils and openstack_utils to directory /utils
JIRA: FUNCTEST-226
Change-Id: I74d09f6322844b25ab45a02156317ae76ab40d8a
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Tue, 26 Apr 2016 11:00:28 +0000 (11:00 +0000)]
Merge "Add Functest Logger centralized Class"
jose.lausuch [Tue, 26 Apr 2016 09:50:58 +0000 (11:50 +0200)]
Add Functest Logger centralized Class
JIRA: FUNCTEST-228
This is to be used by all the scripts using logging mechanisms.
Usage:
import functest_logger as fl
logger = fl.Logger("<script_name>").getLogger()
# treat it as a normal logger object, as before:
logger.info("message to be shown with - INFO - ")
logger.debug("message to be shown with - DEBUG -")
Change-Id: I94e248523bc9bc148c9d171c978804b5d1865dd9
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
vitikkan [Tue, 26 Apr 2016 08:23:08 +0000 (11:23 +0300)]
Corrected logging.Formatter parameters
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Jose Lausuch [Mon, 25 Apr 2016 13:39:19 +0000 (13:39 +0000)]
Merge "Add untracked files to ignore"
vitikkan [Mon, 25 Apr 2016 11:43:57 +0000 (14:43 +0300)]
Corrected if statement for clean_openstack
Change-Id: I3d8c0cb81dc4906ea989bd36dc8c29bf9f1f6396
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Cédric Ollivier [Mon, 25 Apr 2016 07:27:21 +0000 (09:27 +0200)]
Remove backslashs for line continuation
JIRA: FUNCTEST-213
Change-Id: Ia50521cf8fcf60a847aa44fe0ea59b6e64830e92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 25 Apr 2016 08:54:11 +0000 (10:54 +0200)]
Add untracked files to ignore
.gitignore also lists pyc, .project and .pydevproject files
Change-Id: Ica9997b54476108f2fcea865e10f3faef831a852
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
jose.lausuch [Fri, 22 Apr 2016 13:34:49 +0000 (15:34 +0200)]
Add tier_handler and tier_builder
tier_handler: defines the classes for Tier,TestCase and Dependency
tier_builder: reads the testcases.yaml and creates a list of objects
that will be used later on to execute the tests
JIRA: FUNCTEST-190
Change-Id: Iabef344aff036ad3b525088af59fb21b16b02fc8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
vitikkan [Mon, 25 Apr 2016 07:43:29 +0000 (10:43 +0300)]
ConfigParser is used for tempest.conf updating
Bash commands are replaced with python's ConfigParser routines
for configuration file reading/updating.
Removed updating of ssh_user_regex parameter since it is now
into upstream Rally code.
JIRA: FUNCTEST-198
Change-Id: I95f926948a395993e28e993bf7ea2872d6b5c969
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Morgan Richomme [Fri, 22 Apr 2016 15:46:31 +0000 (15:46 +0000)]
Merge "Introduce a sanity test mode for Rally test"
Juha Kosonen [Fri, 22 Apr 2016 07:21:29 +0000 (07:21 +0000)]
Introduce a sanity test mode for Rally test
In a sanity test mode the number of iterations is reduced and only
a subset of tests is executed.
JIRA: FUNCTEST-220
Change-Id: I722f12b8cc6df29bfcb81b8798d8d0802b207d94
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
Morgan Richomme [Fri, 22 Apr 2016 12:12:24 +0000 (14:12 +0200)]
Fix regex to exclude vPing_ssh and vIMS for scenario dealing with bgpvpn
previous regex was excluding most of the scenario
Change-Id: I7dd9e2b3a844eab232a2b44af382202fca2253ca
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Morgan Richomme [Fri, 22 Apr 2016 09:18:36 +0000 (11:18 +0200)]
Affect version field in results for all the testcases
Previously version was scenario
JIRA: FUNCTEST-225
Change-Id: Ia86f83dbe98ad5f9dbced60c46e57f58eccba7e9
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
jose.lausuch [Fri, 22 Apr 2016 07:44:01 +0000 (09:44 +0200)]
Enable PYTHONPATH env variable inside the container
JIRA: FUNCTEST-224
Change-Id: Ib10dc312a761b06fe36174c5c19a0165f746593e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Thu, 21 Apr 2016 11:56:41 +0000 (13:56 +0200)]
prepare_env CI_DEBUG when calling generate_defaults.py
JIRA: FUNCTEST-205
Change-Id: I3887f5ab408667437675e12c9247c7075080f0f8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Thu, 21 Apr 2016 08:39:19 +0000 (10:39 +0200)]
Remove cleanup from vPing scripts, and use the existing cleanup script
JIRA: FUNCTEST-215
Change-Id: I1ec494097a9b70de142da9f90136256535af5100
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Wed, 20 Apr 2016 14:03:44 +0000 (16:03 +0200)]
Fix Flake8 Violations in the Functest scripts
JIRA: FUNCTEST-213
Change-Id: I66c02dd6ff12ffb9798ebe44a4cfe7bfc73e76c3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Mon, 11 Apr 2016 21:27:56 +0000 (23:27 +0200)]
Add Tier scripts handlers and list of test cases yaml
JIRA: FUNCTEST-190
Change-Id: If63034be36e5a7a5d8b3f549444d53fb9ce28b55
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Wed, 20 Apr 2016 08:07:13 +0000 (10:07 +0200)]
Print openstack info only if CI_DEBUG==true
JIRA: FUNCTEST-205
Change-Id: I550d26ba1fddcedf5697dadd38a85148ecef2d44
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Tue, 19 Apr 2016 22:52:59 +0000 (00:52 +0200)]
Remove RALLY_REPO in config_functest since it is not used
Change-Id: Ifb3b338543b4ce3b961564a6e9cb1e943634af3d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Tue, 19 Apr 2016 20:47:55 +0000 (22:47 +0200)]
Dockerfile, fix typo in git clone command
Change-Id: Ic14f81362357d0a653bf174b1ccdc859bd7cea5e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Tue, 19 Apr 2016 11:13:11 +0000 (13:13 +0200)]
Small adaptations in prepare_env,run_tests and common
Change-Id: I5f31392b04b168247e332bc2ea97efeb733cdf97
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
jose.lausuch [Mon, 18 Apr 2016 14:26:10 +0000 (16:26 +0200)]
Adapt Functest output to the env variable CI_DEBUG
JIRA: FUNCTEST-205
Apply CI_DEBUG environment variable in the call to the scripts
Change-Id: Ia8da993de8a60517b475f763c22ce06e9ce35b3e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Morgan Richomme [Tue, 19 Apr 2016 09:10:15 +0000 (09:10 +0000)]
Merge "Quote missing"
Tim Rozet [Mon, 18 Apr 2016 18:03:13 +0000 (14:03 -0400)]
Quote missing
The missing " was causing some problems, like the REPOS_DIR variable missing
Previous:
Fixes unset REPOS_DIR var
REPOS_DIR never gets set in the script, and it looks like it should be
/home/opnfv/repos according to what is in the container. This patch
defaults it to that location.
Change-Id: I739f7df52f4a0f3506fd77d72dfb09a4658f06c0
Signed-off-by: Tim Rozet <trozet@redhat.com>
Morgan Richomme [Mon, 18 Apr 2016 15:54:55 +0000 (15:54 +0000)]
Merge "Author: Luke Hinds <lhinds@redhat.com> Date: Mon 18 Apr 11:48:27 2016 +0100"
Morgan Richomme [Mon, 18 Apr 2016 15:53:57 +0000 (15:53 +0000)]
Merge "Generating test lists for tempest"
jose.lausuch [Mon, 18 Apr 2016 13:32:51 +0000 (15:32 +0200)]
Remove all the repo handling in prepare_env
JIRA: FUNCTEST-203
Since almost all the repos always pull from master and latest,
this is about saving some time and to avoid needing internet
to pull or checkout the repos. The needed repos content has to be
present in the docker image.
Change-Id: Ia6e1ed2b5d5b2aff8661a38eb64a081cc8016019
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
Ciprian Barbu [Thu, 14 Apr 2016 12:06:58 +0000 (15:06 +0300)]
Allow rally to use existing glance image
This allows to use a prebuilt glance image without deleting it after the test.
For ARM platforms this is especially helpful because the test image is
three-part and can be created before running any tests.
Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399
Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
lukehinds [Mon, 18 Apr 2016 10:46:58 +0000 (11:46 +0100)]
Author: Luke Hinds <lhinds@redhat.com>
Date: Mon 18 Apr 11:48:27 2016 +0100
JIRA: FUNCTEST-169 Inital commit of security test code
The following code peforms NFVi based SCAP security scans.
This code is still pending integration with functest scripts,
for when flashtest development is complete.
Amend: Removed pyc file, requirements.txt and fixed flake8
Change-Id: Ie182ae5c21d36218f5c9b389c4b6e63ecbf1d151
Signed-off-by: lukehinds <lukehinds@gmail.com>
vitikkan [Thu, 14 Apr 2016 11:56:32 +0000 (14:56 +0300)]
Generating test lists for tempest
'testr list-tests' command is now used for generating smoke and full
test case lists for tempest.
test_list.txt file is replaced by defcore_req.txt file which contains
latest (2016.01) DefCore test case for possible references.
Partly implements JIRA: FUNCTEST-196
Change-Id: I993aa8a3919b97d50f081725ced686dbe6ffc4b7
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
Code Review / functest.git / log