functest.git
8 years agomodify onos tests' link to support onos 1.6 11/15911/4
wuwb1989 [Tue, 21 Jun 2016 10:04:00 +0000 (18:04 +0800)]
modify onos tests' link to support onos 1.6

Change-Id: Ice9b19a1d569b4084921961ec0a3a9d961923521
Signed-off-by: wuwb1989 <wuwenbin2@huawei.com>
8 years agoMerge "Serena's presentation review"
Morgan Richomme [Tue, 21 Jun 2016 07:24:41 +0000 (07:24 +0000)]
Merge "Serena's presentation review"

8 years agoSerena's presentation review 73/15873/1
Morgan Richomme [Mon, 20 Jun 2016 05:51:19 +0000 (07:51 +0200)]
Serena's presentation review

Change-Id: Iea8958a3a64d0a0f53bbbd1d43aca9d27c4d6523
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agobugfix: name format and testcase start time 69/15869/2
boucherv [Mon, 20 Jun 2016 08:52:21 +0000 (10:52 +0200)]
bugfix: name format and testcase start time

Change-Id: I8929ccc69c09dc70eee92695eab1ebfa77dcf283
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agoMerge "change cloudify cli version from 3.3 to 3.3.1"
Morgan Richomme [Mon, 20 Jun 2016 05:49:28 +0000 (05:49 +0000)]
Merge "change cloudify cli version from 3.3 to 3.3.1"

8 years agoMerge "add slides for qtip"
Morgan Richomme [Mon, 20 Jun 2016 05:49:12 +0000 (05:49 +0000)]
Merge "add slides for qtip"

8 years agoAdded content for StorPerf 67/15867/1
Mark Beierl [Sun, 19 Jun 2016 14:44:24 +0000 (16:44 +0200)]
Added content for StorPerf

Change-Id: Ib46ce8fa1d0373d3eee4c59b85abc0e87fab6a79
Signed-off-by: Mark Beierl <mark.beierl@emc.com>
8 years agoadd slides for qtip 53/15853/1
Yujun Zhang [Fri, 17 Jun 2016 05:56:39 +0000 (13:56 +0800)]
add slides for qtip

Change-Id: I020a296a64ffb2b10b0772e0f971fd8732f0f2d7
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
8 years agoupdate team image 33/15833/1
Morgan Richomme [Fri, 17 Jun 2016 16:06:24 +0000 (18:06 +0200)]
update team image

Change-Id: I9d1a62553d9fdcae1ac7f72a4b70d76b64fe22f9
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoUpdate image, add Qtip and minor formatting changes 03/15803/2
Morgan Richomme [Fri, 17 Jun 2016 09:56:41 +0000 (11:56 +0200)]
Update image, add Qtip and minor formatting changes

Change-Id: I122075c94a3511ccec8c2a43f7bf0802d19b7da7
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoCheck resources exist before testing delete 27/15827/1
Cédric Ollivier [Fri, 17 Jun 2016 14:54:25 +0000 (16:54 +0200)]
Check resources exist before testing delete

It checks if network, subnet or port exists before calling the delete
operation. It also replaces NetID by NETID to conform robotframework
best practices.

Change-Id: Ie13f41e2b29c0a0cbfba3115dd8189a805fcf056
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agochange cloudify cli version from 3.3 to 3.3.1 17/15817/1
boucherv [Fri, 17 Jun 2016 13:12:55 +0000 (15:12 +0200)]
change cloudify cli version from 3.3 to 3.3.1

Change-Id: Ied464d22ba1947f359f6af9584c56908e101f1b7
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agoMerge "Align test names in DB and config file"
Morgan Richomme [Fri, 17 Jun 2016 13:00:08 +0000 (13:00 +0000)]
Merge "Align test names in DB and config file"

8 years agoMerge "fix format problem"
Morgan Richomme [Fri, 17 Jun 2016 10:06:13 +0000 (10:06 +0000)]
Merge "fix format problem"

8 years agoadjust testAPI presentation 01/15801/1
SerenaFeng [Fri, 17 Jun 2016 09:40:11 +0000 (17:40 +0800)]
adjust testAPI presentation

JIRA: FUNCTEST-323

Change-Id: I0ae5cbfa17564fc20983c864662807ac2cd85830
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agofix format problem 99/15799/1
kubi [Fri, 17 Jun 2016 08:50:56 +0000 (16:50 +0800)]
fix format problem

I need a lift indent as functest section
JIRA:-

Change-Id: Ib5965ebef84b66af58409d500d56bf23df632998
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoAlign test names in DB and config file 55/15755/1
Morgan Richomme [Thu, 16 Jun 2016 13:19:56 +0000 (15:19 +0200)]
Align test names in DB and config file

JIRA: FUNCTEST-304

Change-Id: I98d3155beb1c5e49eda84b443df603c2630b4823
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Remove default values if the os credentials are not set"
jose.lausuch [Thu, 16 Jun 2016 13:16:11 +0000 (13:16 +0000)]
Merge "Remove default values if the os credentials are not set"

8 years agoMerge "Fixed auth url in v2.Password"
Jose Lausuch [Thu, 16 Jun 2016 12:46:21 +0000 (12:46 +0000)]
Merge "Fixed auth url in v2.Password"

8 years agoRemove default values if the os credentials are not set 43/15743/3
jose.lausuch [Thu, 16 Jun 2016 12:21:00 +0000 (14:21 +0200)]
Remove default values if the os credentials are not set

If the creds are not sourced, then exit.

Change-Id: I55c9cd3a5a0885b81df4ce14502ba816546bcbaa
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoFixed auth url in v2.Password 25/15725/6
Luke Hinds [Thu, 16 Jun 2016 09:57:30 +0000 (09:57 +0000)]
Fixed auth url in v2.Password

Completes "Added use of OS_AUTH_URL to security_scan and
exec_test.sh" [1]

[1] https://gerrit.opnfv.org/gerrit/#/c/15633/

Change-Id: I756c10091c3e7fe9e7c8978e2747582bb0f4d281
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agobugfix: import module 39/15739/1
boucherv [Thu, 16 Jun 2016 11:41:50 +0000 (13:41 +0200)]
bugfix: import module

Change-Id: I233ea8bc8df52ae9192ce4963e18f2389caa920c
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agoAdded use of OS_AUTH_URL to security_scan and exec_test.sh 33/15633/5
Luke Hinds [Wed, 15 Jun 2016 15:50:52 +0000 (16:50 +0100)]
Added use of OS_AUTH_URL to security_scan and exec_test.sh

JIRA: FUNCTEST-315

Change-Id: I1f8ac20cd93ce25548dbf47d62fc6a076d347d62
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agoMerge "Try/except ODL push to DB until ODL tests are refactored"
Morgan Richomme [Wed, 15 Jun 2016 16:42:57 +0000 (16:42 +0000)]
Merge "Try/except ODL push to DB until ODL tests are refactored"

8 years agoAdd documentation to conform to odlreport2db.py 35/15635/1
Cédric Ollivier [Wed, 15 Jun 2016 16:08:20 +0000 (18:08 +0200)]
Add documentation to conform to odlreport2db.py

It completes "Add reachability testcase for ODL" [1]

[1] https://gerrit.opnfv.org/gerrit/#/c/15509/

Change-Id: I9273f1c636ccfc1b192a69f7af04e6a5c1731bec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "Replace deprecated keywords"
Morgan Richomme [Wed, 15 Jun 2016 15:58:01 +0000 (15:58 +0000)]
Merge "Replace deprecated keywords"

8 years agoTry/except ODL push to DB until ODL tests are refactored 31/15631/1
Morgan Richomme [Wed, 15 Jun 2016 15:42:59 +0000 (17:42 +0200)]
Try/except ODL push to DB until ODL tests are refactored

Change-Id: I7919c69655ce43831d5269afc1d86bf2c929bb8f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoReplace deprecated keywords 27/15627/2
Cédric Ollivier [Wed, 15 Jun 2016 15:15:28 +0000 (17:15 +0200)]
Replace deprecated keywords

It replaces get by get request, post by post request and delete by
delete request.

Change-Id: I6bfa6d8d53a1ec54416e3b8b2678e01f54bf7811
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoformat fix + KPI section update 25/15625/1
Morgan Richomme [Wed, 15 Jun 2016 15:00:25 +0000 (17:00 +0200)]
format fix + KPI section update

Change-Id: I0a021b1a3d04131dc2e9635adbb7e98a63b7c668
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoUpdate css and team image 13/15613/1
Morgan Richomme [Wed, 15 Jun 2016 10:14:38 +0000 (12:14 +0200)]
Update css and team image

Change-Id: Ic78ee1071e477e89842d89bb99bd82cc021d9d78
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoLessons learned for Tempest into Berlin presentation 01/15601/1
vitikkan [Wed, 15 Jun 2016 05:14:20 +0000 (08:14 +0300)]
Lessons learned for Tempest into Berlin presentation

Change-Id: I5599e887fcdad1f70a23e3f7be16acebe7c13250
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoRemove unused librairies in robot files 35/15535/2
Cédric Ollivier [Tue, 14 Jun 2016 12:53:10 +0000 (14:53 +0200)]
Remove unused librairies in robot files

Change-Id: Ifade280e02354b20869d54b15ba89838d2857640
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "Add yardstick section into Presentation"
Morgan Richomme [Tue, 14 Jun 2016 12:40:52 +0000 (12:40 +0000)]
Merge "Add yardstick section into Presentation"

8 years agoMerge "Add reachability testcase for ODL"
Morgan Richomme [Tue, 14 Jun 2016 12:39:57 +0000 (12:39 +0000)]
Merge "Add reachability testcase for ODL"

8 years agoEnable security scanning 15/15515/2
Luke Hinds [Tue, 14 Jun 2016 10:07:38 +0000 (11:07 +0100)]
Enable security scanning

Change-Id: Ib179ee6b2fcc7cf6c9ac522fdb83755ecbb99f52
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agoAdd reachability testcase for ODL 09/15509/1
Cédric Ollivier [Tue, 14 Jun 2016 09:17:21 +0000 (11:17 +0200)]
Add reachability testcase for ODL

It simply gets the complete lists of networks, subnets and ports.

Change-Id: I529c381996ee45f0b11f5fa24844f25c2f8f4a93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoReduce rally run script log output 99/15499/1
Juha Kosonen [Tue, 14 Jun 2016 06:42:54 +0000 (06:42 +0000)]
Reduce rally run script log output

Log scenario specific tables only in debug mode.

JIRA: FUNCTEST-312

Change-Id: Iacfdfb8156b1d5e9bc0a85abc1d6a10d6cac032e
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
8 years agoAdd yardstick section into Presentation 93/15493/1
kubi [Tue, 14 Jun 2016 04:16:33 +0000 (12:16 +0800)]
Add yardstick section into Presentation

I add yardstick section into the Conversation with
Testing Community Presentation.
please feel free to give comments to me.

Change-Id: I42662e8fed6d258c7613b7097ddd54dedfd72141
JIRA:-
Signed-off-by: kubi <jean.gaoliang@huawei.com>
8 years agoSSH key key type select improvements and jump host rename 55/15455/8
Luke Hinds [Mon, 13 Jun 2016 13:00:57 +0000 (14:00 +0100)]
SSH key key type select improvements and jump host rename

JIRA: FUNCTEST-310

Change-Id: I7adca57febfe8e6861d22de18858c6afd97b5199
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agoRemove unnecessary defaults from rally task file 59/15459/2
Juha Kosonen [Mon, 13 Jun 2016 13:59:29 +0000 (13:59 +0000)]
Remove unnecessary defaults from rally task file

Parameters used in test scenarios are defined and correctly set by run
script. No need to hardcode defaults in task file.

JIRA: FUNCTEST-311

Change-Id: Ic7decfc5144c40a50cd32862eb4aed263930a78e
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
8 years agoFix bug: use right format for date when pushing to DB 53/15453/1
Morgan Richomme [Mon, 13 Jun 2016 12:55:24 +0000 (14:55 +0200)]
Fix bug: use right format for date when pushing to DB

JIRA: FUNCTEST-303

Change-Id: I53e7c8f963ef0fa248d76e0d1c5f04326a750dcc
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoRemove external server references on Rally scenarios 43/15443/3
Juha Kosonen [Mon, 13 Jun 2016 10:35:49 +0000 (10:35 +0000)]
Remove external server references on Rally scenarios

Use url derived from OS_AUTH_URL on a scenario making http request and
checking the response. This way successful test execution does not
require internet connection nor rely on external servers functionality.

JIRA: FUNCTEST-201

Change-Id: Ic11f8f5c32d015624bdec1db07d8bb49f7b77bc8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
8 years agoCreating Glance image for Tempest suite 41/15441/1
vitikkan [Mon, 13 Jun 2016 10:29:38 +0000 (13:29 +0300)]
Creating Glance image for Tempest suite

If not yet existing, Cirros-0.3.4 image is created before
running Tempest test suite. Source file for the image is included
into opnfv/functest Docker container.

JIRA: FUNCTEST-195

Change-Id: I980193c4207c1301ca4e3b6e850b4056e6aa0130
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoFix flake8 violations 37/15437/1
Morgan Richomme [Mon, 13 Jun 2016 09:04:28 +0000 (11:04 +0200)]
Fix flake8 violations

Change-Id: I911eab6d4c0cdcfcf4d75f03e91c528d3388876c
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agobug fix: end_time var does not exist to calculate duration 33/15433/1
Morgan Richomme [Mon, 13 Jun 2016 07:57:34 +0000 (09:57 +0200)]
bug fix: end_time var does not exist to calculate duration

Change-Id: If73b6fbf022a837e4cb0190ab8074d18017ca57b
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "little changes in testapi presentation"
Morgan Richomme [Mon, 13 Jun 2016 07:26:37 +0000 (07:26 +0000)]
Merge "little changes in testapi presentation"

8 years agoMerge "Update testapi presentation"
Morgan Richomme [Mon, 13 Jun 2016 07:25:51 +0000 (07:25 +0000)]
Merge "Update testapi presentation"

8 years agolittle changes in testapi presentation 11/15411/5
SerenaFeng [Sun, 12 Jun 2016 03:04:47 +0000 (11:04 +0800)]
little changes in testapi presentation

change testapi0.png file
rename test_criteria to criteria
change criteria description from passed/failed to PASS/FAILED

JIRA: FUNCTEST-308

Change-Id: I29c05c4068c50cfe47ab6b5e8acc3d797f2ff43a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoUpdate testapi presentation 67/15367/1
Morgan Richomme [Fri, 10 Jun 2016 06:16:07 +0000 (08:16 +0200)]
Update testapi presentation

Change-Id: Ic1fd53a7a1e7cc35259bc2af78dab791617b6185
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoFixes and Docker Specific Attributes on security_scan 39/15339/2
Luke Hinds [Thu, 9 Jun 2016 18:14:19 +0000 (19:14 +0100)]
Fixes and Docker Specific Attributes on security_scan

JIRA:  FUNCTEST-306

Fixed Incorrect logging format
Added Key Download
Added Docker Specifics discovered during tests

Change-Id: I0c275c77a1eeb5911afb472bd0cb9c8020ae5879
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agoFix vPing success criteria evaluation bugfix 23/15323/2
jose.lausuch [Thu, 9 Jun 2016 09:26:22 +0000 (11:26 +0200)]
Fix vPing success criteria evaluation bugfix

Switching back to the odl approach. Need more discussions
to see how to evaluate the result from testcases.yaml

Change-Id: Iaa866db3010d35bd2cc427190dfe64db6b732a93
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoAdd CPerf slide to OPNFV Summit Berlin deck 09/15309/1
Daniel Farrell [Wed, 8 Jun 2016 17:00:42 +0000 (13:00 -0400)]
Add CPerf slide to OPNFV Summit Berlin deck

Change-Id: Ia1d3ce3c220a405821d8fae80cb5f4ddd22c72ec
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
8 years agoMerge "Fixes incorrect parenthesis format & adds ft_logger import"
Morgan Richomme [Wed, 8 Jun 2016 16:06:15 +0000 (16:06 +0000)]
Merge "Fixes incorrect parenthesis format & adds ft_logger import"

8 years agoFixes incorrect parenthesis format & adds ft_logger import 07/15307/1
Luke Hinds [Wed, 8 Jun 2016 15:59:44 +0000 (16:59 +0100)]
Fixes incorrect parenthesis format & adds ft_logger import

JIRA: FUNCTEST-302

Change-Id: Id83077a1b1376f726ea8abd4a97e5b705c22f9cc
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agoAdapt functest testcase to APi refactoring 91/15291/2
Morgan Richomme [Wed, 8 Jun 2016 13:56:54 +0000 (15:56 +0200)]
Adapt functest testcase to APi refactoring

JIRA: FUNCTEST-303

Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge changes I23a47424,I34393b03
Morgan Richomme [Wed, 8 Jun 2016 13:56:12 +0000 (13:56 +0000)]
Merge changes I23a47424,I34393b03

* changes:
  Add presentation for test API
  Presentation Test community Design Summit

8 years agoAdded paramiko.util.log_to_file 69/15269/1
Luke Hinds [Wed, 8 Jun 2016 10:49:36 +0000 (11:49 +0100)]
Added paramiko.util.log_to_file

JIRA: FUNCTEST-301

Change-Id: I489653d4e47232c5bf51bbae54d2a89c7ac780b6
Signed-off-by: Luke Hinds <lukehinds@gmail.com>
8 years agoUse current ODL Integration/Test repo 55/15255/2
Daniel Farrell [Tue, 7 Jun 2016 15:48:35 +0000 (11:48 -0400)]
Use current ODL Integration/Test repo

ODL Integration used to contain system testing, Karaf distribution
building and packaging/delivery logic. It was split into three
projects in August 2015: Int/Test, Int/Distribution and Int/Packaging.

https://wiki.opendaylight.org/view/Archive_Proposals/Integration

The integration.git repo Functest was cloning is the old one,
containing all three projects. It hasn't been updated since the split.

The new integration-test.git repo is the current version of ODL's system
test code.

This change also clones ODL from its official Gerrit, instead of its
GitHub mirror.

Change-Id: I6b38b1fedada504411ca0e0639355339f373084c
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
8 years agoAdd presentation for test API 43/15143/2
Morgan Richomme [Fri, 3 Jun 2016 13:29:38 +0000 (15:29 +0200)]
Add presentation for test API

Change-Id: I23a474247680751bb4f9ac0cc17b00229edd8886
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoPresentation Test community Design Summit 87/15087/3
Morgan Richomme [Thu, 2 Jun 2016 13:38:40 +0000 (15:38 +0200)]
Presentation Test community Design Summit

Change-Id: I34393b0398f1c7a4f7aef9fea79f265ec5c915b5
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoStop the job and quit with error if a test case fails 13/15113/1
jose.lausuch [Thu, 2 Jun 2016 20:26:03 +0000 (22:26 +0200)]
Stop the job and quit with error if a test case fails

JIRA: FUNCTEST-282

Change-Id: I9fd638c19333772040481140f9e2324b7d80772f
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoReplace subnet by port 83/15083/5
Cédric Ollivier [Thu, 2 Jun 2016 12:12:31 +0000 (14:12 +0200)]
Replace subnet by port

It also fixes several upper case letters and formats *delete*.robot

Change-Id: I071be39860dd33296a067e4f3d0188d36e9b9660
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoRename Robot Framework sources to *.robot 97/15097/1
Cédric Ollivier [Thu, 2 Jun 2016 14:42:56 +0000 (16:42 +0200)]
Rename Robot Framework sources to *.robot

It avoids mixing robot and txt suffixes in the same directory.

Change-Id: Ia2288cc9ad7dc86fc9a4cea2c6ca7a08a7dd3e3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "Add criteria in testcases.yaml and Test class"
Morgan Richomme [Thu, 2 Jun 2016 07:41:44 +0000 (07:41 +0000)]
Merge "Add criteria in testcases.yaml and Test class"

8 years agoFix duplicated output when using the functest logger 67/14967/2
jose.lausuch [Wed, 1 Jun 2016 12:38:21 +0000 (14:38 +0200)]
Fix duplicated output when using the functest logger

JIRA: FUNCTEST-275

Change-Id: I49c66521652b31d5bb398ea4013ac061f320d725
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Add framework for presentations"
Morgan Richomme [Wed, 1 Jun 2016 14:42:03 +0000 (14:42 +0000)]
Merge "Add framework for presentations"

8 years agoMerge "Check correctly arguments"
Morgan Richomme [Wed, 1 Jun 2016 14:39:42 +0000 (14:39 +0000)]
Merge "Check correctly arguments"

8 years agoCheck correctly arguments 65/14965/1
Cédric Ollivier [Wed, 1 Jun 2016 12:30:40 +0000 (14:30 +0200)]
Check correctly arguments

It fixes argument parsing and verifies all mandatory arguments are
provided. It also prevents UnboundLocalError exceptions.

Change-Id: Iec3403533b312c95dd453236ccadb1fe495d61cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoAdd criteria in testcases.yaml and Test class 61/14861/8
jose.lausuch [Tue, 31 May 2016 09:39:51 +0000 (11:39 +0200)]
Add criteria in testcases.yaml and Test class

JIRA: FUNCTEST-257

Added example of usage in vping_ssh

Change-Id: Iac143b811db163f0f86682b0688948c20843ede5
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agobug fix: pb when pushing bgpvpn results when no failed 45/14945/1
Morgan Richomme [Wed, 1 Jun 2016 07:56:03 +0000 (09:56 +0200)]
bug fix: pb when pushing bgpvpn results when no failed
failed field is empty (not equal to 0)

JIRA: FUNCTEST-234

Change-Id: Ic243e1e23615d585a735266d9012fc4c52d67ba3
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Add Apex based security scan code"
Morgan Richomme [Wed, 1 Jun 2016 06:46:03 +0000 (06:46 +0000)]
Merge "Add Apex based security scan code"

8 years agoAvoid tuples when printing multiple strings 91/14891/1
Cédric Ollivier [Tue, 31 May 2016 15:49:49 +0000 (17:49 +0200)]
Avoid tuples when printing multiple strings

It fixes bugs induced by [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/12623

Change-Id: I0232b14bed767b3ff857192146551a7963699bb9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoWrite login correctly 77/14877/2
Cédric Ollivier [Tue, 31 May 2016 13:41:59 +0000 (15:41 +0200)]
Write login correctly

Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoAdd Apex based security scan code 49/14749/11
lukehinds [Thu, 26 May 2016 18:53:28 +0000 (19:53 +0100)]
Add Apex based security scan code

JIRA: FUNCTEST-169

Performs a SCAP based security scan of all overcloud
nodes, followed by report download to functest dashboard

Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd
Signed-off-by: lukehinds <lukehinds@gmail.com>
8 years agoRemove unused CI_DEBUG 69/14869/1
Cédric Ollivier [Tue, 31 May 2016 12:34:07 +0000 (14:34 +0200)]
Remove unused CI_DEBUG

Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoBugfix: can not find tempest.log 07/14807/4
SerenaFeng [Sat, 28 May 2016 14:18:45 +0000 (22:18 +0800)]
Bugfix: can not find tempest.log

JIRA: FUNCTEST-269

Remove dependency on CI_DEBUG and use subprocess.call to
redirect stdout to tempest.log in any case.

Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "bug fix: if all tests passed failed could be empty"
Morgan Richomme [Fri, 27 May 2016 12:54:57 +0000 (12:54 +0000)]
Merge "bug fix: if all tests passed failed could be empty"

8 years agobug fix: if all tests passed failed could be empty 67/14767/1
Morgan Richomme [Fri, 27 May 2016 08:24:31 +0000 (10:24 +0200)]
bug fix: if all tests passed failed could be empty

consider failed only if regex match

JIRA: FUNCTEST-234

Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Use flavor name instead of flavor id"
Morgan Richomme [Fri, 27 May 2016 07:41:56 +0000 (07:41 +0000)]
Merge "Use flavor name instead of flavor id"

8 years agoMerge "Add simple error logs in result DB"
Morgan Richomme [Fri, 27 May 2016 07:40:40 +0000 (07:40 +0000)]
Merge "Add simple error logs in result DB"

8 years agoTake report arg into account 19/14719/1
Cédric Ollivier [Thu, 26 May 2016 11:40:05 +0000 (13:40 +0200)]
Take report arg into account

$report is now tested before calling odlreport2db.py

Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoAdd simple error logs in result DB 15/14715/1
Morgan Richomme [Thu, 26 May 2016 09:41:01 +0000 (11:41 +0200)]
Add simple error logs in result DB

Used afterwards for the reporting to identify quickly
which case(s) are failing

Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoUse flavor name instead of flavor id 99/14699/1
Cédric Ollivier [Thu, 26 May 2016 09:05:15 +0000 (11:05 +0200)]
Use flavor name instead of flavor id

Default flavor id changes if its attributes have been modified.
Flavor name is used instead of flavor id.

Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoAdd security_scan in Functest CI pipeline 71/14671/3
Morgan Richomme [Wed, 25 May 2016 15:51:36 +0000 (17:51 +0200)]
Add security_scan in Functest CI pipeline

JIRA: FUNCTEST-258

Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Added 60 sec delay before launching instances in healthcheck"
Jose Lausuch [Wed, 25 May 2016 15:26:49 +0000 (15:26 +0000)]
Merge "Added 60 sec delay before launching instances in healthcheck"

8 years agoPush results if INSTALLER_TYPE and NODE_NAME are defined 53/14653/2
Cédric Ollivier [Wed, 25 May 2016 09:22:31 +0000 (11:22 +0200)]
Push results if INSTALLER_TYPE and NODE_NAME are defined

INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL
results in DB

Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoAllow unknown ci_installer or ci_scenario in is_compatible 51/14651/2
Cédric Ollivier [Wed, 25 May 2016 08:19:12 +0000 (10:19 +0200)]
Allow unknown ci_installer or ci_scenario in is_compatible

ci_installer and ci_scenario are only tested if they are set. At least one of
theses variables must be set to get dependencies

It modifies the previous logic introduced by the first implementation of
tier_handler.py [1]

[1] https://gerrit.opnfv.org/gerrit/#/c/12579/

Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoAdded 60 sec delay before launching instances in healthcheck 57/14657/1
vitikkan [Wed, 25 May 2016 12:03:52 +0000 (15:03 +0300)]
Added 60 sec delay before launching instances in healthcheck

This delay should be removed after resolving Jira case APEX-149.
The purpose is to give some time to populate openflow rules
by SDN controller in case of odl_l2 scenario.

Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoJoin Rally_full and Tempest_full in the same Tier 57/14557/2
jose.lausuch [Tue, 24 May 2016 08:23:09 +0000 (10:23 +0200)]
Join Rally_full and Tempest_full in the same Tier

JIRA: FUNCTEST-190

Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoAdd framework for presentations 17/14517/5
Morgan Richomme [Mon, 23 May 2016 12:40:54 +0000 (14:40 +0200)]
Add framework for presentations

Change-Id: I8ba24fb4b2a3a6c8d8c69f15a1fd9259aea4ab6c
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoPush bgpvpn_api results into Test DB 35/14435/1
Morgan Richomme [Fri, 20 May 2016 12:29:51 +0000 (14:29 +0200)]
Push bgpvpn_api results into Test DB

JIRA: FUNCTEST-234

Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoPreserving Nova instances from os_defaults.yaml 59/14359/4
vitikkan [Thu, 19 May 2016 11:08:47 +0000 (14:08 +0300)]
Preserving Nova instances from os_defaults.yaml

Previously clean_openstack deleted all the existing instances
even if they were included into os_defaults.yaml.

Change-Id: Id7c17ec86a5616c44bd2965844a4a8545054358b
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoFix path for vping.sh and exit if SCP fails 63/14363/2
jose.lausuch [Thu, 19 May 2016 11:24:35 +0000 (13:24 +0200)]
Fix path for vping.sh and exit if SCP fails

Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agofix vPing paths post refactoring effect 45/14345/1
Morgan Richomme [Thu, 19 May 2016 06:25:36 +0000 (08:25 +0200)]
fix vPing paths post refactoring effect

Change-Id: I24e961965db5103af1625418e7f5ae977bcabf54
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoChange 'testcases' directory structure 63/14263/2
jose.lausuch [Tue, 17 May 2016 19:36:56 +0000 (21:36 +0200)]
Change 'testcases' directory structure

JIRA: FUNCTEST-226

- Remove all 'CI' subdirs
- Remove VIM dir and have OpenStack dir within /testcases/
- Split rally and tempest in 2 different dirs

Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "BGPVPN test case refactored"
Morgan Richomme [Tue, 17 May 2016 13:27:40 +0000 (13:27 +0000)]
Merge "BGPVPN test case refactored"

8 years agoMerge "Catch TypeError exceptions in ci/tier_handler.py"
Jose Lausuch [Tue, 17 May 2016 08:19:49 +0000 (08:19 +0000)]
Merge "Catch TypeError exceptions in ci/tier_handler.py"

8 years agoBGPVPN test case refactored 81/14181/3
vitikkan [Mon, 16 May 2016 05:05:45 +0000 (08:05 +0300)]
BGPVPN test case refactored

BGPVPN test case is refactored and moved into bgpvpn.py module.

JIRA: FUNCTEST-234

Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoRefactor ODL vars in ci/exec_test.sh 95/14095/1
Cédric Ollivier [Fri, 13 May 2016 12:41:00 +0000 (14:41 +0200)]
Refactor ODL vars in ci/exec_test.sh

neutron_ip is set equal to neutron public endpoint and odl_ip to
neutron_ip or SDN_CONTROLLER according to INSTALLER_TYPE.
It also doesn't exit if INSTALLER_TYPE is unset.

Change-Id: I9ffa9f2837216ba88645d9bdfeeedd7a86a50b84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoReplace error in ci/exec_test.sh 91/14091/1
Cédric Ollivier [Fri, 13 May 2016 12:02:14 +0000 (14:02 +0200)]
Replace error in ci/exec_test.sh

error undefined in ci/exec_test.sh is now replaced by echo $msg >&2

Change-Id: I90fc44d94680206a2b0e85f9dfa5c48dadf6ac04
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>