functest.git
8 years ago[ODL-SFC] Open port 22 in default secgroup for sfc scenario 33/21833/2
jose.lausuch [Tue, 20 Sep 2016 14:04:33 +0000 (16:04 +0200)]
[ODL-SFC] Open port 22 in default secgroup for sfc scenario

JIRA: SFC-48

After some troublehsooting done in Boron RC3.5, vPing
doesn't work because the instances are created on 2
security groups. One (vping-sg) opens port 22 but
the default secgroup doesn't. This patch allows port
22 also on the default and therefore vPing passes.

This patch is to workaround a bug in ODL. The bug
will be reported to the corresponding community.

Change-Id: I807249d42cebe7c8dccd78a3496c1d34996d73ee
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoRemove parser test case from bgpvpn scenarios 91/21491/1
jose.lausuch [Mon, 19 Sep 2016 17:26:51 +0000 (19:26 +0200)]
Remove parser test case from bgpvpn scenarios

Due to the same performance issue encountered in bgpvpn
scenarios, Jenkins still times out and can't have a summary
of all the tests and upload logs to artifacts.
The removal of this test case will affect only
Colorado 1.0, and will be reactivated in
Colorado 2.0 with ODL Boron.

Change-Id: Ic2d8cc43a1a732daa063aa7c01a309a3dfa2050d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Remove TODO in Functest user guide - Add links to feature project user guide...
Morgan Richomme [Mon, 19 Sep 2016 14:19:43 +0000 (14:19 +0000)]
Merge "Remove TODO in Functest user guide - Add links to feature project user guide - Add links to external web site - Change Dashboard picture"

8 years agoStyle the headers for release-notes 41/21441/1
cristinapauna [Mon, 19 Sep 2016 13:28:54 +0000 (16:28 +0300)]
Style the headers for release-notes

Title level was inconsistent for release notes

Change-Id: I3e8edc04e6bcd77134a43e4543f4255ff49e16d6
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years agoUpdate results on ARM 19/21419/3
cristinapauna [Mon, 19 Sep 2016 11:03:21 +0000 (14:03 +0300)]
Update results on ARM

Add a table with the scenarios supported by ARM and the coresponing results

Change-Id: Ie32189d15b743e35052c023888ec1da98facb91a
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years agoRemove TODO in Functest user guide 05/21405/2
Morgan Richomme [Mon, 19 Sep 2016 09:17:36 +0000 (11:17 +0200)]
Remove TODO in Functest user guide
- Add links to feature project user guide
- Add links to external web site
- Change Dashboard picture

JIRA: FUNCTEST-434

Change-Id: Ifc760c376361ed5452a874e373767b51d761b91f
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Updated results info for os-odl_l2-fdio-noha"
Morgan Richomme [Mon, 19 Sep 2016 06:59:12 +0000 (06:59 +0000)]
Merge "Updated results info for os-odl_l2-fdio-noha"

8 years agoUpdated results info for os-odl_l2-fdio-noha 95/21295/3
Frank Brockners [Fri, 16 Sep 2016 17:07:26 +0000 (10:07 -0700)]
Updated results info for os-odl_l2-fdio-noha

Updated results info reflecting latest info in
testresults.opnfv.org database.
Added link to results information.

Change-Id: I1389f0caf7742c37189846c413a17a840fa1448d
Signed-off-by: Frank Brockners <fbrockne@cisco.com>
8 years agoAdd user guide link for copper 13/21313/6
blsaws [Fri, 16 Sep 2016 18:35:25 +0000 (11:35 -0700)]
Add user guide link for copper

JIRA: COPPER-1
Add colorado folder
Add user guide content
Update note on HA deployment of VIM services.
Correct specified
Correct link (add /docs)

Change-Id: I44e996a2c51a868cb4212085d45482a9545ea2e9
Signed-off-by: blsaws <bryan.sullivan@att.com>
8 years agoFix formatting error 65/21265/1
cristinapauna [Fri, 16 Sep 2016 12:03:15 +0000 (15:03 +0300)]
Fix formatting error

This is a fix for https://jira.opnfv.org/browse/FUNCTEST-477
The script terminated due to incomplete formatting

Change-Id: I580750e2fe6b1b8957ab017c64d44b9693760860
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years agoUpdate release notes with ARM results 57/21257/1
cristinapauna [Fri, 16 Sep 2016 11:03:16 +0000 (14:03 +0300)]
Update release notes with ARM results

Add a link to the Funtest results on ARM in the fuel section

Change-Id: I1ecf5ab4ac5ef00c64309ac6b8488a673149f361
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years agoMerge "Added support for custom images and flavors in tempest"
Morgan Richomme [Fri, 16 Sep 2016 08:54:06 +0000 (08:54 +0000)]
Merge "Added support for custom images and flavors in tempest"

8 years agoCorrected Promise links (According to final opnfvdocs directives) 41/21241/1
Bertrand Souville [Fri, 16 Sep 2016 07:02:57 +0000 (09:02 +0200)]
Corrected Promise links (According to final opnfvdocs directives)

Change-Id: I1d565a92bf9dd2de8ae679c4ca9c0bb5a9148830
Signed-off-by: Bertrand Souville <souville@docomolab-euro.com>
8 years agoMerge "Update release Note"
Morgan Richomme [Thu, 15 Sep 2016 15:49:27 +0000 (15:49 +0000)]
Merge "Update release Note"

8 years agoAdded support for custom images and flavors in tempest 93/21193/2
juraj.linkes [Thu, 15 Sep 2016 14:27:06 +0000 (16:27 +0200)]
Added support for custom images and flavors in tempest

Change-Id: I9335ed1517097e83175a265b603a6707adf476b6
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
8 years agoUpdate release Note 45/21145/11
Morgan Richomme [Wed, 14 Sep 2016 16:35:37 +0000 (18:35 +0200)]
Update release Note

JIRA: FUNCTEST-436

Change-Id: Idbb02dd26e9578fc53e77f4b30447ff037f38ef4
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agofixed updating of hugepage flavors 89/21189/1
juraj.linkes [Thu, 15 Sep 2016 14:11:40 +0000 (16:11 +0200)]
fixed updating of hugepage flavors

Change-Id: I5719aef5d5334584337858cf5fee3ef024c0eaac
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
8 years agoExclude Doctor from Functest for fuel scenarios 63/20663/2
Morgan Richomme [Thu, 8 Sep 2016 09:50:25 +0000 (11:50 +0200)]
Exclude Doctor from Functest for fuel scenarios

Doctor, as part of the feature project, is FAIL on fuel
scenarios

JIRA: FUNCTEST-192

Change-Id: Ic5b9b4afe80fbb2d5887bdf46410a0fc72e7be37
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoExclude copper, doctor and security_scan from apex/fdio scenarios 35/21135/3
Morgan Richomme [Wed, 14 Sep 2016 14:22:03 +0000 (16:22 +0200)]
Exclude copper, doctor and security_scan from apex/fdio scenarios

JIRA: FUNCTEST-475

Change-Id: I720b9d88db94d66f067601608ab2d1435fc93d47
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoAdd delay after SF floating IP assignment 27/21127/1
George Paraskevopoulos [Wed, 14 Sep 2016 12:32:02 +0000 (15:32 +0300)]
Add delay after SF floating IP assignment

JIRA: https://jira.opnfv.org/browse/SFC-48

The assignment of floating IPs to service functions needs some time
to complete, otherwise we get ssh failures

Change-Id: Ia3e789be95d20801ee2c741a473d407e936f4fb6
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoMerge "Include latest tag for Multisite Kingbird"
Jose Lausuch [Wed, 14 Sep 2016 11:29:20 +0000 (11:29 +0000)]
Merge "Include latest tag for Multisite Kingbird"

8 years agoInclude latest tag for Multisite Kingbird 17/21117/1
Ashish Singh [Wed, 14 Sep 2016 10:21:51 +0000 (15:51 +0530)]
Include latest tag for Multisite Kingbird

Fix for one of Kingbird testcase failure is in latest tag.
Modifying docker to pick the latest kingbird tag from github.

Change-Id: I4250322b808a104511e68b9a085717e6141a9eca
Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
8 years agoMerge "Push FAIL to DB for onos-sfc"
Jose Lausuch [Wed, 14 Sep 2016 10:15:29 +0000 (10:15 +0000)]
Merge "Push FAIL to DB for onos-sfc"

8 years agoMerge "Added missing parameter into logger warning message"
Jose Lausuch [Wed, 14 Sep 2016 09:29:53 +0000 (09:29 +0000)]
Merge "Added missing parameter into logger warning message"

8 years agoAdded missing parameter into logger warning message 75/21075/2
vitikkan [Wed, 14 Sep 2016 04:31:58 +0000 (07:31 +0300)]
Added missing parameter into logger warning message

Missing parameter prevented using of customer defined
installer type when executing "functest env prepare" command.

JIRA: FUNCTEST-467

Change-Id: I69b69fa43584ec7ae4e4d8925f99624711131ef9
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoPush FAIL to DB for onos-sfc 51/20851/8
wuwenbin2 [Mon, 12 Sep 2016 02:19:29 +0000 (10:19 +0800)]
Push FAIL to DB for onos-sfc

Change-Id: Ifae2cba32d9a0df44ae46e642129931692f65a7c
Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
8 years agoAdd utils for getting bgpvpn information 93/21093/1
Romanos Skiadas [Wed, 14 Sep 2016 07:36:50 +0000 (10:36 +0300)]
Add utils for getting bgpvpn information

Change-Id: I86f9e2afa6578dc60ea82fd163427a4f6e2f8526
Signed-off-by: Romanos Skiadas <rski@intracom-telecom.com>
Co-Authored-By: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoMerge "Doc for Xreview by other test projects"
Morgan Richomme [Tue, 13 Sep 2016 16:33:13 +0000 (16:33 +0000)]
Merge "Doc for Xreview by other test projects"

8 years agoDoc for Xreview by other test projects 15/20315/5
Morgan Richomme [Mon, 5 Sep 2016 09:44:41 +0000 (11:44 +0200)]
Doc for Xreview by other test projects

Change-Id: I75da3530685b74f628fc689b2ef8908919df147e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Refactored support for flavor and image hugepages based on Morgan's suggestins"
Morgan Richomme [Tue, 13 Sep 2016 13:42:00 +0000 (13:42 +0000)]
Merge "Refactored support for flavor and image hugepages based on Morgan's suggestins"

8 years agoRefactored support for flavor and image hugepages based on Morgan's suggestins 13/21013/3
juraj.linkes [Tue, 13 Sep 2016 12:08:31 +0000 (14:08 +0200)]
Refactored support for flavor and image hugepages based on Morgan's suggestins

Change-Id: I414338616aecda161a51a780abb24c9e3a8f5c54
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
8 years agoSFC testcase IP tables policy 73/20773/2
George Paraskevopoulos [Fri, 9 Sep 2016 13:16:21 +0000 (16:16 +0300)]
SFC testcase IP tables policy

Add iptables rule to open requests.
Tacker client fails to connect without this firewall rule.

Change-Id: I7ca0258110571d8aacdf8214830e4fce5a172c59
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoMerge "[ODL-SFC] Add push resulst to DB"
Morgan Richomme [Tue, 13 Sep 2016 12:33:38 +0000 (12:33 +0000)]
Merge "[ODL-SFC] Add push resulst to DB"

8 years agoMerge "Add CI link for ARM"
Morgan Richomme [Tue, 13 Sep 2016 11:44:15 +0000 (11:44 +0000)]
Merge "Add CI link for ARM"

8 years agoAdd CI link for ARM 03/21003/1
cristinapauna [Tue, 13 Sep 2016 11:17:11 +0000 (14:17 +0300)]
Add CI link for ARM

Change-Id: Ieb70482ce2a7a63864dfad08d2e6530265f8d55f
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years ago[SDNVPN] Disable Rally Sanity test case for bgpvpn scenarios 97/20997/3
jose.lausuch [Tue, 13 Sep 2016 09:51:00 +0000 (11:51 +0200)]
[SDNVPN] Disable Rally Sanity test case for bgpvpn scenarios

Due to a known issue with API performance when bgpvpn extension
is activated which causes some delays and the tests take longer
time than normal, we get a lot of Jenkins Job timeouts and the
scenario cannot be validated.
Since it is a performance issue, we black list rally sanity, which
takes 1 hour to complete and will re-enable it in Colorado.2.0
where ODL Boron release will be available and SDNVPN team
thinks this will be fixed.

Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years ago[ODL-SFC] Add push resulst to DB 29/20929/5
jose.lausuch [Mon, 12 Sep 2016 16:17:07 +0000 (18:17 +0200)]
[ODL-SFC] Add push resulst to DB

Change-Id: I314cbda828f6ebda70f7fb4e7d39e781696bc073
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Added support for creating images and flavors with hugepages for fdio scenarios"
Jose Lausuch [Mon, 12 Sep 2016 14:27:28 +0000 (14:27 +0000)]
Merge "Added support for creating images and flavors with hugepages for fdio scenarios"

8 years agoAdded support for creating images and flavors with hugepages for fdio scenarios 97/20897/1
juraj.linkes [Mon, 12 Sep 2016 11:27:05 +0000 (13:27 +0200)]
Added support for creating images and flavors with hugepages for fdio scenarios

Change-Id: Idb1cb3a6b71e6de9343a07b14731ae506a44567e
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
8 years agoExclude Tempest basicops case also in noha scenarios 79/20879/1
Morgan Richomme [Mon, 12 Sep 2016 09:11:54 +0000 (11:11 +0200)]
Exclude Tempest basicops case also in noha scenarios

FUNCTEST-470

Change-Id: I7bfd52b5e18e22d78437821906244a8e32ce38a3
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Optimize onos-sfc"
Jose Lausuch [Fri, 9 Sep 2016 08:55:09 +0000 (08:55 +0000)]
Merge "Optimize onos-sfc"

8 years agoOptimize onos-sfc 23/20323/7
wuwenbin2 [Mon, 5 Sep 2016 11:46:33 +0000 (19:46 +0800)]
Optimize onos-sfc

1.Delete print and format in onos-sfc
2.Split class into serveral methods in Sfc.py
3.Update Fail process
4.Use vars of HTTP status code

Change-Id: Ifb2fc5c570e2c2aa2cfb173eadb32c688a84969e
Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
8 years agoMerge "make use of functest_utils.get_parameter_from_yaml"
Morgan Richomme [Thu, 8 Sep 2016 16:40:34 +0000 (16:40 +0000)]
Merge "make use of functest_utils.get_parameter_from_yaml"

8 years ago[Promise] Use the repository from github 77/20677/1
jose.lausuch [Thu, 8 Sep 2016 12:42:46 +0000 (14:42 +0200)]
[Promise] Use the repository from github

The patch https://gerrit.opnfv.org/gerrit/#/c/20433/
modified the source of the repository from github
to gerrit.
Since gerrit repo causes the failures, we change
back to the original one where the latest changes
are performed.

Change-Id: Ibbe944a457ce0ec3f184a33696c302448e25e506
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Exclude some Rally/Nova tests from lxd noha scenario"
Morgan Richomme [Thu, 8 Sep 2016 10:08:49 +0000 (10:08 +0000)]
Merge "Exclude some Rally/Nova tests from lxd noha scenario"

8 years agoExclude some Rally/Nova tests from lxd noha scenario 49/20649/1
Morgan Richomme [Thu, 8 Sep 2016 09:05:37 +0000 (11:05 +0200)]
Exclude some Rally/Nova tests from lxd noha scenario

JIRA: FUNCTEST-464

Change-Id: I0b5014eabccd60c9efaacc4ee529e7b44fd070b2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoTempest release verion updated 12.1.0 -> 12.2.0 37/20637/1
vitikkan [Thu, 8 Sep 2016 07:01:22 +0000 (10:01 +0300)]
Tempest release verion updated 12.1.0 -> 12.2.0

A bug (https://bugs.launchpad.net/tempest/+bug/1597164) in the
older version caused three tearDownClass failures in smoke suite.

JIRA: FUNCTEST-466

Change-Id: Iaa5cb7082b05aa938f2088dc635a47d1319f340c
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agomake use of functest_utils.get_parameter_from_yaml 69/20569/4
SerenaFeng [Wed, 7 Sep 2016 14:13:42 +0000 (22:13 +0800)]
make use of functest_utils.get_parameter_from_yaml

JIRA: FUNCTEST-463

Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "remove imported FUNCTEST_REPO object"
Morgan Richomme [Wed, 7 Sep 2016 14:49:50 +0000 (14:49 +0000)]
Merge "remove imported FUNCTEST_REPO object"

8 years agoExclude Rally/Nova tests for lxd scenario 59/20559/1
Morgan Richomme [Wed, 7 Sep 2016 13:27:12 +0000 (15:27 +0200)]
Exclude Rally/Nova tests for lxd scenario

JIRA: FUNCTEST-464

Change-Id: I521f1ccd88579ba411d3691e4c222a2e8b41e1f8
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoremove imported FUNCTEST_REPO object 01/20501/2
SerenaFeng [Wed, 7 Sep 2016 01:14:27 +0000 (09:14 +0800)]
remove imported FUNCTEST_REPO object

According to openstack style guidelines in http://docs.openstack.org/developer/hacking/
**** Do not import objects, only modules (*) ****
so direct FUNCTEST_REPO import should be avoided
from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO

JIRA: FUNCTEST-459

Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "Clone the proper branches in the dockerfile"
jose.lausuch [Tue, 6 Sep 2016 17:46:34 +0000 (17:46 +0000)]
Merge "Clone the proper branches in the dockerfile"

8 years agoClone the proper branches in the dockerfile 33/20433/7
jose.lausuch [Tue, 6 Sep 2016 09:47:33 +0000 (11:47 +0200)]
Clone the proper branches in the dockerfile

JIRA: FUNCTEST-458

Related: https://gerrit.opnfv.org/gerrit/#/c/20431/

Change-Id: I234b1ed9c61411d7f328340612c28dffe12bb605
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Fix image format set for rally test cases"
Morgan Richomme [Tue, 6 Sep 2016 15:16:15 +0000 (15:16 +0000)]
Merge "Fix image format set for rally test cases"

8 years agoFix image format set for rally test cases 69/20469/1
Juha Kosonen [Tue, 6 Sep 2016 14:15:31 +0000 (14:15 +0000)]
Fix image format set for rally test cases

Always use image format defined in config_functest.yaml when creating
glance images.

JIRA: FUNCTEST-460

Change-Id: Ica6b35605301bc14290daa23a1480114cf6294c0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
8 years agoRemove source-sans-pro directory, fonts not used and license conflict 53/20453/1
Morgan Richomme [Tue, 6 Sep 2016 13:27:34 +0000 (15:27 +0200)]
Remove source-sans-pro directory, fonts not used and license conflict

Change-Id: I0ecdc71fe6cd58923c6fa9ad1bc01a0cc13bf72b
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Reduce logging in the SFC test case"
Jose Lausuch [Tue, 6 Sep 2016 13:22:47 +0000 (13:22 +0000)]
Merge "Reduce logging in the SFC test case"

8 years agoReduce logging in the SFC test case 29/20429/5
George Paraskevopoulos [Tue, 6 Sep 2016 09:42:13 +0000 (12:42 +0300)]
Reduce logging in the SFC test case

JIRA: FUNCTEST-446

Reduce the logs that appear in the Jenkins CI console to make the output
of the SFC test case more readable

- Redirect tacker installation logs to results folder
  /home/opnfv/functest/results/odl-sfc.log
- Split odl-sfc preparation into a new script
- Pipe STDERR in the sfc.py script so that "Added to known hosts"
  messages do not show in the output

Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoMerge "[Promise] Fix bug opening the json result file"
jose.lausuch [Tue, 6 Sep 2016 12:30:55 +0000 (12:30 +0000)]
Merge "[Promise] Fix bug opening the json result file"

8 years ago[Promise] Fix bug opening the json result file 43/20443/1
jose.lausuch [Tue, 6 Sep 2016 12:22:26 +0000 (14:22 +0200)]
[Promise] Fix bug opening the json result file

Change-Id: I8882ffc8139095a79b6542c508a6293ae231f232
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Add support of arm for doctor"
Jose Lausuch [Tue, 6 Sep 2016 12:21:10 +0000 (12:21 +0000)]
Merge "Add support of arm for doctor"

8 years agoAdd support of arm for doctor 71/20371/5
cristinapauna [Mon, 5 Sep 2016 15:51:12 +0000 (18:51 +0300)]
Add support of arm for doctor

This is half of the fix to make the doctor suite run on arm.
The other half is at https://gerrit.opnfv.org/gerrit/#/c/20369/
In this fix I set an enviroment variable, to be used by
the doctor suite when ran with functest. The variable is set only
when present in config_functest.yaml, which we use as a custom file
when running functest on arm.

Change-Id: If34d3e7734a194bf9fe8b525a362e029767caa4f
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years agoMerge "[Promise test case] Use proper way to get parameters from yaml"
jose.lausuch [Tue, 6 Sep 2016 07:22:31 +0000 (07:22 +0000)]
Merge "[Promise test case] Use proper way to get parameters from yaml"

8 years agoMerge "Add blacklist handling for rally test cases"
Morgan Richomme [Tue, 6 Sep 2016 07:10:44 +0000 (07:10 +0000)]
Merge "Add blacklist handling for rally test cases"

8 years ago[Promise test case] Use proper way to get parameters from yaml 41/20341/3
jose.lausuch [Mon, 5 Sep 2016 12:37:54 +0000 (14:37 +0200)]
[Promise test case] Use proper way to get parameters from yaml

Since there is a function in functest_utils to get
a value from the config_functest.yaml directly, there
is no need to load again that file. Better to use common
functions that are designed for that.

Also, Replace location of the results json file to
the results directory. It will be also pushed to artifacts
repository.

Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoAdd blacklist handling for rally test cases 61/20361/1
Juha Kosonen [Mon, 5 Sep 2016 14:36:01 +0000 (14:36 +0000)]
Add blacklist handling for rally test cases

Test cases can be excluded from execution based on installer/scenario
via blacklist file.

JIRA: FUNCTEST-451

Change-Id: I17bbd5f1364a890b88bc196cbc5f49c492df1cb1
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
8 years agoRedirect dominio's output to a log file 51/20351/2
Carlos Goncalves [Mon, 5 Sep 2016 13:01:28 +0000 (15:01 +0200)]
Redirect dominio's output to a log file

Change-Id: Ic4daa57ddbf6587660f982acd915cd4363d3ccbc
Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
8 years agoMerge "solve bidirectional dependencies between ci and utils modules"
Morgan Richomme [Mon, 5 Sep 2016 12:32:42 +0000 (12:32 +0000)]
Merge "solve bidirectional dependencies between ci and utils modules"

8 years agoMerge "[Doctor test case] Redirect output to a log file"
jose.lausuch [Mon, 5 Sep 2016 12:30:40 +0000 (12:30 +0000)]
Merge "[Doctor test case] Redirect output to a log file"

8 years agoMerge "Switch print to logging.info"
Morgan Richomme [Mon, 5 Sep 2016 12:30:08 +0000 (12:30 +0000)]
Merge "Switch print to logging.info"

8 years ago[Doctor test case] Redirect output to a log file 29/20329/2
jose.lausuch [Mon, 5 Sep 2016 12:06:25 +0000 (14:06 +0200)]
[Doctor test case] Redirect output to a log file

The output shown in the Jenkins console will now be
redirected to a file which will be available and linked
to the artifacts repository.

Change-Id: I2e9b5c2ab681a787aa0fc249844cc13feb581764
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoRevert excluding floating IP cases from odl_l3 13/20313/1
vitikkan [Mon, 5 Sep 2016 09:33:13 +0000 (12:33 +0300)]
Revert excluding floating IP cases from odl_l3

Only restrictions table in release notes is updated.

Change-Id: I8f27a876058eabe1c490fc5980de5626aed665a3
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agosolve bidirectional dependencies between ci and utils modules 61/20261/2
SerenaFeng [Fri, 2 Sep 2016 15:33:22 +0000 (23:33 +0800)]
solve bidirectional dependencies between ci and utils modules

Ci module's run_tests.py references utils module's functest_utils,
and functest_utils references ci module's tier_handler.
Form a bidirectional dependencies between two packages.

JIRA: FUNCTEST-456

Change-Id: Idbdd4896fb1ec786fcfd656832bfe2d4048a8278
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "Exclude test cases that use floating IP from odl_l3 scenarios"
Morgan Richomme [Fri, 2 Sep 2016 10:11:20 +0000 (10:11 +0000)]
Merge "Exclude test cases that use floating IP from odl_l3 scenarios"

8 years agoExclude test cases that use floating IP from odl_l3 scenarios 29/20229/1
vitikkan [Fri, 2 Sep 2016 09:33:09 +0000 (12:33 +0300)]
Exclude test cases that use floating IP from odl_l3 scenarios

All the tempest_smoke_serial test cases that use floating IP
addresses for accessing instances are excluded because of
ODL bug https://bugs.opendaylight.org/show_bug.cgi?id=5586

JIRA: FUNCTEST-445

Change-Id: I19468be108a25e989c0cfef031bbe5f2b9db0964
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoMerge "Print all the Copper test output to a log file"
jose.lausuch [Fri, 2 Sep 2016 09:11:00 +0000 (09:11 +0000)]
Merge "Print all the Copper test output to a log file"

8 years agoPrint all the Copper test output to a log file 73/20173/2
jose.lausuch [Thu, 1 Sep 2016 15:40:33 +0000 (17:40 +0200)]
Print all the Copper test output to a log file

To keep the jenkins console clean and readable,
dump all the output that the Copper test case
generates to a log file and push it to artifact
repository at the end.

Change-Id: If4812c7e92b4d050757ca07333f7c353a0220056
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Print all the Parser test output to a log file"
jose.lausuch [Fri, 2 Sep 2016 08:26:55 +0000 (08:26 +0000)]
Merge "Print all the Parser test output to a log file"

8 years agoPrint all the Parser test output to a log file 77/20177/2
jose.lausuch [Thu, 1 Sep 2016 15:55:14 +0000 (17:55 +0200)]
Print all the Parser test output to a log file

To keep the jenkins console clean and readable,
dump all the output that the Parser test case
generates to a log file and push it to artifact
repository at the end.

Change-Id: I04c8507fda535c7bcb0919fc3bc5877336664942
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Add print-to-a-file option when executing a command in functest_utils"
jose.lausuch [Fri, 2 Sep 2016 08:06:28 +0000 (08:06 +0000)]
Merge "Add print-to-a-file option when executing a command in functest_utils"

8 years agoMerge "Change default memory for Promise flavor"
jose.lausuch [Fri, 2 Sep 2016 07:55:10 +0000 (07:55 +0000)]
Merge "Change default memory for Promise flavor"

8 years agoMerge "Fixes cleaning up HA Neutron objects"
Jose Lausuch [Fri, 2 Sep 2016 07:37:02 +0000 (07:37 +0000)]
Merge "Fixes cleaning up HA Neutron objects"

8 years agoMerge "Force python-keystoneclient to version 2.3.1 for tacker to work"
jose.lausuch [Fri, 2 Sep 2016 07:31:01 +0000 (07:31 +0000)]
Merge "Force python-keystoneclient to version 2.3.1 for tacker to work"

8 years agoFixes cleaning up HA Neutron objects 85/20185/1
Tim Rozet [Thu, 1 Sep 2016 19:05:07 +0000 (15:05 -0400)]
Fixes cleaning up HA Neutron objects

This fixes a race condition where the cleanup method is trying to remove
HA networks, while Neutron is also trying to remove the network - after
the HA router is removed.  This only applies to installations where
Neutron L3 HA is enabled (nosdn cases only).

JIRA: FUNCTEST-454

Change-Id: If06b6f6297e99dcce4b0f2aff8ec80b47488ee90
Signed-off-by: Tim Rozet <trozet@redhat.com>
8 years agoChange debug mode for commands that generate too much output in sec_scan 79/20179/3
jose.lausuch [Thu, 1 Sep 2016 16:03:25 +0000 (18:03 +0200)]
Change debug mode for commands that generate too much output in sec_scan

The security scan test case generates sometimes too much output
messages and makes Jenkins unreadable.
For example:
https://build.opnfv.org/ci/job/functest-apex-apex-daily-colorado-daily-colorado/65/console

80% of the output belongs to this test case.
This patch will reduce it since debug information is not
showed in Jenkins but it is pushed as part of
functest.log to artifacts.

Change-Id: I56b3adf87d302d118ee5c15eb86bc10237a7cc4e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoChange default memory for Promise flavor 65/20165/1
jose.lausuch [Thu, 1 Sep 2016 15:09:31 +0000 (17:09 +0200)]
Change default memory for Promise flavor

In some scenarios (bgpvpn) the timeout defined in promise
to boot/delete vms is too tight. Having less memory
might fix the problem as it will take less time and it
doesn't impact the promise test case.

Change-Id: Ib3165ea5d6518d88384f76c8edd10dddb0b529a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoAdd router association utility function 45/20145/1
George Paraskevopoulos [Thu, 1 Sep 2016 13:27:44 +0000 (16:27 +0300)]
Add router association utility function

Add function to create an association between a router and a bgpvpn

Change-Id: I23449a0363f9d8f3c77ea3be1e104586d3c111d1
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoAdd print-to-a-file option when executing a command in functest_utils 31/20131/3
jose.lausuch [Thu, 1 Sep 2016 13:03:18 +0000 (15:03 +0200)]
Add print-to-a-file option when executing a command in functest_utils

Change-Id: I8b91979380d0f4794d5ceaf8edb2a9d80cd7170f
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoFix some bugs 33/20133/1
boucherv [Thu, 1 Sep 2016 13:04:42 +0000 (15:04 +0200)]
Fix some bugs

Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agoSwitch print to logging.info 27/20127/2
Cédric Ollivier [Thu, 1 Sep 2016 11:52:28 +0000 (13:52 +0200)]
Switch print to logging.info

It follows the recommendations described in the next review [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/19795/

Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoForce python-keystoneclient to version 2.3.1 for tacker to work 21/20121/1
jose.lausuch [Thu, 1 Sep 2016 09:37:33 +0000 (11:37 +0200)]
Force python-keystoneclient to version 2.3.1 for tacker to work

Tacker client is installed from Tim Rozet repository, it doesn't
support version 3 of the keystone client.

Change-Id: Ie2005b1590dfccf93442995e96e0c02b4629edea
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agostop hardcoded FUNCTEST_REPO path everywhere 85/20085/3
SerenaFeng [Thu, 1 Sep 2016 02:19:58 +0000 (10:19 +0800)]
stop hardcoded FUNCTEST_REPO path everywhere

functest repo is used by almost every testcase, each place we get it like:
REPOS_DIR = os.getenv('repos_dir')
FUNCTEST_REPO = ("%s/functest" % REPOS_DIR)
provide a common interface in functest_util.py

JIRA: FUNCTEST-453

Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "unify functest_yaml obtain process"
Jose Lausuch [Thu, 1 Sep 2016 08:30:09 +0000 (08:30 +0000)]
Merge "unify functest_yaml obtain process"

8 years agoMerge "Add a specific logger for orchestrator class"
Jose Lausuch [Thu, 1 Sep 2016 07:44:36 +0000 (07:44 +0000)]
Merge "Add a specific logger for orchestrator class"

8 years agoRemove copper from lxd scenario 47/20047/2
Morgan Richomme [Wed, 31 Aug 2016 15:34:40 +0000 (17:34 +0200)]
Remove copper from lxd scenario

JIRA: FUNCTEST-452

Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoRefactor SFC testcase 11/20011/4
George Paraskevopoulos [Mon, 29 Aug 2016 08:13:17 +0000 (11:13 +0300)]
Refactor SFC testcase

- Change the way the test checks if the vxlan_tool has started.
  Now the vxlan_tool is detected even if another python process is up.
- Log the exceptions in the vxlan_tool check block. The exceptions that
  occur are not destructive for the testcase but it's better to be
  visible.
- Add a 60 seconds sleep before the testcase starts to give plenty of
  time to ODL to add the correct flows.
- Move the testcase success/fail check blocks inside the try blocks.
  The checks are performed on the stdout variable which is in scope
  only inside the try blocks.

Change-Id: I49dec176fb83117e9896ac1d19e8a5bd95e3d7cf
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoAdd a specific logger for orchestrator class 49/20049/4
boucherv [Wed, 31 Aug 2016 15:43:08 +0000 (17:43 +0200)]
Add a specific logger for orchestrator class

JIRA: FUNCTEST-428

Change-Id: I1aab08f8f92df3b5527e6f8121cdf45aec2f5c17
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agounify functest_yaml obtain process 45/19945/3
SerenaFeng [Wed, 31 Aug 2016 02:22:33 +0000 (10:22 +0800)]
unify functest_yaml obtain process

functest_yaml is needed in almost all of the testcases, the obtain process is the same:
with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f:
functest_yaml = yaml.safe_load(f)
f.close()
abstract a method to unify the process, and provide the interface

JIRA: FUNCTEST-447

Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoRemove all logers as utils method args. 13/20013/2
Cédric Ollivier [Wed, 31 Aug 2016 13:33:56 +0000 (15:33 +0200)]
Remove all logers as utils method args.

As it modifies method params, it could break the testcases.

JIRA: FUNCTEST-428

Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoUse a global logger instead of method args 61/19961/2
Cédric Ollivier [Wed, 31 Aug 2016 07:38:24 +0000 (09:38 +0200)]
Use a global logger instead of method args

It's the first step to safely remove all logers as method args.
Outputs printed by bash scripts called by execute_command are no longer
written in functest.log. Else logs printed by python scripts will
be duplicated in it.

JIRA: FUNCTEST-428

Change-Id: I60702f3b62121f731cd6845c335e227f97df37c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>