functest.git
8 years agoRemove source-sans-pro directory, fonts not used and license conflict 53/20453/1
Morgan Richomme [Tue, 6 Sep 2016 13:27:34 +0000 (15:27 +0200)]
Remove source-sans-pro directory, fonts not used and license conflict

Change-Id: I0ecdc71fe6cd58923c6fa9ad1bc01a0cc13bf72b
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Reduce logging in the SFC test case"
Jose Lausuch [Tue, 6 Sep 2016 13:22:47 +0000 (13:22 +0000)]
Merge "Reduce logging in the SFC test case"

8 years agoReduce logging in the SFC test case 29/20429/5
George Paraskevopoulos [Tue, 6 Sep 2016 09:42:13 +0000 (12:42 +0300)]
Reduce logging in the SFC test case

JIRA: FUNCTEST-446

Reduce the logs that appear in the Jenkins CI console to make the output
of the SFC test case more readable

- Redirect tacker installation logs to results folder
  /home/opnfv/functest/results/odl-sfc.log
- Split odl-sfc preparation into a new script
- Pipe STDERR in the sfc.py script so that "Added to known hosts"
  messages do not show in the output

Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoMerge "[Promise] Fix bug opening the json result file"
jose.lausuch [Tue, 6 Sep 2016 12:30:55 +0000 (12:30 +0000)]
Merge "[Promise] Fix bug opening the json result file"

8 years ago[Promise] Fix bug opening the json result file 43/20443/1
jose.lausuch [Tue, 6 Sep 2016 12:22:26 +0000 (14:22 +0200)]
[Promise] Fix bug opening the json result file

Change-Id: I8882ffc8139095a79b6542c508a6293ae231f232
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Add support of arm for doctor"
Jose Lausuch [Tue, 6 Sep 2016 12:21:10 +0000 (12:21 +0000)]
Merge "Add support of arm for doctor"

8 years agoAdd support of arm for doctor 71/20371/5
cristinapauna [Mon, 5 Sep 2016 15:51:12 +0000 (18:51 +0300)]
Add support of arm for doctor

This is half of the fix to make the doctor suite run on arm.
The other half is at https://gerrit.opnfv.org/gerrit/#/c/20369/
In this fix I set an enviroment variable, to be used by
the doctor suite when ran with functest. The variable is set only
when present in config_functest.yaml, which we use as a custom file
when running functest on arm.

Change-Id: If34d3e7734a194bf9fe8b525a362e029767caa4f
Signed-off-by: cristinapauna <cristina.pauna@enea.com>
8 years agoMerge "[Promise test case] Use proper way to get parameters from yaml"
jose.lausuch [Tue, 6 Sep 2016 07:22:31 +0000 (07:22 +0000)]
Merge "[Promise test case] Use proper way to get parameters from yaml"

8 years agoMerge "Add blacklist handling for rally test cases"
Morgan Richomme [Tue, 6 Sep 2016 07:10:44 +0000 (07:10 +0000)]
Merge "Add blacklist handling for rally test cases"

8 years ago[Promise test case] Use proper way to get parameters from yaml 41/20341/3
jose.lausuch [Mon, 5 Sep 2016 12:37:54 +0000 (14:37 +0200)]
[Promise test case] Use proper way to get parameters from yaml

Since there is a function in functest_utils to get
a value from the config_functest.yaml directly, there
is no need to load again that file. Better to use common
functions that are designed for that.

Also, Replace location of the results json file to
the results directory. It will be also pushed to artifacts
repository.

Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoAdd blacklist handling for rally test cases 61/20361/1
Juha Kosonen [Mon, 5 Sep 2016 14:36:01 +0000 (14:36 +0000)]
Add blacklist handling for rally test cases

Test cases can be excluded from execution based on installer/scenario
via blacklist file.

JIRA: FUNCTEST-451

Change-Id: I17bbd5f1364a890b88bc196cbc5f49c492df1cb1
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
8 years agoRedirect dominio's output to a log file 51/20351/2
Carlos Goncalves [Mon, 5 Sep 2016 13:01:28 +0000 (15:01 +0200)]
Redirect dominio's output to a log file

Change-Id: Ic4daa57ddbf6587660f982acd915cd4363d3ccbc
Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
8 years agoMerge "solve bidirectional dependencies between ci and utils modules"
Morgan Richomme [Mon, 5 Sep 2016 12:32:42 +0000 (12:32 +0000)]
Merge "solve bidirectional dependencies between ci and utils modules"

8 years agoMerge "[Doctor test case] Redirect output to a log file"
jose.lausuch [Mon, 5 Sep 2016 12:30:40 +0000 (12:30 +0000)]
Merge "[Doctor test case] Redirect output to a log file"

8 years agoMerge "Switch print to logging.info"
Morgan Richomme [Mon, 5 Sep 2016 12:30:08 +0000 (12:30 +0000)]
Merge "Switch print to logging.info"

8 years ago[Doctor test case] Redirect output to a log file 29/20329/2
jose.lausuch [Mon, 5 Sep 2016 12:06:25 +0000 (14:06 +0200)]
[Doctor test case] Redirect output to a log file

The output shown in the Jenkins console will now be
redirected to a file which will be available and linked
to the artifacts repository.

Change-Id: I2e9b5c2ab681a787aa0fc249844cc13feb581764
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoRevert excluding floating IP cases from odl_l3 13/20313/1
vitikkan [Mon, 5 Sep 2016 09:33:13 +0000 (12:33 +0300)]
Revert excluding floating IP cases from odl_l3

Only restrictions table in release notes is updated.

Change-Id: I8f27a876058eabe1c490fc5980de5626aed665a3
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agosolve bidirectional dependencies between ci and utils modules 61/20261/2
SerenaFeng [Fri, 2 Sep 2016 15:33:22 +0000 (23:33 +0800)]
solve bidirectional dependencies between ci and utils modules

Ci module's run_tests.py references utils module's functest_utils,
and functest_utils references ci module's tier_handler.
Form a bidirectional dependencies between two packages.

JIRA: FUNCTEST-456

Change-Id: Idbdd4896fb1ec786fcfd656832bfe2d4048a8278
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "Exclude test cases that use floating IP from odl_l3 scenarios"
Morgan Richomme [Fri, 2 Sep 2016 10:11:20 +0000 (10:11 +0000)]
Merge "Exclude test cases that use floating IP from odl_l3 scenarios"

8 years agoExclude test cases that use floating IP from odl_l3 scenarios 29/20229/1
vitikkan [Fri, 2 Sep 2016 09:33:09 +0000 (12:33 +0300)]
Exclude test cases that use floating IP from odl_l3 scenarios

All the tempest_smoke_serial test cases that use floating IP
addresses for accessing instances are excluded because of
ODL bug https://bugs.opendaylight.org/show_bug.cgi?id=5586

JIRA: FUNCTEST-445

Change-Id: I19468be108a25e989c0cfef031bbe5f2b9db0964
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoMerge "Print all the Copper test output to a log file"
jose.lausuch [Fri, 2 Sep 2016 09:11:00 +0000 (09:11 +0000)]
Merge "Print all the Copper test output to a log file"

8 years agoPrint all the Copper test output to a log file 73/20173/2
jose.lausuch [Thu, 1 Sep 2016 15:40:33 +0000 (17:40 +0200)]
Print all the Copper test output to a log file

To keep the jenkins console clean and readable,
dump all the output that the Copper test case
generates to a log file and push it to artifact
repository at the end.

Change-Id: If4812c7e92b4d050757ca07333f7c353a0220056
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Print all the Parser test output to a log file"
jose.lausuch [Fri, 2 Sep 2016 08:26:55 +0000 (08:26 +0000)]
Merge "Print all the Parser test output to a log file"

8 years agoPrint all the Parser test output to a log file 77/20177/2
jose.lausuch [Thu, 1 Sep 2016 15:55:14 +0000 (17:55 +0200)]
Print all the Parser test output to a log file

To keep the jenkins console clean and readable,
dump all the output that the Parser test case
generates to a log file and push it to artifact
repository at the end.

Change-Id: I04c8507fda535c7bcb0919fc3bc5877336664942
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoMerge "Add print-to-a-file option when executing a command in functest_utils"
jose.lausuch [Fri, 2 Sep 2016 08:06:28 +0000 (08:06 +0000)]
Merge "Add print-to-a-file option when executing a command in functest_utils"

8 years agoMerge "Change default memory for Promise flavor"
jose.lausuch [Fri, 2 Sep 2016 07:55:10 +0000 (07:55 +0000)]
Merge "Change default memory for Promise flavor"

8 years agoMerge "Fixes cleaning up HA Neutron objects"
Jose Lausuch [Fri, 2 Sep 2016 07:37:02 +0000 (07:37 +0000)]
Merge "Fixes cleaning up HA Neutron objects"

8 years agoMerge "Force python-keystoneclient to version 2.3.1 for tacker to work"
jose.lausuch [Fri, 2 Sep 2016 07:31:01 +0000 (07:31 +0000)]
Merge "Force python-keystoneclient to version 2.3.1 for tacker to work"

8 years agoFixes cleaning up HA Neutron objects 85/20185/1
Tim Rozet [Thu, 1 Sep 2016 19:05:07 +0000 (15:05 -0400)]
Fixes cleaning up HA Neutron objects

This fixes a race condition where the cleanup method is trying to remove
HA networks, while Neutron is also trying to remove the network - after
the HA router is removed.  This only applies to installations where
Neutron L3 HA is enabled (nosdn cases only).

JIRA: FUNCTEST-454

Change-Id: If06b6f6297e99dcce4b0f2aff8ec80b47488ee90
Signed-off-by: Tim Rozet <trozet@redhat.com>
8 years agoChange debug mode for commands that generate too much output in sec_scan 79/20179/3
jose.lausuch [Thu, 1 Sep 2016 16:03:25 +0000 (18:03 +0200)]
Change debug mode for commands that generate too much output in sec_scan

The security scan test case generates sometimes too much output
messages and makes Jenkins unreadable.
For example:
https://build.opnfv.org/ci/job/functest-apex-apex-daily-colorado-daily-colorado/65/console

80% of the output belongs to this test case.
This patch will reduce it since debug information is not
showed in Jenkins but it is pushed as part of
functest.log to artifacts.

Change-Id: I56b3adf87d302d118ee5c15eb86bc10237a7cc4e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoChange default memory for Promise flavor 65/20165/1
jose.lausuch [Thu, 1 Sep 2016 15:09:31 +0000 (17:09 +0200)]
Change default memory for Promise flavor

In some scenarios (bgpvpn) the timeout defined in promise
to boot/delete vms is too tight. Having less memory
might fix the problem as it will take less time and it
doesn't impact the promise test case.

Change-Id: Ib3165ea5d6518d88384f76c8edd10dddb0b529a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoAdd router association utility function 45/20145/1
George Paraskevopoulos [Thu, 1 Sep 2016 13:27:44 +0000 (16:27 +0300)]
Add router association utility function

Add function to create an association between a router and a bgpvpn

Change-Id: I23449a0363f9d8f3c77ea3be1e104586d3c111d1
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoAdd print-to-a-file option when executing a command in functest_utils 31/20131/3
jose.lausuch [Thu, 1 Sep 2016 13:03:18 +0000 (15:03 +0200)]
Add print-to-a-file option when executing a command in functest_utils

Change-Id: I8b91979380d0f4794d5ceaf8edb2a9d80cd7170f
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoFix some bugs 33/20133/1
boucherv [Thu, 1 Sep 2016 13:04:42 +0000 (15:04 +0200)]
Fix some bugs

Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agoSwitch print to logging.info 27/20127/2
Cédric Ollivier [Thu, 1 Sep 2016 11:52:28 +0000 (13:52 +0200)]
Switch print to logging.info

It follows the recommendations described in the next review [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/19795/

Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoForce python-keystoneclient to version 2.3.1 for tacker to work 21/20121/1
jose.lausuch [Thu, 1 Sep 2016 09:37:33 +0000 (11:37 +0200)]
Force python-keystoneclient to version 2.3.1 for tacker to work

Tacker client is installed from Tim Rozet repository, it doesn't
support version 3 of the keystone client.

Change-Id: Ie2005b1590dfccf93442995e96e0c02b4629edea
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agostop hardcoded FUNCTEST_REPO path everywhere 85/20085/3
SerenaFeng [Thu, 1 Sep 2016 02:19:58 +0000 (10:19 +0800)]
stop hardcoded FUNCTEST_REPO path everywhere

functest repo is used by almost every testcase, each place we get it like:
REPOS_DIR = os.getenv('repos_dir')
FUNCTEST_REPO = ("%s/functest" % REPOS_DIR)
provide a common interface in functest_util.py

JIRA: FUNCTEST-453

Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "unify functest_yaml obtain process"
Jose Lausuch [Thu, 1 Sep 2016 08:30:09 +0000 (08:30 +0000)]
Merge "unify functest_yaml obtain process"

8 years agoMerge "Add a specific logger for orchestrator class"
Jose Lausuch [Thu, 1 Sep 2016 07:44:36 +0000 (07:44 +0000)]
Merge "Add a specific logger for orchestrator class"

8 years agoRemove copper from lxd scenario 47/20047/2
Morgan Richomme [Wed, 31 Aug 2016 15:34:40 +0000 (17:34 +0200)]
Remove copper from lxd scenario

JIRA: FUNCTEST-452

Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoRefactor SFC testcase 11/20011/4
George Paraskevopoulos [Mon, 29 Aug 2016 08:13:17 +0000 (11:13 +0300)]
Refactor SFC testcase

- Change the way the test checks if the vxlan_tool has started.
  Now the vxlan_tool is detected even if another python process is up.
- Log the exceptions in the vxlan_tool check block. The exceptions that
  occur are not destructive for the testcase but it's better to be
  visible.
- Add a 60 seconds sleep before the testcase starts to give plenty of
  time to ODL to add the correct flows.
- Move the testcase success/fail check blocks inside the try blocks.
  The checks are performed on the stdout variable which is in scope
  only inside the try blocks.

Change-Id: I49dec176fb83117e9896ac1d19e8a5bd95e3d7cf
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
8 years agoAdd a specific logger for orchestrator class 49/20049/4
boucherv [Wed, 31 Aug 2016 15:43:08 +0000 (17:43 +0200)]
Add a specific logger for orchestrator class

JIRA: FUNCTEST-428

Change-Id: I1aab08f8f92df3b5527e6f8121cdf45aec2f5c17
Signed-off-by: boucherv <valentin.boucher@orange.com>
8 years agounify functest_yaml obtain process 45/19945/3
SerenaFeng [Wed, 31 Aug 2016 02:22:33 +0000 (10:22 +0800)]
unify functest_yaml obtain process

functest_yaml is needed in almost all of the testcases, the obtain process is the same:
with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f:
functest_yaml = yaml.safe_load(f)
f.close()
abstract a method to unify the process, and provide the interface

JIRA: FUNCTEST-447

Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoRemove all logers as utils method args. 13/20013/2
Cédric Ollivier [Wed, 31 Aug 2016 13:33:56 +0000 (15:33 +0200)]
Remove all logers as utils method args.

As it modifies method params, it could break the testcases.

JIRA: FUNCTEST-428

Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoUse a global logger instead of method args 61/19961/2
Cédric Ollivier [Wed, 31 Aug 2016 07:38:24 +0000 (09:38 +0200)]
Use a global logger instead of method args

It's the first step to safely remove all logers as method args.
Outputs printed by bash scripts called by execute_command are no longer
written in functest.log. Else logs printed by python scripts will
be duplicated in it.

JIRA: FUNCTEST-428

Change-Id: I60702f3b62121f731cd6845c335e227f97df37c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "unify testcases.yaml obtain process"
Morgan Richomme [Wed, 31 Aug 2016 12:13:43 +0000 (12:13 +0000)]
Merge "unify testcases.yaml obtain process"

8 years agoMerge "delete useless FUNCTEST_REPO variable"
Morgan Richomme [Wed, 31 Aug 2016 12:12:50 +0000 (12:12 +0000)]
Merge "delete useless FUNCTEST_REPO variable"

8 years agoparser fails on virtual environement 69/19969/1
SerenaFeng [Wed, 31 Aug 2016 09:06:23 +0000 (17:06 +0800)]
parser fails on virtual environement

Parser tests needs lots of resources, such as vcpu/memory/disk,
virtuals pod may not meet the requirements, so exclude Parser
running on virtual pods by exclude 'noha' scenario

JIRA: FUNCTEST-444

Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoFix problem with SFC test 15/19915/2
Brady Johnson [Tue, 30 Aug 2016 15:50:10 +0000 (17:50 +0200)]
Fix problem with SFC test

- If its not possible to get the IPs, then exit
- Patch Set 2: addressed code review comments

Change-Id: I16e22513b32e2b0da311ebcc280f3611570634a3
Signed-off-by: Brady Johnson <brady.allen.johnson@ericsson.com>
8 years agoCommitter promotion: Cedric Ollivier 65/19365/2
Morgan Richomme [Tue, 23 Aug 2016 15:07:17 +0000 (17:07 +0200)]
Committer promotion: Cedric Ollivier

Cedric joind Functest for Colorado
He fully refactored the ODL section including work upstream within ODL community
In addition of ODL skills, Cedric is a great benevolent reviewer.
Even if he is famous in the project for his gerrit -1, his reviews are always
usefull and clearly consolidate the code baseline for functest.
He is very relevant on all the technical aspects and we always need a Debianist
among commiters

Change-Id: I4bd0f778edfaa0d8969bdda3387d5a5ebc8b0f93
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Committer promotion: Serena Feng"
Morgan Richomme [Wed, 31 Aug 2016 06:48:25 +0000 (06:48 +0000)]
Merge "Committer promotion: Serena Feng"

8 years agounify testcases.yaml obtain process 49/19949/2
SerenaFeng [Wed, 31 Aug 2016 03:07:40 +0000 (11:07 +0800)]
unify testcases.yaml obtain process

hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever
testcases.yaml is needed, abstract a method to provide unified interface

JIRA: FUNCTEST-449

Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agodelete useless FUNCTEST_REPO variable 47/19947/1
SerenaFeng [Wed, 31 Aug 2016 02:37:15 +0000 (10:37 +0800)]
delete useless FUNCTEST_REPO variable

FUNCTEST_REPO appears in lots of feature testcases, but never be used, delete it clean the code

JIRA: FUNCTEST-448

Change-Id: I4a9a10eac29e09b481563ed2c33f4122dd9ee3de
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoRelease note: add restriction for joid/domino 31/19831/5
Morgan Richomme [Tue, 30 Aug 2016 07:01:31 +0000 (09:01 +0200)]
Release note: add restriction for joid/domino

JIRA: FUNCTEST-436

Change-Id: I44fb50a2ef58095aff54f03b837bf456850f3057
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agodisable test case does not make sense for LXD. 09/19909/1
Narinder Gupta [Tue, 30 Aug 2016 15:28:28 +0000 (10:28 -0500)]
disable test case does not make sense for LXD.

This patch will disable the test cases which does not make sense
to run on LXD deployments.

Change-Id: I683b3714aa5af3c750ca57fab9fceff907b7d646
Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com>
8 years agoMerge "update fuel ref in tacker setup script"
Jose Lausuch [Tue, 30 Aug 2016 12:12:04 +0000 (12:12 +0000)]
Merge "update fuel ref in tacker setup script"

8 years agoExclude healthcheck from lxd scenarios 75/19875/1
Morgan Richomme [Tue, 30 Aug 2016 10:17:09 +0000 (12:17 +0200)]
Exclude healthcheck from lxd scenarios

JIRA: FUNCTEST-442

Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoupdate fuel ref in tacker setup script 73/19873/1
Ferenc Cserepkei [Tue, 30 Aug 2016 10:10:47 +0000 (12:10 +0200)]
update fuel ref in tacker setup script

Since the poc script is fixed it's fuel commit hash in the setup
script have to be updated to select the fixed poc script.

Change-Id: I1fd22e4dc216fd2889adea0c9889df1d4a1bf476
Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com>
8 years agoAllow realtime Jenkins' console output 99/19799/5
Cédric Ollivier [Mon, 29 Aug 2016 20:50:53 +0000 (22:50 +0200)]
Allow realtime Jenkins' console output

Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoForce stdin, stdout and stderr to be totally unbuffered 95/19795/3
Cédric Ollivier [Mon, 29 Aug 2016 19:57:03 +0000 (21:57 +0200)]
Force stdin, stdout and stderr to be totally unbuffered

It protects against mixed logs as lots of python scripts directly call
print which doesn't flush stdout as opposed to log.info(). This
requirement is induced by subprocess.Popen() initiated by run_tests.py.

The following programs could switch to logging instead of print [1]

[1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \
        |grep \ print\  |cut -d: -f 1 |sort -u
./testcases/Controllers/ODL/OpenDaylightTesting.py
./testcases/Controllers/ONOS/Sfc/Sfc_fun.py
./testcases/Controllers/ONOS/Sfc/Sfc.py
./testcases/Controllers/ONOS/Teston/adapters/client.py
./testcases/Controllers/ONOS/Teston/adapters/connection.py
./testcases/Controllers/ONOS/Teston/adapters/environment.py
./testcases/Controllers/ONOS/Teston/adapters/foundation.py
./testcases/OpenStack/vPing/vping_util.py
./testcases/security_scan/connect.py
./utils/functest_utils.py
./utils/functest_vacation.py
./utils/openstack_clean.py

JIRA: FUNCTEST-441

Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "Stop hard-coding db url"
Morgan Richomme [Tue, 30 Aug 2016 09:06:00 +0000 (09:06 +0000)]
Merge "Stop hard-coding db url"

8 years agoMerge "Flush stdout as it can be redirected to log"
Morgan Richomme [Tue, 30 Aug 2016 09:05:37 +0000 (09:05 +0000)]
Merge "Flush stdout as it can be redirected to log"

8 years agoExclude floating-ip related tempest tests to blacklist for bgpvpn scenario 51/19751/2
jose.lausuch [Mon, 29 Aug 2016 13:35:35 +0000 (15:35 +0200)]
Exclude floating-ip related tempest tests to blacklist for bgpvpn scenario

Change-Id: I7115018e64a2413209313b9a432d3d1b59e841d1
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
8 years agoStop hard-coding db url 43/19843/1
Cédric Ollivier [Tue, 30 Aug 2016 08:33:39 +0000 (10:33 +0200)]
Stop hard-coding db url

Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoFlush stdout as it can be redirected to log 93/19793/3
Cédric Ollivier [Mon, 29 Aug 2016 19:24:52 +0000 (21:24 +0200)]
Flush stdout as it can be redirected to log

It avoids mixed logs in Jenkins' console by flushing every message
printed by the forked programs as logger.info() does.
It must be complete by refactoring logger management in util functions
[1] and by preventing output buffering in forked programs.

[1] https://jira.opnfv.org/browse/FUNCTEST-428

JIRA: FUNCTEST-441

Change-Id: Id8da814d79ea6b1e6b91b49e23a85c3802e11515
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "Set env vars as mandatory to push to DB"
Morgan Richomme [Tue, 30 Aug 2016 07:07:44 +0000 (07:07 +0000)]
Merge "Set env vars as mandatory to push to DB"

8 years agoMerge "Update Release note"
Morgan Richomme [Tue, 30 Aug 2016 06:50:45 +0000 (06:50 +0000)]
Merge "Update Release note"

8 years agoUpdate Release note 45/19645/5
Morgan Richomme [Fri, 26 Aug 2016 10:16:05 +0000 (12:16 +0200)]
Update Release note

JIRA: FUNCTEST-436

Change-Id: I3cbf6b276494c77afb10802af6735647ea6e62d5
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Review dev guide"
Morgan Richomme [Mon, 29 Aug 2016 12:36:36 +0000 (12:36 +0000)]
Merge "Review dev guide"

8 years agoReview dev guide 13/19513/10
Morgan Richomme [Wed, 24 Aug 2016 14:37:14 +0000 (16:37 +0200)]
Review dev guide

JIRA: FUNCTEST-433

Change-Id: Ic141a5b74d9b3afc165e1f1f65f3dc1b05d77f4e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoSet env vars as mandatory to push to DB 55/19655/2
Cédric Ollivier [Fri, 26 Aug 2016 14:53:41 +0000 (16:53 +0200)]
Set env vars as mandatory to push to DB

Now env vars are mandatory in push_results_to_db. It avoids testing
programs to check them even if they are useless from their points of
view.
The related getters aren't removed to help debugging via
logger_test_results which could be run without report.

Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoMerge "configuration guide review"
Morgan Richomme [Fri, 26 Aug 2016 13:41:17 +0000 (13:41 +0000)]
Merge "configuration guide review"

8 years agoconfiguration guide review 11/19611/2
Morgan Richomme [Thu, 25 Aug 2016 16:00:55 +0000 (18:00 +0200)]
configuration guide review

JIRA: FUNCTEST-435

Change-Id: I5b18f1223a5892d084c761f174ac5f713ceed476
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agorefactor create shared network process to eliminate reduplicate 39/19539/4
SerenaFeng [Thu, 25 Aug 2016 03:20:17 +0000 (11:20 +0800)]
refactor create shared network process to eliminate reduplicate

Some places shared network is created through create_network_full first,
then update it to shared, abstract a uniformed method to eliminate reduplicate

JIRA: FUNCTEST-437

Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoMerge "refactor create or get image process to eliminate reduplicate"
Morgan Richomme [Fri, 26 Aug 2016 06:48:26 +0000 (06:48 +0000)]
Merge "refactor create or get image process to eliminate reduplicate"

8 years agoMerge "Stop calling exec_test.sh in the middle of python scripts"
Morgan Richomme [Fri, 26 Aug 2016 06:47:17 +0000 (06:47 +0000)]
Merge "Stop calling exec_test.sh in the middle of python scripts"

8 years agoMerge "[Fuel] Skip test_server_basic_ops tempest test"
Morgan Richomme [Fri, 26 Aug 2016 06:32:49 +0000 (06:32 +0000)]
Merge "[Fuel] Skip test_server_basic_ops tempest test"

8 years agorefactor create or get image process to eliminate reduplicate 29/19429/3
SerenaFeng [Tue, 23 Aug 2016 05:44:36 +0000 (13:44 +0800)]
refactor create or get image process to eliminate reduplicate

Some places when create image is referred, they check if image exist,
if exist use it directly, else create a new one.
Abstract a method to integrate the process

JIRA: FUNCTEST-432

Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoStop calling exec_test.sh in the middle of python scripts 23/19523/2
Cédric Ollivier [Wed, 24 Aug 2016 15:55:10 +0000 (17:55 +0200)]
Stop calling exec_test.sh in the middle of python scripts

Now run_tests.py calls directly OpenDaylightTesting.functest_run().
It mainly reads env vars as exec_test.sh does.

Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoUse by default the default ODL web port 19/19519/2
Cédric Ollivier [Wed, 24 Aug 2016 15:31:01 +0000 (17:31 +0200)]
Use by default the default ODL web port

Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agoFixing commit f1054f8f 09/19509/1
Ferenc Cserepkei [Wed, 24 Aug 2016 14:24:11 +0000 (16:24 +0200)]
Fixing commit f1054f8f

fix missed the apt-get action

Change-Id: Iac94576a2f712133eee92e4b5460f85d59e90e94
Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com>
8 years agoMerge "Included correct links (Colorado) to Doctor/Promise user guides"
Morgan Richomme [Wed, 24 Aug 2016 12:25:02 +0000 (12:25 +0000)]
Merge "Included correct links (Colorado) to Doctor/Promise user guides"

8 years agoIncluded correct links (Colorado) to Doctor/Promise user guides 55/19455/2
Bertrand Souville [Wed, 24 Aug 2016 08:37:04 +0000 (10:37 +0200)]
Included correct links (Colorado) to Doctor/Promise user guides

Change-Id: I9f6a3d806407f088bd97826c978417d23b18613a
Signed-off-by: Bertrand Souville <souville@docomolab-euro.com>
8 years ago[SFC] Fixing CI 43/19443/1
Nikolas Hermanns [Wed, 24 Aug 2016 08:17:09 +0000 (10:17 +0200)]
[SFC] Fixing CI

The fix https://gerrit.opnfv.org/gerrit/#/c/19351 will need
more time for dicussion. In the meanwhile we can use this
one so that CI does not break anymore.

Change-Id: Icbd54200bd62e5019c2a556699ceb41afdb229ca
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
8 years agoCommitter promotion: Serena Feng 61/19361/1
Morgan Richomme [Tue, 23 Aug 2016 14:59:48 +0000 (16:59 +0200)]
Committer promotion: Serena Feng

Serena has joined the project for Colorado
She managed 22% of the open JIRAs (Ast rank in Functest)
She fully managed the refactoring of the testapi used by most of the projects
She also was key for the integration of several feature projects
She replaced the PTL during Summer

Change-Id: Id2a1ca253f80a425d7db4cb64591a44b4bcc5898
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
8 years agoMerge "Avoid duplicating logs in run_tests.py"
valentin boucher [Tue, 23 Aug 2016 12:36:14 +0000 (12:36 +0000)]
Merge "Avoid duplicating logs in run_tests.py"

8 years agoMerge "when create/get/update failed return None rather than False"
Morgan Richomme [Tue, 23 Aug 2016 12:23:58 +0000 (12:23 +0000)]
Merge "when create/get/update failed return None rather than False"

8 years agoMerge "delete useless image_exists in vping"
Morgan Richomme [Tue, 23 Aug 2016 12:03:26 +0000 (12:03 +0000)]
Merge "delete useless image_exists in vping"

8 years agoAvoid duplicating logs in run_tests.py 37/19337/1
Cédric Ollivier [Tue, 23 Aug 2016 11:25:02 +0000 (13:25 +0200)]
Avoid duplicating logs in run_tests.py

When run_tests.py sets logger as execute_command arg, logs are
duplicated in functest.log and not shown in console (as every DEBUG
message). As logger is mainly managed by the python scripts in charge
of testing, it can be safely removed here.
stderr is also redirected to stdout in execute_command to print
possible relevant data.

JIRA: FUNCTEST-431

Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agowhen create/get/update failed return None rather than False 87/19287/2
SerenaFeng [Tue, 23 Aug 2016 06:27:51 +0000 (14:27 +0800)]
when create/get/update failed return None rather than False

In openstack_util.py, when create/get/update network or other resources failed,
False is returned, which is incompatible with success return value such as id, network_nic.

JIRA: FUNCTEST-427

Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoEnable security scan for apex scenarios 15/19315/1
vitikkan [Tue, 23 Aug 2016 08:17:30 +0000 (11:17 +0300)]
Enable security scan for apex scenarios

Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years ago[Fuel] Skip test_server_basic_ops tempest test 13/19313/1
Michael Polenchuk [Tue, 23 Aug 2016 07:49:25 +0000 (10:49 +0300)]
[Fuel] Skip test_server_basic_ops tempest test

Skip TestServerBasicOps which fails when deleting server
and floating ip almost at the same time.

JIRA: FUEL-173
JIRA: FUEL-176
Change-Id: I24f3397096757028bed9d32d6353aa689e8eaa9a
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
8 years agoMerge "refactor push_result_to_db print thing"
Morgan Richomme [Tue, 23 Aug 2016 07:50:12 +0000 (07:50 +0000)]
Merge "refactor push_result_to_db print thing"

8 years agorefactor push_result_to_db print thing 61/19261/4
SerenaFeng [Mon, 22 Aug 2016 10:23:25 +0000 (18:23 +0800)]
refactor push_result_to_db print thing

when Exceptions happen, the print code is too difficult
to understand and maintain, modify to make it clear

jira: FUNCTEST-425

Change-Id: Ie12af989e711df3791167955642f2edf1164b146
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
8 years agoCreate tempest resources before generating tempest.conf 07/19307/1
vitikkan [Tue, 23 Aug 2016 07:32:24 +0000 (10:32 +0300)]
Create tempest resources before generating tempest.conf

During generating tempest.conf file rally tries to download
cirros image from the internet if no suitable images exist in
the configuration. This change ensures that cirros image is
created before generating tempest.conf file.

JIRA: FUNCTEST-195

Change-Id: I9e2df8af40bd02db9b78b8b6b730b4f4168a8b2d
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
8 years agoMerge "doctor test support fuel installer"
Morgan Richomme [Tue, 23 Aug 2016 06:54:03 +0000 (06:54 +0000)]
Merge "doctor test support fuel installer"

8 years agoMerge "Add logger to push_results_to_db args"
Morgan Richomme [Tue, 23 Aug 2016 06:52:17 +0000 (06:52 +0000)]
Merge "Add logger to push_results_to_db args"

8 years agoMerge "Point tempest to stable 12.1.0"
Morgan Richomme [Tue, 23 Aug 2016 06:47:02 +0000 (06:47 +0000)]
Merge "Point tempest to stable 12.1.0"

8 years agoAdd logger to push_results_to_db args 85/19285/1
Cédric Ollivier [Tue, 23 Aug 2016 06:23:08 +0000 (08:23 +0200)]
Add logger to push_results_to_db args

It conforms to the current implementation of functest_utils

Change-Id: I50fa05fbf81a7c76cf4a6e3ef906fffe8aec15bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
8 years agodelete useless image_exists in vping 79/19279/1
SerenaFeng [Tue, 23 Aug 2016 03:05:52 +0000 (11:05 +0800)]
delete useless image_exists in vping

In rally, image_exists is used to decide whether the image
resource should be cleaned or not. But unlike rally,
image_exists in vping is only assigned but not never be actually used.

JIRA: FUNCTEST-426

Change-Id: Id2089dd2a9734ba957cc1c80d4dc31bc27907b0a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>