Remove all order in testcases.yaml

Change-Id: I7ff541ebe5b99f2bc66cbf725530fdff55504435
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c7da909eb32f7203ffa2b1c3e71107e1ca4cc4c3)

Wrap long env values

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-kali-k8s_smoke-run/162/console

Change-Id: If6837a85f54309ad7c221144570c10eb1615993d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 16742834bbca1a7074f19a57d004a1b41068744d)

Fix duration calculation

It falsy printed 00:60

Change-Id: Ib2852268a6833b353232c80e9013b6926058479c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 242696fe51c7dc3530587350550ab07164706e56)

Remove order in testcases.yaml

It's not used and asked for useless configuration data.

Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2480a8ed48d232b6395f992fc46d388ba2820872)

Make testcases descriptions optional

Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 150405525d6e9924858cd40c872600ddb2bfb57c)

Suppress admin password in default logs

Currently, OS_PASSWORD is getting printed in the console of
Functest. This password is secret and must not be printed in
default log file.

This patch suppresses the logging of OS_PASSWORD unless
users ask for debug logs.

Signed-off-by: mahajanajay33@gmail.com
Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4
(cherry picked from commit bbdc01c30dcf5a1365ad5a61ec0f7fee49b7fb59)

Switch to arm32v6 and arm64v8 repos

Change-Id: I82ee83912b70d3d1d626038471f00f4332cf76aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 02d0e5086d7f78d4bbac284a41d3be6f2cfba9ee)

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ia584b34e3d09c4dc8c8014c057e6bbf49f8de867

Post-processed data from DB

It removes base_url to match the location in archive.

It forces a relative path by removing first "/".
It makes sense but it may raise side effects in dovetail webportal.

Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0ef9c196b42b8c9182710b0f937f775199b0feea)

Add a missing blank line

Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Compress Campaign data (zip)

Change-Id: I7b46a88a181293297cc764026f2804d36a59955a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f187187c3afa730e94ffcdffd84e54494def306a)

Enable debug messages via env var

It stops printing in xtesting.debug.log by default.
It decreases testing duration via Raspberry PI without additional
tasks [1].

[1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Dump DB and artifacts for third-party certification

It conforms with Kubernetes Conformance [1] model and could be reused
by OVP or any third-party CNTT-based certification.

It publishes the final archive in the S3 repository.

XtestingCI will generate the final job calling this feature.

[1] https://github.com/cncf/k8s-conformance

Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 65b489bbc42c7b24c7f9a435de6e5094d5208cf3)

Disable false ansible list warnings

git commit has to be executed via shell module [1].

[1] https://github.com/ansible/ansible/issues/50334

Change-Id: I0ad8abe12bd592cb2a790ec3373452d46573776a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4ac26ff408f928518c7a35f1178fcb590b32cd7f)

Postprocess the TestAPI href returned

[1] returned http://localhost:8082

[1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console

Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 740afc884b2af2f068945e7a9963d5e4b66a1a0e)

Run update package index before installing pkg in Circle CI.

Change-Id: Id160a5bc68c2201db124773bf6eee8b6bb4cb7fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b209efd0fa4233ba58e5d21175c567c8b0946dde)

Forbid multipart upload if google storage

Google Storage doesn't support S3 multipart uploads
https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html
https://cloud.google.com/storage/docs/composite-objects

5 * 1024 ** 5 is the multipart upload limit.
https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html

Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f5aceb5447deed25234c5354b9dd9601115d9378)

Add ContentType when publishing artifacts

The default value 'application/octet-stream' is mostly
incorrect and forces downloading all links.

https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console

Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e2e7dbe185a552b21315063dbbed8ac4f40f309d)

Improve file scanning when publishing artifacts

Else it copies files from other testcases if the full suite is
executed sequentially.

Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a48c62165923be6a37aaff5d54918dbe9cb6ff58)

Add links in testcase details

It allows finding easily reports thanks to DB.

Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 256e6b0a10d43e930ecd81078d9cbcd89ebb5a06)

Print Test API links in console

It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH
port forwardings.

Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 384308c4a5af0a66ff9e78de17ace94ab7d1d51f)

Add S3 env vars in env.py

It completes the previous commits adding S3 support:
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68760
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68796

Change-Id: Iaaeb02ef2d9c6cdb7ff6c2c52e7086c751119871
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 66809ebba91d1f068c0a930dba695c3b02fc85bd)

Create Bucket if it doesn't exist

Xtesting Ansible Role no longer creates bucket after starting Minio
[1].

[1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811

Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7ddcfae7ff8a20fac21f5ba2b923e8e5cbce19e5)

Publish artifacts to S3 repository

It simplifies Jenkins or Gitlab jobs by automatically publishing all
artifacts via the framework.

It leverages on Amazon Web Services (AWS) SDK [1] which supports the
current cases (OPNFV, Xtesting Ansible role [2], etc.).

[1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway
[2] https://github.com/collivier/ansible-role-xtesting

Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d012f3ac3ec4aa2730532be095956867d797aefb)

Switch to py3.6 in containers

Xtesting has supported both py2 and py3.
py3 is now selected due to the OPNFV Iruya planning closed to python2
EOL.

It also removes energy as in master which should have been updated
(pylint).

Change-Id: Ic1113b95f85f5882676e10acea1159a808a98f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Override default Xtesting Ansible role values

It ease maintaining the Xtesting branches.

Change-Id: Iaaeed0eb4331908266163746350e4163c102238a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4bef764e2b3976f73e91fed7bca97b40d4123522)

Add **kwargs in Energy wrapper()

It's asked by few Functest testcases (rally_full).

Change-Id: Ia1c91c9284f703d239542a1ed929f67eae15ca6c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run Xtesting unit tests via CircleCI

It runs tox and published the artifacts.
It's worth mentioning that all docker images are already built via
Travis CI (amd64, arm and arm64) [1].

https://travis-ci.org/collivier/functest-xtesting

Change-Id: Icc57b6c45062425181230f3ebbdc5d3f7a925f99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4be2e13c066fe5952b3a6339d27cd603e0fbaa18)

Run perm when verifying changes

umask is now correct in lf-virtual1 (0022).

Change-Id: I073a48eddaf1e26bcb3bbeeb232eb69d4a03a124
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6fcd58709c2aeb123dad6f86a103ae5f3af282e1)

Fix ssl issues in travis-ci

https://travis-ci.org/collivier/functest-xtesting/builds/564133127

Change-Id: Ic0b8f20edfcccceda3d7226789f16e875af0bdb9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9c9be693530188872b9b945a4666e6bd98e94af2)

Enable py36 unit tests

It benefits from the swith to lf-virtual1.

Change-Id: I9f99f24a5e3c8ef6374e049d7117aa7d5aa4d442
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Change-Id: Ic450c26f61160e1fb7a5a074ea6a7a286cd6d123
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run bandit when verifying changes

It reports only MEDIUM issues or higher like nova [1].
It selects bandit 1.1.0 as defined in nova and neutron lower
constraints [2].

[1] https://github.com/openstack/nova/blob/master/tox.ini#L221
[2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8

Change-Id: I52524df867d99fae75798475c762a5f8253dacfa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c659caccbf1f55db4e6e3cb31bf088ac57751e86)

Set utf-8 in decode and encode calls

It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].

[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console

Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
(cherry picked from commit 12aa6e34ec1f388a40cb5a00826729f7c0d6f201)

Fix unit tests (py36)

It completes the patch "Update to Python3" [1] which was not fully
verified in Functest Gates [2].

[1] https://gerrit.opnfv.org/gerrit/#/c/67782/
[2] https://travis-ci.org/collivier/functest-xtesting/jobs/531380395

Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 934e90a269ea6b65e38578ac3f9a8bf7fc5212b1)

Stop setting utf-8 in decode/encode calls

It's the default value.

Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0d308f4db3434ae6f8147f0f452e5c542429e636)

Update to Python3

Now Xtesting containers use Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html

It also updates robotframework to latest release.

Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6f8aa2785e0239dbed22fcb4d093a5bc110bcc3c)

Rename HelloWorld.txt to HelloWorld.robot

It takes the following warning into account [1] "Automatically parsing
other than '*.robot' files is deprecated"

[1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console

Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 74d0cd9b2c43a730c76ea3f03d0db8510a3be831)

Update to opendev.org in tox.ini

It completes the previous commit [1].

[1] https://gerrit.opnfv.org/gerrit/#/c/67651/

Change-Id: I5298e406d7973572034242224b867ba8fd79e60f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b0fd44ea0320e95e2fcbfa0007f11fdf8e29dc76)

Update all OpenStack refs to opendev.org

Change-Id: Iefb247bcfbc490fd64bd9a78b4cacffca1603126
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d25d66ff328a91f4e75264768740409d6aac711d)

Updated from global requirements

Change-Id: Ia65916b9e113033ff258fe1e2172f37678a83b61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add python3.6-dev

It's mandatory for building all python packages [1].

[1] https://travis-ci.org/collivier/functest-xtesting/builds/519646504

Change-Id: I71afe76a33a68f9bf0550c80003aa04ac76c9774
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3fe94a30a171912be79f3bde3ffa4208567af87d)

Run tox in .travis-ci

It installs python3 via ppa to run unit tests vs py36.
It completes the OPNFV gates which can't verify them.

Change-Id: I6942f12ec7daf50e62173290e55df87af9e35d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit be261aeeef79961a2cb1ac018a7df86e20ee7de4)

Build Raspberry PI image via travis-ci

Change-Id: I91ced3f779921ed26bb91daa971692620311feaf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 108be5e77a4832cd648474e4c3398fdaae9829ea)

Publish Xtesting Iruya release

Change-Id: Ic0409dd375434f070000538c6169c04ee8e6e7f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set iruya as default branch in .gitreview

Change-Id: I54daea3d4aab2650490f9eb9e437f09fb5cf2a81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix manifest-tool builds

It now selects the last release to allow compiling it [1]

[1] https://travis-ci.org/collivier/functest-xtesting/jobs/510384544

Change-Id: I4fdff1df75f39b3b2bc70c3ee9c9910adbe9f0ff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Update Alpine tag in build.sh"

Update Alpine tag in build.sh

It completes the previous commit updating Alpine.

Change-Id: Ic7bb294eeebad360278dcb75f841efec8e87c03b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Update to Apine 3.9"

Update to Apine 3.9

It updates to the latest Alpine release [1]

[1] https://www.alpinelinux.org/posts/Alpine-3.9.0-released.html

Change-Id: I5c7bd64333fb38fcc7aa0c315de2bcd40435ed0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Change-Id: I6a2c5a16efdba81dda01fe21ad79f734dad3fd32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix default host in ansible (127.0.0.1)

Change-Id: Ief3656032a808a66fcb701272d5a4c3ecdca1427
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove former ci jobs

They can now be generated via the new ansible role.

Change-Id: I4c8fdf209fd4f9fd8b10342a86453ff5e1cb5b09
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Fix typo"

Merge "Remove url from logs"

Fix typo

Change-Id: I501ca227374e782286920bf0cab09ba1a4355f46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove url from logs

It can be false in case of NAT.

Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Change-Id: Ic9fb51a1ab37d105d4040c5ea0bee442cdad5696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply operations via sixer

Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow printing bash cmd output in console

It switches to Popen to print real-time console.
Console has to be enabled per testcase (testcases.yaml).

Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Generate reports for unit tests

It now leverages on subunit to generate html and xml reports.

Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix OpenStack version (master) in tox.ini

Change-Id: I4a5c3a85870ce515d64be5efb25b016908b56164
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Verify the Ansible playbook via ansible-lint

Change-Id: I9e6778b935a0a8d6e76cb4f1f16ef08c811eee73
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Verify missing yaml files via yamllint

Change-Id: I0cd412cd49cac62b393658bf55e0e32def908c85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Deploy CI/CD toolchains for any Xtesting-based project

It allows deploying the CI/CD toolchain via ansible for all projects
based on Xtesting (e.g. OPNFV Functest, ONAP robot tests, etc.).

It deploys Jenkins, Minio and S3www and loads all jobs in Jenkins.
Last components (MongoDB, TestAPI and dashboard) will be deployed in
the next update of the ansible role.

To deploy the testing toolchain:
$ ansible-galaxy install collivier.xtesting
$ ansible-playbook ansible/site.yml

Change-Id: I5a8ddb45fc354c9a22c52f0d42ce2e0181f345b7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enable robot sample in the container

The testcase is disabled by default in package as the location
depends on OS. But it can be safely enabled in the Alpine container.

Change-Id: I8d1befd09b8d823010dfce7fbb18eddb864fd6e6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set shell=True in subprocess.check_call

It allows running multiple shell instructions (see third).

Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f99cef18b6dd3eff6703c4d748fae415fea78ae2)

Stop returning values in run()

Runner only checks status via is_successful().

Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Temporarily disable py36

Verify servers haven't been updated yet to support py36.

Change-Id: Id2999a94f9c2c03432412a4b40a4b3c593aaffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix a wierd pylint error

Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update python3 to python3.6

Change-Id: I845f8eb0544dc32febec7a17ac7c05412eb31198
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Updated from global requirements"

Updated from global requirements

Change-Id: I8eb758bb28904ed9504cba4eef5a94026a0e34bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Follow OpenStack master

Change-Id: I9b3ead197d54061adddbf47b6b94bbeb79c81793
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rewrite git clone

Change-Id: I0e17233faaf8eddb263e90cb82b65335f1c9cf40
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish daily and gating jjbs

Change-Id: I1050741ce34e151be30404275670e83fc2a40d1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.8

https://alpinelinux.org/posts/Alpine-3.8.0-released.html

Change-Id: I73fba49c3d1bbf018e94e67c835c4049c34209b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove former samples/testcases.yaml

Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop verifying ResultWriter.write_results exit codes

ResultWriter.write_results() returns false if one test fails.
It's skipped by run() because the report is correctly generated.

[1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html

Change-Id: If29059b272679ed89a1189e0bb52997c83401b94
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Change output dir

It now reads case_name instead of selecting an hardcoded value
(robot).

Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update RobotFramework config

It completes "Leverage on abc and stevedore".

Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Initialize testcase results to EX_TESTCASE_FAILED

Else the testcase returns EX_OK if exceptions in __init__()

Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Protect vs None when calling regex"

Protect vs None when calling regex

Change-Id: I93d22442c28e674433234d7729838944962bdbe2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Leverage on abc and stevedore

Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip the selected testcase too

It completes "Allow calling a skip test" [1]

[1] https://gerrit.opnfv.org/gerrit/60655

Change-Id: I02499aed56e6b23563165ea1f17b476e12408823
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Generate robot reports

Change-Id: Ib9efe14bce6227f9609200c12ded4470bd0be969
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow calling a skip test

run_tests shouldn't return an incorrect value if the test is skipped.
Else it simply forbids running tests in parallel (one test per
thread).

Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop skipping testcases if one raises exceptions

https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console

Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop printing exceptions twice

Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix results when only one skipped test

Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow dynamically skipping testcases

Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip testcases by any env var

It also removes CI_LOOP which is releng centric.
It can be passed as dependency if required.

Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Improve dependency management

It avoids declaring dependencies if needed.
Negative regex are correcty managed as well.

Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove Feature logger

This class atttribute is removed as it's quite useless (it forces one
module per project). All messages are now printed to xtesting.log
whatever the namespace and all warnings are printed in console.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I6860eaf427093ea21b3bd78650bec7939e947b2d
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Check shell scripts via bashate

Change-Id: I33df0017945a32946c46bff0768624901e13f6f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create a static method to configure logger

It helps OPNFV Features to configure their multiple loggers as
self.logger is not suitable in case of multiple modules.

Change-Id: I5794a3e323d70abfdd85db89a9890488828efd88
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to stable/queens

Change-Id: I2a8d624df52c0c705d5fbc662f11948bdc51d765
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Change-Id: If9959fb71b9970a27f607ec1c491bf790adfe499
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>