Clean res dir before running pytest

Pytest fails when rerun

Change-Id: I957955300b2ef65bd1c5fdb28869921bca34ac57
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ed61c53f85c9dcb5a5a3029c84d50100028d5e63)

Add no:cacheprovider by default

Change-Id: Ic9df362d954d79e42f005089401bda6c951d2ccc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1c22d1932c4bc2dceb76521bd520a95ee30aed8e)

Force python 3.9 in package

Change-Id: I9c03c34a5d1cb77851ac53769c9c36169574fccb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0085fc85caaefc0894a43f4a93574a72c002a880)

Fix versions in Ansible playbook

Change-Id: I332f71c42a23525296fa0434cd221d3076b6c875
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove the use of pip_version

Change-Id: I4888889c030d236a10f125ef69abd2c11477d199
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f22b596de0a8ac7e55b313ed6de7a0db2258332a)

Build Xtesting virtual machines

Change-Id: Ia3d82b3b77b3fab3e88405a07cb7151258538b04
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Upgrade pylint and fix latest warnings

Change-Id: I8b9e4b663a12ac9be18fded2d7b4e4b38428fa9f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f430ee4d9ef63f104dde63710fce7f8fa3c61591)

Prepare Xtesting 2023.1

Change-Id: I1f9ff35cf62c9cefe193e7bf55dcc2b51b0afdc3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set defaultbranch=stable/2023.1 in .gitreview

Change-Id: I38a1e542c53d93f2265ce35b4135150faef0b9ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove MTS from Xtesting

The MTS drivers is unmaintained and they are lots of security issues
in its dependencies.

Change-Id: I397e22c8868204b8d52a8ac35906278b5e530961
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add pytest driver in Xtesting

Co-authored-by: Edouard Hinard <edouard.hinard@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ice364f7f4287aacc7f375ed4a23503fd38c8e543

Allow setting env vars via testcases.yaml

It helps defining env vars per test cases.
/home/opnfv/functest/conf/env_file is rather designed
for comme env vars ro all test cases (see OpenStack Creds).

Change-Id: Ic5d34701475440e1f768bbb22be7a4cfa3e1625b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add missing api docs

Change-Id: I29a470f74d2429862d0e26426a375d0a76550082
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run pre-commit in the Xtesting gates

Change-Id: I691d0982b8e8f70afce622950c6b27a47e2bb417
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove a useless duplicate when calling pytest

Change-Id: Ie11aac5f0d74c897c4c7c973179de401bbb4a0df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update Alpine to 3.17

https://www.alpinelinux.org/posts/Alpine-3.17.0-released.html

Change-Id: I660a04c8de1184d83f7e6bfc6777fa571fabc080
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Make robot driver even more generic

It allows setting any option via testcases.yaml

Change-Id: I8cb5ead037a65f962c3ba1a14729b52195e95483
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add deny_skipping parameter

It takes into account or not skip tests in the global result
It also adds unit tests to cover it.

It should be noted that if follows the deny skipping
model proposed by Functest (tempest).

Change-Id: I15fa7a3946c6e3b2ae190e4f8abf3b9361a391a4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.16

It also switches to pytest because
nose fails vs py3.10.

Change-Id: I920baef12d4934b359873519d5518835007c2f02
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.15

Change-Id: I283f95fa9c0a51b31c2612f44c1e722a688f6a02
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Change working dir

/ is no longer good as we allow non root user.

Change-Id: If2483f7d177db8f2b99e05456d1ea803e3153466
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Define xtesting user to harden security

It applies security guidelines even if everybody was already
free to harden his own containers via the python package.

Change-Id: Ia9936d158c02b4e5c86386cb046ff7e35af07f03
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Protect vs Bucket containing html chars

It allows dumping MTS output files.

Change-Id: I2b35ee81a764573a9d17cb3a225cb5febed5fa46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Complete previous commit

It adds xtesting/utils/config.py

Change-Id: Iaa36568d7b4e1f6c3cfa1d74cf81d9d73a61f3eb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rewrite last direct call to ci/testcases.yaml

Change-Id: Ic4a857b6cdee7e3f9e2330414b0e6a6df98eea25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Only erase the fallback config files.

It enforces the best backward compatibility.

Change-Id: I6516ad15c4ca514dde7ae761c9c00f437646e3b4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Search config files in tree

It allows putting configurations in classical dirs.
It fallbacks to the python package for backward compatibility.

Change-Id: Ie33b9482fb197926c7d7d66ace815fa4ae01d02d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow overriding project_name via env

It now offers a new env var, PROJECT_NAME, to override the default
value in testcases.yaml.

Change-Id: I911f1af56afe88edb37de40176733b65bc8e490a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reset argv to prevent wrong usage

It bypasses a clear pyats issue

Change-Id: Ib5e8d51b5bea1015c7e1b371b5ba4679c0921555
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Protect if detail is returned as None

It occured when running ansible.

Change-Id: I908270fdb76fbc3bdf60787b189cdbc29c41b52b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix incorrect f-string

Change-Id: I463dc155d03b0d5c86b72f4fb7868c1aa7c29a0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove ansiblelint as tox entry

It false asks for ansible in any XtestingCI child's test requirements.

Change-Id: I6cff0ba900360c97db64f519ef4055e2e18cc28c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Leverage latest pylint features

It adds encoding in all open call and leverage f-strings.

Change-Id: I70ccd2bfcadae44929d5874f98fa3bf4ff644488
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update robotframework to latest release

Change-Id: I298320f666e048d42047fd00de74df83142a5186
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update requirements

Change-Id: Id7f0007a87df545f97d9674a4055b2bb26dff30d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Correct documented return values

In particular, for mts, error cases can yield values other than -1.

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I50ba896b835075fd3f3dd01f848fcc45076245ac

Fix .circleci/config.yml (py39)

Change-Id: I151092e3e1b7388c24de3a9763fee640bebf899b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Update pylint to 2.9.6"

Update pylint to 2.9.6

It stops filtering upper constraints by versions as python 2 (and 3.5)
dropped.

Change-Id: Ieb96d068ebda813e020a093f3291b4a9526402e4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Update container builds due to Alpine 3.14"

Use python 3 super() style

See https://www.python.org/dev/peps/pep-3135/

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I4f74db4a019b70d0289f8969d57fa9ad629c586f

Update container builds due to Alpine 3.14

Change-Id: I2db26b02adb2b9e19a6636f9527765fde3588fdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.14

Change-Id: Id0b5ecc341315b0010a4e52dcb54ebe7bb37c5f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix tag logics in behave

The unit tests will be fully rewritten in a second change (out of this
bugfix).

Co-Authored-By: Ugur Caglar Kilic <ugur.caglar.kilic@oracle.com>
Change-Id: I6413fbcecdf44dbfe9c978045f4b1d43ca0de2ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

MTS inherits BashFeature

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: Ifa3a5d5946c29863905490de5f875e17026744a5

Merge "Drop six"

Delete wrong docstring

This seems an unfortunate copy-paste from the file feature.py

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: If4c8eec10616f0dce3f1ac90abb0c2e78aeae11d

Drop six

python 2 was dropped [1] so we don't need six anymore

[1]: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68262

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I840211990b76f77a46e9e737fc4a4c857b57c0b2

Merge "Add proper references to xml schemas"

Switch to focal in travis-ci gates

Change-Id: I8386e274813a4d41bf259145147f52d7bfee711d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Use constants instead of hard-coding paths"

Merge "dash-separated keys will be deprecated in future"

Merge "Fix remaining py37 testenv"

Merge "Remove six from Openstack requirements"

Fix remaining py37 testenv

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I7847ac6f9f642fb64097a172bd4e8396040f8aa7

Remove six from Openstack requirements

Attempting uninstall: six
  Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Iad64341d8014621bc999bade94676d4059e71353
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Delete dead code

The piece of code became unused following change
https://gerrit.opnfv.org/gerrit/c/functest/+/39443

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I0bf80790c05cef217be574ad196d8c4e8dfb4c2d

Add proper references to xml schemas

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I1f837fede6b62260cc49a590b065de259df0d444

Use constants instead of hard-coding paths

This complements
https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/72495
which missed one occurence due to trailing slash difference.

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: Iabfa89161cc099c924a7609aeb4ef6ed1b027cd3

dash-separated keys will be deprecated in future

See https://setuptools.readthedocs.io/en/latest/history.html#v54-1-0

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I123266e2ebe0e18ceea3568000e13da12b39ca83

Merge "Correct version to actuals in PyPI classifiers"

Remove superfluous property declaration

It is inherited.

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: Ic68172dfb93f03cc62cf4944b82de8bc1e37b097

Correct version to actuals in PyPI classifiers

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I040bf8d139d0ce159de4999cd14db48fb12f5b25

Merge "Remove unnecessary condition in statement flow"

Merge "Fix Flake8 abstact and concrete deps"

Fix Flake8 abstact and concrete deps

It's no longer managed by OpenStack requirements.

Co-Authored-By: Vincent Danno <vincent.danno@orange.com>
Change-Id: I7c509d483b4daf9c8b47390426d9f60f8a6a7482
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I234f0a861709b4199aba2306ea9f858866009917

Use constants instead of hard-coding paths

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I9bef7db7584d6b615ef102d13797914095512733

Remove unnecessary condition in statement flow

First, the condition should be limited to only defining the default
value, rather than applying to the statement flow. This not only avoids
unnecessary repetition of statements, but is more logical.

Second, it is not even necessary to explicitly code a condition here,
because the language itself defaults to our desired default value.

Signed-off-by: Vincent Danno <vincent.danno@orange.com>
Change-Id: I119567f5b31444a0e864ba41dee8a5f640ff0c22

Add eighth in ansible/site.gate.yml

Change-Id: I11f0aa1562dfa25c596e851d475f74778914ad0e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Allow printing playbook output to console"

Allow printing playbook output to console

User can specify quiet: False in "testcases.yaml" if he wants to print
the output on console.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Signed-off-by: Ajay kumar <ajay4.kumar@orange.com>
Change-Id: I30fa21bdcc2ed97757cd3c0b4720f9413466833f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add console parameter to behaveframework

Change-Id: I289de43bdea8c52181ec0622c83c5c56dd6890e3
Signed-off-by: Francois Regis Menguy <francoisregis.menguy@orange.com>

Add an Ansible driver

It calls ansible_runner.interface.run() by converting the testcase
description data to kwargs. It only overrides quiet and artifact_dir to
implement the Xtesting behavior.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ifd09810400babc0f2b81f2c33edf55a3ed88807b
Signed-off-by: Ajay kumar <ajay4.kumar@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add the missing action

Change-Id: I8c88da0ec7924cc517e453d4a8de52bb5bb0275f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Pulish former wiki page as README.md

https://wiki.opnfv.org/display/functest/Write+your+own+Xtesting+driver

Change-Id: If135bf9d84e1c357911eb0b2331539844288969a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

aarch64 mts builds mostly fail

Change-Id: I87d9e4f33824c7a486d92f4e151b0b40bf10e675
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update site.gate.yml accordint to latest XtestingCI changes

Change-Id: Iaaad4fff95b3df7564c5277eed80db182f8e3e19
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix arch in .travis-ci.yml

Change-Id: I0b56d7d2e9714034e54f42426ada1806036ec47f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create dummy xtesting-mts:arm

Change-Id: Ib6cc1236aa46b7fb1fd9dfa96750894d87c3563e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix tag substitutes

Change-Id: I72e82055d32a87d81877152fa4bce4885bddc4cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Upgrade system first

Change-Id: I9ee2ac74785212f8fa6f4ca84dabfcf0ebd3ed18
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update ansible-lint verification

Change-Id: I1f0e2a4dc3d2410a409c990605a9086a5776ca34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Take pylint's len-as-condition into account

Change-Id: Ib19de453857a2732d9c70a24539a96cd7129613d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to alpine:3.13

Change-Id: I84459504fa374effb3c0355cf37a09c32b4e61a4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: Ifc4abd2d1f28bfb63ba66796e1690b398c1e4760
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Cleanup previous run output files

Signed-off-by: Vincent Mahe <v.mahe@orange.com>
Change-Id: I9ec39012457ae1a5f7017d41d79237d7a1e300d4

Split Gates in a dedicated site.yml

Change-Id: Ib9fb9968071543c1a881fd862f15076488845ecb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Change version of MTS software to 6.6.21

Signed-off-by: Vincent Mahe <v.mahe@orange.com>
Change-Id: I846d5adf55d1f20e3adf50fccbbb431dda7f55d6

Protect mts vs py2

Change-Id: I7a9aa9267a81161b10b1d625efbaa924187f8690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove all order in testcases.yaml

Change-Id: I7ff541ebe5b99f2bc66cbf725530fdff55504435
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Wrap long env values

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-kali-k8s_smoke-run/162/console

Change-Id: If6837a85f54309ad7c221144570c10eb1615993d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix duration calculation

It falsy printed 00:60

Change-Id: Ib2852268a6833b353232c80e9013b6926058479c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove order in testcases.yaml

It's not used and asked for useless configuration data.

Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Make testcases descriptions optional

Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Suppress admin password in default logs

Currently, OS_PASSWORD is getting printed in the console of
Functest. This password is secret and must not be printed in
default log file.

This patch suppresses the logging of OS_PASSWORD unless
users ask for debug logs.

Signed-off-by: mahajanajay33@gmail.com
Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4

Merge "Stop building xtesting-mts for arm32"

Stop building xtesting-mts for arm32

It raised TravisCI timeouts [1].

[1] https://travis-ci.org/github/collivier/functest-xtesting/jobs/715338705

Change-Id: Ifa4e0957386961a6cde2b2ea7877d808d6e46d70
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I19049637a64628e266de4e5bdd825435ca0bebe3

Install py3-wheel in xtesting

It fixes all deprecated warnings.

Change-Id: Ide9b140e56555fba3b5bc94c71df15d4627b72cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>