functest-kubernetes.git
3 years agoFix project name in security's testcases.yaml 22/70422/1
Cédric Ollivier [Sat, 14 Mar 2020 09:05:08 +0000 (10:05 +0100)]
Fix project name in security's testcases.yaml

Change-Id: I7770873b2f7d61db05a9546631fdc2d4ddf3d20c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2649efe3166ec1525f825bf21b63e6eb53aaaac6)

3 years agoAdd kubernetes in requirements 21/70421/1
Cédric Ollivier [Wed, 1 Jul 2020 17:18:13 +0000 (19:18 +0200)]
Add kubernetes in requirements

Change-Id: I8e1bf595ca090a9c3b4d10a60d22a38abc1117f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd security docker for functest-kubernetes 16/70416/2
mrichomme [Mon, 10 Feb 2020 16:49:43 +0000 (17:49 +0100)]
Add security docker for functest-kubernetes

run kube-hunter and kube-bench cases dealing with security in kubernetes (check
vulnerabilities) [1][2]

It's the first step only printing the output.

[1]: https://github.com/aquasecurity/kube-bench
[2]: https://github.com/aquasecurity/kube-hunter

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0
Signed-off-by: mrichomme <morgan.richomme@orange.com>
(cherry picked from commit 98d9f93337ab514fa9aafc1cd1e87473de68b364)

3 years agoApply Rally patch (switch to threading for tasks) 04/70304/1
Cédric Ollivier [Mon, 8 Jun 2020 08:16:32 +0000 (10:16 +0200)]
Apply Rally patch (switch to threading for tasks)

Change-Id: I8f4df2d4c220edc538c743cccce8050efe4a1140
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bfd0063c81f5d5d4fad2389832c8f1479a28f73d)

4 years agoTry a quick fix vs the race conditions in xrally 63/70163/1
Cédric Ollivier [Tue, 5 May 2020 21:43:23 +0000 (23:43 +0200)]
Try a quick fix vs the race conditions in xrally

Change-Id: I57a4c317ba365586c10b13d425aac021dd030949
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 81139b1576981990f32df76719f179441e4d12ee)

4 years agoDisable perm check 15/70115/1
Cédric Ollivier [Fri, 1 May 2020 14:14:14 +0000 (16:14 +0200)]
Disable perm check

.travis-ci applies a false umask

Change-Id: I8e93d64019fffe0a88cd49c565a40419a491f5a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6099914e9832592ac63f0d3505ea3466eb13117d)

4 years agoRemove py27 06/70106/1
Cédric Ollivier [Fri, 1 May 2020 11:54:24 +0000 (13:54 +0200)]
Remove py27

rally dropped py27 support

Change-Id: Ib8a7dc634cc81930dcbea5234eb4509ad93af267
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate K8S to v1.17.4 83/69883/3
Cédric Ollivier [Sat, 4 Apr 2020 08:40:32 +0000 (10:40 +0200)]
Update K8S to v1.17.4

Change-Id: I04c7cbc5281abffd458b1fc75e924f8dd3e70c3f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove Kubernetes.create_check_and_delete_daemonset 63/69763/2
Cédric Ollivier [Sun, 8 Mar 2020 16:30:22 +0000 (17:30 +0100)]
Remove Kubernetes.create_check_and_delete_daemonset

It seems incorrect as Rally tired waiting to become 3 pods [1]
Here are the nodes:
- control-plane
- worker
- worker

[1] http://artifacts.opnfv.org/functest-kubernetes/0LMEWUMSA2U6/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run-157/xrally_kubernetes/xrally_kubernetes.html

Change-Id: I19bb19eb1e0f2ae66a64532d99d4a59f82651a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit efee842caa2585c2174c9b780ea1d33f69c69f2e)

4 years agoUpdate K8S_TAG to v1.17.3 65/69765/2
Cédric Ollivier [Sun, 8 Mar 2020 16:38:19 +0000 (17:38 +0100)]
Update K8S_TAG to v1.17.3

Change-Id: I88dd9c19a6a44d00154c676a53ece6748394ea1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate go for Kubernetes v1.17 65/69365/1
Cédric Ollivier [Tue, 17 Dec 2019 14:26:22 +0000 (15:26 +0100)]
Update go for Kubernetes v1.17

Kubernetes v1.17 requires go1.13.4 or greater.
It completes "Update to K8S_TAG v1.17.0" [1].

[1] https://git.opnfv.org/functest-kubernetes/commit/?h=stable/jerma&id=6013753b39971c5d246f7e39574a8176065a5aaf

Change-Id: Ia247930811c20526a157d61f3a86f7abf558f68c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate to K8S_TAG v1.17.0 45/69345/1
Cédric Ollivier [Sat, 14 Dec 2019 12:02:37 +0000 (13:02 +0100)]
Update to K8S_TAG v1.17.0

It updates to the latest K8s stable version.

Change-Id: Iac85e8d5139eb27e689eb6d8357a55f3308471d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDisable false ansiblelint warnings 82/69282/1
Cédric Ollivier [Sat, 7 Dec 2019 13:15:02 +0000 (14:15 +0100)]
Disable false ansiblelint warnings

git commit has to be executed via shell module [1].
it also fixes Functest branch

[1] https://github.com/ansible/ansible/issues/50334

Change-Id: Ie4595f7bc2b54545b2f824f5ac3fb1d20340f13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit abe7e05d27f7801b902821a85186dca0c9e563ae)

4 years agoUpdate package index before install packaging in CircleCI 21/69121/1
Cédric Ollivier [Wed, 27 Nov 2019 10:30:13 +0000 (11:30 +0100)]
Update package index before install packaging in CircleCI

Change-Id: I5f61bfdcfa7efa7dfe0a3cf379770e79334de90e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6119abf09d3d5a98509619b650b054aca2edbceb)

4 years agoCorrectly override dir_results and res_dir in rally_kubernetes 18/68918/1
Cédric Ollivier [Sun, 17 Nov 2019 09:27:46 +0000 (10:27 +0100)]
Correctly override dir_results and res_dir in rally_kubernetes

Both have to be modified else publishing artifacts fails [1].

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-jerma-xrally_kubernetes-run/47/console

Change-Id: If21334d7d1342737575f9a260a0ad647c4f382e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 004d28383111d344aeb82ba9080c7c015970c9bb)

4 years agoAdd mailcap in dependencies 14/68914/1
Cédric Ollivier [Sat, 16 Nov 2019 17:03:09 +0000 (18:03 +0100)]
Add mailcap in dependencies

It allows detecting mimetypes.

Change-Id: Ieeae5e92142daab2ea724f1c332a71a8b0c63102
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bee77a2c2c6571c622a8e533ed0b80cdb49302ea)

4 years agoCorrectly override dir_results and res_dir 02/68902/1
Cédric Ollivier [Sat, 16 Nov 2019 13:07:49 +0000 (14:07 +0100)]
Correctly override dir_results and res_dir

Both have to be modified else publishing artifacts fails [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run/139/console

Change-Id: Ieefee6a9a61452bb4f23d40f75b60280803cd215
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63ef7413921dcd06d4bd15ae59a20da811cfe7d3)

4 years agoUpdate to Xtesting 0.82 48/68848/2
Cédric Ollivier [Sun, 10 Nov 2019 08:19:13 +0000 (09:19 +0100)]
Update to Xtesting 0.82

It overrides the default log files.

Change-Id: I6a1f9951b47b761e4e1832140181a57dd886117c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63b56cf0740fd5e2e0b7b022e287b27ddb898dee)

4 years agoFix sed calls in build.sh 02/68602/1
Cédric Ollivier [Tue, 8 Oct 2019 04:29:36 +0000 (06:29 +0200)]
Fix sed calls in build.sh

Change-Id: I880c49c1f56256813e400076d49a49de9b1b0203
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPublish first Functest K8s Jerma containers 97/68597/2
Cédric Ollivier [Mon, 7 Oct 2019 19:42:05 +0000 (21:42 +0200)]
Publish first Functest K8s Jerma containers

It leverages on latest K8s tag (v1.16.1).

Change-Id: I57014c4193c7732c4dfd46d7a29e3104eec652ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSet Jerma as defaultbranch in .gitreview 96/68596/1
Cédric Ollivier [Mon, 7 Oct 2019 19:46:37 +0000 (21:46 +0200)]
Set Jerma as defaultbranch in .gitreview

Change-Id: I3d0b66971f3491c91cd537a54b3628eeeaf7e985
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSelect go 1.12 instead of 1.13 (rolling) 14/68514/1
Cédric Ollivier [Fri, 20 Sep 2019 03:45:21 +0000 (05:45 +0200)]
Select go 1.12 instead of 1.13 (rolling)

Functest K8s container builds failed [1]

[1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-kubernetes-docker-master/94/

Change-Id: I3da0ebf05e1dd25b7fb609e0e851c07ed1722723
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove Features containers 15/68415/1
Cédric Ollivier [Sat, 31 Aug 2019 09:20:46 +0000 (11:20 +0200)]
Remove Features containers

Most the features are stopped and Functest shouldn't host dead code.
Functest is a framework (Docker and Python modules) which can be still
reused by any third-party (OPNFV Feature or anything else) in its tree
and CI

Change-Id: Ie2f5beddd21b09aabfbdf2bb2f3366e652d43b3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoConforms with latest changes in Xtesting ansible role. 85/68385/1
Cédric Ollivier [Thu, 22 Aug 2019 13:16:32 +0000 (15:16 +0200)]
Conforms with latest changes in Xtesting ansible role.

It selects the generic way to set execution-type [1].

[1] https://github.com/collivier/ansible-role-xtesting/commit/292ab576fb8f0a13519bacc5ec46561a3ed8f838

Change-Id: I8b4d7dc3433cc210cd9eac180a1f247286ac1d7e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRun Functest K8s unit tests via CircleCI 37/68337/1
Cédric Ollivier [Sat, 10 Aug 2019 12:59:41 +0000 (14:59 +0200)]
Run Functest K8s unit tests via CircleCI

It runs tox and published the artifacts.
It's worth mentioning that all docker images are already built via
Travis CI (amd64, arm and arm64) [1].

https://travis-ci.org/collivier/functest-kubernetes

Change-Id: I668481c123adfbfddb4f41feec1ebcec7c75f85d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRun perm in functest-kubernetes 05/68305/1
Cédric Ollivier [Sat, 3 Aug 2019 12:41:24 +0000 (14:41 +0200)]
Run perm in functest-kubernetes

Change-Id: If2d786c50addbd17948afdcd3c803293d03318f8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSwitch to Python 3.7 and Alpine 3.10 77/68277/3
Cédric Ollivier [Sat, 27 Jul 2019 15:09:05 +0000 (17:09 +0200)]
Switch to Python 3.7 and Alpine 3.10

pylint is updated to 2.3.1 (lastest py3.7 version)

Change-Id: I8b70e9764e2802aeb517969c265fbebfa03458ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd a new testcase leveraging on xrally/kubernetes 67/68167/9
Cédric Ollivier [Sun, 30 Jun 2019 13:03:00 +0000 (15:03 +0200)]
Add a new testcase leveraging on xrally/kubernetes

It partially runs the all-in-one task for checking basic functionality
of Kubernetes cluster.

Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoTurn bashate warnings into errors 14/68214/4
Cédric Ollivier [Wed, 10 Jul 2019 18:20:39 +0000 (20:20 +0200)]
Turn bashate warnings into errors

It also fixes the warning.

Change-Id: Ia24208590994418dc8a200e7336cf8a62f0976d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRewrite kubernetes parsing 42/68142/2
Cédric Ollivier [Thu, 27 Jun 2019 19:33:20 +0000 (21:33 +0200)]
Rewrite kubernetes parsing

It now sets details and result thanks to 1 regex.
It also prints the failure summary if needed.

Change-Id: Ia89d6825134161cf6513924dac93281d677eada6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDisable log dump 32/68132/2
Cédric Ollivier [Thu, 27 Jun 2019 09:31:48 +0000 (11:31 +0200)]
Disable log dump

It avoids dumping logs at the end which requires gcloud configured (CI).
Then it partially reverts "Keep kubernetes sources" [1].

It now dumps e2e.test output in e2e.log as sonobuoy [2].

[1] https://gerrit.opnfv.org/gerrit/68106
[2] https://raw.githubusercontent.com/cncf/k8s-conformance/master/v1.15/kubeadm/e2e.log

Change-Id: I400e1cf92a8540eba3d40db1ed4237628921efe6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove useless ci_loop in testcase descriptions 33/68133/2
Cédric Ollivier [Thu, 27 Jun 2019 12:09:25 +0000 (14:09 +0200)]
Remove useless ci_loop in testcase descriptions

Change-Id: I89f5a9172bed9d6861543250a971e09466d1307b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoKeep kubernetes sources 06/68106/2
Cédric Ollivier [Tue, 25 Jun 2019 11:35:34 +0000 (13:35 +0200)]
Keep kubernetes sources

It now only removes .git and _output
Else they are missing files when dumping the logs in case of failures
[1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-iruya-k8s_conformance-run/107/console

Change-Id: Ia8b45b8af48bc0005e75a174258e27f1f3edcaac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun bandit when verifying changes 43/67943/2
Cédric Ollivier [Sat, 25 May 2019 08:17:21 +0000 (10:17 +0200)]
Run bandit when verifying changes

It reports only MEDIUM issues or higher like nova [1]

[1] https://github.com/openstack/nova/blob/master/tox.ini#L221

Change-Id: I1302b28ed1dcc4e074c6c6f2aa5e915c88eb03f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSet utf-8 in decode and encode calls 39/67939/1
Cédric Ollivier [Sat, 25 May 2019 07:58:27 +0000 (09:58 +0200)]
Set utf-8 in decode and encode calls

It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].

[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console

Change-Id: If241c5323f286c33aaae804479375efe4c3c1588
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
5 years agoUpdate to Python3 40/67840/1
Cédric Ollivier [Sun, 12 May 2019 10:58:29 +0000 (12:58 +0200)]
Update to Python3

Functest containers leverage on Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html

Change-Id: I4f148e91259377b4e3b9076621f192a6e00f6009
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSlightly improve tox.ini 84/67684/2
Cédric Ollivier [Wed, 24 Apr 2019 16:46:14 +0000 (18:46 +0200)]
Slightly improve tox.ini

Change-Id: I92802637ad2177044f6f8c6f628ede80887583c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate all OpenStack refs to opendev.org 56/67656/2
Cédric Ollivier [Sun, 21 Apr 2019 18:32:45 +0000 (20:32 +0200)]
Update all OpenStack refs to opendev.org

Change-Id: I829c7798d21abb013db09d80cc509862fa5b9e2d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRun tox in .travis-ci 60/67560/1
Cédric Ollivier [Sat, 13 Apr 2019 14:56:28 +0000 (16:56 +0200)]
Run tox in .travis-ci

It installs python3 via ppa to run unit tests vs py36.
It completes the OPNFV gates which can't verify them.

Change-Id: I58e74e0272eb501ff5ffdb1eca1459a6c549fc17
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoVerify Ansible playbooks via ansible-lint 14/67414/1
Cédric Ollivier [Wed, 19 Dec 2018 08:50:53 +0000 (09:50 +0100)]
Verify Ansible playbooks via ansible-lint

Change-Id: Id51c2932e126ce1b29e43c95cc786101675bfa99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix manifest-tool builds 68/67368/2
Cédric Ollivier [Sun, 24 Mar 2019 12:53:07 +0000 (13:53 +0100)]
Fix manifest-tool builds

It now selects the last release to allow compiling it [1]

[1] https://travis-ci.org/collivier/functest-xtesting/jobs/510384544

Change-Id: Ia7d83c88c262102b26b7aa725bcf9577e13e54a7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSet db_project in ansible/site.yml 62/67362/1
Cédric Ollivier [Sun, 24 Mar 2019 10:03:37 +0000 (11:03 +0100)]
Set db_project in ansible/site.yml

functest-kubernetes is defined as part of functest in OPNFV DB (see
testcases.yaml).

Change-Id: I09eadefd1f6b7bc9b58309fdbe92f8c23e7a5815
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate Alpine tag in build.sh and ansible/site.yml 52/67352/1
Cédric Ollivier [Sat, 23 Mar 2019 18:32:43 +0000 (19:32 +0100)]
Update Alpine tag in build.sh and ansible/site.yml

It completes the previous commit updating Alpine.

Change-Id: I5f29bbe9d8c79f50d3270ad76eec687073351e43
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate to Apine 3.9 93/67293/4
Cédric Ollivier [Mon, 18 Mar 2019 20:20:28 +0000 (21:20 +0100)]
Update to Apine 3.9

It updates to the latest Alpine release [1]

[1] https://www.alpinelinux.org/posts/Alpine-3.9.0-released.html

Change-Id: I4afbc1d4830647f11509a02df5820ce7d33541ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoPublish Junit files and fix Conformance regex 22/67222/1
Cédric Ollivier [Sun, 10 Mar 2019 08:17:57 +0000 (09:17 +0100)]
Publish Junit files and fix Conformance regex

It fixes Conformance to [Conformance] and add the skips test regex.
It now conforms with Kubernetes Certification (see Sunobuoy)

Change-Id: Ic25bb72c839810cf41668a3a8b86579a3fd59629
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix container names in ansible/site.yml 41/66541/1
Cédric Ollivier [Mon, 21 Jan 2019 12:58:49 +0000 (13:58 +0100)]
Fix container names in ansible/site.yml

Change-Id: I246065e176eba9e8dbd31b8f54974b3b2a498f2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFix BRANCH args in ansible.yml 65/66465/2
Cédric Ollivier [Thu, 17 Jan 2019 17:37:27 +0000 (18:37 +0100)]
Fix BRANCH args in ansible.yml

Change-Id: Ic7db95470d510813949c059b2b573425446d2c34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSwitch from port to dport 05/66405/1
Cédric Ollivier [Tue, 15 Jan 2019 14:18:36 +0000 (15:18 +0100)]
Switch from port to dport

port is reserved in ansible.

Change-Id: I095396a94ac34ca6bded65033d1a7e2446eaeb8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRemove former ci jobs 79/66379/2
Cédric Ollivier [Mon, 14 Jan 2019 17:55:57 +0000 (18:55 +0100)]
Remove former ci jobs

They can now be generated via the new ansible role.

Change-Id: I6ca1f14873b83a343e00a5d5a75a746ce9d0e6e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAdd Functest k8s gate jobs 23/66223/1
Cédric Ollivier [Sat, 5 Jan 2019 15:43:25 +0000 (16:43 +0100)]
Add Functest k8s gate jobs

Change-Id: Icfe4445c1405749698d2db42fa6001ad3d261e29
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAdd build dependencies 99/66099/1
Cédric Ollivier [Thu, 27 Dec 2018 18:55:27 +0000 (19:55 +0100)]
Add build dependencies

New OpenStack upper-constraints require build deps.

Change-Id: Ib0318badfb13f528c20f4e01afdeaba36f442f9c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoDeploy Functest Kubernetes CI toolchains 71/65971/2
Cédric Ollivier [Wed, 19 Dec 2018 06:59:53 +0000 (07:59 +0100)]
Deploy Functest Kubernetes CI toolchains

It eases verifying OpenStack by deploying the full testing toolchain
via Ansible. As opposed to the Releng model, all tests can be executed
in parallel.

It leverages on Xtesting Ansible role which currently deploys
Jenkins, Minio, S3www, MongoDB, TestAPI and loads all jobs in Jenkins.
The dashboard will be deployed in the next update of the ansible role.

To deploy the testing toolchain:
$ ansible-galaxy install collivier.xtesting
$ ansible-playbook ansible/site.yml

Change-Id: Ie409653ae4f7f4d315449ee54ae0c504272f7899
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge changes I9b371e44,I79c404d4
Cedric Ollivier [Tue, 30 Oct 2018 19:43:38 +0000 (19:43 +0000)]
Merge changes I9b371e44,I79c404d4

* changes:
  Prepare OPNFV functest releases
  Disable py36

5 years agoPrepare OPNFV functest releases 59/64259/2
Cédric Ollivier [Tue, 30 Oct 2018 19:31:31 +0000 (20:31 +0100)]
Prepare OPNFV functest releases

It sets version = 9 (I-release).

Change-Id: I9b371e444be9fc61b3d1dcaf41870795287f3fed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoDisable py36 67/64267/1
Cédric Ollivier [Tue, 30 Oct 2018 19:35:48 +0000 (20:35 +0100)]
Disable py36

All OPNFV build server doesn't support py36.

Change-Id: I79c404d4104d90917cb50e87b545cbc9d7f158ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoTemporarily disable py36 63/63763/1
Cédric Ollivier [Fri, 19 Oct 2018 14:14:01 +0000 (16:14 +0200)]
Temporarily disable py36

Build servers haven't been updated yet to support py36.

Change-Id: I05247a7ded6518a558ffd52eb38433c45a5338e4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSwitch to golang:alpine3.8 as based image 01/63701/2
Cédric Ollivier [Thu, 18 Oct 2018 15:50:11 +0000 (17:50 +0200)]
Switch to golang:alpine3.8 as based image

It fixes all issues raised by the Alpine testing go package [1].
It conforms with Kubernetes which requires the latest go version.

[1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/45/console

Change-Id: I388c843a21af9763703a40586ecf9b0b4583ebcb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate python3 to python3.6 51/63651/1
Cédric Ollivier [Wed, 17 Oct 2018 11:48:52 +0000 (13:48 +0200)]
Update python3 to python3.6

It conforms with Alpine 3.8

Change-Id: If384d374224bdc465b68f134e60051d43ef951af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoSet Ginkgo's reporter not to print out in color 73/63373/1
Juha Kosonen [Wed, 10 Oct 2018 10:08:18 +0000 (13:08 +0300)]
Set Ginkgo's reporter not to print out in color

Change-Id: If0ef89ba521d02b5ea1a1fcb5bc3e546f93e2859
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
5 years agoUpdate .travis.yml to manage manifests 73/62373/2
Cédric Ollivier [Sat, 15 Sep 2018 11:08:31 +0000 (13:08 +0200)]
Update .travis.yml to manage manifests

It has to be updated since functest-kubernetes supports arm64.

Change-Id: I7726af24dd9a5ef29ed97003de64469cd27b1703
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoStop writing in clusterapi-tester/pod.yaml 19/62319/1
Cédric Ollivier [Fri, 14 Sep 2018 12:26:30 +0000 (14:26 +0200)]
Stop writing in clusterapi-tester/pod.yaml

It was removed in master tree [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-arm64-master/20/console

Change-Id: Ice0c88c2a3954934acdb69828d9675efac6bb1fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate K8s tag to master 03/62303/1
Cédric Ollivier [Fri, 14 Sep 2018 05:51:06 +0000 (07:51 +0200)]
Update K8s tag to master

Change-Id: I772d9b267f5cbdac37a297ef617da77e97bc4d2b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Disable OPNFV Features"
Cedric Ollivier [Fri, 14 Sep 2018 03:27:13 +0000 (03:27 +0000)]
Merge "Disable OPNFV Features"

5 years agoDisable OPNFV Features 89/62289/1
Cédric Ollivier [Thu, 13 Sep 2018 20:10:37 +0000 (22:10 +0200)]
Disable OPNFV Features

From the time being, none is synced to OPNFV hunter or newer.

Change-Id: If8a39bd185d1b7d396ea61bfebca2416b9bd5566
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge changes I2b52f659,I894bb969
Cedric Ollivier [Thu, 13 Sep 2018 08:19:34 +0000 (08:19 +0000)]
Merge changes I2b52f659,I894bb969

* changes:
  Add OpenStack constraints
  Update to OpenStack master

5 years agoAdd OpenStack constraints 03/62203/1
Cédric Ollivier [Thu, 13 Sep 2018 07:42:37 +0000 (09:42 +0200)]
Add OpenStack constraints

Change-Id: I2b52f6594629b171312caf25906b9e582613379b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate to OpenStack master 01/62201/1
Cédric Ollivier [Thu, 13 Sep 2018 07:41:19 +0000 (09:41 +0200)]
Update to OpenStack master

Change-Id: I894bb969d690537f6910b8cfcdb52162747121a6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdated from global requirements 87/62187/1
Cédric Ollivier [Thu, 13 Sep 2018 05:51:34 +0000 (07:51 +0200)]
Updated from global requirements

Change-Id: I218e6cc1813824bc0c03e3eec42b6efdd463d8c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRewrite git clones 79/61779/1
Cédric Ollivier [Mon, 3 Sep 2018 18:54:58 +0000 (20:54 +0200)]
Rewrite git clones

Change-Id: I04c60b6c10ccd7b7e939002505e6e43e9c98eae7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate Xtesting to 0.60 25/61725/1
Cédric Ollivier [Sun, 2 Sep 2018 12:55:13 +0000 (14:55 +0200)]
Update Xtesting to 0.60

Xtesting leverages on stevedore [1] which will bring much more
flexibility (discovery, module or class renaming, etc).

OPNFV Features have to be updated as well:
  - https://gerrit.opnfv.org/gerrit/61719
  - https://gerrit.opnfv.org/gerrit/61723

[1] https://docs.openstack.org/stevedore/latest/

Change-Id: Ibe2a6ab3ddca92882aa4a26f140d2db28d77cb86
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate Kubernetes to v1.11.2 91/61691/5
Cédric Ollivier [Sat, 1 Sep 2018 19:48:32 +0000 (21:48 +0200)]
Update Kubernetes to v1.11.2

Change-Id: If674867a7dc488c64fc3f0cda530560b5d306416
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoUpdate to Alpine 3.8 95/61695/1
Cédric Ollivier [Sat, 1 Sep 2018 20:24:15 +0000 (22:24 +0200)]
Update to Alpine 3.8

https://alpinelinux.org/posts/Alpine-3.8.0-released.html

Change-Id: Ie9197f0cbc682d0c9a7cfee18b5ca6a27c466c89
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAvoid downloading git history 89/61689/1
Cédric Ollivier [Fri, 31 Aug 2018 14:04:37 +0000 (16:04 +0200)]
Avoid downloading git history

It decreases build duration because of kubernetes history.

Change-Id: I650c271e123b97e7350933b32d05b6b0781a79e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoFully remove kubernetes working dir 35/61635/1
Cédric Ollivier [Fri, 31 Aug 2018 09:54:36 +0000 (11:54 +0200)]
Fully remove kubernetes working dir

It hugely decreases the size of our containers.

Change-Id: I7bdc31645fb00c01e16855795bf99dd1b3b17dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoPublish daily and gating jjbs 93/61393/4
Cédric Ollivier [Mon, 20 Aug 2018 09:14:17 +0000 (11:14 +0200)]
Publish daily and gating jjbs

Change-Id: Ic7fd7bc9adf1672573878d6b74d43fa55e777be3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRemove useless env vars 11/61611/2
Cédric Ollivier [Thu, 30 Aug 2018 20:43:13 +0000 (22:43 +0200)]
Remove useless env vars

In OPNFV context, provider is always local.

Change-Id: Ieb51153bedfec34c0a3dfba9705b0b2afcebb8c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoRemove kubernetes/.git 09/61609/1
Cédric Ollivier [Thu, 30 Aug 2018 20:41:30 +0000 (22:41 +0200)]
Remove kubernetes/.git

Change-Id: Ib8ee11a51cd89cdb401b5d1781522fc0e3990f0e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoMerge "Fix issue of error image when running healthcheck case on arm platform"
Cedric Ollivier [Sat, 25 Aug 2018 07:16:35 +0000 (07:16 +0000)]
Merge "Fix issue of error image when running healthcheck case on arm platform"

5 years agoFix issue of error image when running healthcheck case on arm platform 49/61249/3
Jingzhao Ni [Wed, 22 Aug 2018 13:57:36 +0000 (21:57 +0800)]
Fix issue of error image when running healthcheck case on arm platform

Replace the "amd64" with "arm64" in the pod.yaml when building
the healthcheck images.

Change-Id: I58b2d91ce1c74575becb77eee4c711623becd0fe
Signed-off-by: Jingzhao Ni <jingzhao.ni@arm.com>
5 years agoFix smoke/testcases.yaml 71/61271/1
Cédric Ollivier [Wed, 22 Aug 2018 21:37:06 +0000 (23:37 +0200)]
Fix smoke/testcases.yaml

https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/265/console

Change-Id: I83e98e678f931f8ac22f8dd5dfca8b2583874ff1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoConform with last Xtesting updates 09/61109/1
Cédric Ollivier [Mon, 20 Aug 2018 09:16:24 +0000 (11:16 +0200)]
Conform with last Xtesting updates

Change-Id: If22886c8e436203c9878d0e97aa1250493804bc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 years agoAdd some build option in build.sh for supporting arm arch 31/61031/3
Jingzhao Ni [Fri, 17 Aug 2018 08:58:58 +0000 (16:58 +0800)]
Add some build option in build.sh for supporting arm arch

In build.sh, add some build options for arm arch.

It also updates constraints to OpenStack Queens.

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I3cc6c10e2e52c281e2324d8b42b721383be30c0b
Signed-off-by: Jingzhao Ni <jingzhao.ni@arm.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoFix functest-k8s logging to log all k8s tests 95/57595/4
Konrad Djimeli [Sun, 20 May 2018 00:40:21 +0000 (01:40 +0100)]
Fix functest-k8s logging to log all k8s tests

JIRA: FUNCTEST-967

Change-Id: If4924a5c6d66dcbda48ac5ea80d67fcef11ba40a
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoUpdate logging to log Errors, when they occur 13/56613/4
Konrad Djimeli [Thu, 26 Apr 2018 07:40:17 +0000 (08:40 +0100)]
Update logging to log Errors, when they occur

Enable logging of errors which can occur due to
incorrect configfile, wrong KUBE_MASTER_URL or
KUBE_MASTER_IP etc.

Change-Id: I352ed0ab0376e9392d205decdc569bac6304ba27
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoCheck build.sh via bashate 13/56413/1
Cédric Ollivier [Tue, 24 Apr 2018 17:34:54 +0000 (19:34 +0200)]
Check build.sh via bashate

Change-Id: I367d87539ce25d9d114ee1f75b2f8af383408865
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove installer dependencies 11/56211/1
Cédric Ollivier [Sun, 22 Apr 2018 17:16:35 +0000 (19:16 +0200)]
Remove installer dependencies

They are useless as all scenarios are well defined.
It will allow running k8s testcases without defining INSTALLER_TYPE
as OpenStack and eases maintaining that files.

Change-Id: I6f9b0b5a8162e9db3ccc9155a9f88a97eda56f20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add ONS2018 functest-k8s meeting presentation"
Cedric Ollivier [Tue, 17 Apr 2018 18:52:01 +0000 (18:52 +0000)]
Merge "Add ONS2018 functest-k8s meeting presentation"

6 years agoAdd ONS2018 functest-k8s meeting presentation 97/55497/4
Konrad Djimeli [Thu, 12 Apr 2018 02:30:51 +0000 (03:30 +0100)]
Add ONS2018 functest-k8s meeting presentation

Change-Id: Iadb0942b2699cae05698df2ee3689d3d1eed963e
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoAdd minor description grammar fix 31/55631/1
Konrad Djimeli [Fri, 13 Apr 2018 02:18:09 +0000 (03:18 +0100)]
Add minor description grammar fix

Change-Id: I27e4cf14a2036c739d49259744beda982bb20f96
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoUpdated from global requirements 29/55529/1
Cédric Ollivier [Thu, 12 Apr 2018 07:19:35 +0000 (09:19 +0200)]
Updated from global requirements

Change-Id: I0bb401f32a43e4d8dbc2a36c8f404d27973edb92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Remove functest from test-requirements.txt"
Cedric Ollivier [Tue, 10 Apr 2018 19:49:28 +0000 (19:49 +0000)]
Merge "Remove functest from test-requirements.txt"

6 years agoRemove functest from test-requirements.txt 69/55369/1
Cédric Ollivier [Tue, 10 Apr 2018 19:46:44 +0000 (21:46 +0200)]
Remove functest from test-requirements.txt

Change-Id: Ia3a53ee7b7c3ed1e0a24a9bfa7ed205627df652b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoMerge "Add unit tests for K8sTesting's run and run_kubetest methods"
Cedric Ollivier [Tue, 10 Apr 2018 06:22:30 +0000 (06:22 +0000)]
Merge "Add unit tests for K8sTesting's run and run_kubetest methods"

6 years agoMerge "Add unit test for config file validation"
Cedric Ollivier [Tue, 10 Apr 2018 06:22:24 +0000 (06:22 +0000)]
Merge "Add unit test for config file validation"

6 years agoAdd unit tests for K8sTesting's run and run_kubetest methods 95/55195/2
Konrad Djimeli [Mon, 9 Apr 2018 04:43:23 +0000 (05:43 +0100)]
Add unit tests for K8sTesting's run and run_kubetest methods

Change-Id: I0442614c609d0d6248c1896d0bc8f55c32e5152d
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
6 years agoClean functest-kubernetes-healthcheck too 43/55143/2
Cédric Ollivier [Sat, 7 Apr 2018 13:01:49 +0000 (15:01 +0200)]
Clean functest-kubernetes-healthcheck too

It could have been downloaded by functest-kubernetes-smoke.

Change-Id: If02762300dd832717b7ac4d144aff22167eef986
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoRemove former opnfv/functest-kubernetes files 21/55121/3
Cédric Ollivier [Sat, 7 Apr 2018 10:42:29 +0000 (12:42 +0200)]
Remove former opnfv/functest-kubernetes files

Change-Id: I7443f52541526b630b3e4b8a73f6ec47d27b9598
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
6 years agoAdd testcase clover_k8s 43/54543/8
QiLiang [Wed, 28 Mar 2018 09:00:27 +0000 (17:00 +0800)]
Add testcase clover_k8s

Clover testcase hook patch:
  https://gerrit.opnfv.org/gerrit/#/c/54541/

This patch is depend on patch:
  https://gerrit.opnfv.org/gerrit/#/c/54695/

Scenario k8-istio-clover run k8s_smoke and clover_k8s

Change-Id: I2cd76ed9d882f94567fd721d250da13b19aaa37b
Signed-off-by: QiLiang <liangqi1@huawei.com>
6 years agoInstall test case clover_k8s 95/54695/6
QiLiang [Sun, 1 Apr 2018 14:51:21 +0000 (22:51 +0800)]
Install test case clover_k8s

Clover testcase hook patch:
  https://gerrit.opnfv.org/gerrit/#/c/54541/

Change-Id: Iab6c2c4fc65e482604d48ca2cbd028453b8a437a
Signed-off-by: QiLiang <liangqi1@huawei.com>
6 years agoAdd unit test for config file validation 69/55169/2
Konrad Djimeli [Sun, 8 Apr 2018 05:20:45 +0000 (06:20 +0100)]
Add unit test for config file validation

Change-Id: I170de36f9641fce253acdd169061476443b86f81
Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>