functest-kubernetes.git
3 years agoUpdate cnf_conformance to v0.9.4 42/71442/2
Cédric Ollivier [Sat, 21 Nov 2020 12:06:25 +0000 (13:06 +0100)]
Update cnf_conformance to v0.9.4

It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts
to the new cnf-conformance result output logic.

It runs all workload tests as it's now proposed (k8s conformance
is already part of smoke) and select the latest coredns
cnf-conformance.yml taking latest helm repo changes into account.

It sets criteria 95 as all steps are considered as passed and a
overall result 100/105.

[1] https://github.com/cncf/cnf-conformance/issues/388

Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 854f164998793000fcf8019214b259b7283f5194)

3 years agoSkip cnf_conformance till helm repos are fixed 34/71434/1
Cédric Ollivier [Fri, 20 Nov 2020 11:19:32 +0000 (12:19 +0100)]
Skip cnf_conformance till helm repos are fixed

Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 30a5a084fa9e0c8677d70d8b1d7a696ea06b49b9)

3 years agoAdd timeout as needed by Gitlab CI/CD 81/71381/2
Cédric Ollivier [Thu, 12 Nov 2020 16:26:25 +0000 (17:26 +0100)]
Add timeout as needed by Gitlab CI/CD

Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for both test cases even if only k8s_conformance
reaches 1h (XtestingCI design).

Change-Id: Ieaef1cefb3dfc7f9ca47b1ce8ec082409fa52604
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f38caec124b925f8c633f9d8b4474bd1085638a2)

3 years agoSplit Gates in a dedicated site.yml 49/71349/2
Cédric Ollivier [Mon, 9 Nov 2020 15:37:00 +0000 (16:37 +0100)]
Split Gates in a dedicated site.yml

Change-Id: I8b31468e8244e63feed163134f25461d019dbdea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate upper-constraints 40/71240/1
Cédric Ollivier [Tue, 6 Oct 2020 21:37:58 +0000 (23:37 +0200)]
Update upper-constraints

It takes the new requirements just published into account.

Change-Id: Iea0ba4113b44d3056f2f8f1b1516271d33e84e32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix BRANCH and OPNFV_TAG in stable/leguer 11/71211/1
Cédric Ollivier [Sun, 4 Oct 2020 13:44:46 +0000 (15:44 +0200)]
Fix BRANCH and OPNFV_TAG in stable/leguer

Change-Id: I82797911296ac68701bbe1ced37c3c843360d92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPrepare Functest Kubernetes Leguer containers 03/71203/1
Cédric Ollivier [Sun, 4 Oct 2020 10:54:01 +0000 (12:54 +0200)]
Prepare Functest Kubernetes Leguer containers

Change-Id: I91b31f2af0c2265cdda5715ae152558ffcbe003b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSet default branch in .gitreview 02/71202/1
Cédric Ollivier [Sun, 4 Oct 2020 10:45:41 +0000 (12:45 +0200)]
Set default branch in .gitreview

Change-Id: I834255837e15487bc6ae52b0c2dc805f84fb82b3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSplit kube_bench_master and kube_bench_node in site.cntt.yml 72/71172/1
Cédric Ollivier [Wed, 23 Sep 2020 07:12:48 +0000 (09:12 +0200)]
Split kube_bench_master and kube_bench_node in site.cntt.yml

Change-Id: Ifb9a5ac2fac7286d5f3f5e677fc2a7ecda6ade25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop hardcoding ims- as generate_name 71/71171/1
Cédric Ollivier [Tue, 22 Sep 2020 14:47:04 +0000 (16:47 +0200)]
Stop hardcoding ims- as generate_name

Change-Id: I3ea22a4050ff1eb609cffb61edc41c49fab44366
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRedirect helm false warnings to logs 60/71160/1
Cédric Ollivier [Sun, 20 Sep 2020 16:28:36 +0000 (18:28 +0200)]
Redirect helm false warnings to logs

Helm fails when detecting arch if qemu.
time="2020-09-17T16:25:15Z" level=error msg="failure getting variant" error="getCPUInfo for pattern: Cpu architecture: not found"

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-arm64-latest-helm_vims-run/1/console

Change-Id: Ida37062a780f9e2acf60035bf2d41fb8fbb61173
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd helm_vims in site.cntt.yml 44/71144/1
Cédric Ollivier [Wed, 16 Sep 2020 09:34:51 +0000 (11:34 +0200)]
Add helm_vims in site.cntt.yml

https://github.com/cntt-n/CNTT/pull/2022

Change-Id: Icb4bdfa0c1ecca9d0c5b4d5beef7ff4c5edb289e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish helm_vims also based on clearwater-docker 31/71131/1
Cédric Ollivier [Tue, 15 Sep 2020 21:18:16 +0000 (23:18 +0200)]
Publish helm_vims also based on clearwater-docker

It leverages helm rather than kubectl as proposed by k8s_vims.
A new abstract class Vims is added to factorize code between both
testcases.

Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoIncrease timeout in vIMS 30/71130/1
Cédric Ollivier [Tue, 15 Sep 2020 08:03:30 +0000 (10:03 +0200)]
Increase timeout in vIMS

It depends on bandwidth.
30 minutes should be enough in all scenarios

Change-Id: Ieaad053c8f8a270e5da08275de217b15fdf17f44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDon't run disruptive hunter checks 21/71121/1
Cédric Ollivier [Mon, 14 Sep 2020 19:47:11 +0000 (21:47 +0200)]
Don't run disruptive hunter checks

Change-Id: I52cb8303950269946774546cf8e413166c70a33c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSplit kube-bench master and node 07/71107/3
Cédric Ollivier [Sun, 13 Sep 2020 12:53:26 +0000 (14:53 +0200)]
Split kube-bench master and node

The former deployment asked for all-in-one.

Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoself.details must be a dict 02/71102/1
Cédric Ollivier [Sun, 13 Sep 2020 08:44:38 +0000 (10:44 +0200)]
self.details must be a dict

Change-Id: I4f65a9eeb7eda471371668db9abfa49e2875c5b0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoImprove kube_bench output 97/71097/1
Cédric Ollivier [Sat, 12 Sep 2020 14:12:50 +0000 (16:12 +0200)]
Improve kube_bench output

It also fills self.details.

Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoEnhance kube-hunter result postprocessing 88/71088/1
Cédric Ollivier [Sat, 12 Sep 2020 11:52:47 +0000 (13:52 +0200)]
Enhance kube-hunter result postprocessing

It fills self.details and checks if the test case passes according
to criteria (severity = high by default)

Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAvoid running VNF testing if deployment failed 87/71087/1
Cédric Ollivier [Sat, 12 Sep 2020 09:31:37 +0000 (11:31 +0200)]
Avoid running VNF testing if deployment failed

Change-Id: Id7642e47ec2cc438c5fe3a0ec9447f72b358adab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd clusterIP: None in ims svc.yaml 82/71082/1
Cédric Ollivier [Fri, 11 Sep 2020 22:42:07 +0000 (00:42 +0200)]
Add clusterIP: None in ims svc.yaml

Change-Id: I0709e83f32261af232c20f94c1edef7423e05527
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove clusterIP: None in ims svc.yaml 76/71076/1
Cédric Ollivier [Thu, 10 Sep 2020 19:54:00 +0000 (21:54 +0200)]
Remove clusterIP: None in ims svc.yaml

It now works on minikube in addition to Functest gates.

Change-Id: I314989516f81dcddb3e615fe23480135f1d8cf9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAllow setting e2e non blocking taints via env vars 69/71069/1
Cédric Ollivier [Thu, 10 Sep 2020 15:07:53 +0000 (17:07 +0200)]
Allow setting e2e non blocking taints via env vars

Change-Id: I8132769ea23a376b2cae8b93beed27f5e66b9207
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd quay.io/coreos/etcd:v2.2.5 in download_images.sh 65/71065/1
Cédric Ollivier [Thu, 10 Sep 2020 09:41:10 +0000 (11:41 +0200)]
Add quay.io/coreos/etcd:v2.2.5 in download_images.sh

Change-Id: I4b5da162dcb1efff810514498a20250c05afb3ba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish CNTT RC2 playbook 55/71055/1
Cédric Ollivier [Wed, 9 Sep 2020 17:25:12 +0000 (19:25 +0200)]
Publish CNTT RC2 playbook

It runs the mandatory CNTT test cases [1].

[1] https://github.com/cntt-n/CNTT/commit/6af033c254727b7405fbfb2efbaa023e2b8ba876

Change-Id: I87d381c78049f7309c564791ed701cf446cc85d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd helper to download all images 51/71051/3
Cédric Ollivier [Tue, 8 Sep 2020 21:27:50 +0000 (23:27 +0200)]
Add helper to download all images

It eases offline testing.
The default command leverages kind as in-use in Functest.

Change-Id: I66a20ede5e857f80cf49b9b708843034bc3b9904
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSet all image tags 45/71045/2
Cédric Ollivier [Tue, 8 Sep 2020 20:42:48 +0000 (22:42 +0200)]
Set all image tags

It allows offline testing via xrally_kubernetes, k8s_vims, kube_bench
and kube_hunter.

Change-Id: I3084abec19f06a894d0083ecb3ed61882eddd785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove latest in all images 39/71039/1
Cédric Ollivier [Tue, 8 Sep 2020 18:45:18 +0000 (20:45 +0200)]
Remove latest in all images

The Kubernetes default pull policy is IfNotPresent unless the image tag
is :latest in which case the default policy is Always. IfNotPresent
causes the Kubelet to skip pulling an image if it already exists [1]

[1] https://kind.sigs.k8s.io/docs/user/quick-start/

Change-Id: I83dac6165d2bbef165ca852dd03e5b76a5356f2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove all imagePullPolicy: Always in ims depl yaml 16/71016/1
Cédric Ollivier [Tue, 8 Sep 2020 09:11:44 +0000 (11:11 +0200)]
Remove all imagePullPolicy: Always in ims depl yaml

It forbids offline testing.

Change-Id: I6790f64fd1382671300374b339ae038ef015cfab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoOverride default Xtesting logs in cnf-conformance 02/71002/1
Cédric Ollivier [Mon, 7 Sep 2020 08:24:22 +0000 (10:24 +0200)]
Override default Xtesting logs in cnf-conformance

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/7/console

Change-Id: Ia6845525e62274f7792b4cb1909f36204fb51418
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDecreate cnf-conformance criteria 84/70984/1
Cédric Ollivier [Sun, 6 Sep 2020 13:32:11 +0000 (15:32 +0200)]
Decreate cnf-conformance criteria

conf-confirmance is beta.
Let's decrease criteria to allow gating [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console

Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSlightly generalize ginkgo params 78/70978/1
Cédric Ollivier [Sun, 6 Sep 2020 11:57:11 +0000 (13:57 +0200)]
Slightly generalize ginkgo params

Change-Id: I51b013056bb5b88ef2e1de31e9171129e8ce4475
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish k8s_quick as proposed by sonobuoy 73/70973/1
Cédric Ollivier [Sun, 6 Sep 2020 11:28:05 +0000 (13:28 +0200)]
Publish k8s_quick as proposed by sonobuoy

https://github.com/vmware-tanzu/sonobuoy

Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoConform with latest sonubuoy's non disruptive list 70/70970/1
Cédric Ollivier [Sun, 6 Sep 2020 10:02:07 +0000 (12:02 +0200)]
Conform with latest sonubuoy's non disruptive list

https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43

Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate Xtesting to 0.91.0 65/70965/1
Cédric Ollivier [Sun, 6 Sep 2020 08:34:06 +0000 (10:34 +0200)]
Update Xtesting to 0.91.0

Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAllow skipping arm and arm64 if cnf-conformance 17/70917/1
Cédric Ollivier [Fri, 4 Sep 2020 19:24:55 +0000 (21:24 +0200)]
Allow skipping arm and arm64 if cnf-conformance

cnf-conformance doesn't support this architectures.
It also improve cleaning to publish artifacts [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console

Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd cnf-conformance in functest-kubernetes-cnf 14/70914/3
Cédric Ollivier [Wed, 2 Sep 2020 17:46:25 +0000 (19:46 +0200)]
Add cnf-conformance in functest-kubernetes-cnf

It selects cnf-conformance v0.7.2-beta1 (current latest release) and
the default CNF as proposed by [1].

The end user is free to override the default yml files on purpose (e.g.
docker volumes). Tag (default: all) could be modified too via
testcases.yaml

[1] https://hackmd.io/@vulk/SkY54QnsU

Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoIncrease cassandra timeouts 98/70898/1
Cédric Ollivier [Sun, 30 Aug 2020 11:39:42 +0000 (13:39 +0200)]
Increase cassandra timeouts

homestead-prov sometimes fails reaching cassandra
30-08-2020 10:33:44.064 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code
30-08-2020 10:34:32.257 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code

Change-Id: I48566e39dca3dc9644733a76140a76300bbfd84e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop pushing all details in Test DB 64/70864/1
Cédric Ollivier [Sun, 23 Aug 2020 02:53:16 +0000 (04:53 +0200)]
Stop pushing all details in Test DB

It raises 413 Client Error: Request Entity Too Large for url [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console

Change-Id: I165f7aec53d8ce1e567491a5b5559f00b1fe4a4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSet output logs in Rally testcases 59/70859/2
Cédric Ollivier [Sun, 23 Aug 2020 02:37:08 +0000 (04:37 +0200)]
Set output logs in Rally testcases

https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console

Change-Id: I13685d74ce9e286520af6f1e5cd6ce9dafc3d5ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix kube-hunter command 58/70858/1
Cédric Ollivier [Sun, 23 Aug 2020 02:26:02 +0000 (04:26 +0200)]
Fix kube-hunter command

https://github.com/aquasecurity/kube-hunter/commit/3e06647b4c09257cb994bbdd174ee621e2af5406

Change-Id: Idf470f0161aaeb7a326a3e2a4e680445d9f00eac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix last hardcoded concurrencies 51/70851/1
Cédric Ollivier [Sat, 22 Aug 2020 16:41:38 +0000 (18:41 +0200)]
Fix last hardcoded concurrencies

Change-Id: Ib2b7bb6de8cd6524fcc52baf48ebf5c4835c396b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd xrally_kubernetes_full 44/70844/1
Cédric Ollivier [Sat, 22 Aug 2020 14:36:19 +0000 (16:36 +0200)]
Add xrally_kubernetes_full

It iterates 10 times all operations run by xrally_kubernetes.
Now times, concurrenty and count can be set via testcases.yaml.

It creates a new containers functest-kubernetes-benchamrking as
Functest.

Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge "Add tempo waiting for ellis account"
Cedric Ollivier [Tue, 18 Aug 2020 07:56:39 +0000 (07:56 +0000)]
Merge "Add tempo waiting for ellis account"

3 years agoAdd tempo waiting for ellis account 20/70820/1
Cédric Ollivier [Mon, 17 Aug 2020 19:26:16 +0000 (21:26 +0200)]
Add tempo waiting for ellis account

Change-Id: I63c6af9d0e20aab426e7f875cdb4f86d206f49aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSafely decode e2e.test output 75/70775/3
Cédric Ollivier [Thu, 13 Aug 2020 23:04:04 +0000 (01:04 +0200)]
Safely decode e2e.test output

https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-healthcheck-arm-latest-k8s_smoke-run/2/console

Change-Id: I57f3ae0051fb55c8c80de81e79168e61c06d85bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSwitch to latest K9S v1.19 rc 03/70803/1
Cédric Ollivier [Mon, 17 Aug 2020 08:12:17 +0000 (10:12 +0200)]
Switch to latest K9S v1.19 rc

Change-Id: I3a8b45e8347b5a4eea3398cb2f84796b2893cace
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix arm -> arm64 92/70792/1
Cédric Ollivier [Sun, 16 Aug 2020 11:47:36 +0000 (13:47 +0200)]
Fix arm -> arm64

Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoLeverage alpine rather than golang 87/70787/1
Cédric Ollivier [Sun, 16 Aug 2020 09:56:12 +0000 (11:56 +0200)]
Leverage alpine rather than golang

golang is now useless as we stop compiling kubernetes binaries.

Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop compiling K8s testing binaries 86/70786/1
Cédric Ollivier [Fri, 14 Aug 2020 11:58:13 +0000 (13:58 +0200)]
Stop compiling K8s testing binaries

It reaches Travis CI timeouts and is quite useless.
PyNaCl is now installed via Alpine packages to save CI.

Change-Id: Ifdf3f46f162a811ed95e3ca07ea7c3d89bc77a91
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate golang to 1.15 in site.yaml 78/70778/1
Cédric Ollivier [Fri, 14 Aug 2020 07:55:35 +0000 (09:55 +0200)]
Update golang to 1.15 in site.yaml

Change-Id: I8891ab01dcbeee7711fcb704535ce1621d0dc7c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate golang to 1.15 76/70776/1
Cédric Ollivier [Fri, 14 Aug 2020 07:29:36 +0000 (09:29 +0200)]
Update golang to 1.15

As asked by Kubernetes [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-latest-gate/60/console

Change-Id: Ic57fe67f6568d19615599f7762a18170158c6771
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoConform with Functest pylint config 69/70769/1
Cédric Ollivier [Thu, 13 Aug 2020 20:01:31 +0000 (22:01 +0200)]
Conform with Functest pylint config

Change-Id: Ie12d17a32fe8ee7ee212a6a4acf6aec107377390
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge "Make K8s security tests namespace aware"
Cedric Ollivier [Thu, 13 Aug 2020 15:16:10 +0000 (15:16 +0000)]
Merge "Make K8s security tests namespace aware"

3 years agoEase modifying the test list in E2E testing 59/70759/3
Cédric Ollivier [Thu, 13 Aug 2020 10:04:31 +0000 (12:04 +0200)]
Ease modifying the test list in E2E testing

It eases creating specific CNTT test cases based on K8s E2E testing.

Change-Id: I304960fda760ffc47d763d53511898699f63e356
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMake K8s security tests namespace aware 64/70764/1
Cédric Ollivier [Thu, 13 Aug 2020 10:51:55 +0000 (12:51 +0200)]
Make K8s security tests namespace aware

It now creates a namespace to allow running the test cases twice in
parallel. It also overprotects clean operations to force a full delete.

Change-Id: Ie0becd8ea9126328e7280591bacc0d88e14dd031
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMake K8s_vims namespace aware 54/70754/2
Cédric Ollivier [Thu, 13 Aug 2020 08:34:48 +0000 (10:34 +0200)]
Make K8s_vims namespace aware

It now creates a namespace to allow running the test case twice in
parallel (see DNS requests).

Change-Id: Ib47b3fb2d753f8259d9224cb79168cde68d8e854
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove GOFLAGS in Dockerfile 40/70740/1
Cédric Ollivier [Tue, 11 Aug 2020 20:38:47 +0000 (22:38 +0200)]
Remove GOFLAGS in Dockerfile

Change-Id: Ifc6c63641b9512b4b930c1d7032cae55d2afb811
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove useless repo in site.yaml 16/70716/1
Cédric Ollivier [Tue, 11 Aug 2020 17:23:25 +0000 (19:23 +0200)]
Remove useless repo in site.yaml

Change-Id: Ie5db13dda8dfcaa5bb26e39858448bddee8f6a2c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop building smoke if arm and arm64 15/70715/1
Cédric Ollivier [Tue, 11 Aug 2020 17:22:07 +0000 (19:22 +0200)]
Stop building smoke if arm and arm64

Change-Id: Ifef3eef410cdca58855bda471ef2be49bf3ba64f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDon't build arm containers on TravisCI 13/70713/2
Cédric Ollivier [Tue, 11 Aug 2020 16:17:34 +0000 (18:17 +0200)]
Don't build arm containers on TravisCI

From the time being, they are reaching timeouts.

Change-Id: I5a2d6060f1f1042f630eeafa1876ed434e681e3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoCompile all Functest K8s containers for arm v7 and v8 09/70709/1
Cédric Ollivier [Mon, 10 Aug 2020 19:40:11 +0000 (21:40 +0200)]
Compile all Functest K8s containers for arm v7 and v8

It removes sudo when useless and turns debug on when compiling K8s
binaries. It avoids TravisCI timeouts (No output has been received)[1]

[1] https://travis-ci.org/github/collivier/functest-kubernetes/jobs/716819529

Change-Id: I4719257596bf9a6510e2f772271b336847d1ccb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoOnly upgrade py3-distlib 84/70684/1
Cédric Ollivier [Thu, 6 Aug 2020 19:59:05 +0000 (21:59 +0200)]
Only upgrade py3-distlib

https://travis-ci.org/github/collivier/functest/jobs/715442363

Change-Id: Ib84615def124d38e29582b31af4229325fd3ab1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdated from global requirements 76/70676/2
Cédric Ollivier [Wed, 5 Aug 2020 23:40:15 +0000 (01:40 +0200)]
Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I3a60f9916ff96b1820c72bb9b45b3c919baeade1

3 years agoInstall py3-wheel in functest-kubernetes-core 74/70674/2
Cédric Ollivier [Wed, 5 Aug 2020 15:09:27 +0000 (17:09 +0200)]
Install py3-wheel in functest-kubernetes-core

It fixes all deprecated warnings.

Change-Id: Idd02668fac42a8e0c93d6df5a3e13b788716e873
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoInstall py3-distlib from Alpine Edge 78/70678/1
Cédric Ollivier [Thu, 6 Aug 2020 04:11:50 +0000 (06:11 +0200)]
Install py3-distlib from Alpine Edge

Alpine 3.12 doesn't offer a version compatible with latest OpenStack
constraints [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-gate/68/console

Change-Id: I70930f888d9612d44b73c5d87b9dc1663d02be1c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoBoot Ellis once homestead-depl is ready 17/70517/1
Cédric Ollivier [Thu, 9 Jul 2020 15:10:28 +0000 (17:10 +0200)]
Boot Ellis once homestead-depl is ready

Change-Id: If61a36020f3dfa5ba0a9858df769138257f9ec94
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoImprove vIMS service order 04/70504/1
Cédric Ollivier [Tue, 7 Jul 2020 14:28:10 +0000 (16:28 +0200)]
Improve vIMS service order

It seems fixing the last side effects.

Change-Id: Iee8506c2f0048f7c2619b772aea815288a40145e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate to go 1.14 02/70502/1
Cédric Ollivier [Tue, 7 Jul 2020 08:29:21 +0000 (10:29 +0200)]
Update to go 1.14

https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/116/console

Change-Id: I8559ee71fe05682792728a62baa628c8199dfdd6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove energy from logging configs 94/70494/1
Cédric Ollivier [Tue, 7 Jul 2020 08:11:43 +0000 (10:11 +0200)]
Remove energy from logging configs

Change-Id: I35c15aa68fe1afadcdbf3d391febb166358c90be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove distlib from OpenStack constraints 93/70493/1
Cédric Ollivier [Tue, 7 Jul 2020 07:51:07 +0000 (09:51 +0200)]
Remove distlib from OpenStack constraints

It raised side effects wih Alpine [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-core-docker-build-amd64-master/126/console

Change-Id: If52bff670c7646e7cdc6703a6ed397a23a2be2b9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoManage Ims service dependencies 87/70487/1
Cédric Ollivier [Mon, 6 Jul 2020 18:09:41 +0000 (20:09 +0200)]
Manage Ims service dependencies

Change-Id: I6647d9acfabd2ce2d12ff2f30393c2de8f6165ff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoApply Rally patch (switch to threading for tasks) 02/70302/1
Cédric Ollivier [Mon, 8 Jun 2020 08:16:32 +0000 (10:16 +0200)]
Apply Rally patch (switch to threading for tasks)

Change-Id: I8f4df2d4c220edc538c743cccce8050efe4a1140
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate to alpine3.12 89/70289/2
Cédric Ollivier [Sat, 6 Jun 2020 16:04:35 +0000 (18:04 +0200)]
Update to alpine3.12

https://alpinelinux.org/posts/Alpine-3.12.0-released.html

Change-Id: I3c95f0867c4364b93fd8ba14093710b7c0fdda8d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoTry a quick fix vs the race conditions in xrally 61/70161/1
Cédric Ollivier [Tue, 5 May 2020 21:43:23 +0000 (23:43 +0200)]
Try a quick fix vs the race conditions in xrally

Change-Id: I57a4c317ba365586c10b13d425aac021dd030949
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDisable perm check 10/70110/1
Cédric Ollivier [Fri, 1 May 2020 14:14:14 +0000 (16:14 +0200)]
Disable perm check

.travis-ci applies a false umask

Change-Id: I8e93d64019fffe0a88cd49c565a40419a491f5a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoImprove Ims coding 89/69889/2
Cédric Ollivier [Sat, 4 Apr 2020 16:35:16 +0000 (18:35 +0200)]
Improve Ims coding

Change-Id: Id8b042fd38399f0cf1868f67b5a3f4f1b4f2ef0d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoMerge "Drop py27 verification"
Cedric Ollivier [Wed, 29 Apr 2020 13:27:46 +0000 (13:27 +0000)]
Merge "Drop py27 verification"

4 years agoUpdated from global requirements 54/70054/1
Cédric Ollivier [Wed, 29 Apr 2020 10:41:36 +0000 (12:41 +0200)]
Updated from global requirements

Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I648dae3ff1573edcdf75df6806527a8427c21edf

4 years agoDrop py27 verification 47/70047/1
Cédric Ollivier [Wed, 29 Apr 2020 09:56:04 +0000 (11:56 +0200)]
Drop py27 verification

Rally dropped py27 support.

Change-Id: I298088905dab16a0b085d7f47aa90a74b253a5d6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix phase conditions 83/69783/1
Cédric Ollivier [Sun, 15 Mar 2020 16:15:38 +0000 (17:15 +0100)]
Fix phase conditions

Else it waits 20 minutes for nothing [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-k8s_vims-run/5/console

Change-Id: I6427f28975b465ef503f9a3f2868b878fa92b55e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPublish debug logging config 82/69782/1
Cédric Ollivier [Sat, 14 Mar 2020 12:22:29 +0000 (13:22 +0100)]
Publish debug logging config

Change-Id: I6a42fdeb20e0d549819c327e92e138c28dc927e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix project name in security's testcases.yaml 81/69781/1
Cédric Ollivier [Sat, 14 Mar 2020 09:05:08 +0000 (10:05 +0100)]
Fix project name in security's testcases.yaml

Change-Id: I7770873b2f7d61db05a9546631fdc2d4ddf3d20c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoOverride the right log files 80/69780/2
Cédric Ollivier [Sat, 14 Mar 2020 07:30:33 +0000 (08:30 +0100)]
Override the right log files

Else Xtesting publishes the default xtesting.log [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-security-latest-kube_hunter-run/2/console

Change-Id: I0b9b9eda04762771d4e10f0d124b4d5f2975a4da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoTake latest test cases into account 79/69779/1
Cédric Ollivier [Fri, 13 Mar 2020 15:39:16 +0000 (16:39 +0100)]
Take latest test cases into account

It adds k8s_vims, kube_bench and kube_hunter.

Change-Id: I13ead6e23c675a6ed2e70d95914cbf7cf9d54842
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd security docker for functest-kubernetes 63/69663/4
mrichomme [Mon, 10 Feb 2020 16:49:43 +0000 (17:49 +0100)]
Add security docker for functest-kubernetes

run kube-hunter and kube-bench cases dealing with security in kubernetes (check
vulnerabilities) [1][2]

It's the first step only printing the output.

[1]: https://github.com/aquasecurity/kube-bench
[2]: https://github.com/aquasecurity/kube-hunter

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0
Signed-off-by: mrichomme <morgan.richomme@orange.com>
4 years agoDeploy Clearwater IMS using Kubernetes 75/69775/5
Cédric Ollivier [Thu, 12 Mar 2020 16:31:56 +0000 (17:31 +0100)]
Deploy Clearwater IMS using Kubernetes

The new testcase "k8s_vims" deploys and tests Clearwater IMS using
Kubernetes. It follows the procedures proposed by clearwater-docker [1].

[1] https://github.com/Metaswitch/clearwater-docker

Change-Id: I2fe3cd03a5dedfc61fbab294c53b4bc0b0fa70be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove Kubernetes.create_check_and_delete_daemonset 62/69762/1
Cédric Ollivier [Sun, 8 Mar 2020 16:30:22 +0000 (17:30 +0100)]
Remove Kubernetes.create_check_and_delete_daemonset

It seems incorrect as Rally tired waiting to become 3 pods [1]
Here are the nodes:
- control-plane
- worker
- worker

[1] http://artifacts.opnfv.org/functest-kubernetes/0LMEWUMSA2U6/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run-157/xrally_kubernetes/xrally_kubernetes.html

Change-Id: I19bb19eb1e0f2ae66a64532d99d4a59f82651a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate Alpine to 3.11 02/69502/2
Cédric Ollivier [Sat, 4 Jan 2020 21:10:48 +0000 (22:10 +0100)]
Update Alpine to 3.11

It also updates Python to 3.8 (default version).

https://alpinelinux.org/posts/Alpine-3.11.0-released.html

Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDisable false ansiblelint warnings 85/69285/1
Cédric Ollivier [Sat, 7 Dec 2019 13:15:02 +0000 (14:15 +0100)]
Disable false ansiblelint warnings

git commit has to be executed via shell module [1].

[1] https://github.com/ansible/ansible/issues/50334

Change-Id: Ie4595f7bc2b54545b2f824f5ac3fb1d20340f13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate package index before install packaging in CircleCI 20/69120/1
Cédric Ollivier [Wed, 27 Nov 2019 10:30:13 +0000 (11:30 +0100)]
Update package index before install packaging in CircleCI

Change-Id: I5f61bfdcfa7efa7dfe0a3cf379770e79334de90e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoCorrectly override dir_results and res_dir in rally_kubernetes 17/68917/1
Cédric Ollivier [Sun, 17 Nov 2019 09:27:46 +0000 (10:27 +0100)]
Correctly override dir_results and res_dir in rally_kubernetes

Both have to be modified else publishing artifacts fails [1].

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-jerma-xrally_kubernetes-run/47/console

Change-Id: If21334d7d1342737575f9a260a0ad647c4f382e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd mailcap in dependencies 13/68913/1
Cédric Ollivier [Sat, 16 Nov 2019 17:03:09 +0000 (18:03 +0100)]
Add mailcap in dependencies

It allows detecting mimetypes.

Change-Id: Ieeae5e92142daab2ea724f1c332a71a8b0c63102
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoCorrectly override dir_results and res_dir 01/68901/1
Cédric Ollivier [Sat, 16 Nov 2019 13:07:49 +0000 (14:07 +0100)]
Correctly override dir_results and res_dir

Both have to be modified else publishing artifacts fails [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run/139/console

Change-Id: Ieefee6a9a61452bb4f23d40f75b60280803cd215
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate to Xtesting 0.82 47/68847/2
Cédric Ollivier [Sun, 10 Nov 2019 08:19:13 +0000 (09:19 +0100)]
Update to Xtesting 0.82

It overrides the default log files.

Change-Id: I6a1f9951b47b761e4e1832140181a57dd886117c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate to Go 1.13 09/68809/1
Cédric Ollivier [Thu, 7 Nov 2019 21:34:03 +0000 (22:34 +0100)]
Update to Go 1.13

It's asked by Kubernetes master [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/90/console

Change-Id: I0fdd06944fea8ce328e16459e6cf4a9e2c6fa4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSelect go 1.12 instead of 1.13 (rolling) 14/68514/1
Cédric Ollivier [Fri, 20 Sep 2019 03:45:21 +0000 (05:45 +0200)]
Select go 1.12 instead of 1.13 (rolling)

Functest K8s container builds failed [1]

[1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-kubernetes-docker-master/94/

Change-Id: I3da0ebf05e1dd25b7fb609e0e851c07ed1722723
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove Features containers 15/68415/1
Cédric Ollivier [Sat, 31 Aug 2019 09:20:46 +0000 (11:20 +0200)]
Remove Features containers

Most the features are stopped and Functest shouldn't host dead code.
Functest is a framework (Docker and Python modules) which can be still
reused by any third-party (OPNFV Feature or anything else) in its tree
and CI

Change-Id: Ie2f5beddd21b09aabfbdf2bb2f3366e652d43b3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoConforms with latest changes in Xtesting ansible role. 85/68385/1
Cédric Ollivier [Thu, 22 Aug 2019 13:16:32 +0000 (15:16 +0200)]
Conforms with latest changes in Xtesting ansible role.

It selects the generic way to set execution-type [1].

[1] https://github.com/collivier/ansible-role-xtesting/commit/292ab576fb8f0a13519bacc5ec46561a3ed8f838

Change-Id: I8b4d7dc3433cc210cd9eac180a1f247286ac1d7e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRun Functest K8s unit tests via CircleCI 37/68337/1
Cédric Ollivier [Sat, 10 Aug 2019 12:59:41 +0000 (14:59 +0200)]
Run Functest K8s unit tests via CircleCI

It runs tox and published the artifacts.
It's worth mentioning that all docker images are already built via
Travis CI (amd64, arm and arm64) [1].

https://travis-ci.org/collivier/functest-kubernetes

Change-Id: I668481c123adfbfddb4f41feec1ebcec7c75f85d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>