Install setuptools_scm before xrally

Else upper-constraints basically fails.

Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)

Move former wiki to README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=20742412

Change-Id: I75a9303b2ee5b2df66e0169b37408bb9ad881d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 15f754678e4c8734c4600fea94fcbe66f2584515)
(cherry picked from commit a33e2fe3956ce5dcf0893454131121af8e73f863)

Fix CVE-2020-8231

https://build.opnfv.org/ci/view/functest-kubernetes-trivy/job/functest-kubernetes-opnfv-functest-kubernetes-benchmarking-iruya-trivy/2/console

Change-Id: I3dac33ee5d292374f28ee7394324f5e27cd0e318
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix CVE-2020-8231

https://build.opnfv.org/ci/view/functest-kubernetes-trivy/job/functest-kubernetes-opnfv-functest-kubernetes-benchmarking-hunter-trivy/1/console

Change-Id: Icd687fbc1f99a1a741271179dc2289cc884f1bdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Upgrade system first

Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9ebe47c8458c99066fd71a65007fff923004d209)

Allow parameterizing K8s versions

ONAP integration team asks to support all K8s versions.
A couple of OPNFV releases will allow testing 2 K8s versions.

Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0163bb977604a32a0c46e10a97313ce0feea7b5f)

Update cnf-conformance to v0.9.19

It also adds configs needed by resilience.

https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19

Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7385caf54c27b471bda8599d491aa3aee21b7b89)

Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: Ic3770f4098c52b0d26bc62291c9e79e8ee81d107
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0c99749bb65cadd0142c90cd73e13802d48cb7f6)

Allow offline testing via xrally_kubernetes

It locally patches xrally_kubernetes before [1] is merged upstream.
It adds docker.io/appropriate/curl:edge in download_images.sh too.

[1] https://github.com/xrally/xrally-kubernetes/pull/51

Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com>
Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ea2715240015a482c5321d309257d801a412f02d)

Reduce cnf-conformance criteria

It's considered as passed vs 95 out of 105 [1].

[1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log

Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 53b16e8f00e5a60db2e6db7f375bd06f184a5cc8)

Update cnf_conformance to v0.9.4

It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts
to the new cnf-conformance result output logic.

It runs all workload tests as it's now proposed (k8s conformance
is already part of smoke) and select the latest coredns
cnf-conformance.yml taking latest helm repo changes into account.

It sets criteria 95 as all steps are considered as passed and a
overall result 100/105.

[1] https://github.com/cncf/cnf-conformance/issues/388

Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 854f164998793000fcf8019214b259b7283f5194)

Skip cnf_conformance till helm repos are fixed

Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 30a5a084fa9e0c8677d70d8b1d7a696ea06b49b9)

Add timeout as needed by Gitlab CI/CD

Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for both test cases even if only k8s_conformance
reaches 1h (XtestingCI design).

Change-Id: Ieaef1cefb3dfc7f9ca47b1ce8ec082409fa52604
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f38caec124b925f8c633f9d8b4474bd1085638a2)

Split Gates in a dedicated site.yml

Change-Id: Id41d92d83748e6680d2d91723b11c19315230cb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Split kube_bench_master and kube_bench_node in site.cntt.yml

Change-Id: Ifb9a5ac2fac7286d5f3f5e677fc2a7ecda6ade25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 687723872c04c4b889cf4b529f6534776b16908d)

Stop hardcoding ims- as generate_name

Change-Id: I3ea22a4050ff1eb609cffb61edc41c49fab44366
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3a3bd294ea8101c22896d8601fe2723861f73124)

Redirect helm false warnings to logs

Helm fails when detecting arch if qemu.
time="2020-09-17T16:25:15Z" level=error msg="failure getting variant" error="getCPUInfo for pattern: Cpu architecture: not found"

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-arm64-latest-helm_vims-run/1/console

Change-Id: Ida37062a780f9e2acf60035bf2d41fb8fbb61173
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit aed4dd8a97dbfcb9d0558f2df8f8ef8696f2c421)

Add helm_vims in site.cntt.yml

https://github.com/cntt-n/CNTT/pull/2022

Change-Id: Icb4bdfa0c1ecca9d0c5b4d5beef7ff4c5edb289e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63476e09e51c5c847df47b0855ee9d1b0ea1add1)

Publish helm_vims also based on clearwater-docker

It leverages helm rather than kubectl as proposed by k8s_vims.
A new abstract class Vims is added to factorize code between both
testcases.

Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 32dfc10f56ead9abea8798e1ce16fe87652ca480)

Increase timeout in vIMS

It depends on bandwidth.
30 minutes should be enough in all scenarios

Change-Id: Ieaad053c8f8a270e5da08275de217b15fdf17f44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f6e86e451a0f5bf0e9775482c487d86249b935bd)

Don't run disruptive hunter checks

Change-Id: I52cb8303950269946774546cf8e413166c70a33c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4fa706f4b37d655f2239ad9381df8041e0701142)

Split kube-bench master and node

The former deployment asked for all-in-one.

Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bced94b6fe24c7e939fb22834deb77477e4a9bb9)

self.details must be a dict

Change-Id: I4f65a9eeb7eda471371668db9abfa49e2875c5b0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b866c73d70079fdb52e5fc999f49a32d2af82349)

Improve kube_bench output

It also fills self.details.

Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 823b3a005ace9372a080421b2ae19152505201e4)

Enhance kube-hunter result postprocessing

It fills self.details and checks if the test case passes according
to criteria (severity = high by default)

Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4f197110710e9f148eae4533792e8e7e2d72f053)

Avoid running VNF testing if deployment failed

Change-Id: Id7642e47ec2cc438c5fe3a0ec9447f72b358adab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3afa7d700eebf2bfcaabab7bdd3aa09198ba4fe0)

Add clusterIP: None in ims svc.yaml

Change-Id: I0709e83f32261af232c20f94c1edef7423e05527
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 70d96ca61f1f11aafcf9e6975e61bce41febd371)

Remove clusterIP: None in ims svc.yaml

It now works on minikube in addition to Functest gates.

Change-Id: I314989516f81dcddb3e615fe23480135f1d8cf9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 757fcb55867aa8c0545543a87ec9741827e9ab50)

Allow setting e2e non blocking taints via env vars

Change-Id: I8132769ea23a376b2cae8b93beed27f5e66b9207
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d4af425da9a60c0eb8e80cb74972b99e3deadeb8)

Add quay.io/coreos/etcd:v2.2.5 in download_images.sh

Change-Id: I4b5da162dcb1efff810514498a20250c05afb3ba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ef4ef77dfda94d02e2d933318c1b0072da224e43)

Publish CNTT RC2 playbook

It runs the mandatory CNTT test cases [1].

[1] https://github.com/cntt-n/CNTT/commit/6af033c254727b7405fbfb2efbaa023e2b8ba876

Change-Id: I87d381c78049f7309c564791ed701cf446cc85d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 463f233c0abb77f6758e7c39fa05b5c118fbaf1f)

Add helper to download all images

It eases offline testing.
The default command leverages kind as in-use in Functest.

Change-Id: I66a20ede5e857f80cf49b9b708843034bc3b9904
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6d0b76bf364581b23e06f342d2d78c574a164512)

Set all image tags

It allows offline testing via xrally_kubernetes, k8s_vims, kube_bench
and kube_hunter.

Change-Id: I3084abec19f06a894d0083ecb3ed61882eddd785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8d748b9efc9ed4ed3edb4eaaf09909e41fe29577)

Remove latest in all images

The Kubernetes default pull policy is IfNotPresent unless the image tag
is :latest in which case the default policy is Always. IfNotPresent
causes the Kubelet to skip pulling an image if it already exists [1]

[1] https://kind.sigs.k8s.io/docs/user/quick-start/

Change-Id: I83dac6165d2bbef165ca852dd03e5b76a5356f2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 44492e0da74473460ff6a9f1323c5df3a2af943e)

Remove all imagePullPolicy: Always in ims depl yaml

It forbids offline testing.

Change-Id: I6790f64fd1382671300374b339ae038ef015cfab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6371491ee2bc134c60abaa6a1deec18b9ffe22e2)

Fix K8s release in cnf/Dockerfile

Change-Id: I8029e422e93f318c3254a8545ec9bf9ad9e19ee3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Override default Xtesting logs in cnf-conformance

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/7/console

Change-Id: Ia6845525e62274f7792b4cb1909f36204fb51418
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e09c7eeab3a1bdc361769e469c0ec7a7b5718ebf)

Decreate cnf-conformance criteria

conf-confirmance is beta.
Let's decrease criteria to allow gating [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console

Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 12d6bc18b178d4a8a4f64574bd6549341268645a)

Slightly generalize ginkgo params

Change-Id: I51b013056bb5b88ef2e1de31e9171129e8ce4475
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0ec2aa15acbe7cd2b28d772165c22481b85bad79)

Publish k8s_quick as proposed by sonobuoy

https://github.com/vmware-tanzu/sonobuoy

Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 711d9f1d875816386fd4afeb2e79f8d2de47b036)

Conform with latest sonubuoy's non disruptive list

https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43

Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit de3a7000a3173f0242cbf7bfcdd6a18d8678e0ae)

Update Xtesting to 0.91.0

Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b198dcede7578b1c3bf688cd47cc0590dd8d6d14)

Allow skipping arm and arm64 if cnf-conformance

cnf-conformance doesn't support this architectures.
It also improve cleaning to publish artifacts [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console

Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2cf6903c9a805b9c1b7702292bdf33b9485be319)

Add cnf-conformance in functest-kubernetes-cnf

It selects cnf-conformance v0.7.2-beta1 (current latest release) and
the default CNF as proposed by [1].

The end user is free to override the default yml files on purpose (e.g.
docker volumes). Tag (default: all) could be modified too via
testcases.yaml

[1] https://hackmd.io/@vulk/SkY54QnsU

Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 120daffd8d6d4be727d2ba52a76dbd8eacfe2628)

Increase cassandra timeouts

homestead-prov sometimes fails reaching cassandra
30-08-2020 10:33:44.064 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code
30-08-2020 10:34:32.257 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code

Change-Id: I48566e39dca3dc9644733a76140a76300bbfd84e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e236b0f56f748c888df23eeaf65478967ad852f1)

Stop pushing all details in Test DB

It raises 413 Client Error: Request Entity Too Large for url [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console

Change-Id: I165f7aec53d8ce1e567491a5b5559f00b1fe4a4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1f720b0fabbcf162366160a4fa9a46807e53f8bc)

Set output logs in Rally testcases

https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console

Change-Id: I13685d74ce9e286520af6f1e5cd6ce9dafc3d5ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 42c2bbed87779218a8fe43c4c5c3012c64bec17b)

Fix last hardcoded concurrencies

Change-Id: Ib2b7bb6de8cd6524fcc52baf48ebf5c4835c396b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8a8f6eafc3c6268a3663852f7de8f0cc4c39b817)

Add xrally_kubernetes_full

It iterates 10 times all operations run by xrally_kubernetes.
Now times, concurrenty and count can be set via testcases.yaml.

It creates a new containers functest-kubernetes-benchamrking as
Functest.

Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a0f76d884c1f13c27e906136d3418f12b5342fc4)

Add tempo waiting for ellis account

Change-Id: I63c6af9d0e20aab426e7f875cdb4f86d206f49aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3c7965bb37590eae9e968a530eaaa690ada903f2)

Safely decode e2e.test output

https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-healthcheck-arm-latest-k8s_smoke-run/2/console

Change-Id: I57f3ae0051fb55c8c80de81e79168e61c06d85bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 64771ca4e6965c81aa2922c7efc44e4f7a38a610)

Leverage alpine rather than golang

golang is now useless as we stop compiling kubernetes binaries.

Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1af6a5dc4ec8e087613275e912c819ea1d0aecbc)

Fix arm -> arm64

Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit aa3d694b2c288521b6e3f96ea020a3ac485d4d14)

Stop compiling K8s testing binaries

It reaches Travis CI timeouts and is quite useless.
PyNaCl is now installed via Alpine packages to save CI.

Change-Id: Ifdf3f46f162a811ed95e3ca07ea7c3d89bc77a91
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6801612e85c485e9885cfb41cbc84771475a134f)

Update K8S_TAG to v1.17.11

Change-Id: Ia6cb48e3e009ed38588972e8c8fd02c2d8cd4cf3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Pin latest versions from security tools

It selects kube-bench and kube-hunter 0.3.1.

Change-Id: Icb85f3d0d88056370500ec827ef77c215740e5e4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6b8384b57a0bfc200c15ed9ded71544c33a27e81)

Conform with Functest pylint config

Change-Id: Ie12d17a32fe8ee7ee212a6a4acf6aec107377390
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9cd357b94e7bdb7b8cce73a2666a7547e2a5d7c8)

Merge "Make K8s_vims namespace aware" into stable/jerma

Merge "Ease modifying the test list in E2E testing" into stable/jerma

Ease modifying the test list in E2E testing

It eases creating specific CNTT test cases based on K8s E2E testing.

Change-Id: I304960fda760ffc47d763d53511898699f63e356
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a22553a65d6019350c215c9024c9dc54cf77dc7c)

Make K8s security tests namespace aware

It now creates a namespace to allow running the test cases twice in
parallel. It also overprotects clean operations to force a full delete.

Change-Id: Ie0becd8ea9126328e7280591bacc0d88e14dd031
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8e2a7dbee8f134dbe9022683d40e2328e5e50fe6)

Make K8s_vims namespace aware

It now creates a namespace to allow running the test case twice in
parallel (see DNS requests).

Change-Id: Ib47b3fb2d753f8259d9224cb79168cde68d8e854
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 019101492b51aa74412265cd99ba1a9e27a3de8c)

Fix sed if arm in build.sh

Change-Id: I4d3f54b1b56fbc0b272d1ee178e6ea406268c658
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove GOFLAGS in Dockerfile

Change-Id: Ifc6c63641b9512b4b930c1d7032cae55d2afb811
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit fac999583784f6e3b2c64294f2347fdf8a7a64f0)

Complete the previous git cherry-pick

Change-Id: Id899e3a2919bd74a62e471eb2ada9dd81b2492a1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove useless repo in site.yaml

Change-Id: Ie5db13dda8dfcaa5bb26e39858448bddee8f6a2c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 07f59c24077e3d7906371eb2f8e2ec6458c2ff85)

Take latest test cases into account

It adds k8s_vims, kube_bench and kube_hunter.

Change-Id: I13ead6e23c675a6ed2e70d95914cbf7cf9d54842
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit adaa8ba5907040fdd8198d3fb801256021514dd5)

Stop building smoke if arm and arm64

Change-Id: Ifef3eef410cdca58855bda471ef2be49bf3ba64f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1cdb84efbb57d3bd45d13cf9941ccd93aeef9d6f)

Don't build arm containers on TravisCI

From the time being, they are reaching timeouts.

Change-Id: I5a2d6060f1f1042f630eeafa1876ed434e681e3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e4704c75d6beca998c388b60c57580d2918a89d1)

Compile all Functest K8s containers for arm v7 and v8

It removes sudo when useless and turns debug on when compiling K8s
binaries. It avoids TravisCI timeouts (No output has been received)[1]

[1] https://travis-ci.org/github/collivier/functest-kubernetes/jobs/716819529

Change-Id: I4719257596bf9a6510e2f772271b336847d1ccb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3c4543a8ef6f84a5f25483a6dfe50e0075a9cd0e)

Boot Ellis once homestead-depl is ready

Change-Id: If61a36020f3dfa5ba0a9858df769138257f9ec94
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5bc18405d75e9d765cd707ff9a98c3553de4b0dd)

Fix phase conditions

Else it waits 20 minutes for nothing [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-k8s_vims-run/5/console

Change-Id: I6427f28975b465ef503f9a3f2868b878fa92b55e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 83d3161c52c8cc8d9e4f52d7a693bbcc32508379)

Override the right log files

Else Xtesting publishes the default xtesting.log [1]

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-security-latest-kube_hunter-run/2/console

Change-Id: I0b9b9eda04762771d4e10f0d124b4d5f2975a4da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 36039d940f473d7385d918375390e804b626bad2)

Improve vIMS service order

It seems fixing the last side effects.

Change-Id: Iee8506c2f0048f7c2619b772aea815288a40145e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f7b45c10ef78a96f33568d2480ca79efbbd72505)

Remove energy from logging configs

Change-Id: I35c15aa68fe1afadcdbf3d391febb166358c90be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 62b861884f55815e00b24f3aca6acb95e0f804b9)

Publish debug logging config

Change-Id: I6a42fdeb20e0d549819c327e92e138c28dc927e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7168abb7509750ece58fa501a56a8b1ebad2dbf8)

Manage Ims service dependencies

Change-Id: I6647d9acfabd2ce2d12ff2f30393c2de8f6165ff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 68b2a9ac43003840ae0b88bf3b2cd6c1fc10db21)

Fix former pep8 issues

It's allowed by the newer version

Change-Id: Ief4cb2f0cce8da8af6e0bee275772f0940f56d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Improve Ims coding

Change-Id: Id8b042fd38399f0cf1868f67b5a3f4f1b4f2ef0d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dbe25c73b976a8a3d9b5c10dc92b8c9a17c68baa)

Deploy Clearwater IMS using Kubernetes

The new testcase "k8s_vims" deploys and tests Clearwater IMS using
Kubernetes. It follows the procedures proposed by clearwater-docker [1].

[1] https://github.com/Metaswitch/clearwater-docker

Change-Id: I2fe3cd03a5dedfc61fbab294c53b4bc0b0fa70be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 080d2414682d5fecea8c01640e2e5971278fe19d)

v1.17.4 -> v1.17.8

Change-Id: I3e2100596366136f8f79aa241e709487cee57361
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix project name in security's testcases.yaml

Change-Id: I7770873b2f7d61db05a9546631fdc2d4ddf3d20c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2649efe3166ec1525f825bf21b63e6eb53aaaac6)

Add kubernetes in requirements

Change-Id: I8e1bf595ca090a9c3b4d10a60d22a38abc1117f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add security docker for functest-kubernetes

run kube-hunter and kube-bench cases dealing with security in kubernetes (check
vulnerabilities) [1][2]

It's the first step only printing the output.

[1]: https://github.com/aquasecurity/kube-bench
[2]: https://github.com/aquasecurity/kube-hunter

Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0
Signed-off-by: mrichomme <morgan.richomme@orange.com>
(cherry picked from commit 98d9f93337ab514fa9aafc1cd1e87473de68b364)

Apply Rally patch (switch to threading for tasks)

Change-Id: I8f4df2d4c220edc538c743cccce8050efe4a1140
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bfd0063c81f5d5d4fad2389832c8f1479a28f73d)

Try a quick fix vs the race conditions in xrally

Change-Id: I57a4c317ba365586c10b13d425aac021dd030949
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 81139b1576981990f32df76719f179441e4d12ee)

Disable perm check

.travis-ci applies a false umask

Change-Id: I8e93d64019fffe0a88cd49c565a40419a491f5a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6099914e9832592ac63f0d3505ea3466eb13117d)

Remove py27

rally dropped py27 support

Change-Id: Ib8a7dc634cc81930dcbea5234eb4509ad93af267
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update K8S to v1.17.4

Change-Id: I04c7cbc5281abffd458b1fc75e924f8dd3e70c3f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove Kubernetes.create_check_and_delete_daemonset

It seems incorrect as Rally tired waiting to become 3 pods [1]
Here are the nodes:
- control-plane
- worker
- worker

[1] http://artifacts.opnfv.org/functest-kubernetes/0LMEWUMSA2U6/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run-157/xrally_kubernetes/xrally_kubernetes.html

Change-Id: I19bb19eb1e0f2ae66a64532d99d4a59f82651a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit efee842caa2585c2174c9b780ea1d33f69c69f2e)

Update K8S_TAG to v1.17.3

Change-Id: I88dd9c19a6a44d00154c676a53ece6748394ea1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update go for Kubernetes v1.17

Kubernetes v1.17 requires go1.13.4 or greater.
It completes "Update to K8S_TAG v1.17.0" [1].

[1] https://git.opnfv.org/functest-kubernetes/commit/?h=stable/jerma&id=6013753b39971c5d246f7e39574a8176065a5aaf

Change-Id: Ia247930811c20526a157d61f3a86f7abf558f68c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to K8S_TAG v1.17.0

It updates to the latest K8s stable version.

Change-Id: Iac85e8d5139eb27e689eb6d8357a55f3308471d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Disable false ansiblelint warnings

git commit has to be executed via shell module [1].
it also fixes Functest branch

[1] https://github.com/ansible/ansible/issues/50334

Change-Id: Ie4595f7bc2b54545b2f824f5ac3fb1d20340f13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit abe7e05d27f7801b902821a85186dca0c9e563ae)

Update package index before install packaging in CircleCI

Change-Id: I5f61bfdcfa7efa7dfe0a3cf379770e79334de90e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6119abf09d3d5a98509619b650b054aca2edbceb)

Correctly override dir_results and res_dir in rally_kubernetes

Both have to be modified else publishing artifacts fails [1].

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-jerma-xrally_kubernetes-run/47/console

Change-Id: If21334d7d1342737575f9a260a0ad647c4f382e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 004d28383111d344aeb82ba9080c7c015970c9bb)

Add mailcap in dependencies

It allows detecting mimetypes.

Change-Id: Ieeae5e92142daab2ea724f1c332a71a8b0c63102
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bee77a2c2c6571c622a8e533ed0b80cdb49302ea)

Correctly override dir_results and res_dir

Both have to be modified else publishing artifacts fails [1].

[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run/139/console

Change-Id: Ieefee6a9a61452bb4f23d40f75b60280803cd215
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63ef7413921dcd06d4bd15ae59a20da811cfe7d3)

Update to Xtesting 0.82

It overrides the default log files.

Change-Id: I6a1f9951b47b761e4e1832140181a57dd886117c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63b56cf0740fd5e2e0b7b022e287b27ddb898dee)

Fix sed calls in build.sh

Change-Id: I880c49c1f56256813e400076d49a49de9b1b0203
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>