Get the right K8s e2e version

Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set defaultbranch in .gitreview

Change-Id: I7e0c95e9c2e61bf7d8e29e07ecff92835051a871
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Feature:ProxyTerminatingEndpoints

It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.

Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Revert latest docker builds

This reverts commit b2be1ff2852320940a1450ed5f2a6f4f4e91d7da.

Change-Id: If2852d6e85e11872fd0f2839445de014427dc535
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Install libxml2 and libxslt

Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)

Prepare v1.24 docker builds

Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Leverage Xtesting 0.96

Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Outdated need to install python2.7-dev in CircleCI

Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove constraints on flake8

Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update active releases in README.md

Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip new Feature testing

It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]

Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update linters and fix all new issues

It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.

Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set defaut provider to local back

It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.

Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set encoding utf-8 when opening file

Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fallback to item calculation

There is no final result if simple tag is called.

Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update CNF_TESTSUITE_TAG to v0.15.0

Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove sig_network_serial

PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].

sig_network_serial is now enpty and then can be safely removed.

[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238

Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove SIG CLI testing

It conforms to https://github.com/cntt-n/CNTT/pull/2579

Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Swith to v1.23 alphas

Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix py site-package path

Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.14

It also disabled wrong order check as it fails vs kubernetes amongst
others.

[1] https://github.com/PyCQA/pylint/issues/2175

Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip git_repo testing

As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".

[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console

Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Print cnf_testsuite console on exceptions

Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove k8s.io from ansible/site.yml

It's now up-to-date.
It also fixes ansible/site.cntt.yml

Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Make clear all skipped Features according to CNTT RA2 Chapter6

Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow passing extra opts to e2e.test

E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd

Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add enchant in travis-ci

Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch to focal in travis-ci gates

Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove six from Openstack requirements

  Attempting uninstall: six
    Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update cnf_testsuite to v0.11.2

https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2

Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Easy creating next netperf branches

Change-Id: If3de6a18b7edd811157cb093434a7128617475d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Publish patch for plotperf

Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Benchmark Kubernetes Networking Performance

https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf

Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update test case results in README

Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Disable cnf_testsuite in master

cnf_testsuite asks for an official stable Kubernetes release
during cnf setup. It doesn't work defacto for Functest K8s master
(currently next v1.22).

Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update skip Feature lists

Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix cnf-conformance results filename

It also decreases criteria to 1 due to massive changes (dockerd).

Change-Id: Ic420139e6355debae183a77d6b0c574801b05076
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update cnf-conformance to cnf-testsuite

https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite

Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce number of threads

It passed successfully with 10 threads (more doesn't reduce the
overall duration so much).

Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update master to next 1.22

Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Mock os.makedirs

Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Install setuptools_scm before xrally

Else upper-constraints basically fails.

Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)

Skip Network.should.set.TCP.CLOSE_WAIT.timeout

https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml

Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove sig_node_serial as it's fully disruptive

There is no other test when NoExecuteTaintManager is skipped.
http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log

Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature

kind master allows dualstack since [1]

[1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551

Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove [k8s.io] testing

v1.21 enforces sig ownership of all e2e tests [1].

[1] https://github.com/kubernetes/kubernetes/issues/98326

Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch to latest-1.21

Else it would consider v1.22.0-alpha.0 (N+2).

Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update test case list

Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add k8s_io and serial test cases

It completes the first sig test cases.

Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge sig_network_features in sig_network

Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Spit conformance into 2 test cases

It hugely decreases the overall test duration.
(10 + 15 << 120)

Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix etcd image repository in etcd-depl.yaml

Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix name in chronos-depl.yaml

Change-Id: Ia6972a216daaa9d807058b34b55615cab2c09b64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run opnfv/functest-kubernetes-smoke sequentially

Now multithreading is enabled at test case level.

Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Properly manage e2e parallel testing

It sets nodes=25 to run all tests in parallel.
It also beautifies all testcases.yml

Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rather use skeleton instead of local

“skeleton”: cluster is accessed via the Kubernetes API and nothing
else.

https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/

Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Disable sig_scheduling as serial

All remaining sig-scheduling tests are serial and for the time
Functest doesn't run serial test cases.

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console

Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove the useless Feature prefix

Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Exlude Serial and Feature:Feature:StorageVersionAPI"

Merge "Blacklist all alpha testing"

Exlude Serial and Feature:Feature:StorageVersionAPI

Serial asks to split the testcases into 2 runs.

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console

Change-Id: I58f9d9023f596141bbefae8339043f813a124854
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Blacklist all alpha testing

Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

 Provide support for air gapped env for e2e

 Sometimes, tested Kubernetes doesn't have direct access to Internet but
 access through repository mirrors.
 This patch handles this case for e2e test case.

Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: Iaa2960ad03aae1fff859d41bcd6ddf3176658f8e

Provide support for air gapped env for ims

Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.

This patch handles this case for ims test cases.

Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: I3b5e78fcf43ca7af6bcfd2d87fa4bb0705373697

Provide support for air gapped env for security

Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.
This patch handles this case for security test cases.

Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: I699d065ee691596c4a5ccf06c22ea76ef00fe497

Add missing blackslashing

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console

Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_node

It runs sig-node tests which are not included in K8s conformance.
It adds 38 single tests.

Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_cluster_lifecycle

It runs sig-cluster-lifecycle tests which are not included in K8s conformance.
It adds 4 single tests.

Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_instrumentation

It runs sig-instrumentation tests which are not included in K8s conformance.
It adds 6 single tests.

Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_scheduling

It runs sig-scheduling tests which are not included in K8s conformance.
It adds 19 single tests.

Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_cli

It runs sig-cli tests which are not included in K8s conformance.
It adds 34 single tests.

Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig-apps

It runs sig-apps tests which are not included in K8s conformance.

Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig-auth

It runs sig-auth tests which are not included in K8s conformance.

Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig-api-machinery

It runs sig-api-machinery which are not included in K8s conformance.
It adds 97 single tests.

Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Provide support for air gapped env for rally

Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.
This patch handles this case for rally test case.

There's two ways for providing the repository mirrors:

- Give an environment variable (`MIRROR_REPO`) which gives a repository
  mirro with all needed images.
- Gives an environment variable per needed repo:
  - `DOCKERHUB_REPO` for DockerHub repository (`docker.io`)
  - `GCR_REPO` for Google Cloud repository (`gcr.io`)
  - `K8S_GCR_REPO` for Kubernetes repository (`k8s.gcr.io`)

Needed images list has also been extracted so Kubernetes administrator can
easily upload these images to the mirror if the mirror also doesn't have
access to Internet.

Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: I2ea6622b79f7e3c3c63c1441c4dab48e9bc4fb1a

Fix k8s.gcr.io/etcd tag (3.4.13-0)

Change-Id: Idbc520f1b196fd9d66dc57d32a543a6af7b73598
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

nit: highlight the release

Change-Id: I09e3708d4afb477bdc767f124a778d0176f448a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Move former wiki to README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=20742412

Change-Id: I75a9303b2ee5b2df66e0169b37408bb9ad881d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Cargo as build dev

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/2/console

Change-Id: Ic4ac415de09226d4ce2bb59a2790be5364efbf35
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Force legacy pip resolver

Change-Id: I6e3ad097333b529e4d80cbf52905e4e75cb96227
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix alpine version

It also install rust as it's now a build dependency.

Change-Id: I8fb11095b3fa29d40ec415c111015abd2dea2b34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Upgrade system first

Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow parameterizing K8s versions

ONAP integration team asks to support all K8s versions.
A couple of OPNFV releases will allow testing 2 K8s versions.

Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rename sig_network_feature -> sig_network_features

It also takes into account the last results (SCTP seems falky):
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console

Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Export GINKGO_PARALLEL=y

It would speedup the testing.

Change-Id: I084bcf0d44a060f65eb9549eab8dcbbf5a4cc9d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run rally first

After all tests are based on e2e tests.

Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig-storage

It runs the remaining sig-storage testing excluding the next labels:
Conformance (part of k8s_conformance), all features, all drivers and
Slow.

Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_network

It runs the remaining sig-network testing excluding the next labels:
Conformance (part of k8s_conformance), all features and load.balancer.

Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add sig_network_feature

It verifies a couple of features by running a subset of e2e tests:
Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP
and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6,
IPv6DualStackAlphaFeature and Example. A couple of features may be
automatically skipped like NEG and kubemci.

Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to alpine:3.13

Change-Id: I6087facf8ac62de3460861fe69e8f5270cf5d922
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update cnf-conformance to v0.9.19

It also adds configs needed by resilience.

https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19

Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch to latest (v1.21.0-alpha.0)

Change-Id: I30d7e4c8861811bf405ae79eb6d6c7bf82226dd6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to latest Kubernetes release

Change-Id: Id2c05f8b425eeba1924bc2bc2688233beeb7457b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: Ic3770f4098c52b0d26bc62291c9e79e8ee81d107
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Sync with xrally_kubernetes

As upstream is fixed [1][2], it can partially revert
- Force Kubernetes 11.0 to please xrall_kubernetes
- Allow offline testing via xrally_kubernetes

[1] https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090
[2] https://github.com/xrally/xrally-kubernetes/commit/8caf16cd017d475360b2345b3091a9881cd884d0

Change-Id: I43ca1966dcf61e55c45f13adf27ba5b0035d8fda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow offline testing via xrally_kubernetes

It locally patches xrally_kubernetes before [1] is merged upstream.
It adds docker.io/appropriate/curl:edge in download_images.sh too.

[1] https://github.com/xrally/xrally-kubernetes/pull/51

Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com>
Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Reduce cnf-conformance criteria

It's considered as passed vs 95 out of 105 [1].

[1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log

Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update cnf_conformance to v0.9.4

It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts
to the new cnf-conformance result output logic.

It runs all workload tests as it's now proposed (k8s conformance
is already part of smoke) and select the latest coredns
cnf-conformance.yml taking latest helm repo changes into account.

It sets criteria 95 as all steps are considered as passed and a
overall result 100/105.

[1] https://github.com/cncf/cnf-conformance/issues/388

Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip cnf_conformance till helm repos are fixed

Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>