Take latest Rally K8S patch into account

Functest's patch was merged upstream.

Change-Id: I04a401e99ea5ce6995e3d7648c1452d307bcf78d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Leverage the new CNF TestSuite repo

Change-Id: I8cba2f8cf510a93efdbc110a288fc5bf99c5143e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Switch master to next v1.30

Change-Id: I412d3b50e9d306f7c6767d1c91ae72990fb58a93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix an invalid name issue

C0103: Variable name "ns" doesn't conform to snake_case naming style (invalid-name)

Change-Id: I05a93badbe059cf868eade47a38699b6186c3528
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update releases in README.md

Change-Id: I284dcf01a252b40a2fa98e3024c6621e913e4b05
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix git url

Change-Id: I7c774ccc027feae75fa1623545ea8ef7af50ccc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f01d93b5abe20f6b1402d3b8fdc02c1dc772b90d)
(cherry picked from commit 0f41e6a4ed2ab0d60c71bd5a0c566c703d7b93c0)

Patch cnf_testsuite namespaces if they exist

Change-Id: Ibace5356cb1f458fa8b929c0c84b2f06e5852ea0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set the rigth working dir

Else zip_compaign fails

Change-Id: Ib26b7c313e29c68098bfcac70cb44c292196adb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enforce baseline psp for cnf_testsuite

It would be better not to change the default
namespace.

Change-Id: I9fde052d4dd7e0e4f6551213e2028c91c0296e42
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Manage netperf namespace to enforce baseline

Change-Id: If74322d583d9f16478aad8dcda6afa2368ff5482
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply privileged pod security standard to kube-bench

Change-Id: I0336d73f8a9663ef259adfe4377ce20499844021
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enforce baseline Pod Security Standard

It allows running both security and ims testcases vs clusters
where PodSecurityConfiguration enforces "restricted" [1].

[1] https://kubernetes.io/docs/tasks/configure-pod-container/enforce-standards-admission-controller/

Change-Id: I9eb420cbb695ec8fb002f25cfd3c96ab50118fcc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Apply PR " Enforce baseline Pod Security Standard with namespace labels"

It's needed for any Cluster where PodSecurityConfiguration enforces "restricted" [1].

[1] https://kubernetes.io/docs/tasks/configure-pod-container/enforce-standards-admission-controller/

Change-Id: I9df12654d09390353a898030314a3fda9074b0d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove Hostpath testing

It's against Security Standards as explained in [1].
"Using the hostPath volume type presents many security risks.
If you can avoid using a hostPath volume, you should."

It basically asks for the profile Privileged
"pod-security.kubernetes.io/enforce": "privileged

[1] https://kubernetes.io/docs/concepts/storage/volumes/#hostpath

Change-Id: I89e35f11ab7917b904ac474401bf609ad9c5dd3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Updated from global requirements

Change-Id: I51f9d4b6266150d02438e3dd2cf42f86a6469176
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix pylint issues in netperf

Change-Id: I47eac42fd30e857e2a94a7b5caa5850b3c7c9196
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Make ansible/site.gate.yml up-to-date

Change-Id: I4607bc297e21e569af6e80a4ac6a0e6aec68ec33
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove tox pip_version in tox.ini

Change-Id: Iafae57b729650e70c084f98abafc6645174a893e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Print netperf logs in console if exception

Change-Id: I7ea76aaa595ba7716d4a355f8a1f2d73c2af3ae8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Help Debugging when e2e result parsing fails

Change-Id: I7f153b0ddef25b0317d8e9a8b2dad55ab580b388
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Protect vs CNF TestSuite instabilities

Change-Id: I8e714abe603180d69a363e4293f44bb3c5cd1255
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix CNF TestSuite's log level

Change-Id: I9a7e1a9d17fd575b7e6077d8ccf5dd5d1a259717
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Exit if early failure in cnf_testsuite

Change-Id: I3a6a264a73bdc73c1c90471948316d216cf6ad98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip [Feature:PodLifecycleSleepAction] testing

It's alpha in 1.29
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: I0be1f82ca6073c7a31b536e30c54eba39f84c338
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip KubeletCredentialProviders testing

            containerStatuses:
            - image: gcr.io/k8s-authenticated-test/agnhost:2.6
              imageID: ""
              lastState: {}
              name: container-auth-image
              ready: false
              restartCount: 0
              started: false
              state:
                waiting:
                  message: Back-off pulling image "gcr.io/k8s-authenticated-test/agnhost:2.6"
                  reason: ImagePullBackOff

https://github.com/kubernetes/kubernetes/pull/117527

Change-Id: Ib4146488cfb945d360485944a8d864ec26905429
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip new [Feature:ServiceCIDRs] testing

https://github.com/kubernetes/kubernetes/commit/cb509b01f316261050583e9f51744e361b9c3a93

      the server could not find the requested resource
      {
          ErrStatus:
              code: 404
              details: {}
              message: the server could not find the requested resource
              metadata: {}
              reason: NotFound
              status: Failure,
      }

Change-Id: Ie857169e8aa54843a9d9456480364cb50c860c29
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Feature:ClusterTrustBundle testing

It's currently alpha
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: I1aa63bd9462f280a3e9f6b5599e28fad770c7698
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Feature:WatchList testing

it's alpha
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: I9b0a1f6ddaafae980e708a61705daf87b431ca5c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Feature:UserNamespacesSupport

it's alpha
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: I129eb4209df3895f7301ac0df922813f676d1532
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip NodeLogQuery testing

it's alpha since v1.27
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: Id8b8a6c5411030fefe45c5598ae37160f3d37fa6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Rather leverage next release than alpha

Change-Id: I24380a5ceed4768ec097738da6a1332091b9e96d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip RecoverVolumeExpansionFailure tests

RecoverVolumeExpansionFailure false Alpha 1.23
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: I3d7786ff37929dc4ff6ddd82901571dbb873491a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip SELinux tests by default

https://github.com/kubernetes-csi/csi-release-tools/pull/208/commits/36e433e2aaaaf96b3257812cecd9bc55a1f71999

Change-Id: I80293c3a4456979970b88ab7cb8dca36f6a6b5fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f86bb8ff598b4838215e990a52a19d63ec3b317f)

Skip all [Feature:SidecarContainers] tests

It's alpha in v1.28.
https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/

Change-Id: Ib8779bc08dc33b4de36d4c993305b1a9bea5539a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip all In-place Resource Resize for Kubernetes Pods tests

It's alpha in v1.27.
https://kubernetes.io/blog/2023/05/12/in-place-pod-resize-alpha/

Change-Id: Iee818623425100dfa40e2198082d29069520c80c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e092df8de5f07137e2287f28ac0f3edfae1362a7)

Skip all Feature:DynamicResourceAllocation tests

It's alpha in v1.26 and v1.27.
https://kubernetes.io/docs/concepts/scheduling-eviction/dynamic-resource-allocation/

Change-Id: I0216241d3e08a828ca92f0c21ed4c1439d09a8c8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a084ca0dd8fe33f16c65f12fda5a5f6fd4683ee1)
(cherry picked from commit d808defacd5cb6bfc4c0fee044fd8c15e934fdd1)

Update cnf testsuite to v0.45.0

Change-Id: I6abd724b2dd4ce8fa014fe9167e853f2d300e4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dc1ee47accf9c188e1f309479f5906afb693648c)

Make xtesting owner of /src/cnf-testsuite

Change-Id: I8e2d50e8b3af829181d8f9f2a0fcb944d83797e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

netperf csv output dir must be writable

It changes working dir in a writable one.

Change-Id: I358233cff30c35da0d04921ac0521645a00b2656
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

k8s.gcr.io -> registry.k8s.io

https://kubernetes.io/blog/2022/11/28/registry-k8s-io-faster-cheaper-ga/
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/

Change-Id: Ibae7149b6da15aa18f536d9ffdf09d155b591692
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fixtures is missing in oslo_config's requirements

Change-Id: Ied31ae23b40ce8bd0fd811ed245421c893c0156e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove now falsy true in ginkgo call.

Change-Id: I02b8984a5bbd13cd89e6118b1c0cf7b5c04e0fba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Add Alpine gcompat package

Change-Id: Iaecbb67b6042197cd8a6f7657b6f348e3bf0b13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove PyYaml from upper constraints

It doesnt compile because of cython

Change-Id: I6e1c531a2f7b3384bc4a5256120d917dec7c43c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Enforce pip's legacy-resolver

Change-Id: Id0b97782db354cfa66656746ee03f102b5c4d6e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Leverage binaries in PATH now

Change-Id: I5fef1deb13b2a914fe744d2f8f66a820a524d3f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop overriding XtestingCI docker images

Change-Id: I2ac153b46f986f5672c44061155fdbe1646ed6ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow building Functest Kubernetes Virtual Machines

Change-Id: I0ae46cae185d84de293f1d576b4e0b6bd08dc6d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Filter packaging in upper-constraints.txt

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/92/console

Change-Id: I9fc43e23bbfcdf04bdc23a7c248d17c5e76c83fb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set xtesting as owner of rally files

Change-Id: I35658a469e3b54973d24959a0771e8fa749136ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Run pre-commit in the Functest K8s gates

Change-Id: I3957dbde922d8ed8edc47d5cf1aee1475f117836
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix url typo in README

Co-authored-by Peter Pongracz <peter.1.pongracz@nokia.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Idd4c0fccae145ab5fd4a4dbb45346dd1d30de23b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update README.md

It take latest updates into account.

Change-Id: I0a6af492c99cb49c326734c061b7934ea7a12127
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix letter is lowercase in repositories.yml

Co-authored-by: Peter Pongracz <peter.1.pongracz@nokia.com>
Change-Id: I78be8192239cad58b25449c106da3e1f558bf13b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use new kubeconfig path in README.md

Change-Id: I1cee2d1ff47a1ab4f79c08d7dc00eb2ab8e6507e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use Path.home() instead of ~

Change-Id: I5863f4e0315b67a07dab4756857dba7aa37932f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop hardcoding KUBECONFIG

Change-Id: I6ac15eb3686d6502dfa1bbe179622693b1961f45
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Create /var/lib/xtesting

Change-Id: I8947b683731a98066bffb47bb49afaa636901446
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use the new homedir

Change-Id: Iaf6161cb3d7379f50702e3f412c233200bcdfae1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Stop using root in testing containers

It now creates and leverages xtesting as main user.

Change-Id: I5b871ac2729a875674514aab75ae079e1bf125f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix tox list

Change-Id: Ie028f15f2154a9dcb8b6613bff439a10860dc946
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix tox list

Change-Id: Ie996cbf5751e757cedf79d03f3a9b2649183f250
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.16

Change-Id: Ib630178c93d4a991f43611796e0c07975ce421ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update release tabs

It takes latest releases into account

Change-Id: Idd27a9e3df8d58c41417e7b9ca60d679fb0c4ebd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

cnf conformance now returns non zero values

Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Use cnf certifaction criteria

Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update cnf_testsuite v0.34.0

It now runs cert (replacing workload)
It downgrades msg to warning as cnf_testsuite now returns
non 0 values.

Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4338a2532600e659179335a5f5f71ab15f83f8d7)

By default just print all vulnerabilities

It's the behavior expected by RA2.
Please change it via testcases.yaml if needed.

Change-Id: I84b02fa273f63ea1930bd356739243756032533d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Uninstall falco and cri_tools after testing

Functest runs several clusters in the same server.
It quickly failes if falco is still running (dkms
tries to unload the module which is in-use).

Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update kube bench test cases to latest dev

Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update hube-hunter

Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Disable new testing Feature UserNamespacesStatelessPodsSupport

All new features are defacto optional until RA2 changes
its status.

Change-Id: I23456ec525c728719cd01533122d6c79c2617631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Merge "Complete Alpine 3.15 update"

Complete Alpine 3.15 update

Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Replace -noColor by --no-color

--noColor is deprecated, use --no-color instead
Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags

Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip Feature:ProxyTerminatingEndpoints

It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.

Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Revert latest docker builds

This reverts commit b2be1ff2852320940a1450ed5f2a6f4f4e91d7da.

Change-Id: If2852d6e85e11872fd0f2839445de014427dc535
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Install libxml2 and libxslt

Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)

Prepare v1.24 docker builds

Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Leverage Xtesting 0.96

Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Outdated need to install python2.7-dev in CircleCI

Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove constraints on flake8

Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update active releases in README.md

Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip new Feature testing

It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]

Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update linters and fix all new issues

It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.

Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set defaut provider to local back

It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.

Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Set encoding utf-8 when opening file

Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fallback to item calculation

There is no final result if simple tag is called.

Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update CNF_TESTSUITE_TAG to v0.15.0

Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove sig_network_serial

PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].

sig_network_serial is now enpty and then can be safely removed.

[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238

Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove SIG CLI testing

It conforms to https://github.com/cntt-n/CNTT/pull/2579

Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Swith to v1.23 alphas

Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Fix py site-package path

Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Update to Alpine 3.14

It also disabled wrong order check as it fails vs kubernetes amongst
others.

[1] https://github.com/PyCQA/pylint/issues/2175

Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Skip git_repo testing

As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".

[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console

Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Print cnf_testsuite console on exceptions

Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove k8s.io from ansible/site.yml

It's now up-to-date.
It also fixes ansible/site.cntt.yml

Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Make clear all skipped Features according to CNTT RA2 Chapter6

Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Allow passing extra opts to e2e.test

E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd

Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>

Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>