Cédric Ollivier [Fri, 15 Dec 2023 12:09:28 +0000 (13:09 +0100)]
Skip all Feature:DynamicResourceAllocation tests
It's alpha in v1.26 and v1.27.
https://kubernetes.io/docs/concepts/scheduling-eviction/dynamic-resource-allocation/
Change-Id: I0216241d3e08a828ca92f0c21ed4c1439d09a8c8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
a084ca0dd8fe33f16c65f12fda5a5f6fd4683ee1)
(cherry picked from commit
d808defacd5cb6bfc4c0fee044fd8c15e934fdd1)
Cédric Ollivier [Fri, 8 Dec 2023 09:57:20 +0000 (10:57 +0100)]
Update cnf testsuite to v0.45.0
Change-Id: I6abd724b2dd4ce8fa014fe9167e853f2d300e4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
dc1ee47accf9c188e1f309479f5906afb693648c)
Cédric Ollivier [Fri, 8 Dec 2023 08:34:21 +0000 (09:34 +0100)]
Make xtesting owner of /src/cnf-testsuite
Change-Id: I8e2d50e8b3af829181d8f9f2a0fcb944d83797e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 7 Dec 2023 17:41:16 +0000 (18:41 +0100)]
netperf csv output dir must be writable
It changes working dir in a writable one.
Change-Id: I358233cff30c35da0d04921ac0521645a00b2656
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 5 Dec 2023 14:10:51 +0000 (15:10 +0100)]
k8s.gcr.io -> registry.k8s.io
https://kubernetes.io/blog/2022/11/28/registry-k8s-io-faster-cheaper-ga/
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/
Change-Id: Ibae7149b6da15aa18f536d9ffdf09d155b591692
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 4 Dec 2023 17:57:17 +0000 (18:57 +0100)]
Fixtures is missing in oslo_config's requirements
Change-Id: Ied31ae23b40ce8bd0fd811ed245421c893c0156e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 1 Dec 2023 13:22:15 +0000 (14:22 +0100)]
Remove now falsy true in ginkgo call.
Change-Id: I02b8984a5bbd13cd89e6118b1c0cf7b5c04e0fba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 1 Dec 2023 12:14:45 +0000 (13:14 +0100)]
Add Alpine gcompat package
Change-Id: Iaecbb67b6042197cd8a6f7657b6f348e3bf0b13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 30 Nov 2023 16:03:56 +0000 (17:03 +0100)]
Remove PyYaml from upper constraints
It doesnt compile because of cython
Change-Id: I6e1c531a2f7b3384bc4a5256120d917dec7c43c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 1 Dec 2023 09:03:14 +0000 (10:03 +0100)]
Enforce pip's legacy-resolver
Change-Id: Id0b97782db354cfa66656746ee03f102b5c4d6e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 21 Oct 2023 15:18:00 +0000 (17:18 +0200)]
Leverage binaries in PATH now
Change-Id: I5fef1deb13b2a914fe744d2f8f66a820a524d3f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 20 Oct 2023 09:11:05 +0000 (11:11 +0200)]
Stop overriding XtestingCI docker images
Change-Id: I2ac153b46f986f5672c44061155fdbe1646ed6ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 20 Oct 2023 06:46:19 +0000 (08:46 +0200)]
Allow building Functest Kubernetes Virtual Machines
Change-Id: I0ae46cae185d84de293f1d576b4e0b6bd08dc6d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 9 May 2023 12:11:11 +0000 (14:11 +0200)]
Filter packaging in upper-constraints.txt
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/92/console
Change-Id: I9fc43e23bbfcdf04bdc23a7c248d17c5e76c83fb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 5 May 2023 15:02:33 +0000 (17:02 +0200)]
Set xtesting as owner of rally files
Change-Id: I35658a469e3b54973d24959a0771e8fa749136ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 20 Mar 2023 09:58:28 +0000 (10:58 +0100)]
Run pre-commit in the Functest K8s gates
Change-Id: I3957dbde922d8ed8edc47d5cf1aee1475f117836
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 2 Mar 2023 15:42:33 +0000 (16:42 +0100)]
Fix url typo in README
Co-authored-by Peter Pongracz <peter.1.pongracz@nokia.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Idd4c0fccae145ab5fd4a4dbb45346dd1d30de23b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 24 Jan 2023 14:34:15 +0000 (15:34 +0100)]
Update README.md
It take latest updates into account.
Change-Id: I0a6af492c99cb49c326734c061b7934ea7a12127
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Jan 2023 10:05:31 +0000 (11:05 +0100)]
Fix letter is lowercase in repositories.yml
Co-authored-by: Peter Pongracz <peter.1.pongracz@nokia.com>
Change-Id: I78be8192239cad58b25449c106da3e1f558bf13b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 Oct 2022 08:46:03 +0000 (10:46 +0200)]
Use new kubeconfig path in README.md
Change-Id: I1cee2d1ff47a1ab4f79c08d7dc00eb2ab8e6507e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 Oct 2022 15:21:54 +0000 (17:21 +0200)]
Use Path.home() instead of ~
Change-Id: I5863f4e0315b67a07dab4756857dba7aa37932f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 Oct 2022 13:52:10 +0000 (15:52 +0200)]
Stop hardcoding KUBECONFIG
Change-Id: I6ac15eb3686d6502dfa1bbe179622693b1961f45
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 Oct 2022 13:45:12 +0000 (15:45 +0200)]
Create /var/lib/xtesting
Change-Id: I8947b683731a98066bffb47bb49afaa636901446
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 Oct 2022 13:34:27 +0000 (15:34 +0200)]
Use the new homedir
Change-Id: Iaf6161cb3d7379f50702e3f412c233200bcdfae1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 Oct 2022 08:46:31 +0000 (10:46 +0200)]
Stop using root in testing containers
It now creates and leverages xtesting as main user.
Change-Id: I5b871ac2729a875674514aab75ae079e1bf125f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Oct 2022 14:45:34 +0000 (16:45 +0200)]
Fix tox list
Change-Id: Ie028f15f2154a9dcb8b6613bff439a10860dc946
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Fix tox list
Change-Id: Ie996cbf5751e757cedf79d03f3a9b2649183f250
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Oct 2022 11:15:24 +0000 (13:15 +0200)]
Update to Alpine 3.16
Change-Id: Ib630178c93d4a991f43611796e0c07975ce421ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 20 Oct 2022 08:34:58 +0000 (10:34 +0200)]
Update release tabs
It takes latest releases into account
Change-Id: Idd27a9e3df8d58c41417e7b9ca60d679fb0c4ebd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 Oct 2022 15:01:41 +0000 (17:01 +0200)]
cnf conformance now returns non zero values
Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 Oct 2022 10:50:04 +0000 (12:50 +0200)]
Use cnf certifaction criteria
Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 Oct 2022 07:09:54 +0000 (09:09 +0200)]
Update cnf_testsuite v0.34.0
It now runs cert (replacing workload)
It downgrades msg to warning as cnf_testsuite now returns
non 0 values.
Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
4338a2532600e659179335a5f5f71ab15f83f8d7)
Cédric Ollivier [Fri, 14 Oct 2022 12:35:19 +0000 (14:35 +0200)]
By default just print all vulnerabilities
It's the behavior expected by RA2.
Please change it via testcases.yaml if needed.
Change-Id: I84b02fa273f63ea1930bd356739243756032533d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 10 Oct 2022 11:15:43 +0000 (13:15 +0200)]
Uninstall falco and cri_tools after testing
Functest runs several clusters in the same server.
It quickly failes if falco is still running (dkms
tries to unload the module which is in-use).
Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 6 Oct 2022 12:46:19 +0000 (14:46 +0200)]
Update kube bench test cases to latest dev
Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 6 Oct 2022 08:10:50 +0000 (10:10 +0200)]
Update hube-hunter
Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 4 Oct 2022 14:45:46 +0000 (16:45 +0200)]
Disable new testing Feature UserNamespacesStatelessPodsSupport
All new features are defacto optional until RA2 changes
its status.
Change-Id: I23456ec525c728719cd01533122d6c79c2617631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Fri, 30 Sep 2022 13:01:11 +0000 (13:01 +0000)]
Merge "Complete Alpine 3.15 update"
Cédric Ollivier [Fri, 30 Sep 2022 09:30:05 +0000 (11:30 +0200)]
Complete Alpine 3.15 update
Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 30 Sep 2022 09:20:46 +0000 (11:20 +0200)]
Replace -noColor by --no-color
--noColor is deprecated, use --no-color instead
Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags
Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 19 May 2022 12:39:33 +0000 (14:39 +0200)]
Skip Feature:ProxyTerminatingEndpoints
It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.
Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 19 May 2022 09:08:22 +0000 (11:08 +0200)]
Revert latest docker builds
This reverts commit
b2be1ff2852320940a1450ed5f2a6f4f4e91d7da.
Change-Id: If2852d6e85e11872fd0f2839445de014427dc535
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 May 2022 14:19:08 +0000 (16:19 +0200)]
Install libxml2 and libxslt
Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
e755e4cad01074086d53893f40b57ed2cbf5dd14)
Cédric Ollivier [Wed, 18 May 2022 14:17:42 +0000 (16:17 +0200)]
Prepare v1.24 docker builds
Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 4 Mar 2022 12:08:15 +0000 (13:08 +0100)]
Leverage Xtesting 0.96
Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 11 Jan 2022 13:30:36 +0000 (14:30 +0100)]
Outdated need to install python2.7-dev in CircleCI
Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Remove constraints on flake8
Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Update active releases in README.md
Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 3 Jan 2022 20:47:41 +0000 (21:47 +0100)]
Skip new Feature testing
It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]
Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 15 Nov 2021 14:13:46 +0000 (15:13 +0100)]
Update linters and fix all new issues
It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.
Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 5 Oct 2021 10:05:08 +0000 (12:05 +0200)]
Set defaut provider to local back
It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.
Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 11 Sep 2021 08:24:53 +0000 (10:24 +0200)]
Set encoding utf-8 when opening file
Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 10 Sep 2021 15:59:25 +0000 (17:59 +0200)]
Fallback to item calculation
There is no final result if simple tag is called.
Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 10 Sep 2021 14:42:36 +0000 (16:42 +0200)]
Update CNF_TESTSUITE_TAG to v0.15.0
Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Aug 2021 14:12:37 +0000 (16:12 +0200)]
Remove sig_network_serial
PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].
sig_network_serial is now enpty and then can be safely removed.
[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/
c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238
Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Aug 2021 08:02:06 +0000 (10:02 +0200)]
Remove SIG CLI testing
It conforms to https://github.com/cntt-n/CNTT/pull/2579
Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 20 Aug 2021 13:12:41 +0000 (15:12 +0200)]
Swith to v1.23 alphas
Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 19 Aug 2021 14:41:11 +0000 (16:41 +0200)]
Fix py site-package path
Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 11 Aug 2021 13:56:12 +0000 (15:56 +0200)]
Update to Alpine 3.14
It also disabled wrong order check as it fails vs kubernetes amongst
others.
[1] https://github.com/PyCQA/pylint/issues/2175
Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 9 Jul 2021 12:14:54 +0000 (14:14 +0200)]
Skip git_repo testing
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".
[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console
Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 7 Jul 2021 13:23:36 +0000 (15:23 +0200)]
Print cnf_testsuite console on exceptions
Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 25 Jun 2021 16:02:51 +0000 (18:02 +0200)]
Remove k8s.io from ansible/site.yml
It's now up-to-date.
It also fixes ansible/site.cntt.yml
Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 20 Jun 2021 11:51:43 +0000 (13:51 +0200)]
Make clear all skipped Features according to CNTT RA2 Chapter6
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 20 Jun 2021 09:59:37 +0000 (11:59 +0200)]
Allow passing extra opts to e2e.test
E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd
Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Jun 2021 12:10:30 +0000 (14:10 +0200)]
Remove distlib from constraints
Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console
Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 May 2021 14:50:09 +0000 (16:50 +0200)]
Add enchant in travis-ci
Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 May 2021 14:16:47 +0000 (16:16 +0200)]
Switch to focal in travis-ci gates
Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 May 2021 08:59:19 +0000 (10:59 +0200)]
Remove six from Openstack requirements
Attempting uninstall: six
Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445
Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 May 2021 04:54:22 +0000 (06:54 +0200)]
Update cnf_testsuite to v0.11.2
https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2
Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 10 May 2021 12:05:52 +0000 (14:05 +0200)]
Easy creating next netperf branches
Change-Id: If3de6a18b7edd811157cb093434a7128617475d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 9 May 2021 17:26:36 +0000 (19:26 +0200)]
Publish patch for plotperf
Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 9 May 2021 15:15:33 +0000 (17:15 +0200)]
Benchmark Kubernetes Networking Performance
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf
Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 5 May 2021 09:24:29 +0000 (11:24 +0200)]
Update test case results in README
Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 7 May 2021 07:47:38 +0000 (09:47 +0200)]
Disable cnf_testsuite in master
cnf_testsuite asks for an official stable Kubernetes release
during cnf setup. It doesn't work defacto for Functest K8s master
(currently next v1.22).
Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 5 May 2021 07:02:12 +0000 (09:02 +0200)]
Update skip Feature lists
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 3 May 2021 14:03:08 +0000 (16:03 +0200)]
Fix cnf-conformance results filename
It also decreases criteria to 1 due to massive changes (dockerd).
Change-Id: Ic420139e6355debae183a77d6b0c574801b05076
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 3 May 2021 07:32:59 +0000 (09:32 +0200)]
Update cnf-conformance to cnf-testsuite
https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite
Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 3 May 2021 07:33:44 +0000 (09:33 +0200)]
Reduce number of threads
It passed successfully with 10 threads (more doesn't reduce the
overall duration so much).
Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 1 May 2021 14:13:44 +0000 (16:13 +0200)]
Update master to next 1.22
Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 20 Apr 2021 15:19:06 +0000 (17:19 +0200)]
Mock os.makedirs
Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 20 Apr 2021 12:30:56 +0000 (14:30 +0200)]
Install setuptools_scm before xrally
Else upper-constraints basically fails.
Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
75170fc0b528c7e182b8164d5905fcbaa6957faa)
Cédric Ollivier [Wed, 14 Apr 2021 22:00:33 +0000 (00:00 +0200)]
Skip Network.should.set.TCP.CLOSE_WAIT.timeout
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml
Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 14 Apr 2021 13:29:23 +0000 (15:29 +0200)]
Remove sig_node_serial as it's fully disruptive
There is no other test when NoExecuteTaintManager is skipped.
http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log
Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 6 Apr 2021 12:13:58 +0000 (14:13 +0200)]
Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature
kind master allows dualstack since [1]
[1] https://github.com/kubernetes-sigs/kind/commit/
31e595678ed008ac657756d650729c8fac9b3551
Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 6 Apr 2021 09:57:13 +0000 (11:57 +0200)]
Remove [k8s.io] testing
v1.21 enforces sig ownership of all e2e tests [1].
[1] https://github.com/kubernetes/kubernetes/issues/98326
Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 5 Apr 2021 08:58:29 +0000 (10:58 +0200)]
Switch to latest-1.21
Else it would consider v1.22.0-alpha.0 (N+2).
Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 4 Apr 2021 12:54:43 +0000 (14:54 +0200)]
Update test case list
Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 4 Apr 2021 12:45:10 +0000 (14:45 +0200)]
Add k8s_io and serial test cases
It completes the first sig test cases.
Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 4 Apr 2021 10:01:15 +0000 (12:01 +0200)]
Merge sig_network_features in sig_network
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 3 Apr 2021 09:14:51 +0000 (11:14 +0200)]
Spit conformance into 2 test cases
It hugely decreases the overall test duration.
(10 + 15 << 120)
Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 3 Apr 2021 07:37:06 +0000 (09:37 +0200)]
Fix etcd image repository in etcd-depl.yaml
Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 2 Apr 2021 14:05:41 +0000 (16:05 +0200)]
Fix name in chronos-depl.yaml
Change-Id: Ia6972a216daaa9d807058b34b55615cab2c09b64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 2 Apr 2021 11:12:52 +0000 (13:12 +0200)]
Run opnfv/functest-kubernetes-smoke sequentially
Now multithreading is enabled at test case level.
Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 2 Apr 2021 07:52:38 +0000 (09:52 +0200)]
Properly manage e2e parallel testing
It sets nodes=25 to run all tests in parallel.
It also beautifies all testcases.yml
Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 1 Apr 2021 23:05:48 +0000 (01:05 +0200)]
Rather use skeleton instead of local
“skeleton”: cluster is accessed via the Kubernetes API and nothing
else.
https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/
Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 31 Mar 2021 17:55:32 +0000 (19:55 +0200)]
Disable sig_scheduling as serial
All remaining sig-scheduling tests are serial and for the time
Functest doesn't run serial test cases.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console
Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Mar 2021 13:44:35 +0000 (14:44 +0100)]
Remove the useless Feature prefix
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cedric Ollivier [Thu, 25 Mar 2021 12:01:01 +0000 (12:01 +0000)]
Merge "Exlude Serial and Feature:Feature:StorageVersionAPI"
Cedric Ollivier [Thu, 25 Mar 2021 12:00:55 +0000 (12:00 +0000)]
Merge "Blacklist all alpha testing"
Cédric Ollivier [Thu, 25 Mar 2021 09:57:32 +0000 (10:57 +0100)]
Exlude Serial and Feature:Feature:StorageVersionAPI
Serial asks to split the testcases into 2 runs.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console
Change-Id: I58f9d9023f596141bbefae8339043f813a124854
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Code Review / functest-kubernetes.git / log