functest-kubernetes.git
3 months agoFix an invalid name issue 31/74531/1 stable/v1.26
Cédric Ollivier [Thu, 18 Jan 2024 13:49:38 +0000 (14:49 +0100)]
Fix an invalid name issue

C0103: Variable name "ns" doesn't conform to snake_case naming style (invalid-name)

Change-Id: I05a93badbe059cf868eade47a38699b6186c3528
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ebf1398051e0b745fe5175b1d2807dfe5604789c)

3 months agoPatch cnf_testsuite namespaces if they exist 09/74509/1
Cédric Ollivier [Wed, 17 Jan 2024 14:00:55 +0000 (15:00 +0100)]
Patch cnf_testsuite namespaces if they exist

Change-Id: Ibace5356cb1f458fa8b929c0c84b2f06e5852ea0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9cb990f8f874f395fe6aa7f045fa9dcc3fdb35c4)

3 months agoSet the rigth working dir 01/74501/1
Cédric Ollivier [Tue, 16 Jan 2024 16:02:30 +0000 (17:02 +0100)]
Set the rigth working dir

Else zip_compaign fails

Change-Id: Ib26b7c313e29c68098bfcac70cb44c292196adb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5a5bbb179ab39109d0ab921a4239d5e9917919b7)

3 months agoEnforce baseline psp for cnf_testsuite 96/74496/4
Cédric Ollivier [Tue, 16 Jan 2024 12:59:48 +0000 (13:59 +0100)]
Enforce baseline psp for cnf_testsuite

It would be better not to change the default
namespace.

Change-Id: I9fde052d4dd7e0e4f6551213e2028c91c0296e42
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d0b8d65cdea15ef7fc0a431add4701ac817da5f2)

4 months agoManage netperf namespace to enforce baseline 91/74491/1
Cédric Ollivier [Sat, 13 Jan 2024 13:48:16 +0000 (14:48 +0100)]
Manage netperf namespace to enforce baseline

Change-Id: If74322d583d9f16478aad8dcda6afa2368ff5482
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a2abab6871ef68435f5c4b3f5579e31ba40b5b3f)

4 months agoApply privileged pod security standard to kube-bench 86/74486/1
Cédric Ollivier [Sat, 13 Jan 2024 11:15:54 +0000 (12:15 +0100)]
Apply privileged pod security standard to kube-bench

Change-Id: I0336d73f8a9663ef259adfe4377ce20499844021
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1bd69d63994d66582f4e7967e4a1f703dc247c69)

4 months agoEnforce baseline Pod Security Standard 81/74481/1
Cédric Ollivier [Sat, 13 Jan 2024 10:35:36 +0000 (11:35 +0100)]
Enforce baseline Pod Security Standard

It allows running both security and ims testcases vs clusters
where PodSecurityConfiguration enforces "restricted" [1].

[1] https://kubernetes.io/docs/tasks/configure-pod-container/enforce-standards-admission-controller/

Change-Id: I9eb420cbb695ec8fb002f25cfd3c96ab50118fcc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 553d57ffd4ff9c3c4f319454a4d190ac7aa4cc76)

4 months agoApply PR " Enforce baseline Pod Security Standard with namespace labels" 74/74474/1
Cédric Ollivier [Fri, 12 Jan 2024 21:19:36 +0000 (22:19 +0100)]
Apply PR " Enforce baseline Pod Security Standard with namespace labels"

It's needed for any Cluster where PodSecurityConfiguration enforces "restricted" [1].

[1] https://kubernetes.io/docs/tasks/configure-pod-container/enforce-standards-admission-controller/

Change-Id: I9df12654d09390353a898030314a3fda9074b0d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 05656f790feab78bb02b6ed0e3b11048eea39901)

4 months agoRemove Hostpath testing 73/74473/1
Cédric Ollivier [Fri, 12 Jan 2024 20:00:04 +0000 (21:00 +0100)]
Remove Hostpath testing

It's against Security Standards as explained in [1].
"Using the hostPath volume type presents many security risks.
If you can avoid using a hostPath volume, you should."

It basically asks for the profile Privileged
"pod-security.kubernetes.io/enforce": "privileged

[1] https://kubernetes.io/docs/concepts/storage/volumes/#hostpath

Change-Id: I89e35f11ab7917b904ac474401bf609ad9c5dd3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 50859e8c92a39b87ad91f14d01908a259a0602ce)

4 months agoUpdated from global requirements 60/74460/1
Cédric Ollivier [Tue, 9 Jan 2024 16:09:22 +0000 (17:09 +0100)]
Updated from global requirements

Change-Id: I51f9d4b6266150d02438e3dd2cf42f86a6469176
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit eaea540c2f3a19ba13b69c3624f2d26c15d0f875)

4 months agoFix git url 35/74435/1
Cédric Ollivier [Tue, 9 Jan 2024 13:57:04 +0000 (14:57 +0100)]
Fix git url

Change-Id: I7c774ccc027feae75fa1623545ea8ef7af50ccc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f01d93b5abe20f6b1402d3b8fdc02c1dc772b90d)

4 months agoFix pylint issues in netperf 30/74430/1
Cédric Ollivier [Tue, 9 Jan 2024 13:36:30 +0000 (14:36 +0100)]
Fix pylint issues in netperf

Change-Id: I47eac42fd30e857e2a94a7b5caa5850b3c7c9196
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e98c46bdcc7087b55ce0339111c7bedc450e94b0)

4 months agoMake ansible/site.gate.yml up-to-date 29/74429/1
Cédric Ollivier [Tue, 9 Jan 2024 12:17:55 +0000 (13:17 +0100)]
Make ansible/site.gate.yml up-to-date

Change-Id: I4607bc297e21e569af6e80a4ac6a0e6aec68ec33
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 months agoRemove tox pip_version in tox.ini 18/74418/1
Cédric Ollivier [Tue, 9 Jan 2024 09:30:31 +0000 (10:30 +0100)]
Remove tox pip_version in tox.ini

Change-Id: Iafae57b729650e70c084f98abafc6645174a893e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit fddcb581e3f1ab10481eeb6b3a739567df2ddd61)

4 months agoHelp Debugging when e2e result parsing fails 91/74391/1
Cédric Ollivier [Thu, 21 Dec 2023 13:53:49 +0000 (14:53 +0100)]
Help Debugging when e2e result parsing fails

Change-Id: I7f153b0ddef25b0317d8e9a8b2dad55ab580b388
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit da0f27e6cc0a416e3a3a89639b7280836daf296d)

4 months agoPrint netperf logs in console if exception 90/74390/1
Cédric Ollivier [Fri, 22 Dec 2023 07:49:10 +0000 (08:49 +0100)]
Print netperf logs in console if exception

Change-Id: I7ea76aaa595ba7716d4a355f8a1f2d73c2af3ae8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 10d72a2e5c8a78cde617d2c10fa0ea46d90f6924)

4 months agoProtect vs CNF TestSuite instabilities 81/74381/1
Cédric Ollivier [Thu, 21 Dec 2023 10:06:19 +0000 (11:06 +0100)]
Protect vs CNF TestSuite instabilities

Change-Id: I8e714abe603180d69a363e4293f44bb3c5cd1255
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 36915488c21d42a112298c3a52fc2b09d099486f)

4 months agoFix CNF TestSuite's log level 75/74375/1
Cédric Ollivier [Thu, 21 Dec 2023 08:26:17 +0000 (09:26 +0100)]
Fix CNF TestSuite's log level

Change-Id: I9a7e1a9d17fd575b7e6077d8ccf5dd5d1a259717
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75db5520f3fffc0e3b5cae2eead6179a44d91da9)

4 months agoExit if early failure in cnf_testsuite 69/74369/1
Cédric Ollivier [Wed, 20 Dec 2023 14:29:02 +0000 (15:29 +0100)]
Exit if early failure in cnf_testsuite

Change-Id: I3a6a264a73bdc73c1c90471948316d216cf6ad98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 65780898fb6c3d4d7131916a6a6e342f3557b685)

4 months agoSkip Feature:add node log viewer 46/74346/1
Cédric Ollivier [Mon, 18 Dec 2023 08:25:52 +0000 (09:25 +0100)]
Skip Feature:add node log viewer

It was reverted next release (and it's an alpha feture)
https://github.com/kubernetes/kubernetes/commit/407bd6a4afa5f7d7cb2a596dda09cacc30828f09

Change-Id: I524e63bec640204e0da036007dd91e9c022b1ab4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 months agoPut SELinux regex in the right testcase 41/74341/1
Cédric Ollivier [Fri, 15 Dec 2023 13:53:12 +0000 (14:53 +0100)]
Put SELinux regex in the right testcase

Change-Id: I42893382178ba53a249ad6e4e7b6eb613c94f9f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 months agoSkip SELinux tests by default 33/74333/1
Cédric Ollivier [Fri, 15 Dec 2023 13:07:16 +0000 (14:07 +0100)]
Skip SELinux tests by default

https://github.com/kubernetes-csi/csi-release-tools/pull/208/commits/36e433e2aaaaf96b3257812cecd9bc55a1f71999

Change-Id: I80293c3a4456979970b88ab7cb8dca36f6a6b5fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 months agoSkip all Feature:DynamicResourceAllocation tests 26/74326/1
Cédric Ollivier [Fri, 15 Dec 2023 12:09:28 +0000 (13:09 +0100)]
Skip all Feature:DynamicResourceAllocation tests

It's alpha in v1.26 and v1.27.
https://kubernetes.io/docs/concepts/scheduling-eviction/dynamic-resource-allocation/

Change-Id: I0216241d3e08a828ca92f0c21ed4c1439d09a8c8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 months agoUpdate cnf testsuite to v0.45.0 21/74321/1
Cédric Ollivier [Fri, 8 Dec 2023 09:57:20 +0000 (10:57 +0100)]
Update cnf testsuite to v0.45.0

Change-Id: I6abd724b2dd4ce8fa014fe9167e853f2d300e4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dc1ee47accf9c188e1f309479f5906afb693648c)

5 months agoMake xtesting owner of /src/cnf-testsuite 14/74314/1
Cédric Ollivier [Fri, 8 Dec 2023 08:34:21 +0000 (09:34 +0100)]
Make xtesting owner of /src/cnf-testsuite

Change-Id: I8e2d50e8b3af829181d8f9f2a0fcb944d83797e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 months agonetperf csv output dir must be writable 05/74305/1
Cédric Ollivier [Thu, 7 Dec 2023 17:41:16 +0000 (18:41 +0100)]
netperf csv output dir must be writable

It changes working dir in a writable one.

Change-Id: I358233cff30c35da0d04921ac0521645a00b2656
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 677e872910555585f0400e99585d821491cd1c43)

5 months agoEnforce pip's legacy-resolver 00/74300/1
Cédric Ollivier [Fri, 1 Dec 2023 09:03:14 +0000 (10:03 +0100)]
Enforce pip's legacy-resolver

Change-Id: Id0b97782db354cfa66656746ee03f102b5c4d6e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e085945c2c9ae516d0cacf09cc5fe42440f339f6)
(cherry picked from commit 4574f026ad4c979cf5f258783da446c9b38b40f9)

5 months agok8s.gcr.io -> registry.k8s.io 99/74299/1
Cédric Ollivier [Tue, 5 Dec 2023 14:10:51 +0000 (15:10 +0100)]
k8s.gcr.io -> registry.k8s.io

https://kubernetes.io/blog/2022/11/28/registry-k8s-io-faster-cheaper-ga/
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/

Change-Id: Ibae7149b6da15aa18f536d9ffdf09d155b591692
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4f21ac9faf95be6216ddb2b564a6ca4fc6e3f53c)

5 months agoAdd Alpine gcompat package 95/74295/1
Cédric Ollivier [Fri, 1 Dec 2023 12:14:45 +0000 (13:14 +0100)]
Add Alpine gcompat package

Change-Id: Iaecbb67b6042197cd8a6f7657b6f348e3bf0b13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 41ca9d7f98eead4bcdcf36211130c84b11e78f47)

5 months agoRemove PyYaml from upper constraints 93/74293/1
Cédric Ollivier [Thu, 30 Nov 2023 16:03:56 +0000 (17:03 +0100)]
Remove PyYaml from upper constraints

It doesnt compile because of cython

Change-Id: I6e1c531a2f7b3384bc4a5256120d917dec7c43c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0f6720448bd99fd9b732f124da1a1272ee331589)

6 months agoAllow building Functest Kubernetes Virtual Machines 20/74220/1
Cédric Ollivier [Fri, 20 Oct 2023 06:46:19 +0000 (08:46 +0200)]
Allow building Functest Kubernetes Virtual Machines

Change-Id: I0a18096fc10547423baf6282e3eb9f4d96cd8473
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
12 months agoSet xtesting as owner of rally files 04/74004/1
Cédric Ollivier [Fri, 5 May 2023 15:02:33 +0000 (17:02 +0200)]
Set xtesting as owner of rally files

Change-Id: I35658a469e3b54973d24959a0771e8fa749136ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
13 months agoRun pre-commit in the Functest K8s gates 24/73924/1
Cédric Ollivier [Mon, 20 Mar 2023 09:58:28 +0000 (10:58 +0100)]
Run pre-commit in the Functest K8s gates

Change-Id: I3957dbde922d8ed8edc47d5cf1aee1475f117836
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bd1c09890c7c1fff392572de709a0ccc6a283b6)

14 months agoFix url typo in README 70/73870/1
Cédric Ollivier [Thu, 2 Mar 2023 15:42:33 +0000 (16:42 +0100)]
Fix url typo in README

Co-authored-by Peter Pongracz <peter.1.pongracz@nokia.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Idd4c0fccae145ab5fd4a4dbb45346dd1d30de23b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c99d1bc1af18ec3c717dd74faae962f0303dff1b)

15 months agoUpdate kube_bench version 38/73838/1
Cédric Ollivier [Fri, 27 Jan 2023 15:50:26 +0000 (16:50 +0100)]
Update kube_bench version

Change-Id: I67bf1b11e81228aa7461f9ba2477c235d4ab8034
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
15 months agoPrepare Functest K8s v1.26 release 25/73825/1
Cédric Ollivier [Mon, 23 Jan 2023 10:36:17 +0000 (11:36 +0100)]
Prepare Functest K8s v1.26 release

Change-Id: I1e542daeaabfefe5d4df8f81746b2ac6d35bc612
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
15 months agoFix letter is lowercase in repositories.yml 24/73824/1
Cédric Ollivier [Mon, 23 Jan 2023 10:05:31 +0000 (11:05 +0100)]
Fix letter is lowercase in repositories.yml

Co-authored-by: Peter Pongracz <peter.1.pongracz@nokia.com>
Change-Id: I78be8192239cad58b25449c106da3e1f558bf13b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d17ec335dc198c17e0bf167350f154ec64876d58)

15 months agoSet defaultbranch=stable/v1.26 in .gitreview 23/73823/1
Cédric Ollivier [Mon, 23 Jan 2023 10:17:24 +0000 (11:17 +0100)]
Set defaultbranch=stable/v1.26 in .gitreview

Change-Id: Id591c2fc28e11e36722caf0a9f2647ae25875033
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUse new kubeconfig path in README.md 00/73600/1
Cédric Ollivier [Tue, 25 Oct 2022 08:46:03 +0000 (10:46 +0200)]
Use new kubeconfig path in README.md

Change-Id: I1cee2d1ff47a1ab4f79c08d7dc00eb2ab8e6507e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUse Path.home() instead of ~ 92/73592/2
Cédric Ollivier [Fri, 21 Oct 2022 15:21:54 +0000 (17:21 +0200)]
Use Path.home() instead of ~

Change-Id: I5863f4e0315b67a07dab4756857dba7aa37932f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoStop hardcoding KUBECONFIG 87/73587/1
Cédric Ollivier [Fri, 21 Oct 2022 13:52:10 +0000 (15:52 +0200)]
Stop hardcoding KUBECONFIG

Change-Id: I6ac15eb3686d6502dfa1bbe179622693b1961f45
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoCreate /var/lib/xtesting 84/73584/1
Cédric Ollivier [Fri, 21 Oct 2022 13:45:12 +0000 (15:45 +0200)]
Create /var/lib/xtesting

Change-Id: I8947b683731a98066bffb47bb49afaa636901446
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUse the new homedir 81/73581/1
Cédric Ollivier [Fri, 21 Oct 2022 13:34:27 +0000 (15:34 +0200)]
Use the new homedir

Change-Id: Iaf6161cb3d7379f50702e3f412c233200bcdfae1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoStop using root in testing containers 73/73573/2
Cédric Ollivier [Fri, 21 Oct 2022 08:46:31 +0000 (10:46 +0200)]
Stop using root in testing containers

It now creates and leverages xtesting as main user.

Change-Id: I5b871ac2729a875674514aab75ae079e1bf125f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoFix tox list 70/73570/2
Cédric Ollivier [Thu, 20 Oct 2022 14:45:34 +0000 (16:45 +0200)]
Fix tox list

Change-Id: Ie028f15f2154a9dcb8b6613bff439a10860dc946
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoFix tox list 72/73572/3
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Fix tox list

Change-Id: Ie996cbf5751e757cedf79d03f3a9b2649183f250
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUpdate to Alpine 3.16 64/73564/2
Cédric Ollivier [Thu, 20 Oct 2022 11:15:24 +0000 (13:15 +0200)]
Update to Alpine 3.16

Change-Id: Ib630178c93d4a991f43611796e0c07975ce421ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUpdate release tabs 59/73559/1
Cédric Ollivier [Thu, 20 Oct 2022 08:34:58 +0000 (10:34 +0200)]
Update release tabs

It takes latest releases into account

Change-Id: Idd27a9e3df8d58c41417e7b9ca60d679fb0c4ebd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agocnf conformance now returns non zero values 51/73551/2
Cédric Ollivier [Mon, 17 Oct 2022 15:01:41 +0000 (17:01 +0200)]
cnf conformance now returns non zero values

Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUse cnf certifaction criteria 50/73550/1
Cédric Ollivier [Mon, 17 Oct 2022 10:50:04 +0000 (12:50 +0200)]
Use cnf certifaction criteria

Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUpdate cnf_testsuite v0.34.0 46/73546/2
Cédric Ollivier [Mon, 17 Oct 2022 07:09:54 +0000 (09:09 +0200)]
Update cnf_testsuite v0.34.0

It now runs cert (replacing workload)
It downgrades msg to warning as cnf_testsuite now returns
non 0 values.

Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4338a2532600e659179335a5f5f71ab15f83f8d7)

19 months agoBy default just print all vulnerabilities 42/73542/1
Cédric Ollivier [Fri, 14 Oct 2022 12:35:19 +0000 (14:35 +0200)]
By default just print all vulnerabilities

It's the behavior expected by RA2.
Please change it via testcases.yaml if needed.

Change-Id: I84b02fa273f63ea1930bd356739243756032533d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUninstall falco and cri_tools after testing 37/73537/1
Cédric Ollivier [Mon, 10 Oct 2022 11:15:43 +0000 (13:15 +0200)]
Uninstall falco and cri_tools after testing

Functest runs several clusters in the same server.
It quickly failes if falco is still running (dkms
tries to unload the module which is in-use).

Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate kube bench test cases to latest dev 30/73530/1
Cédric Ollivier [Thu, 6 Oct 2022 12:46:19 +0000 (14:46 +0200)]
Update kube bench test cases to latest dev

Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate hube-hunter 27/73527/1
Cédric Ollivier [Thu, 6 Oct 2022 08:10:50 +0000 (10:10 +0200)]
Update hube-hunter

Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoDisable new testing Feature UserNamespacesStatelessPodsSupport 23/73523/1
Cédric Ollivier [Tue, 4 Oct 2022 14:45:46 +0000 (16:45 +0200)]
Disable new testing Feature UserNamespacesStatelessPodsSupport

All new features are defacto optional until RA2 changes
its status.

Change-Id: I23456ec525c728719cd01533122d6c79c2617631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoMerge "Complete Alpine 3.15 update"
Cedric Ollivier [Fri, 30 Sep 2022 13:01:11 +0000 (13:01 +0000)]
Merge "Complete Alpine 3.15 update"

19 months agoComplete Alpine 3.15 update 05/73505/2
Cédric Ollivier [Fri, 30 Sep 2022 09:30:05 +0000 (11:30 +0200)]
Complete Alpine 3.15 update

Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoReplace -noColor by --no-color 03/73503/1
Cédric Ollivier [Fri, 30 Sep 2022 09:20:46 +0000 (11:20 +0200)]
Replace -noColor by --no-color

--noColor is deprecated, use --no-color instead
Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags

Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
23 months agoSkip Feature:ProxyTerminatingEndpoints 82/73382/1
Cédric Ollivier [Thu, 19 May 2022 12:39:33 +0000 (14:39 +0200)]
Skip Feature:ProxyTerminatingEndpoints

It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.

Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
23 months agoRevert latest docker builds 79/73379/1
Cédric Ollivier [Thu, 19 May 2022 09:08:22 +0000 (11:08 +0200)]
Revert latest docker builds

This reverts commit b2be1ff2852320940a1450ed5f2a6f4f4e91d7da.

Change-Id: If2852d6e85e11872fd0f2839445de014427dc535
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
23 months agoInstall libxml2 and libxslt 76/73376/2
Cédric Ollivier [Wed, 18 May 2022 14:19:08 +0000 (16:19 +0200)]
Install libxml2 and libxslt

Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)

23 months agoPrepare v1.24 docker builds 77/73377/1
Cédric Ollivier [Wed, 18 May 2022 14:17:42 +0000 (16:17 +0200)]
Prepare v1.24 docker builds

Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoLeverage Xtesting 0.96 61/73261/1
Cédric Ollivier [Fri, 4 Mar 2022 12:08:15 +0000 (13:08 +0100)]
Leverage Xtesting 0.96

Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoOutdated need to install python2.7-dev in CircleCI 70/73170/1
Cédric Ollivier [Tue, 11 Jan 2022 13:30:36 +0000 (14:30 +0100)]
Outdated need to install python2.7-dev in CircleCI

Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove constraints on flake8 13/73113/3
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Remove constraints on flake8

Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate active releases in README.md 39/73139/1
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Update active releases in README.md

Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Feature testing 34/73134/1
Cédric Ollivier [Mon, 3 Jan 2022 20:47:41 +0000 (21:47 +0100)]
Skip new Feature testing

It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]

Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate linters and fix all new issues 21/73021/1
Cédric Ollivier [Mon, 15 Nov 2021 14:13:46 +0000 (15:13 +0100)]
Update linters and fix all new issues

It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.

Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet defaut provider to local back 46/72946/1
Cédric Ollivier [Tue, 5 Oct 2021 10:05:08 +0000 (12:05 +0200)]
Set defaut provider to local back

It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.

Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet encoding utf-8 when opening file 11/72911/2
Cédric Ollivier [Sat, 11 Sep 2021 08:24:53 +0000 (10:24 +0200)]
Set encoding utf-8 when opening file

Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFallback to item calculation 01/72901/1
Cédric Ollivier [Fri, 10 Sep 2021 15:59:25 +0000 (17:59 +0200)]
Fallback to item calculation

There is no final result if simple tag is called.

Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate CNF_TESTSUITE_TAG to v0.15.0 00/72900/1
Cédric Ollivier [Fri, 10 Sep 2021 14:42:36 +0000 (16:42 +0200)]
Update CNF_TESTSUITE_TAG to v0.15.0

Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove sig_network_serial 64/72864/1
Cédric Ollivier [Thu, 26 Aug 2021 14:12:37 +0000 (16:12 +0200)]
Remove sig_network_serial

PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].

sig_network_serial is now enpty and then can be safely removed.

[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238

Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove SIG CLI testing 61/72861/1
Cédric Ollivier [Thu, 26 Aug 2021 08:02:06 +0000 (10:02 +0200)]
Remove SIG CLI testing

It conforms to https://github.com/cntt-n/CNTT/pull/2579

Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwith to v1.23 alphas 48/72848/1
Cédric Ollivier [Fri, 20 Aug 2021 13:12:41 +0000 (15:12 +0200)]
Swith to v1.23 alphas

Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix py site-package path 40/72840/1
Cédric Ollivier [Thu, 19 Aug 2021 14:41:11 +0000 (16:41 +0200)]
Fix py site-package path

Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate to Alpine 3.14 11/72811/3
Cédric Ollivier [Wed, 11 Aug 2021 13:56:12 +0000 (15:56 +0200)]
Update to Alpine 3.14

It also disabled wrong order check as it fails vs kubernetes amongst
others.

[1] https://github.com/PyCQA/pylint/issues/2175

Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip git_repo testing 69/72769/1
Cédric Ollivier [Fri, 9 Jul 2021 12:14:54 +0000 (14:14 +0200)]
Skip git_repo testing

As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".

[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console

Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoPrint cnf_testsuite console on exceptions 61/72761/1
Cédric Ollivier [Wed, 7 Jul 2021 13:23:36 +0000 (15:23 +0200)]
Print cnf_testsuite console on exceptions

Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove k8s.io from ansible/site.yml 10/72710/1
Cédric Ollivier [Fri, 25 Jun 2021 16:02:51 +0000 (18:02 +0200)]
Remove k8s.io from ansible/site.yml

It's now up-to-date.
It also fixes ansible/site.cntt.yml

Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoMake clear all skipped Features according to CNTT RA2 Chapter6 93/72693/1
Cédric Ollivier [Sun, 20 Jun 2021 11:51:43 +0000 (13:51 +0200)]
Make clear all skipped Features according to CNTT RA2 Chapter6

Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAllow passing extra opts to e2e.test 89/72689/1
Cédric Ollivier [Sun, 20 Jun 2021 09:59:37 +0000 (11:59 +0200)]
Allow passing extra opts to e2e.test

E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd

Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove distlib from constraints 59/72659/1
Cédric Ollivier [Thu, 10 Jun 2021 12:10:30 +0000 (14:10 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAdd enchant in travis-ci 85/72585/1
Cédric Ollivier [Wed, 26 May 2021 14:50:09 +0000 (16:50 +0200)]
Add enchant in travis-ci

Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwitch to focal in travis-ci gates 78/72578/1
Cédric Ollivier [Tue, 25 May 2021 14:16:47 +0000 (16:16 +0200)]
Switch to focal in travis-ci gates

Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove six from Openstack requirements 64/72564/1
Cédric Ollivier [Tue, 25 May 2021 08:59:19 +0000 (10:59 +0200)]
Remove six from Openstack requirements

  Attempting uninstall: six
    Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate cnf_testsuite to v0.11.2 63/72563/1
Cédric Ollivier [Tue, 25 May 2021 04:54:22 +0000 (06:54 +0200)]
Update cnf_testsuite to v0.11.2

https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2

Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoEasy creating next netperf branches 99/72499/1
Cédric Ollivier [Mon, 10 May 2021 12:05:52 +0000 (14:05 +0200)]
Easy creating next netperf branches

Change-Id: If3de6a18b7edd811157cb093434a7128617475d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish patch for plotperf 90/72490/1
Cédric Ollivier [Sun, 9 May 2021 17:26:36 +0000 (19:26 +0200)]
Publish patch for plotperf

Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoBenchmark Kubernetes Networking Performance 89/72489/1
Cédric Ollivier [Sun, 9 May 2021 15:15:33 +0000 (17:15 +0200)]
Benchmark Kubernetes Networking Performance

https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf

Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case results in README 85/72485/1
Cédric Ollivier [Wed, 5 May 2021 09:24:29 +0000 (11:24 +0200)]
Update test case results in README

Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDisable cnf_testsuite in master 84/72484/1
Cédric Ollivier [Fri, 7 May 2021 07:47:38 +0000 (09:47 +0200)]
Disable cnf_testsuite in master

cnf_testsuite asks for an official stable Kubernetes release
during cnf setup. It doesn't work defacto for Functest K8s master
(currently next v1.22).

Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate skip Feature lists 81/72481/1
Cédric Ollivier [Wed, 5 May 2021 07:02:12 +0000 (09:02 +0200)]
Update skip Feature lists

Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix cnf-conformance results filename 70/72470/1
Cédric Ollivier [Mon, 3 May 2021 14:03:08 +0000 (16:03 +0200)]
Fix cnf-conformance results filename

It also decreases criteria to 1 due to massive changes (dockerd).

Change-Id: Ic420139e6355debae183a77d6b0c574801b05076
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate cnf-conformance to cnf-testsuite 62/72462/1
Cédric Ollivier [Mon, 3 May 2021 07:32:59 +0000 (09:32 +0200)]
Update cnf-conformance to cnf-testsuite

https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite

Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoReduce number of threads 61/72461/1
Cédric Ollivier [Mon, 3 May 2021 07:33:44 +0000 (09:33 +0200)]
Reduce number of threads

It passed successfully with 10 threads (more doesn't reduce the
overall duration so much).

Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate master to next 1.22 56/72456/1
Cédric Ollivier [Sat, 1 May 2021 14:13:44 +0000 (16:13 +0200)]
Update master to next 1.22

Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMock os.makedirs 20/72420/4
Cédric Ollivier [Tue, 20 Apr 2021 15:19:06 +0000 (17:19 +0200)]
Mock os.makedirs

Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoInstall setuptools_scm before xrally 18/72418/1
Cédric Ollivier [Tue, 20 Apr 2021 12:30:56 +0000 (14:30 +0200)]
Install setuptools_scm before xrally

Else upper-constraints basically fails.

Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)