functest-kubernetes.git
5 months agoProtect vs CNF TestSuite instabilities 82/74382/1
Cédric Ollivier [Thu, 21 Dec 2023 10:06:19 +0000 (11:06 +0100)]
Protect vs CNF TestSuite instabilities

Change-Id: I8e714abe603180d69a363e4293f44bb3c5cd1255
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 36915488c21d42a112298c3a52fc2b09d099486f)

5 months agoFix CNF TestSuite's log level 76/74376/1
Cédric Ollivier [Thu, 21 Dec 2023 08:26:17 +0000 (09:26 +0100)]
Fix CNF TestSuite's log level

Change-Id: I9a7e1a9d17fd575b7e6077d8ccf5dd5d1a259717
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75db5520f3fffc0e3b5cae2eead6179a44d91da9)

5 months agoExit if early failure in cnf_testsuite 70/74370/1
Cédric Ollivier [Wed, 20 Dec 2023 14:29:02 +0000 (15:29 +0100)]
Exit if early failure in cnf_testsuite

Change-Id: I3a6a264a73bdc73c1c90471948316d216cf6ad98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 65780898fb6c3d4d7131916a6a6e342f3557b685)

5 months agoUpdate cnf testsuite to v0.45.0 64/74364/1
Cédric Ollivier [Fri, 8 Dec 2023 09:57:20 +0000 (10:57 +0100)]
Update cnf testsuite to v0.45.0

Change-Id: I6abd724b2dd4ce8fa014fe9167e853f2d300e4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dc1ee47accf9c188e1f309479f5906afb693648c)

5 months agok8s.gcr.io -> registry.k8s.io 24/74324/1
Cédric Ollivier [Tue, 5 Dec 2023 14:10:51 +0000 (15:10 +0100)]
k8s.gcr.io -> registry.k8s.io

https://kubernetes.io/blog/2022/11/28/registry-k8s-io-faster-cheaper-ga/
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/

Change-Id: Ibae7149b6da15aa18f536d9ffdf09d155b591692
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4f21ac9faf95be6216ddb2b564a6ca4fc6e3f53c)
(cherry picked from commit fd01d14673e8eff2f607e691c58529d06309c9ee)

5 months agoAdd Alpine gcompat package 22/74322/1
Cédric Ollivier [Fri, 1 Dec 2023 12:14:45 +0000 (13:14 +0100)]
Add Alpine gcompat package

Change-Id: Iaecbb67b6042197cd8a6f7657b6f348e3bf0b13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 41ca9d7f98eead4bcdcf36211130c84b11e78f47)

5 months agoMake xtesting owner of /src/cnf-testsuite 12/74312/1
Cédric Ollivier [Fri, 8 Dec 2023 08:34:21 +0000 (09:34 +0100)]
Make xtesting owner of /src/cnf-testsuite

Change-Id: I8e2d50e8b3af829181d8f9f2a0fcb944d83797e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 months agoEnforce pip's legacy-resolver 09/74309/1
Cédric Ollivier [Fri, 1 Dec 2023 09:03:14 +0000 (10:03 +0100)]
Enforce pip's legacy-resolver

Change-Id: Id0b97782db354cfa66656746ee03f102b5c4d6e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e085945c2c9ae516d0cacf09cc5fe42440f339f6)

5 months agoRemove PyYaml from upper constraints 08/74308/1
Cédric Ollivier [Thu, 30 Nov 2023 16:03:56 +0000 (17:03 +0100)]
Remove PyYaml from upper constraints

It doesnt compile because of cython

Change-Id: I6e1c531a2f7b3384bc4a5256120d917dec7c43c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0f6720448bd99fd9b732f124da1a1272ee331589)

5 months agonetperf csv output dir must be writable 06/74306/1
Cédric Ollivier [Thu, 7 Dec 2023 17:41:16 +0000 (18:41 +0100)]
netperf csv output dir must be writable

It changes working dir in a writable one.

Change-Id: I358233cff30c35da0d04921ac0521645a00b2656
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 677e872910555585f0400e99585d821491cd1c43)

7 months agoAllow building Functest Kubernetes Virtual Machines 21/74221/1
Cédric Ollivier [Fri, 20 Oct 2023 06:46:19 +0000 (08:46 +0200)]
Allow building Functest Kubernetes Virtual Machines

Change-Id: I0a18096fc10547423baf6282e3eb9f4d96cd8473
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 049f674dd8a1b0e16ba8b37df72f936d8d0f0e5b)

12 months agoSet xtesting as owner of rally files 06/74006/1
Cédric Ollivier [Fri, 5 May 2023 15:02:33 +0000 (17:02 +0200)]
Set xtesting as owner of rally files

Change-Id: I35658a469e3b54973d24959a0771e8fa749136ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoRun pre-commit in the Functest K8s gates 25/73925/1
Cédric Ollivier [Mon, 20 Mar 2023 09:58:28 +0000 (10:58 +0100)]
Run pre-commit in the Functest K8s gates

Change-Id: I3957dbde922d8ed8edc47d5cf1aee1475f117836
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bd1c09890c7c1fff392572de709a0ccc6a283b6)

14 months agoFix url typo in README 71/73871/1
Cédric Ollivier [Thu, 2 Mar 2023 15:42:33 +0000 (16:42 +0100)]
Fix url typo in README

Co-authored-by Peter Pongracz <peter.1.pongracz@nokia.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Idd4c0fccae145ab5fd4a4dbb45346dd1d30de23b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c99d1bc1af18ec3c717dd74faae962f0303dff1b)

16 months agoUpdate README.md 30/73830/1
Cédric Ollivier [Tue, 24 Jan 2023 14:34:15 +0000 (15:34 +0100)]
Update README.md

It take latest updates into account.

Change-Id: I0a6af492c99cb49c326734c061b7934ea7a12127
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 142bc4a751bf5568cd0bb13c8550959f9a0b83c2)

16 months agoFix letter is lowercase in repositories.yml 19/73819/1
Cédric Ollivier [Mon, 23 Jan 2023 10:05:31 +0000 (11:05 +0100)]
Fix letter is lowercase in repositories.yml

Co-authored-by: Peter Pongracz <peter.1.pongracz@nokia.com>
Change-Id: I78be8192239cad58b25449c106da3e1f558bf13b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d17ec335dc198c17e0bf167350f154ec64876d58)

19 months agoUse new kubeconfig path in README.md 01/73601/1
Cédric Ollivier [Tue, 25 Oct 2022 08:46:03 +0000 (10:46 +0200)]
Use new kubeconfig path in README.md

Change-Id: I1cee2d1ff47a1ab4f79c08d7dc00eb2ab8e6507e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f6eba4b5b93b994a6773867fdb123c2c34a56415)

19 months agoUse Path.home() instead of ~ 93/73593/1
Cédric Ollivier [Fri, 21 Oct 2022 15:21:54 +0000 (17:21 +0200)]
Use Path.home() instead of ~

Change-Id: I5863f4e0315b67a07dab4756857dba7aa37932f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d744fb5276d47fb3ba7ad2d4cb1fb2d3bfaca3eb)

19 months agoStop hardcoding KUBECONFIG 88/73588/1
Cédric Ollivier [Fri, 21 Oct 2022 13:52:10 +0000 (15:52 +0200)]
Stop hardcoding KUBECONFIG

Change-Id: I6ac15eb3686d6502dfa1bbe179622693b1961f45
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit abcc9aa9e57a8af8e4479f897a77c22b16324f6a)

19 months agoCreate /var/lib/xtesting 85/73585/1
Cédric Ollivier [Fri, 21 Oct 2022 13:45:12 +0000 (15:45 +0200)]
Create /var/lib/xtesting

Change-Id: I8947b683731a98066bffb47bb49afaa636901446
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 59f27f97aaba00efb937b00494e42d79074d5055)

19 months agoUse the new homedir 82/73582/1
Cédric Ollivier [Fri, 21 Oct 2022 13:34:27 +0000 (15:34 +0200)]
Use the new homedir

Change-Id: Iaf6161cb3d7379f50702e3f412c233200bcdfae1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7c1a48eec52a131fd3702e759e67509939c48532)

19 months agoRemove nosetests 77/73577/1
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Remove nosetests

Change-Id: I13babcba37e7f3ce54b0ae38bd84ed2ee12ee935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoStop using root in testing containers 74/73574/2
Cédric Ollivier [Fri, 21 Oct 2022 08:46:31 +0000 (10:46 +0200)]
Stop using root in testing containers

It now creates and leverages xtesting as main user.

Change-Id: I5b871ac2729a875674514aab75ae079e1bf125f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b1e22e37cc436451b3519a0ef7f9704b5a86f9cc)

19 months agoFix tox list 71/73571/2
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Fix tox list

Change-Id: Ie996cbf5751e757cedf79d03f3a9b2649183f250
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate to Alpine 3.16 65/73565/3
Cédric Ollivier [Thu, 20 Oct 2022 11:15:24 +0000 (13:15 +0200)]
Update to Alpine 3.16

Change-Id: Ib630178c93d4a991f43611796e0c07975ce421ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 651fbe30a574fde8c62e7b73b3f05e40fba6e58b)

19 months agoFix all Ansible playbooks 66/73566/2
Cédric Ollivier [Thu, 20 Oct 2022 11:20:13 +0000 (13:20 +0200)]
Fix all Ansible playbooks

Change-Id: Ic267835da8f1b5a9ae11c7bbf604dd2237e48cab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate release tabs 63/73563/1
Cédric Ollivier [Thu, 20 Oct 2022 08:34:58 +0000 (10:34 +0200)]
Update release tabs

It takes latest releases into account

Change-Id: Idd27a9e3df8d58c41417e7b9ca60d679fb0c4ebd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agocnf conformance now returns non zero values 52/73552/2
Cédric Ollivier [Mon, 17 Oct 2022 15:01:41 +0000 (17:01 +0200)]
cnf conformance now returns non zero values

Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f0ebad3e5b23350483929a2a881f89d0f2822f5e)

19 months agoUse cnf certifaction criteria 49/73549/1
Cédric Ollivier [Mon, 17 Oct 2022 10:50:04 +0000 (12:50 +0200)]
Use cnf certifaction criteria

Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate cnf_testsuite v0.34.0 45/73545/2
Cédric Ollivier [Mon, 17 Oct 2022 07:09:54 +0000 (09:09 +0200)]
Update cnf_testsuite v0.34.0

It now runs cert (replacing workload)
It downgrades msg to warning as cnf_testsuite now returns
non 0 values.

Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoBy default just print all vulnerabilities 43/73543/1
Cédric Ollivier [Fri, 14 Oct 2022 12:35:19 +0000 (14:35 +0200)]
By default just print all vulnerabilities

It's the behavior expected by RA2.
Please change it via testcases.yaml if needed.

Change-Id: I84b02fa273f63ea1930bd356739243756032533d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit cf40e38be4d85c235a9d85a15f7fa326ebf356e6)

19 months agoUninstall falco and cri_tools after testing 36/73536/1
Cédric Ollivier [Mon, 10 Oct 2022 11:15:43 +0000 (13:15 +0200)]
Uninstall falco and cri_tools after testing

Functest runs several clusters in the same server.
It quickly failes if falco is still running (dkms
tries to unload the module which is in-use).

Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoPin netperf tools 34/73534/1
Cédric Ollivier [Thu, 6 Oct 2022 14:00:40 +0000 (16:00 +0200)]
Pin netperf tools

Change-Id: I36dde21d9af2cc7d96be4a8f0947d94491ae00c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate kube bench test cases to latest dev 31/73531/1
Cédric Ollivier [Thu, 6 Oct 2022 12:46:19 +0000 (14:46 +0200)]
Update kube bench test cases to latest dev

Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5926e9d259cf7f0c620aaa18aa2dc55a4c0208f5)

19 months agoUpdate hube-hunter 28/73528/1
Cédric Ollivier [Thu, 6 Oct 2022 08:10:50 +0000 (10:10 +0200)]
Update hube-hunter

Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 06eb071ee719c015f696ed6c0a685926a8a0ae62)

19 months agoDisable new testing Feature UserNamespacesStatelessPodsSupport 24/73524/1
Cédric Ollivier [Tue, 4 Oct 2022 14:45:46 +0000 (16:45 +0200)]
Disable new testing Feature UserNamespacesStatelessPodsSupport

All new features are defacto optional until RA2 changes
its status.

Change-Id: I23456ec525c728719cd01533122d6c79c2617631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f327dbcb465d64dadb1c8e717a3b4ec99403cd)

19 months agoComplete Alpine 3.15 update 14/73514/1
Cédric Ollivier [Fri, 30 Sep 2022 12:59:35 +0000 (14:59 +0200)]
Complete Alpine 3.15 update

Change-Id: I7cd5c8b22634af52d494b8a8d1eedb158f42d288
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoFix docker tags 12/73512/1
Cédric Ollivier [Fri, 30 Sep 2022 12:48:11 +0000 (14:48 +0200)]
Fix docker tags

Change-Id: Ibbeab1b318a097d1f53b9251214f2e6a85ee63f3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoReplace -noColor by --no-color 08/73508/1
Cédric Ollivier [Fri, 30 Sep 2022 09:20:46 +0000 (11:20 +0200)]
Replace -noColor by --no-color

--noColor is deprecated, use --no-color instead
Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags

Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b56474a4e5e5c60eb318d9605c6042158535ef8d)

19 months agoGet the right K8s e2e version 07/73507/1
Cédric Ollivier [Fri, 30 Sep 2022 09:30:05 +0000 (11:30 +0200)]
Get the right K8s e2e version

Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoSet defaultbranch in .gitreview 06/73506/1
Cédric Ollivier [Fri, 30 Sep 2022 09:32:41 +0000 (11:32 +0200)]
Set defaultbranch in .gitreview

Change-Id: I7e0c95e9c2e61bf7d8e29e07ecff92835051a871
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip Feature:ProxyTerminatingEndpoints 82/73382/1
Cédric Ollivier [Thu, 19 May 2022 12:39:33 +0000 (14:39 +0200)]
Skip Feature:ProxyTerminatingEndpoints

It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.

Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRevert latest docker builds 79/73379/1
Cédric Ollivier [Thu, 19 May 2022 09:08:22 +0000 (11:08 +0200)]
Revert latest docker builds

This reverts commit b2be1ff2852320940a1450ed5f2a6f4f4e91d7da.

Change-Id: If2852d6e85e11872fd0f2839445de014427dc535
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoInstall libxml2 and libxslt 76/73376/2
Cédric Ollivier [Wed, 18 May 2022 14:19:08 +0000 (16:19 +0200)]
Install libxml2 and libxslt

Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)

2 years agoPrepare v1.24 docker builds 77/73377/1
Cédric Ollivier [Wed, 18 May 2022 14:17:42 +0000 (16:17 +0200)]
Prepare v1.24 docker builds

Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoLeverage Xtesting 0.96 61/73261/1
Cédric Ollivier [Fri, 4 Mar 2022 12:08:15 +0000 (13:08 +0100)]
Leverage Xtesting 0.96

Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoOutdated need to install python2.7-dev in CircleCI 70/73170/1
Cédric Ollivier [Tue, 11 Jan 2022 13:30:36 +0000 (14:30 +0100)]
Outdated need to install python2.7-dev in CircleCI

Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove constraints on flake8 13/73113/3
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Remove constraints on flake8

Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate active releases in README.md 39/73139/1
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Update active releases in README.md

Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Feature testing 34/73134/1
Cédric Ollivier [Mon, 3 Jan 2022 20:47:41 +0000 (21:47 +0100)]
Skip new Feature testing

It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]

Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate linters and fix all new issues 21/73021/1
Cédric Ollivier [Mon, 15 Nov 2021 14:13:46 +0000 (15:13 +0100)]
Update linters and fix all new issues

It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.

Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet defaut provider to local back 46/72946/1
Cédric Ollivier [Tue, 5 Oct 2021 10:05:08 +0000 (12:05 +0200)]
Set defaut provider to local back

It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.

Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet encoding utf-8 when opening file 11/72911/2
Cédric Ollivier [Sat, 11 Sep 2021 08:24:53 +0000 (10:24 +0200)]
Set encoding utf-8 when opening file

Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFallback to item calculation 01/72901/1
Cédric Ollivier [Fri, 10 Sep 2021 15:59:25 +0000 (17:59 +0200)]
Fallback to item calculation

There is no final result if simple tag is called.

Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate CNF_TESTSUITE_TAG to v0.15.0 00/72900/1
Cédric Ollivier [Fri, 10 Sep 2021 14:42:36 +0000 (16:42 +0200)]
Update CNF_TESTSUITE_TAG to v0.15.0

Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove sig_network_serial 64/72864/1
Cédric Ollivier [Thu, 26 Aug 2021 14:12:37 +0000 (16:12 +0200)]
Remove sig_network_serial

PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].

sig_network_serial is now enpty and then can be safely removed.

[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238

Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove SIG CLI testing 61/72861/1
Cédric Ollivier [Thu, 26 Aug 2021 08:02:06 +0000 (10:02 +0200)]
Remove SIG CLI testing

It conforms to https://github.com/cntt-n/CNTT/pull/2579

Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwith to v1.23 alphas 48/72848/1
Cédric Ollivier [Fri, 20 Aug 2021 13:12:41 +0000 (15:12 +0200)]
Swith to v1.23 alphas

Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix py site-package path 40/72840/1
Cédric Ollivier [Thu, 19 Aug 2021 14:41:11 +0000 (16:41 +0200)]
Fix py site-package path

Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate to Alpine 3.14 11/72811/3
Cédric Ollivier [Wed, 11 Aug 2021 13:56:12 +0000 (15:56 +0200)]
Update to Alpine 3.14

It also disabled wrong order check as it fails vs kubernetes amongst
others.

[1] https://github.com/PyCQA/pylint/issues/2175

Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip git_repo testing 69/72769/1
Cédric Ollivier [Fri, 9 Jul 2021 12:14:54 +0000 (14:14 +0200)]
Skip git_repo testing

As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".

[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console

Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoPrint cnf_testsuite console on exceptions 61/72761/1
Cédric Ollivier [Wed, 7 Jul 2021 13:23:36 +0000 (15:23 +0200)]
Print cnf_testsuite console on exceptions

Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove k8s.io from ansible/site.yml 10/72710/1
Cédric Ollivier [Fri, 25 Jun 2021 16:02:51 +0000 (18:02 +0200)]
Remove k8s.io from ansible/site.yml

It's now up-to-date.
It also fixes ansible/site.cntt.yml

Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoMake clear all skipped Features according to CNTT RA2 Chapter6 93/72693/1
Cédric Ollivier [Sun, 20 Jun 2021 11:51:43 +0000 (13:51 +0200)]
Make clear all skipped Features according to CNTT RA2 Chapter6

Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAllow passing extra opts to e2e.test 89/72689/1
Cédric Ollivier [Sun, 20 Jun 2021 09:59:37 +0000 (11:59 +0200)]
Allow passing extra opts to e2e.test

E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd

Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove distlib from constraints 59/72659/1
Cédric Ollivier [Thu, 10 Jun 2021 12:10:30 +0000 (14:10 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd enchant in travis-ci 85/72585/1
Cédric Ollivier [Wed, 26 May 2021 14:50:09 +0000 (16:50 +0200)]
Add enchant in travis-ci

Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSwitch to focal in travis-ci gates 78/72578/1
Cédric Ollivier [Tue, 25 May 2021 14:16:47 +0000 (16:16 +0200)]
Switch to focal in travis-ci gates

Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove six from Openstack requirements 64/72564/1
Cédric Ollivier [Tue, 25 May 2021 08:59:19 +0000 (10:59 +0200)]
Remove six from Openstack requirements

  Attempting uninstall: six
    Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate cnf_testsuite to v0.11.2 63/72563/1
Cédric Ollivier [Tue, 25 May 2021 04:54:22 +0000 (06:54 +0200)]
Update cnf_testsuite to v0.11.2

https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2

Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoEasy creating next netperf branches 99/72499/1
Cédric Ollivier [Mon, 10 May 2021 12:05:52 +0000 (14:05 +0200)]
Easy creating next netperf branches

Change-Id: If3de6a18b7edd811157cb093434a7128617475d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish patch for plotperf 90/72490/1
Cédric Ollivier [Sun, 9 May 2021 17:26:36 +0000 (19:26 +0200)]
Publish patch for plotperf

Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoBenchmark Kubernetes Networking Performance 89/72489/1
Cédric Ollivier [Sun, 9 May 2021 15:15:33 +0000 (17:15 +0200)]
Benchmark Kubernetes Networking Performance

https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf

Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case results in README 85/72485/1
Cédric Ollivier [Wed, 5 May 2021 09:24:29 +0000 (11:24 +0200)]
Update test case results in README

Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDisable cnf_testsuite in master 84/72484/1
Cédric Ollivier [Fri, 7 May 2021 07:47:38 +0000 (09:47 +0200)]
Disable cnf_testsuite in master

cnf_testsuite asks for an official stable Kubernetes release
during cnf setup. It doesn't work defacto for Functest K8s master
(currently next v1.22).

Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate skip Feature lists 81/72481/1
Cédric Ollivier [Wed, 5 May 2021 07:02:12 +0000 (09:02 +0200)]
Update skip Feature lists

Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix cnf-conformance results filename 70/72470/1
Cédric Ollivier [Mon, 3 May 2021 14:03:08 +0000 (16:03 +0200)]
Fix cnf-conformance results filename

It also decreases criteria to 1 due to massive changes (dockerd).

Change-Id: Ic420139e6355debae183a77d6b0c574801b05076
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate cnf-conformance to cnf-testsuite 62/72462/1
Cédric Ollivier [Mon, 3 May 2021 07:32:59 +0000 (09:32 +0200)]
Update cnf-conformance to cnf-testsuite

https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite

Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoReduce number of threads 61/72461/1
Cédric Ollivier [Mon, 3 May 2021 07:33:44 +0000 (09:33 +0200)]
Reduce number of threads

It passed successfully with 10 threads (more doesn't reduce the
overall duration so much).

Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate master to next 1.22 56/72456/1
Cédric Ollivier [Sat, 1 May 2021 14:13:44 +0000 (16:13 +0200)]
Update master to next 1.22

Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMock os.makedirs 20/72420/4
Cédric Ollivier [Tue, 20 Apr 2021 15:19:06 +0000 (17:19 +0200)]
Mock os.makedirs

Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoInstall setuptools_scm before xrally 18/72418/1
Cédric Ollivier [Tue, 20 Apr 2021 12:30:56 +0000 (14:30 +0200)]
Install setuptools_scm before xrally

Else upper-constraints basically fails.

Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)

3 years agoSkip Network.should.set.TCP.CLOSE_WAIT.timeout 75/72375/1
Cédric Ollivier [Wed, 14 Apr 2021 22:00:33 +0000 (00:00 +0200)]
Skip Network.should.set.TCP.CLOSE_WAIT.timeout

https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml

Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove sig_node_serial as it's fully disruptive 69/72369/2
Cédric Ollivier [Wed, 14 Apr 2021 13:29:23 +0000 (15:29 +0200)]
Remove sig_node_serial as it's fully disruptive

There is no other test when NoExecuteTaintManager is skipped.
http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log

Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRun Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature 49/72349/1
Cédric Ollivier [Tue, 6 Apr 2021 12:13:58 +0000 (14:13 +0200)]
Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature

kind master allows dualstack since [1]

[1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551

Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove [k8s.io] testing 48/72348/1
Cédric Ollivier [Tue, 6 Apr 2021 09:57:13 +0000 (11:57 +0200)]
Remove [k8s.io] testing

v1.21 enforces sig ownership of all e2e tests [1].

[1] https://github.com/kubernetes/kubernetes/issues/98326

Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSwitch to latest-1.21 45/72345/1
Cédric Ollivier [Mon, 5 Apr 2021 08:58:29 +0000 (10:58 +0200)]
Switch to latest-1.21

Else it would consider v1.22.0-alpha.0 (N+2).

Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case list 41/72341/1
Cédric Ollivier [Sun, 4 Apr 2021 12:54:43 +0000 (14:54 +0200)]
Update test case list

Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd k8s_io and serial test cases 37/72337/1
Cédric Ollivier [Sun, 4 Apr 2021 12:45:10 +0000 (14:45 +0200)]
Add k8s_io and serial test cases

It completes the first sig test cases.

Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge sig_network_features in sig_network 33/72333/2
Cédric Ollivier [Sun, 4 Apr 2021 10:01:15 +0000 (12:01 +0200)]
Merge sig_network_features in sig_network

Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSpit conformance into 2 test cases 29/72329/2
Cédric Ollivier [Sat, 3 Apr 2021 09:14:51 +0000 (11:14 +0200)]
Spit conformance into 2 test cases

It hugely decreases the overall test duration.
(10 + 15 << 120)

Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix etcd image repository in etcd-depl.yaml 24/72324/1
Cédric Ollivier [Sat, 3 Apr 2021 07:37:06 +0000 (09:37 +0200)]
Fix etcd image repository in etcd-depl.yaml

Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix name in chronos-depl.yaml 18/72318/1
Cédric Ollivier [Fri, 2 Apr 2021 14:05:41 +0000 (16:05 +0200)]
Fix name in chronos-depl.yaml

Change-Id: Ia6972a216daaa9d807058b34b55615cab2c09b64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRun opnfv/functest-kubernetes-smoke sequentially 17/72317/1
Cédric Ollivier [Fri, 2 Apr 2021 11:12:52 +0000 (13:12 +0200)]
Run opnfv/functest-kubernetes-smoke sequentially

Now multithreading is enabled at test case level.

Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoProperly manage e2e parallel testing 04/72304/1
Cédric Ollivier [Fri, 2 Apr 2021 07:52:38 +0000 (09:52 +0200)]
Properly manage e2e parallel testing

It sets nodes=25 to run all tests in parallel.
It also beautifies all testcases.yml

Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRather use skeleton instead of local 03/72303/1
Cédric Ollivier [Thu, 1 Apr 2021 23:05:48 +0000 (01:05 +0200)]
Rather use skeleton instead of local

“skeleton”: cluster is accessed via the Kubernetes API and nothing
else.

https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/

Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDisable sig_scheduling as serial 98/72298/1
Cédric Ollivier [Wed, 31 Mar 2021 17:55:32 +0000 (19:55 +0200)]
Disable sig_scheduling as serial

All remaining sig-scheduling tests are serial and for the time
Functest doesn't run serial test cases.

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console

Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove the useless Feature prefix 71/72271/1
Cédric Ollivier [Thu, 25 Mar 2021 13:44:35 +0000 (14:44 +0100)]
Remove the useless Feature prefix

Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge "Exlude Serial and Feature:Feature:StorageVersionAPI"
Cedric Ollivier [Thu, 25 Mar 2021 12:01:01 +0000 (12:01 +0000)]
Merge "Exlude Serial and Feature:Feature:StorageVersionAPI"

3 years agoMerge "Blacklist all alpha testing"
Cedric Ollivier [Thu, 25 Mar 2021 12:00:55 +0000 (12:00 +0000)]
Merge "Blacklist all alpha testing"