functest-kubernetes.git
3 months agoFix upper-constraints 18/74518/1 stable/v1.24
Cédric Ollivier [Wed, 17 Jan 2024 16:34:24 +0000 (17:34 +0100)]
Fix upper-constraints

Change-Id: If56940e0821c94febd5b3698dcdff68fe0b86c6f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 92a3461f56a0d808af645dc01f7e49c067cc1cbf)

3 months agoSet the rigth working dir 03/74503/1
Cédric Ollivier [Tue, 16 Jan 2024 16:02:30 +0000 (17:02 +0100)]
Set the rigth working dir

Else zip_compaign fails

Change-Id: Ib26b7c313e29c68098bfcac70cb44c292196adb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5a5bbb179ab39109d0ab921a4239d5e9917919b7)

4 months agoUpdated from global requirements 62/74462/1
Cédric Ollivier [Tue, 9 Jan 2024 16:09:22 +0000 (17:09 +0100)]
Updated from global requirements

Change-Id: I51f9d4b6266150d02438e3dd2cf42f86a6469176
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit eaea540c2f3a19ba13b69c3624f2d26c15d0f875)

4 months agoFix git url 37/74437/1
Cédric Ollivier [Tue, 9 Jan 2024 13:57:04 +0000 (14:57 +0100)]
Fix git url

Change-Id: I7c774ccc027feae75fa1623545ea8ef7af50ccc9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f01d93b5abe20f6b1402d3b8fdc02c1dc772b90d)

4 months agoFix pylint issues in netperf 32/74432/1
Cédric Ollivier [Tue, 9 Jan 2024 13:36:30 +0000 (14:36 +0100)]
Fix pylint issues in netperf

Change-Id: I47eac42fd30e857e2a94a7b5caa5850b3c7c9196
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e98c46bdcc7087b55ce0339111c7bedc450e94b0)

4 months agoMake ansible/site.gate.yml up-to-date 25/74425/1
Cédric Ollivier [Tue, 9 Jan 2024 12:17:55 +0000 (13:17 +0100)]
Make ansible/site.gate.yml up-to-date

Change-Id: I4607bc297e21e569af6e80a4ac6a0e6aec68ec33
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 months agoRemove tox pip_version in tox.ini 20/74420/1
Cédric Ollivier [Tue, 9 Jan 2024 09:30:31 +0000 (10:30 +0100)]
Remove tox pip_version in tox.ini

Change-Id: Iafae57b729650e70c084f98abafc6645174a893e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit fddcb581e3f1ab10481eeb6b3a739567df2ddd61)

4 months agoHelp Debugging when e2e result parsing fails 95/74395/1
Cédric Ollivier [Thu, 21 Dec 2023 13:53:49 +0000 (14:53 +0100)]
Help Debugging when e2e result parsing fails

Change-Id: I7f153b0ddef25b0317d8e9a8b2dad55ab580b388
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit da0f27e6cc0a416e3a3a89639b7280836daf296d)

4 months agoPrint netperf logs in console if exception 94/74394/1
Cédric Ollivier [Fri, 22 Dec 2023 07:49:10 +0000 (08:49 +0100)]
Print netperf logs in console if exception

Change-Id: I7ea76aaa595ba7716d4a355f8a1f2d73c2af3ae8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 10d72a2e5c8a78cde617d2c10fa0ea46d90f6924)

4 months agoProtect vs CNF TestSuite instabilities 83/74383/1
Cédric Ollivier [Thu, 21 Dec 2023 10:06:19 +0000 (11:06 +0100)]
Protect vs CNF TestSuite instabilities

Change-Id: I8e714abe603180d69a363e4293f44bb3c5cd1255
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 36915488c21d42a112298c3a52fc2b09d099486f)

4 months agoFix CNF TestSuite's log level 77/74377/1
Cédric Ollivier [Thu, 21 Dec 2023 08:26:17 +0000 (09:26 +0100)]
Fix CNF TestSuite's log level

Change-Id: I9a7e1a9d17fd575b7e6077d8ccf5dd5d1a259717
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75db5520f3fffc0e3b5cae2eead6179a44d91da9)

4 months agoExit if early failure in cnf_testsuite 71/74371/1
Cédric Ollivier [Wed, 20 Dec 2023 14:29:02 +0000 (15:29 +0100)]
Exit if early failure in cnf_testsuite

Change-Id: I3a6a264a73bdc73c1c90471948316d216cf6ad98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 65780898fb6c3d4d7131916a6a6e342f3557b685)

4 months agoUpdate cnf testsuite to v0.45.0 65/74365/1
Cédric Ollivier [Fri, 8 Dec 2023 09:57:20 +0000 (10:57 +0100)]
Update cnf testsuite to v0.45.0

Change-Id: I6abd724b2dd4ce8fa014fe9167e853f2d300e4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dc1ee47accf9c188e1f309479f5906afb693648c)

4 months agoFix Feature:NodeAuthenticator testing 47/74347/1
Cédric Ollivier [Mon, 18 Dec 2023 09:05:14 +0000 (10:05 +0100)]
Fix Feature:NodeAuthenticator testing

https://github.com/kubernetes/kubernetes/pull/109719

Change-Id: Ib7739b1fd292d6fa728db4f063e9e70ec2cdb8f8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 months agok8s.gcr.io -> registry.k8s.io 25/74325/1
Cédric Ollivier [Tue, 5 Dec 2023 14:10:51 +0000 (15:10 +0100)]
k8s.gcr.io -> registry.k8s.io

https://kubernetes.io/blog/2022/11/28/registry-k8s-io-faster-cheaper-ga/
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/

Change-Id: Ibae7149b6da15aa18f536d9ffdf09d155b591692
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4f21ac9faf95be6216ddb2b564a6ca4fc6e3f53c)
(cherry picked from commit fd01d14673e8eff2f607e691c58529d06309c9ee)
(cherry picked from commit 606d2d9221276f80088ecd68fbf27b092aa7b613)

5 months agoAdd Alpine gcompat package 23/74323/1
Cédric Ollivier [Fri, 1 Dec 2023 12:14:45 +0000 (13:14 +0100)]
Add Alpine gcompat package

Change-Id: Iaecbb67b6042197cd8a6f7657b6f348e3bf0b13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 41ca9d7f98eead4bcdcf36211130c84b11e78f47)

5 months agoMake xtesting owner of /src/cnf-testsuite 13/74313/1
Cédric Ollivier [Fri, 8 Dec 2023 08:34:21 +0000 (09:34 +0100)]
Make xtesting owner of /src/cnf-testsuite

Change-Id: I8e2d50e8b3af829181d8f9f2a0fcb944d83797e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 months agoEnforce pip's legacy-resolver 11/74311/1
Cédric Ollivier [Fri, 1 Dec 2023 09:03:14 +0000 (10:03 +0100)]
Enforce pip's legacy-resolver

Change-Id: Id0b97782db354cfa66656746ee03f102b5c4d6e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e085945c2c9ae516d0cacf09cc5fe42440f339f6)

5 months agoRemove PyYaml from upper constraints 10/74310/1
Cédric Ollivier [Thu, 30 Nov 2023 16:03:56 +0000 (17:03 +0100)]
Remove PyYaml from upper constraints

It doesnt compile because of cython

Change-Id: I6e1c531a2f7b3384bc4a5256120d917dec7c43c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0f6720448bd99fd9b732f124da1a1272ee331589)

5 months agonetperf csv output dir must be writable 07/74307/1
Cédric Ollivier [Thu, 7 Dec 2023 17:41:16 +0000 (18:41 +0100)]
netperf csv output dir must be writable

It changes working dir in a writable one.

Change-Id: I358233cff30c35da0d04921ac0521645a00b2656
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 677e872910555585f0400e99585d821491cd1c43)

6 months agoAllow building Functest Kubernetes Virtual Machines 22/74222/1
Cédric Ollivier [Fri, 20 Oct 2023 06:46:19 +0000 (08:46 +0200)]
Allow building Functest Kubernetes Virtual Machines

Change-Id: I0a18096fc10547423baf6282e3eb9f4d96cd8473
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 049f674dd8a1b0e16ba8b37df72f936d8d0f0e5b)

12 months agoSet xtesting as owner of rally files 07/74007/1
Cédric Ollivier [Fri, 5 May 2023 15:02:33 +0000 (17:02 +0200)]
Set xtesting as owner of rally files

Change-Id: I35658a469e3b54973d24959a0771e8fa749136ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
13 months agoRun pre-commit in the Functest K8s gates 26/73926/1
Cédric Ollivier [Mon, 20 Mar 2023 09:58:28 +0000 (10:58 +0100)]
Run pre-commit in the Functest K8s gates

Change-Id: I3957dbde922d8ed8edc47d5cf1aee1475f117836
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bd1c09890c7c1fff392572de709a0ccc6a283b6)

14 months agoFix url typo in README 72/73872/1
Cédric Ollivier [Thu, 2 Mar 2023 15:42:33 +0000 (16:42 +0100)]
Fix url typo in README

Co-authored-by Peter Pongracz <peter.1.pongracz@nokia.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Idd4c0fccae145ab5fd4a4dbb45346dd1d30de23b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c99d1bc1af18ec3c717dd74faae962f0303dff1b)

15 months agoUpdate README.md 32/73832/1
Cédric Ollivier [Tue, 24 Jan 2023 14:34:15 +0000 (15:34 +0100)]
Update README.md

It take latest updates into account.

Change-Id: I0a6af492c99cb49c326734c061b7934ea7a12127
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 142bc4a751bf5568cd0bb13c8550959f9a0b83c2)

15 months agoFix letter is lowercase in repositories.yml 20/73820/1
Cédric Ollivier [Mon, 23 Jan 2023 10:05:31 +0000 (11:05 +0100)]
Fix letter is lowercase in repositories.yml

Co-authored-by: Peter Pongracz <peter.1.pongracz@nokia.com>
Change-Id: I78be8192239cad58b25449c106da3e1f558bf13b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d17ec335dc198c17e0bf167350f154ec64876d58)

18 months agoUse new kubeconfig path in README.md 02/73602/1
Cédric Ollivier [Tue, 25 Oct 2022 08:46:03 +0000 (10:46 +0200)]
Use new kubeconfig path in README.md

Change-Id: I1cee2d1ff47a1ab4f79c08d7dc00eb2ab8e6507e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f6eba4b5b93b994a6773867fdb123c2c34a56415)

18 months agoUse Path.home() instead of ~ 94/73594/1
Cédric Ollivier [Fri, 21 Oct 2022 15:21:54 +0000 (17:21 +0200)]
Use Path.home() instead of ~

Change-Id: I5863f4e0315b67a07dab4756857dba7aa37932f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d744fb5276d47fb3ba7ad2d4cb1fb2d3bfaca3eb)

18 months agoStop hardcoding KUBECONFIG 91/73591/1
Cédric Ollivier [Fri, 21 Oct 2022 13:52:10 +0000 (15:52 +0200)]
Stop hardcoding KUBECONFIG

Change-Id: I6ac15eb3686d6502dfa1bbe179622693b1961f45
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit abcc9aa9e57a8af8e4479f897a77c22b16324f6a)

18 months agoCreate /var/lib/xtesting 86/73586/1
Cédric Ollivier [Fri, 21 Oct 2022 13:45:12 +0000 (15:45 +0200)]
Create /var/lib/xtesting

Change-Id: I8947b683731a98066bffb47bb49afaa636901446
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 59f27f97aaba00efb937b00494e42d79074d5055)

18 months agoUse the new homedir 83/73583/1
Cédric Ollivier [Fri, 21 Oct 2022 13:34:27 +0000 (15:34 +0200)]
Use the new homedir

Change-Id: Iaf6161cb3d7379f50702e3f412c233200bcdfae1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7c1a48eec52a131fd3702e759e67509939c48532)

18 months agoFix tox list 76/73576/1
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Fix tox list

Change-Id: Ie996cbf5751e757cedf79d03f3a9b2649183f250
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b33276d0596b86176df7595f26d5e7bb56a9016b)

18 months agoStop using root in testing containers 75/73575/1
Cédric Ollivier [Fri, 21 Oct 2022 08:46:31 +0000 (10:46 +0200)]
Stop using root in testing containers

It now creates and leverages xtesting as main user.

Change-Id: I5b871ac2729a875674514aab75ae079e1bf125f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b1e22e37cc436451b3519a0ef7f9704b5a86f9cc)

18 months agoUpdate to Alpine 3.16 67/73567/3
Cédric Ollivier [Thu, 20 Oct 2022 11:15:24 +0000 (13:15 +0200)]
Update to Alpine 3.16

Change-Id: Ib630178c93d4a991f43611796e0c07975ce421ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 651fbe30a574fde8c62e7b73b3f05e40fba6e58b)

18 months agoFix all Ansible playbooks 68/73568/2
Cédric Ollivier [Thu, 20 Oct 2022 11:20:13 +0000 (13:20 +0200)]
Fix all Ansible playbooks

Change-Id: Ic267835da8f1b5a9ae11c7bbf604dd2237e48cab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dc9d165a5db87fe73d4b75350b8d6aa9ba0dca3d)

18 months agoUpdate release tabs 60/73560/1
Cédric Ollivier [Thu, 20 Oct 2022 08:34:58 +0000 (10:34 +0200)]
Update release tabs

It takes latest releases into account

Change-Id: Idd27a9e3df8d58c41417e7b9ca60d679fb0c4ebd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agocnf conformance now returns non zero values 53/73553/2
Cédric Ollivier [Mon, 17 Oct 2022 15:01:41 +0000 (17:01 +0200)]
cnf conformance now returns non zero values

Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f0ebad3e5b23350483929a2a881f89d0f2822f5e)

18 months agoUse cnf certifaction criteria 48/73548/1
Cédric Ollivier [Mon, 17 Oct 2022 10:50:04 +0000 (12:50 +0200)]
Use cnf certifaction criteria

Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUpdate cnf_testsuite v0.34.0 47/73547/2
Cédric Ollivier [Mon, 17 Oct 2022 07:09:54 +0000 (09:09 +0200)]
Update cnf_testsuite v0.34.0

It now runs cert (replacing workload)
It downgrades msg to warning as cnf_testsuite now returns
non 0 values.

Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4338a2532600e659179335a5f5f71ab15f83f8d7)

19 months agoBy default just print all vulnerabilities 44/73544/1
Cédric Ollivier [Fri, 14 Oct 2022 12:35:19 +0000 (14:35 +0200)]
By default just print all vulnerabilities

It's the behavior expected by RA2.
Please change it via testcases.yaml if needed.

Change-Id: I84b02fa273f63ea1930bd356739243756032533d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit cf40e38be4d85c235a9d85a15f7fa326ebf356e6)

19 months agoUninstall falco and cri_tools after testing 38/73538/1
Cédric Ollivier [Mon, 10 Oct 2022 11:15:43 +0000 (13:15 +0200)]
Uninstall falco and cri_tools after testing

Functest runs several clusters in the same server.
It quickly failes if falco is still running (dkms
tries to unload the module which is in-use).

Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 334cdea22b2c47c75523399ed3ebfa08f105e57c)

19 months agoPin netperf tools 33/73533/1
Cédric Ollivier [Thu, 6 Oct 2022 14:00:40 +0000 (16:00 +0200)]
Pin netperf tools

Change-Id: I36dde21d9af2cc7d96be4a8f0947d94491ae00c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate kube bench test cases to latest dev 32/73532/1
Cédric Ollivier [Thu, 6 Oct 2022 12:46:19 +0000 (14:46 +0200)]
Update kube bench test cases to latest dev

Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate hube-hunter 29/73529/1
Cédric Ollivier [Thu, 6 Oct 2022 08:10:50 +0000 (10:10 +0200)]
Update hube-hunter

Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 06eb071ee719c015f696ed6c0a685926a8a0ae62)

19 months agoComplete Alpine 3.15 update 15/73515/1
Cédric Ollivier [Fri, 30 Sep 2022 12:59:35 +0000 (14:59 +0200)]
Complete Alpine 3.15 update

Change-Id: I7cd5c8b22634af52d494b8a8d1eedb158f42d288
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9cb9e74a1bfd1a185ac72e409851e6d951c6ac82)

19 months agoFix tags in build.sh 13/73513/1
Cédric Ollivier [Fri, 30 Sep 2022 12:53:03 +0000 (14:53 +0200)]
Fix tags in build.sh

Change-Id: I06ae108a154560d8a2cc31c4a648a699606a634d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoDon't Replace -noColor by --no-color in v1.24 10/73510/1
Cédric Ollivier [Fri, 30 Sep 2022 10:19:51 +0000 (12:19 +0200)]
Don't Replace -noColor by --no-color in v1.24

Change-Id: I565c6e6c2eb4ccc44dc374e9afd5375f0bceb9fd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoReplace -noColor by --no-color 09/73509/1
Cédric Ollivier [Fri, 30 Sep 2022 09:20:46 +0000 (11:20 +0200)]
Replace -noColor by --no-color

--noColor is deprecated, use --no-color instead
Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags

Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b56474a4e5e5c60eb318d9605c6042158535ef8d)

19 months agoGet the right K8s e2e version 04/73504/1
Cédric Ollivier [Fri, 30 Sep 2022 09:30:05 +0000 (11:30 +0200)]
Get the right K8s e2e version

Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
23 months agoSkip Feature:ProxyTerminatingEndpoints 83/73383/1
Cédric Ollivier [Thu, 19 May 2022 12:39:33 +0000 (14:39 +0200)]
Skip Feature:ProxyTerminatingEndpoints

It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.

Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7d1b01dafdfcd65bea716b61a6036a972dcf395b)

23 months agoUpdate gitreview 78/73378/1
Cédric Ollivier [Thu, 19 May 2022 09:06:24 +0000 (11:06 +0200)]
Update gitreview

Change-Id: Ie09d962d6b65e93289635ff48319c2af0157959a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
23 months agoInstall libxml2 and libxslt 76/73376/2
Cédric Ollivier [Wed, 18 May 2022 14:19:08 +0000 (16:19 +0200)]
Install libxml2 and libxslt

Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)

23 months agoPrepare v1.24 docker builds 77/73377/1
Cédric Ollivier [Wed, 18 May 2022 14:17:42 +0000 (16:17 +0200)]
Prepare v1.24 docker builds

Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoLeverage Xtesting 0.96 61/73261/1
Cédric Ollivier [Fri, 4 Mar 2022 12:08:15 +0000 (13:08 +0100)]
Leverage Xtesting 0.96

Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoOutdated need to install python2.7-dev in CircleCI 70/73170/1
Cédric Ollivier [Tue, 11 Jan 2022 13:30:36 +0000 (14:30 +0100)]
Outdated need to install python2.7-dev in CircleCI

Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove constraints on flake8 13/73113/3
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Remove constraints on flake8

Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate active releases in README.md 39/73139/1
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Update active releases in README.md

Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Feature testing 34/73134/1
Cédric Ollivier [Mon, 3 Jan 2022 20:47:41 +0000 (21:47 +0100)]
Skip new Feature testing

It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]

Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate linters and fix all new issues 21/73021/1
Cédric Ollivier [Mon, 15 Nov 2021 14:13:46 +0000 (15:13 +0100)]
Update linters and fix all new issues

It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.

Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet defaut provider to local back 46/72946/1
Cédric Ollivier [Tue, 5 Oct 2021 10:05:08 +0000 (12:05 +0200)]
Set defaut provider to local back

It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.

Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet encoding utf-8 when opening file 11/72911/2
Cédric Ollivier [Sat, 11 Sep 2021 08:24:53 +0000 (10:24 +0200)]
Set encoding utf-8 when opening file

Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFallback to item calculation 01/72901/1
Cédric Ollivier [Fri, 10 Sep 2021 15:59:25 +0000 (17:59 +0200)]
Fallback to item calculation

There is no final result if simple tag is called.

Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate CNF_TESTSUITE_TAG to v0.15.0 00/72900/1
Cédric Ollivier [Fri, 10 Sep 2021 14:42:36 +0000 (16:42 +0200)]
Update CNF_TESTSUITE_TAG to v0.15.0

Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove sig_network_serial 64/72864/1
Cédric Ollivier [Thu, 26 Aug 2021 14:12:37 +0000 (16:12 +0200)]
Remove sig_network_serial

PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].

sig_network_serial is now enpty and then can be safely removed.

[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238

Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove SIG CLI testing 61/72861/1
Cédric Ollivier [Thu, 26 Aug 2021 08:02:06 +0000 (10:02 +0200)]
Remove SIG CLI testing

It conforms to https://github.com/cntt-n/CNTT/pull/2579

Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwith to v1.23 alphas 48/72848/1
Cédric Ollivier [Fri, 20 Aug 2021 13:12:41 +0000 (15:12 +0200)]
Swith to v1.23 alphas

Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix py site-package path 40/72840/1
Cédric Ollivier [Thu, 19 Aug 2021 14:41:11 +0000 (16:41 +0200)]
Fix py site-package path

Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate to Alpine 3.14 11/72811/3
Cédric Ollivier [Wed, 11 Aug 2021 13:56:12 +0000 (15:56 +0200)]
Update to Alpine 3.14

It also disabled wrong order check as it fails vs kubernetes amongst
others.

[1] https://github.com/PyCQA/pylint/issues/2175

Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip git_repo testing 69/72769/1
Cédric Ollivier [Fri, 9 Jul 2021 12:14:54 +0000 (14:14 +0200)]
Skip git_repo testing

As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".

[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console

Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoPrint cnf_testsuite console on exceptions 61/72761/1
Cédric Ollivier [Wed, 7 Jul 2021 13:23:36 +0000 (15:23 +0200)]
Print cnf_testsuite console on exceptions

Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove k8s.io from ansible/site.yml 10/72710/1
Cédric Ollivier [Fri, 25 Jun 2021 16:02:51 +0000 (18:02 +0200)]
Remove k8s.io from ansible/site.yml

It's now up-to-date.
It also fixes ansible/site.cntt.yml

Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoMake clear all skipped Features according to CNTT RA2 Chapter6 93/72693/1
Cédric Ollivier [Sun, 20 Jun 2021 11:51:43 +0000 (13:51 +0200)]
Make clear all skipped Features according to CNTT RA2 Chapter6

Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAllow passing extra opts to e2e.test 89/72689/1
Cédric Ollivier [Sun, 20 Jun 2021 09:59:37 +0000 (11:59 +0200)]
Allow passing extra opts to e2e.test

E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd

Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove distlib from constraints 59/72659/1
Cédric Ollivier [Thu, 10 Jun 2021 12:10:30 +0000 (14:10 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAdd enchant in travis-ci 85/72585/1
Cédric Ollivier [Wed, 26 May 2021 14:50:09 +0000 (16:50 +0200)]
Add enchant in travis-ci

Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwitch to focal in travis-ci gates 78/72578/1
Cédric Ollivier [Tue, 25 May 2021 14:16:47 +0000 (16:16 +0200)]
Switch to focal in travis-ci gates

Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove six from Openstack requirements 64/72564/1
Cédric Ollivier [Tue, 25 May 2021 08:59:19 +0000 (10:59 +0200)]
Remove six from Openstack requirements

  Attempting uninstall: six
    Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate cnf_testsuite to v0.11.2 63/72563/1
Cédric Ollivier [Tue, 25 May 2021 04:54:22 +0000 (06:54 +0200)]
Update cnf_testsuite to v0.11.2

https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2

Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoEasy creating next netperf branches 99/72499/1
Cédric Ollivier [Mon, 10 May 2021 12:05:52 +0000 (14:05 +0200)]
Easy creating next netperf branches

Change-Id: If3de6a18b7edd811157cb093434a7128617475d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish patch for plotperf 90/72490/1
Cédric Ollivier [Sun, 9 May 2021 17:26:36 +0000 (19:26 +0200)]
Publish patch for plotperf

Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoBenchmark Kubernetes Networking Performance 89/72489/1
Cédric Ollivier [Sun, 9 May 2021 15:15:33 +0000 (17:15 +0200)]
Benchmark Kubernetes Networking Performance

https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf

Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case results in README 85/72485/1
Cédric Ollivier [Wed, 5 May 2021 09:24:29 +0000 (11:24 +0200)]
Update test case results in README

Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDisable cnf_testsuite in master 84/72484/1
Cédric Ollivier [Fri, 7 May 2021 07:47:38 +0000 (09:47 +0200)]
Disable cnf_testsuite in master

cnf_testsuite asks for an official stable Kubernetes release
during cnf setup. It doesn't work defacto for Functest K8s master
(currently next v1.22).

Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate skip Feature lists 81/72481/1
Cédric Ollivier [Wed, 5 May 2021 07:02:12 +0000 (09:02 +0200)]
Update skip Feature lists

Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix cnf-conformance results filename 70/72470/1
Cédric Ollivier [Mon, 3 May 2021 14:03:08 +0000 (16:03 +0200)]
Fix cnf-conformance results filename

It also decreases criteria to 1 due to massive changes (dockerd).

Change-Id: Ic420139e6355debae183a77d6b0c574801b05076
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate cnf-conformance to cnf-testsuite 62/72462/1
Cédric Ollivier [Mon, 3 May 2021 07:32:59 +0000 (09:32 +0200)]
Update cnf-conformance to cnf-testsuite

https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite

Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoReduce number of threads 61/72461/1
Cédric Ollivier [Mon, 3 May 2021 07:33:44 +0000 (09:33 +0200)]
Reduce number of threads

It passed successfully with 10 threads (more doesn't reduce the
overall duration so much).

Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate master to next 1.22 56/72456/1
Cédric Ollivier [Sat, 1 May 2021 14:13:44 +0000 (16:13 +0200)]
Update master to next 1.22

Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMock os.makedirs 20/72420/4
Cédric Ollivier [Tue, 20 Apr 2021 15:19:06 +0000 (17:19 +0200)]
Mock os.makedirs

Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoInstall setuptools_scm before xrally 18/72418/1
Cédric Ollivier [Tue, 20 Apr 2021 12:30:56 +0000 (14:30 +0200)]
Install setuptools_scm before xrally

Else upper-constraints basically fails.

Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)

3 years agoSkip Network.should.set.TCP.CLOSE_WAIT.timeout 75/72375/1
Cédric Ollivier [Wed, 14 Apr 2021 22:00:33 +0000 (00:00 +0200)]
Skip Network.should.set.TCP.CLOSE_WAIT.timeout

https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml

Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove sig_node_serial as it's fully disruptive 69/72369/2
Cédric Ollivier [Wed, 14 Apr 2021 13:29:23 +0000 (15:29 +0200)]
Remove sig_node_serial as it's fully disruptive

There is no other test when NoExecuteTaintManager is skipped.
http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log

Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRun Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature 49/72349/1
Cédric Ollivier [Tue, 6 Apr 2021 12:13:58 +0000 (14:13 +0200)]
Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature

kind master allows dualstack since [1]

[1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551

Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove [k8s.io] testing 48/72348/1
Cédric Ollivier [Tue, 6 Apr 2021 09:57:13 +0000 (11:57 +0200)]
Remove [k8s.io] testing

v1.21 enforces sig ownership of all e2e tests [1].

[1] https://github.com/kubernetes/kubernetes/issues/98326

Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSwitch to latest-1.21 45/72345/1
Cédric Ollivier [Mon, 5 Apr 2021 08:58:29 +0000 (10:58 +0200)]
Switch to latest-1.21

Else it would consider v1.22.0-alpha.0 (N+2).

Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case list 41/72341/1
Cédric Ollivier [Sun, 4 Apr 2021 12:54:43 +0000 (14:54 +0200)]
Update test case list

Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd k8s_io and serial test cases 37/72337/1
Cédric Ollivier [Sun, 4 Apr 2021 12:45:10 +0000 (14:45 +0200)]
Add k8s_io and serial test cases

It completes the first sig test cases.

Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge sig_network_features in sig_network 33/72333/2
Cédric Ollivier [Sun, 4 Apr 2021 10:01:15 +0000 (12:01 +0200)]
Merge sig_network_features in sig_network

Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSpit conformance into 2 test cases 29/72329/2
Cédric Ollivier [Sat, 3 Apr 2021 09:14:51 +0000 (11:14 +0200)]
Spit conformance into 2 test cases

It hugely decreases the overall test duration.
(10 + 15 << 120)

Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix etcd image repository in etcd-depl.yaml 24/72324/1
Cédric Ollivier [Sat, 3 Apr 2021 07:37:06 +0000 (09:37 +0200)]
Fix etcd image repository in etcd-depl.yaml

Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>