functest-kubernetes.git
5 months agoUpdate cnf testsuite to v0.45.0 64/74364/1
Cédric Ollivier [Fri, 8 Dec 2023 09:57:20 +0000 (10:57 +0100)]
Update cnf testsuite to v0.45.0

Change-Id: I6abd724b2dd4ce8fa014fe9167e853f2d300e4c7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dc1ee47accf9c188e1f309479f5906afb693648c)

5 months agok8s.gcr.io -> registry.k8s.io 24/74324/1
Cédric Ollivier [Tue, 5 Dec 2023 14:10:51 +0000 (15:10 +0100)]
k8s.gcr.io -> registry.k8s.io

https://kubernetes.io/blog/2022/11/28/registry-k8s-io-faster-cheaper-ga/
https://kubernetes.io/blog/2023/03/10/image-registry-redirect/

Change-Id: Ibae7149b6da15aa18f536d9ffdf09d155b591692
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4f21ac9faf95be6216ddb2b564a6ca4fc6e3f53c)
(cherry picked from commit fd01d14673e8eff2f607e691c58529d06309c9ee)

5 months agoAdd Alpine gcompat package 22/74322/1
Cédric Ollivier [Fri, 1 Dec 2023 12:14:45 +0000 (13:14 +0100)]
Add Alpine gcompat package

Change-Id: Iaecbb67b6042197cd8a6f7657b6f348e3bf0b13c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 41ca9d7f98eead4bcdcf36211130c84b11e78f47)

5 months agoMake xtesting owner of /src/cnf-testsuite 12/74312/1
Cédric Ollivier [Fri, 8 Dec 2023 08:34:21 +0000 (09:34 +0100)]
Make xtesting owner of /src/cnf-testsuite

Change-Id: I8e2d50e8b3af829181d8f9f2a0fcb944d83797e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
5 months agoEnforce pip's legacy-resolver 09/74309/1
Cédric Ollivier [Fri, 1 Dec 2023 09:03:14 +0000 (10:03 +0100)]
Enforce pip's legacy-resolver

Change-Id: Id0b97782db354cfa66656746ee03f102b5c4d6e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e085945c2c9ae516d0cacf09cc5fe42440f339f6)

5 months agoRemove PyYaml from upper constraints 08/74308/1
Cédric Ollivier [Thu, 30 Nov 2023 16:03:56 +0000 (17:03 +0100)]
Remove PyYaml from upper constraints

It doesnt compile because of cython

Change-Id: I6e1c531a2f7b3384bc4a5256120d917dec7c43c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0f6720448bd99fd9b732f124da1a1272ee331589)

5 months agonetperf csv output dir must be writable 06/74306/1
Cédric Ollivier [Thu, 7 Dec 2023 17:41:16 +0000 (18:41 +0100)]
netperf csv output dir must be writable

It changes working dir in a writable one.

Change-Id: I358233cff30c35da0d04921ac0521645a00b2656
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 677e872910555585f0400e99585d821491cd1c43)

7 months agoAllow building Functest Kubernetes Virtual Machines 21/74221/1
Cédric Ollivier [Fri, 20 Oct 2023 06:46:19 +0000 (08:46 +0200)]
Allow building Functest Kubernetes Virtual Machines

Change-Id: I0a18096fc10547423baf6282e3eb9f4d96cd8473
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 049f674dd8a1b0e16ba8b37df72f936d8d0f0e5b)

12 months agoSet xtesting as owner of rally files 06/74006/1
Cédric Ollivier [Fri, 5 May 2023 15:02:33 +0000 (17:02 +0200)]
Set xtesting as owner of rally files

Change-Id: I35658a469e3b54973d24959a0771e8fa749136ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoRun pre-commit in the Functest K8s gates 25/73925/1
Cédric Ollivier [Mon, 20 Mar 2023 09:58:28 +0000 (10:58 +0100)]
Run pre-commit in the Functest K8s gates

Change-Id: I3957dbde922d8ed8edc47d5cf1aee1475f117836
Co-authored-by: Guillaume Lambert <guillaume.lambert@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bd1c09890c7c1fff392572de709a0ccc6a283b6)

14 months agoFix url typo in README 71/73871/1
Cédric Ollivier [Thu, 2 Mar 2023 15:42:33 +0000 (16:42 +0100)]
Fix url typo in README

Co-authored-by Peter Pongracz <peter.1.pongracz@nokia.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Idd4c0fccae145ab5fd4a4dbb45346dd1d30de23b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c99d1bc1af18ec3c717dd74faae962f0303dff1b)

16 months agoUpdate README.md 30/73830/1
Cédric Ollivier [Tue, 24 Jan 2023 14:34:15 +0000 (15:34 +0100)]
Update README.md

It take latest updates into account.

Change-Id: I0a6af492c99cb49c326734c061b7934ea7a12127
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 142bc4a751bf5568cd0bb13c8550959f9a0b83c2)

16 months agoFix letter is lowercase in repositories.yml 19/73819/1
Cédric Ollivier [Mon, 23 Jan 2023 10:05:31 +0000 (11:05 +0100)]
Fix letter is lowercase in repositories.yml

Co-authored-by: Peter Pongracz <peter.1.pongracz@nokia.com>
Change-Id: I78be8192239cad58b25449c106da3e1f558bf13b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d17ec335dc198c17e0bf167350f154ec64876d58)

19 months agoUse new kubeconfig path in README.md 01/73601/1
Cédric Ollivier [Tue, 25 Oct 2022 08:46:03 +0000 (10:46 +0200)]
Use new kubeconfig path in README.md

Change-Id: I1cee2d1ff47a1ab4f79c08d7dc00eb2ab8e6507e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f6eba4b5b93b994a6773867fdb123c2c34a56415)

19 months agoUse Path.home() instead of ~ 93/73593/1
Cédric Ollivier [Fri, 21 Oct 2022 15:21:54 +0000 (17:21 +0200)]
Use Path.home() instead of ~

Change-Id: I5863f4e0315b67a07dab4756857dba7aa37932f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d744fb5276d47fb3ba7ad2d4cb1fb2d3bfaca3eb)

19 months agoStop hardcoding KUBECONFIG 88/73588/1
Cédric Ollivier [Fri, 21 Oct 2022 13:52:10 +0000 (15:52 +0200)]
Stop hardcoding KUBECONFIG

Change-Id: I6ac15eb3686d6502dfa1bbe179622693b1961f45
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit abcc9aa9e57a8af8e4479f897a77c22b16324f6a)

19 months agoCreate /var/lib/xtesting 85/73585/1
Cédric Ollivier [Fri, 21 Oct 2022 13:45:12 +0000 (15:45 +0200)]
Create /var/lib/xtesting

Change-Id: I8947b683731a98066bffb47bb49afaa636901446
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 59f27f97aaba00efb937b00494e42d79074d5055)

19 months agoUse the new homedir 82/73582/1
Cédric Ollivier [Fri, 21 Oct 2022 13:34:27 +0000 (15:34 +0200)]
Use the new homedir

Change-Id: Iaf6161cb3d7379f50702e3f412c233200bcdfae1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7c1a48eec52a131fd3702e759e67509939c48532)

19 months agoRemove nosetests 77/73577/1
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Remove nosetests

Change-Id: I13babcba37e7f3ce54b0ae38bd84ed2ee12ee935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoStop using root in testing containers 74/73574/2
Cédric Ollivier [Fri, 21 Oct 2022 08:46:31 +0000 (10:46 +0200)]
Stop using root in testing containers

It now creates and leverages xtesting as main user.

Change-Id: I5b871ac2729a875674514aab75ae079e1bf125f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b1e22e37cc436451b3519a0ef7f9704b5a86f9cc)

19 months agoFix tox list 71/73571/2
Cédric Ollivier [Thu, 20 Oct 2022 14:48:37 +0000 (16:48 +0200)]
Fix tox list

Change-Id: Ie996cbf5751e757cedf79d03f3a9b2649183f250
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate to Alpine 3.16 65/73565/3
Cédric Ollivier [Thu, 20 Oct 2022 11:15:24 +0000 (13:15 +0200)]
Update to Alpine 3.16

Change-Id: Ib630178c93d4a991f43611796e0c07975ce421ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 651fbe30a574fde8c62e7b73b3f05e40fba6e58b)

19 months agoFix all Ansible playbooks 66/73566/2
Cédric Ollivier [Thu, 20 Oct 2022 11:20:13 +0000 (13:20 +0200)]
Fix all Ansible playbooks

Change-Id: Ic267835da8f1b5a9ae11c7bbf604dd2237e48cab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate release tabs 63/73563/1
Cédric Ollivier [Thu, 20 Oct 2022 08:34:58 +0000 (10:34 +0200)]
Update release tabs

It takes latest releases into account

Change-Id: Idd27a9e3df8d58c41417e7b9ca60d679fb0c4ebd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agocnf conformance now returns non zero values 52/73552/2
Cédric Ollivier [Mon, 17 Oct 2022 15:01:41 +0000 (17:01 +0200)]
cnf conformance now returns non zero values

Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f0ebad3e5b23350483929a2a881f89d0f2822f5e)

19 months agoUse cnf certifaction criteria 49/73549/1
Cédric Ollivier [Mon, 17 Oct 2022 10:50:04 +0000 (12:50 +0200)]
Use cnf certifaction criteria

Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate cnf_testsuite v0.34.0 45/73545/2
Cédric Ollivier [Mon, 17 Oct 2022 07:09:54 +0000 (09:09 +0200)]
Update cnf_testsuite v0.34.0

It now runs cert (replacing workload)
It downgrades msg to warning as cnf_testsuite now returns
non 0 values.

Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoBy default just print all vulnerabilities 43/73543/1
Cédric Ollivier [Fri, 14 Oct 2022 12:35:19 +0000 (14:35 +0200)]
By default just print all vulnerabilities

It's the behavior expected by RA2.
Please change it via testcases.yaml if needed.

Change-Id: I84b02fa273f63ea1930bd356739243756032533d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit cf40e38be4d85c235a9d85a15f7fa326ebf356e6)

19 months agoUninstall falco and cri_tools after testing 36/73536/1
Cédric Ollivier [Mon, 10 Oct 2022 11:15:43 +0000 (13:15 +0200)]
Uninstall falco and cri_tools after testing

Functest runs several clusters in the same server.
It quickly failes if falco is still running (dkms
tries to unload the module which is in-use).

Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoPin netperf tools 34/73534/1
Cédric Ollivier [Thu, 6 Oct 2022 14:00:40 +0000 (16:00 +0200)]
Pin netperf tools

Change-Id: I36dde21d9af2cc7d96be4a8f0947d94491ae00c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoUpdate kube bench test cases to latest dev 31/73531/1
Cédric Ollivier [Thu, 6 Oct 2022 12:46:19 +0000 (14:46 +0200)]
Update kube bench test cases to latest dev

Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5926e9d259cf7f0c620aaa18aa2dc55a4c0208f5)

19 months agoUpdate hube-hunter 28/73528/1
Cédric Ollivier [Thu, 6 Oct 2022 08:10:50 +0000 (10:10 +0200)]
Update hube-hunter

Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 06eb071ee719c015f696ed6c0a685926a8a0ae62)

19 months agoDisable new testing Feature UserNamespacesStatelessPodsSupport 24/73524/1
Cédric Ollivier [Tue, 4 Oct 2022 14:45:46 +0000 (16:45 +0200)]
Disable new testing Feature UserNamespacesStatelessPodsSupport

All new features are defacto optional until RA2 changes
its status.

Change-Id: I23456ec525c728719cd01533122d6c79c2617631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f327dbcb465d64dadb1c8e717a3b4ec99403cd)

19 months agoComplete Alpine 3.15 update 14/73514/1
Cédric Ollivier [Fri, 30 Sep 2022 12:59:35 +0000 (14:59 +0200)]
Complete Alpine 3.15 update

Change-Id: I7cd5c8b22634af52d494b8a8d1eedb158f42d288
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoFix docker tags 12/73512/1
Cédric Ollivier [Fri, 30 Sep 2022 12:48:11 +0000 (14:48 +0200)]
Fix docker tags

Change-Id: Ibbeab1b318a097d1f53b9251214f2e6a85ee63f3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoReplace -noColor by --no-color 08/73508/1
Cédric Ollivier [Fri, 30 Sep 2022 09:20:46 +0000 (11:20 +0200)]
Replace -noColor by --no-color

--noColor is deprecated, use --no-color instead
Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags

Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b56474a4e5e5c60eb318d9605c6042158535ef8d)

19 months agoGet the right K8s e2e version 07/73507/1
Cédric Ollivier [Fri, 30 Sep 2022 09:30:05 +0000 (11:30 +0200)]
Get the right K8s e2e version

Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
19 months agoSet defaultbranch in .gitreview 06/73506/1
Cédric Ollivier [Fri, 30 Sep 2022 09:32:41 +0000 (11:32 +0200)]
Set defaultbranch in .gitreview

Change-Id: I7e0c95e9c2e61bf7d8e29e07ecff92835051a871
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip Feature:ProxyTerminatingEndpoints 82/73382/1
Cédric Ollivier [Thu, 19 May 2022 12:39:33 +0000 (14:39 +0200)]
Skip Feature:ProxyTerminatingEndpoints

It's a new v1.24 feature testing which must be set as
mandatory in Anuket if relevant.

Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRevert latest docker builds 79/73379/1
Cédric Ollivier [Thu, 19 May 2022 09:08:22 +0000 (11:08 +0200)]
Revert latest docker builds

This reverts commit b2be1ff2852320940a1450ed5f2a6f4f4e91d7da.

Change-Id: If2852d6e85e11872fd0f2839445de014427dc535
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoInstall libxml2 and libxslt 76/73376/2
Cédric Ollivier [Wed, 18 May 2022 14:19:08 +0000 (16:19 +0200)]
Install libxml2 and libxslt

Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)

2 years agoPrepare v1.24 docker builds 77/73377/1
Cédric Ollivier [Wed, 18 May 2022 14:17:42 +0000 (16:17 +0200)]
Prepare v1.24 docker builds

Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoLeverage Xtesting 0.96 61/73261/1
Cédric Ollivier [Fri, 4 Mar 2022 12:08:15 +0000 (13:08 +0100)]
Leverage Xtesting 0.96

Change-Id: I6235342d4d53a688b960698b30332824cd372551
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoOutdated need to install python2.7-dev in CircleCI 70/73170/1
Cédric Ollivier [Tue, 11 Jan 2022 13:30:36 +0000 (14:30 +0100)]
Outdated need to install python2.7-dev in CircleCI

Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove constraints on flake8 13/73113/3
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Remove constraints on flake8

Change-Id: I23142c207c50eca24ad075a838f44d00293989b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate active releases in README.md 39/73139/1
Cédric Ollivier [Thu, 16 Dec 2021 08:13:34 +0000 (09:13 +0100)]
Update active releases in README.md

Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Feature testing 34/73134/1
Cédric Ollivier [Mon, 3 Jan 2022 20:47:41 +0000 (21:47 +0100)]
Skip new Feature testing

It skips new features which have not been selected yet by Anuket:
- [Feature:CustomResourceValidationExpressions]
- [Feature:StatefulSetAutoDeletePVC]
- [Feature:GRPCContainerProbe]

Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate linters and fix all new issues 21/73021/1
Cédric Ollivier [Mon, 15 Nov 2021 14:13:46 +0000 (15:13 +0100)]
Update linters and fix all new issues

It mostly adds encoding in open calls and leverages f-strings.
It removes ansible-lint as it now asks for ansible, roles and collections.

Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet defaut provider to local back 46/72946/1
Cédric Ollivier [Tue, 5 Oct 2021 10:05:08 +0000 (12:05 +0200)]
Set defaut provider to local back

It apply the same rules as sonuoboy.
Any user is free to set skeleton or something else via testcases.yml.

Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSet encoding utf-8 when opening file 11/72911/2
Cédric Ollivier [Sat, 11 Sep 2021 08:24:53 +0000 (10:24 +0200)]
Set encoding utf-8 when opening file

Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFallback to item calculation 01/72901/1
Cédric Ollivier [Fri, 10 Sep 2021 15:59:25 +0000 (17:59 +0200)]
Fallback to item calculation

There is no final result if simple tag is called.

Change-Id: If86c5115e917e5790799fac4308cf08d57e87905
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate CNF_TESTSUITE_TAG to v0.15.0 00/72900/1
Cédric Ollivier [Fri, 10 Sep 2021 14:42:36 +0000 (16:42 +0200)]
Update CNF_TESTSUITE_TAG to v0.15.0

Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove sig_network_serial 64/72864/1
Cédric Ollivier [Thu, 26 Aug 2021 14:12:37 +0000 (16:12 +0200)]
Remove sig_network_serial

PerformanceDNS is now optional [1] and DNS configMap nameserver makes
operations on coredns which would break an living deployment [2].

sig_network_serial is now enpty and then can be safely removed.

[1] https://github.com/cntt-n/CNTT/pull/2580
[2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238

Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove SIG CLI testing 61/72861/1
Cédric Ollivier [Thu, 26 Aug 2021 08:02:06 +0000 (10:02 +0200)]
Remove SIG CLI testing

It conforms to https://github.com/cntt-n/CNTT/pull/2579

Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwith to v1.23 alphas 48/72848/1
Cédric Ollivier [Fri, 20 Aug 2021 13:12:41 +0000 (15:12 +0200)]
Swith to v1.23 alphas

Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix py site-package path 40/72840/1
Cédric Ollivier [Thu, 19 Aug 2021 14:41:11 +0000 (16:41 +0200)]
Fix py site-package path

Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate to Alpine 3.14 11/72811/3
Cédric Ollivier [Wed, 11 Aug 2021 13:56:12 +0000 (15:56 +0200)]
Update to Alpine 3.14

It also disabled wrong order check as it fails vs kubernetes amongst
others.

[1] https://github.com/PyCQA/pylint/issues/2175

Change-Id: I3d641c213067428848212a148d25d78051c5674f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip git_repo testing 69/72769/1
Cédric Ollivier [Fri, 9 Jul 2021 12:14:54 +0000 (14:14 +0200)]
Skip git_repo testing

As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type.
"we shouldn't expend resources on these volume types".

[1] https://github.com/kubernetes-sigs/kind/issues/2356
[2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console

Change-Id: I9951f49208376652e8d580b3086f72994424cf80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoPrint cnf_testsuite console on exceptions 61/72761/1
Cédric Ollivier [Wed, 7 Jul 2021 13:23:36 +0000 (15:23 +0200)]
Print cnf_testsuite console on exceptions

Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove k8s.io from ansible/site.yml 10/72710/1
Cédric Ollivier [Fri, 25 Jun 2021 16:02:51 +0000 (18:02 +0200)]
Remove k8s.io from ansible/site.yml

It's now up-to-date.
It also fixes ansible/site.cntt.yml

Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoMake clear all skipped Features according to CNTT RA2 Chapter6 93/72693/1
Cédric Ollivier [Sun, 20 Jun 2021 11:51:43 +0000 (13:51 +0200)]
Make clear all skipped Features according to CNTT RA2 Chapter6

Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAllow passing extra opts to e2e.test 89/72689/1
Cédric Ollivier [Sun, 20 Jun 2021 09:59:37 +0000 (11:59 +0200)]
Allow passing extra opts to e2e.test

E2E_TEST_OPTS now allows setting runtime opts.
For instance, Functest K8s gates ask for -container-runtime containerd

Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove distlib from constraints 59/72659/1
Cédric Ollivier [Thu, 10 Jun 2021 12:10:30 +0000 (14:10 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd enchant in travis-ci 85/72585/1
Cédric Ollivier [Wed, 26 May 2021 14:50:09 +0000 (16:50 +0200)]
Add enchant in travis-ci

Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSwitch to focal in travis-ci gates 78/72578/1
Cédric Ollivier [Tue, 25 May 2021 14:16:47 +0000 (16:16 +0200)]
Switch to focal in travis-ci gates

Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove six from Openstack requirements 64/72564/1
Cédric Ollivier [Tue, 25 May 2021 08:59:19 +0000 (10:59 +0200)]
Remove six from Openstack requirements

  Attempting uninstall: six
    Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate cnf_testsuite to v0.11.2 63/72563/1
Cédric Ollivier [Tue, 25 May 2021 04:54:22 +0000 (06:54 +0200)]
Update cnf_testsuite to v0.11.2

https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2

Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoEasy creating next netperf branches 99/72499/1
Cédric Ollivier [Mon, 10 May 2021 12:05:52 +0000 (14:05 +0200)]
Easy creating next netperf branches

Change-Id: If3de6a18b7edd811157cb093434a7128617475d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish patch for plotperf 90/72490/1
Cédric Ollivier [Sun, 9 May 2021 17:26:36 +0000 (19:26 +0200)]
Publish patch for plotperf

Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoBenchmark Kubernetes Networking Performance 89/72489/1
Cédric Ollivier [Sun, 9 May 2021 15:15:33 +0000 (17:15 +0200)]
Benchmark Kubernetes Networking Performance

https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf

Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case results in README 85/72485/1
Cédric Ollivier [Wed, 5 May 2021 09:24:29 +0000 (11:24 +0200)]
Update test case results in README

Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDisable cnf_testsuite in master 84/72484/1
Cédric Ollivier [Fri, 7 May 2021 07:47:38 +0000 (09:47 +0200)]
Disable cnf_testsuite in master

cnf_testsuite asks for an official stable Kubernetes release
during cnf setup. It doesn't work defacto for Functest K8s master
(currently next v1.22).

Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate skip Feature lists 81/72481/1
Cédric Ollivier [Wed, 5 May 2021 07:02:12 +0000 (09:02 +0200)]
Update skip Feature lists

Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix cnf-conformance results filename 70/72470/1
Cédric Ollivier [Mon, 3 May 2021 14:03:08 +0000 (16:03 +0200)]
Fix cnf-conformance results filename

It also decreases criteria to 1 due to massive changes (dockerd).

Change-Id: Ic420139e6355debae183a77d6b0c574801b05076
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate cnf-conformance to cnf-testsuite 62/72462/1
Cédric Ollivier [Mon, 3 May 2021 07:32:59 +0000 (09:32 +0200)]
Update cnf-conformance to cnf-testsuite

https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite

Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoReduce number of threads 61/72461/1
Cédric Ollivier [Mon, 3 May 2021 07:33:44 +0000 (09:33 +0200)]
Reduce number of threads

It passed successfully with 10 threads (more doesn't reduce the
overall duration so much).

Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate master to next 1.22 56/72456/1
Cédric Ollivier [Sat, 1 May 2021 14:13:44 +0000 (16:13 +0200)]
Update master to next 1.22

Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMock os.makedirs 20/72420/4
Cédric Ollivier [Tue, 20 Apr 2021 15:19:06 +0000 (17:19 +0200)]
Mock os.makedirs

Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoInstall setuptools_scm before xrally 18/72418/1
Cédric Ollivier [Tue, 20 Apr 2021 12:30:56 +0000 (14:30 +0200)]
Install setuptools_scm before xrally

Else upper-constraints basically fails.

Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)

3 years agoSkip Network.should.set.TCP.CLOSE_WAIT.timeout 75/72375/1
Cédric Ollivier [Wed, 14 Apr 2021 22:00:33 +0000 (00:00 +0200)]
Skip Network.should.set.TCP.CLOSE_WAIT.timeout

https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml

Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove sig_node_serial as it's fully disruptive 69/72369/2
Cédric Ollivier [Wed, 14 Apr 2021 13:29:23 +0000 (15:29 +0200)]
Remove sig_node_serial as it's fully disruptive

There is no other test when NoExecuteTaintManager is skipped.
http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log

Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRun Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature 49/72349/1
Cédric Ollivier [Tue, 6 Apr 2021 12:13:58 +0000 (14:13 +0200)]
Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeature

kind master allows dualstack since [1]

[1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551

Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove [k8s.io] testing 48/72348/1
Cédric Ollivier [Tue, 6 Apr 2021 09:57:13 +0000 (11:57 +0200)]
Remove [k8s.io] testing

v1.21 enforces sig ownership of all e2e tests [1].

[1] https://github.com/kubernetes/kubernetes/issues/98326

Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSwitch to latest-1.21 45/72345/1
Cédric Ollivier [Mon, 5 Apr 2021 08:58:29 +0000 (10:58 +0200)]
Switch to latest-1.21

Else it would consider v1.22.0-alpha.0 (N+2).

Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case list 41/72341/1
Cédric Ollivier [Sun, 4 Apr 2021 12:54:43 +0000 (14:54 +0200)]
Update test case list

Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd k8s_io and serial test cases 37/72337/1
Cédric Ollivier [Sun, 4 Apr 2021 12:45:10 +0000 (14:45 +0200)]
Add k8s_io and serial test cases

It completes the first sig test cases.

Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge sig_network_features in sig_network 33/72333/2
Cédric Ollivier [Sun, 4 Apr 2021 10:01:15 +0000 (12:01 +0200)]
Merge sig_network_features in sig_network

Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSpit conformance into 2 test cases 29/72329/2
Cédric Ollivier [Sat, 3 Apr 2021 09:14:51 +0000 (11:14 +0200)]
Spit conformance into 2 test cases

It hugely decreases the overall test duration.
(10 + 15 << 120)

Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix etcd image repository in etcd-depl.yaml 24/72324/1
Cédric Ollivier [Sat, 3 Apr 2021 07:37:06 +0000 (09:37 +0200)]
Fix etcd image repository in etcd-depl.yaml

Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix name in chronos-depl.yaml 18/72318/1
Cédric Ollivier [Fri, 2 Apr 2021 14:05:41 +0000 (16:05 +0200)]
Fix name in chronos-depl.yaml

Change-Id: Ia6972a216daaa9d807058b34b55615cab2c09b64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRun opnfv/functest-kubernetes-smoke sequentially 17/72317/1
Cédric Ollivier [Fri, 2 Apr 2021 11:12:52 +0000 (13:12 +0200)]
Run opnfv/functest-kubernetes-smoke sequentially

Now multithreading is enabled at test case level.

Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoProperly manage e2e parallel testing 04/72304/1
Cédric Ollivier [Fri, 2 Apr 2021 07:52:38 +0000 (09:52 +0200)]
Properly manage e2e parallel testing

It sets nodes=25 to run all tests in parallel.
It also beautifies all testcases.yml

Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRather use skeleton instead of local 03/72303/1
Cédric Ollivier [Thu, 1 Apr 2021 23:05:48 +0000 (01:05 +0200)]
Rather use skeleton instead of local

“skeleton”: cluster is accessed via the Kubernetes API and nothing
else.

https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/

Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDisable sig_scheduling as serial 98/72298/1
Cédric Ollivier [Wed, 31 Mar 2021 17:55:32 +0000 (19:55 +0200)]
Disable sig_scheduling as serial

All remaining sig-scheduling tests are serial and for the time
Functest doesn't run serial test cases.

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console

Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove the useless Feature prefix 71/72271/1
Cédric Ollivier [Thu, 25 Mar 2021 13:44:35 +0000 (14:44 +0100)]
Remove the useless Feature prefix

Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoMerge "Exlude Serial and Feature:Feature:StorageVersionAPI"
Cedric Ollivier [Thu, 25 Mar 2021 12:01:01 +0000 (12:01 +0000)]
Merge "Exlude Serial and Feature:Feature:StorageVersionAPI"

3 years agoMerge "Blacklist all alpha testing"
Cedric Ollivier [Thu, 25 Mar 2021 12:00:55 +0000 (12:00 +0000)]
Merge "Blacklist all alpha testing"

3 years agoExlude Serial and Feature:Feature:StorageVersionAPI 70/72270/2
Cédric Ollivier [Thu, 25 Mar 2021 09:57:32 +0000 (10:57 +0100)]
Exlude Serial and Feature:Feature:StorageVersionAPI

Serial asks to split the testcases into 2 runs.

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console

Change-Id: I58f9d9023f596141bbefae8339043f813a124854
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoBlacklist all alpha testing 69/72269/1
Cédric Ollivier [Thu, 25 Mar 2021 09:55:16 +0000 (10:55 +0100)]
Blacklist all alpha testing

Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years ago Provide support for air gapped env for e2e 63/72263/7
Sylvain Desbureaux [Wed, 24 Mar 2021 07:44:29 +0000 (08:44 +0100)]
 Provide support for air gapped env for e2e

 Sometimes, tested Kubernetes doesn't have direct access to Internet but
 access through repository mirrors.
 This patch handles this case for e2e test case.

Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: Iaa2960ad03aae1fff859d41bcd6ddf3176658f8e