functest.git
4 months agoPrecise the right Functest version 49/74449/1 stable/xena
Cédric Ollivier [Tue, 9 Jan 2024 15:40:55 +0000 (16:40 +0100)]
Precise the right Functest version

Change-Id: Ia2bf3d3b5f5dcc03542f757acad9eb129a0801a2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7a1a8de00e68a0c0517e92c62a41b2da4ceee1c3)

4 months agoMake ansible/site.gate.yml up-to-date 43/74443/1
Cédric Ollivier [Tue, 9 Jan 2024 14:04:54 +0000 (15:04 +0100)]
Make ansible/site.gate.yml up-to-date

Change-Id: I453ba137bd7b57b716fa4692f18b1137b9d638c0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f469c4a7244dded492a03ebf4b4d31c873f1fd96)

4 months agoRemove tox pip_version 42/74442/1
Cédric Ollivier [Tue, 9 Jan 2024 14:04:35 +0000 (15:04 +0100)]
Remove tox pip_version

Change-Id: Ic98be7d50c38c6aa221743cc71fc348e56480dc4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 325baf2c7426b8e84bde31c3642a9fbfb05ea8da)

6 months agoPublish Functest Virtual Machines 16/74216/1
Cédric Ollivier [Thu, 19 Oct 2023 12:50:14 +0000 (14:50 +0200)]
Publish Functest Virtual Machines

Change-Id: I0c0b40df0fe1d72be07b950320f0e759156dd3b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 76be4ab4dae0348baff605dbc0e5dc12cbd4f92f)

13 months agoClean tabs and trailing blanks 29/73929/1
guillaume.lambert [Thu, 7 Jul 2022 17:57:48 +0000 (19:57 +0200)]
Clean tabs and trailing blanks

Signed-off-by: guillaume.lambert <guillaume.lambert@orange.com>
Change-Id: I82c3a2c26f02d9314fce8fa3f5b49c4a65ec8f75
(cherry picked from commit 7677c43363c22c7bfca60855058af503860c63b8)

14 months agotest_openstack_version14 -> test_openstack_version15 04/73904/1
Cédric Ollivier [Mon, 13 Mar 2023 15:45:36 +0000 (16:45 +0100)]
test_openstack_version14 -> test_openstack_version15

Change-Id: I155a00e46762b6710baf30f47bf19730e0be1238
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoChanlge all wiki links 01/73901/1
Cédric Ollivier [Mon, 13 Mar 2023 14:48:24 +0000 (15:48 +0100)]
Chanlge all wiki links

Change-Id: Ia1693aa55ee84c9529dd2aab55e23746b74ef3a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0914270da35fdd3db7d58ac250edd258a5d55c40)

14 months agoSwitch SNAPs link as it was removed from wiki 97/73897/1
Cédric Ollivier [Mon, 13 Mar 2023 14:10:03 +0000 (15:10 +0100)]
Switch SNAPs link as it was removed from wiki

Change-Id: Ib187246a5f6f3912d4ce607001f26ab6b21fb150
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoDetect OpenStack Xena 89/73889/1
Cédric Ollivier [Mon, 13 Mar 2023 09:59:26 +0000 (10:59 +0100)]
Detect OpenStack Xena

Change-Id: I3b0c9e030f2d31a6151d9ba44f2a06a627b3d913
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0e1b036ed4f4527c09cf1355a707875f640ee569)

18 months agoStop using docker install script 37/73637/1
Cédric Ollivier [Tue, 8 Nov 2022 16:14:06 +0000 (17:14 +0100)]
Stop using docker install script

As this script fails vs xenial, let's update ubuntu
and install the official package.

Change-Id: Iba4124429bcd80280f6c5d128758ca72f00bb8f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 587d560e6685ed7460d5f51dbaa1edde1fc27175)
(cherry picked from commit ed537f467b3dfabc7a6abb05a96f9b4d52c7a8eb)

18 months agoRemove neutron from constraints 31/73631/1
Cédric Ollivier [Mon, 7 Nov 2022 13:29:26 +0000 (14:29 +0100)]
Remove neutron from constraints

https://build.opnfv.org/ci/view/functest-docker/job/functest-xena-docker/1335/

Change-Id: Ifc6462b2854403f8891ac41ab6baa9c850c72d6d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix incorrect robotframework-sshlibrary version 08/73208/1
Cédric Ollivier [Mon, 7 Feb 2022 13:42:34 +0000 (14:42 +0100)]
Fix incorrect robotframework-sshlibrary version

It's silent in Functest but breaks ONAP integration gates.

Co-Authored-By: Michal Jagiello <michal.jagiello@t-mobile.pl>
Change-Id: Id8a6a96f3311dc53b107877fe6c9f53a7a83fc77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a628780776d12bb9461e38aa00cc54d93f5ffd84)

2 years agoUpdate rally-openstack to latest crucial changes 96/73196/1
Cédric Ollivier [Fri, 28 Jan 2022 09:54:00 +0000 (10:54 +0100)]
Update rally-openstack to latest crucial changes

It fixes cinder "update_volume_type() got an unexpected keyword and
the bugs detected by CI (here Cinder v3)
Then it also reverts:
 - Temporarily remove CinderVolumeTypes.create_and_update_volume_type
 - Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access

Change-Id: I3bdcc6891da25728453a80903aa18c113f81fd81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix new enchant package name 65/73165/1
Cédric Ollivier [Tue, 11 Jan 2022 12:27:44 +0000 (13:27 +0100)]
Fix new enchant package name

https://packages.debian.org/fr/bullseye/enchant-2

Change-Id: Idc5d856a8be90852c94ca213c62922e7ba6b2585
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3885a894aeb42b7856d159be8252a3bb4e3c2fe8)

2 years agoUpdate Xtesting to 0.94.0 45/73145/1
Cédric Ollivier [Wed, 5 Jan 2022 00:01:12 +0000 (01:01 +0100)]
Update Xtesting to 0.94.0

Change-Id: I34f816bedb7394034d3d149d496ab42fc18261bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dd46fa34caae1f535bcf6305fcb160530ac3c373)

2 years agoTemporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access 66/73066/1
Cédric Ollivier [Sat, 4 Dec 2021 16:30:52 +0000 (17:30 +0100)]
Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access

Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoTemporarily remove CinderVolumeTypes.create_and_update_volume_type 65/73065/1
Cédric Ollivier [Fri, 3 Dec 2021 16:50:10 +0000 (17:50 +0100)]
Temporarily remove CinderVolumeTypes.create_and_update_volume_type

A few tests are linked to Cinder v2 which was dropped in Xena

Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpgrade rally-openstack to 2.2.0 64/73064/1
Cédric Ollivier [Fri, 3 Dec 2021 16:49:49 +0000 (17:49 +0100)]
Upgrade rally-openstack to 2.2.0

Change-Id: I780c35db947d4293f5e7e2ff6d9d82dac10c9e8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoEnable RefStack back 59/73059/1
Cédric Ollivier [Fri, 26 Nov 2021 16:05:45 +0000 (17:05 +0100)]
Enable RefStack back

Change-Id: Ia87753bb12963c2da9515231b1241860546b7cfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFilter test_policy_minimum_bandwidth_rule_rbac in Patrole 57/73057/1
Cédric Ollivier [Thu, 25 Nov 2021 16:44:25 +0000 (17:44 +0100)]
Filter test_policy_minimum_bandwidth_rule_rbac in Patrole

https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html

Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c21b9453d34bac7be124b4133fb8a1501e92770b)

2 years agoReduce Patrole test case lists 55/73055/1
Cédric Ollivier [Thu, 25 Nov 2021 13:37:10 +0000 (14:37 +0100)]
Reduce Patrole test case lists

They seem related to Patrole obsolescence

patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action
Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service.

Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c7a5cf97160a6b980249da846cd8c40430d42073)

2 years agoIncreate test_count in tempest_slow_cntt 54/73054/1
Cédric Ollivier [Thu, 25 Nov 2021 13:24:22 +0000 (14:24 +0100)]
Increate test_count in tempest_slow_cntt

http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html

Change-Id: I88446714338e46188f61bcac8967196c421f0edd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 70b49c093c683170f38b6ef822053d82bc5f9486)

2 years agoIncreate test_count in tempest_full_cntt 53/73053/1
Cédric Ollivier [Thu, 25 Nov 2021 13:22:18 +0000 (14:22 +0100)]
Increate test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html

Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 00c6cecbb618183aaebfef85ca3fe83c9c291062)

2 years agoSkip new image import related tests in CNTT 29/73029/1
Cédric Ollivier [Sat, 20 Nov 2021 10:28:47 +0000 (11:28 +0100)]
Skip new image import related tests in CNTT

This feature is optional in CNTT.

Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2ec8656ca144af77462faaa80bc990255faf6488)

2 years agoTake hostname_fqdn_sanitization into account 28/73028/1
Cédric Ollivier [Sat, 20 Nov 2021 10:23:10 +0000 (11:23 +0100)]
Take hostname_fqdn_sanitization into account

It's skipped in CNTT as it's not enabled yet.

Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f3bfdf806216930da4da656684f8955503ba3538)

2 years agoUpdate linters and fix all new issues 20/73020/1
Cédric Ollivier [Wed, 10 Nov 2021 14:42:57 +0000 (15:42 +0100)]
Update linters and fix all new issues

It mostly add encoding in open calls and leverage f-strings.

Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4fdbdd34fb5fea55571a18b2438ececa953928ff)

2 years agoUpdate Xtesting to 0.93.0 14/73014/1
Cédric Ollivier [Tue, 9 Nov 2021 14:03:20 +0000 (15:03 +0100)]
Update Xtesting to 0.93.0

Change-Id: Idc5cc6d83d3f4f4786fae533bafeafc1ac9ea245
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e25e576af33547657c278e2dae49b033bf6a1fa1)

2 years agoSync requirements.txt 07/73007/1
Cédric Ollivier [Mon, 8 Nov 2021 16:02:01 +0000 (17:02 +0100)]
Sync requirements.txt

Change-Id: If20994285d09234f4bf696de5f8462e660b48b9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAdd Xena tags in README.md 73/72973/1
Cédric Ollivier [Fri, 15 Oct 2021 12:50:59 +0000 (14:50 +0200)]
Add Xena tags in README.md

Change-Id: I89ec89a859869bcbf90d87d646809bc2ca553a8c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate RefStack test case descriptions 72/72972/1
Cédric Ollivier [Fri, 15 Oct 2021 12:50:24 +0000 (14:50 +0200)]
Update RefStack test case descriptions

RefStack now allows skip tests.

Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate tempest plugin test counts 68/72968/1
Cédric Ollivier [Tue, 12 Oct 2021 09:51:20 +0000 (11:51 +0200)]
Update tempest plugin test counts

http://artifacts.opnfv.org/functest/0V6VK1CX6MXV/functest-opnfv-functest-smoke-cntt-xena-tempest_neutron_cntt-run-1/tempest_neutron_cntt/tempest-report.html
http://artifacts.opnfv.org/functest/39VVHMHL4G7J/functest-opnfv-functest-smoke-cntt-xena-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html

Change-Id: I62c76e4d34f4bf840f0e6e0b4b201b16f3ab4d8e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate tags and branches to Xena 63/72963/1
Cédric Ollivier [Mon, 11 Oct 2021 11:24:17 +0000 (13:24 +0200)]
Update tags and branches to Xena

Change-Id: I14b36aee77848067aa45a2bfdba5fa224c230980
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoPrepare all Functest stable/xena containers 61/72961/1
Cédric Ollivier [Mon, 11 Oct 2021 07:44:16 +0000 (09:44 +0200)]
Prepare all Functest stable/xena containers

Change-Id: Ic843ba12132bf25ad7c339bd483f0a211ac2d003
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate .gitreview to stable/xena 60/72960/1
Cédric Ollivier [Mon, 11 Oct 2021 07:07:03 +0000 (09:07 +0200)]
Update .gitreview to stable/xena

Change-Id: I2631d424b73b8074e0de7fcf6b14a9ff3ea4ed1c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks" 34/72834/1
Cédric Ollivier [Wed, 18 Aug 2021 12:09:22 +0000 (14:09 +0200)]
Fallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks"

Bootable volume support (bump) is breaking cinder changes removing Cinder v3 [1].

[1] https://opendev.org/x/vmtp/commit/5ac228a575153e059e3d683d5e125415dd32e89f

Change-Id: Id71332f537203d45ad62dae13745f505f46734b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate pylint to latest stable 33/72833/1
Cédric Ollivier [Wed, 18 Aug 2021 11:11:02 +0000 (13:11 +0200)]
Update pylint to latest stable

It also stops filtering py27 which dropped for a while.

Change-Id: Idf19d1d90e0c753b6c05bbe77f3748027c2e0af5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwitch to provider_vlans public 32/72832/1
Cédric Ollivier [Wed, 18 Aug 2021 07:56:52 +0000 (09:56 +0200)]
Switch to provider_vlans public

It follows the new OpenStack gate configs.

Change-Id: I74ae08bf857f092012abab59e108128fc54ddea4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate to Alpine 3.14 26/72826/5
Cédric Ollivier [Thu, 12 Aug 2021 14:41:38 +0000 (16:41 +0200)]
Update to Alpine 3.14

It also fixes lots of new pylint warnings.

Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSelect Wallaby as CNTT baseline (Lakelse) 07/72807/1
Cédric Ollivier [Tue, 10 Aug 2021 10:06:14 +0000 (12:06 +0200)]
Select Wallaby as CNTT baseline (Lakelse)

Change-Id: I5637da29b3fa4c43e288ffb5f2306273a5bc2c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate README.md 25/72725/2
Cédric Ollivier [Wed, 30 Jun 2021 13:27:09 +0000 (15:27 +0200)]
Update README.md

It takes Wallaby into account

Change-Id: I529147fd2e80bcc4a19c786b46a0412b32f9ffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove distlib from constraints 60/72660/1
Cédric Ollivier [Thu, 10 Jun 2021 16:40:09 +0000 (18:40 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: Ibec464eed800f5b9e7d55bff6bb02f1c43b15aff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove six from Openstack requirements 87/72587/1
Cédric Ollivier [Wed, 26 May 2021 19:38:27 +0000 (21:38 +0200)]
Remove six from Openstack requirements

Attempting uninstall: six
  Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Id31393e9df11920ebebb13cfc4d9080c49a85e52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAdd enchant in travis-ci 83/72583/3
Cédric Ollivier [Wed, 26 May 2021 14:43:29 +0000 (16:43 +0200)]
Add enchant in travis-ci

Change-Id: Ibbf0ecfc0b1e178a27a4981b10689f62fa103d62
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwitch to focal in travis-ci gates 76/72576/3
Cédric Ollivier [Tue, 25 May 2021 14:13:05 +0000 (16:13 +0200)]
Switch to focal in travis-ci gates

Change-Id: Id6d1685762be5d81c5093c05f85c0cc36c234d76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 847a25ffe68aaa98e6101cd66e74144b6c25ea1e)

2 years agoSkip new Cinder rbac testing in CNTT 59/72559/1
Cédric Ollivier [Fri, 21 May 2021 16:36:05 +0000 (18:36 +0200)]
Skip new Cinder rbac testing in CNTT

Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Glance testing in CNTT 56/72556/1
Cédric Ollivier [Fri, 21 May 2021 13:05:19 +0000 (15:05 +0200)]
Skip new Glance testing in CNTT

They ask for features not mandatory in CNTT

Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Keystone RBAC testing in CNTT 52/72552/1
Cédric Ollivier [Fri, 21 May 2021 12:52:51 +0000 (14:52 +0200)]
Skip new Keystone RBAC testing in CNTT

Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)

2 years agoSkip test_get_network_ip_availabilities 51/72551/1
Cédric Ollivier [Fri, 21 May 2021 12:12:02 +0000 (14:12 +0200)]
Skip test_get_network_ip_availabilities

http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html

Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate test case counts 48/72548/1
Cédric Ollivier [Wed, 19 May 2021 21:45:18 +0000 (23:45 +0200)]
Update test case counts

Change-Id: I5a10da026a98218496de36beb0a92d668514e336
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoConfigure dashboard.dashboard_url if tempest_slow 43/72543/2
Cédric Ollivier [Tue, 18 May 2021 17:21:53 +0000 (19:21 +0200)]
Configure dashboard.dashboard_url if tempest_slow

Tempest Horizon is now also executed in tempest_slow.

Change-Id: I910adc68eeb067d089b705feb794911afd1747e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix mkfs.ext4 path if Cirros 0.5 40/72540/1
Cédric Ollivier [Tue, 18 May 2021 12:00:01 +0000 (14:00 +0200)]
Fix mkfs.ext4 path if Cirros 0.5

Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoDetect OpenStack ussuri 34/72534/1
Cédric Ollivier [Mon, 17 May 2021 14:02:52 +0000 (16:02 +0200)]
Detect OpenStack ussuri

Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate test case counts in CNTT 33/72533/1
Cédric Ollivier [Mon, 17 May 2021 13:57:25 +0000 (15:57 +0200)]
Update test case counts in CNTT

Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)

2 years agoUpdate scenario img_file in tempest.conf 32/72532/1
Cédric Ollivier [Mon, 17 May 2021 11:13:18 +0000 (13:13 +0200)]
Update scenario img_file in tempest.conf

It's now an absolute filename [1].
It also updates the cirros version.

[1] https://github.com/openstack/barbican-tempest-plugin/commit/3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49

Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c068c042c8a9c02a7ba9c30257e897dab7705b2d)

3 years agoRefactor test_run_verifier_tests_default 23/72423/1
Cédric Ollivier [Tue, 20 Apr 2021 16:02:00 +0000 (18:02 +0200)]
Refactor test_run_verifier_tests_default

https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809

Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPin setuptools_scm===6.0.1 10/72410/1
Cédric Ollivier [Mon, 19 Apr 2021 16:39:31 +0000 (18:39 +0200)]
Pin setuptools_scm===6.0.1

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console

Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit ff8546b16057e6a053ea54de0eac1a2229a7ec75)

3 years agoMove Functest on Raspberry PI to md 94/72094/1
Cédric Ollivier [Wed, 17 Feb 2021 22:41:42 +0000 (23:41 +0100)]
Move Functest on Raspberry PI to md

https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoTypos 79/72079/1
Cédric Ollivier [Wed, 17 Feb 2021 20:37:39 +0000 (21:37 +0100)]
Typos

Change-Id: Ib6972a88644913621dc376367821148286123e9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate INFO.yml 78/72078/2
Cédric Ollivier [Wed, 17 Feb 2021 20:30:00 +0000 (21:30 +0100)]
Update INFO.yml

Functest has been promoted as Mature.
Badly lots of contributors dropped.

Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix typo 76/72076/1
Cédric Ollivier [Wed, 17 Feb 2021 19:47:33 +0000 (20:47 +0100)]
Fix typo

Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish former wiki page as README.md 73/72073/1
Cédric Ollivier [Wed, 17 Feb 2021 18:51:09 +0000 (19:51 +0100)]
Publish former wiki page as README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751

Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpgrade system first 37/72037/1
Cédric Ollivier [Sat, 13 Feb 2021 19:29:02 +0000 (20:29 +0100)]
Upgrade system first

Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agotempest_horizon has been merged into openstack/tempest 87/71987/2
Cédric Ollivier [Thu, 11 Feb 2021 14:13:00 +0000 (15:13 +0100)]
tempest_horizon has been merged into openstack/tempest

https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035

Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoForce ansible-lint===4.2.0 71/71971/1
Cédric Ollivier [Wed, 10 Feb 2021 22:46:47 +0000 (23:46 +0100)]
Force ansible-lint===4.2.0

Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFollow new pip name resolver 58/71958/13
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Follow new pip name resolver

Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate to alpine:3.13 91/71791/1
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Update to alpine:3.13

Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate tempest_neutron test_count to 529 43/71743/1
Cédric Ollivier [Thu, 10 Dec 2020 21:31:32 +0000 (22:31 +0100)]
Update tempest_neutron test_count to 529

artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html

Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUse pip==20.2.4 in tox venv 29/71729/1
Cédric Ollivier [Thu, 10 Dec 2020 17:44:20 +0000 (18:44 +0100)]
Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSet NEW_USER ROLE in tempest_heat classic user 16/71716/1
Cédric Ollivier [Thu, 10 Dec 2020 08:32:17 +0000 (09:32 +0100)]
Set NEW_USER ROLE in tempest_heat classic user

Else it fails when member is not the default role.

Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove all network data in Rally full tasks 01/71701/1
Cédric Ollivier [Wed, 9 Dec 2020 17:54:17 +0000 (18:54 +0100)]
Remove all network data in Rally full tasks

Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate Rally sanity tasks and blacklists for L2 only 00/71700/1
Cédric Ollivier [Wed, 9 Dec 2020 15:18:30 +0000 (16:18 +0100)]
Update Rally sanity tasks and blacklists for L2 only

This issues were hidden by Airship limitation (live-migration fails)

Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRally_jobs asks for Router in several tasks 89/71689/1
Cédric Ollivier [Wed, 9 Dec 2020 11:06:12 +0000 (12:06 +0100)]
Rally_jobs asks for Router in several tasks

NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).

As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]

[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports

Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDon't filter vs NO_TENANT_NETWORK in CNTT testcases 88/71688/1
Cédric Ollivier [Wed, 9 Dec 2020 11:04:45 +0000 (12:04 +0100)]
Don't filter vs NO_TENANT_NETWORK in CNTT testcases

This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.

Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip test_minbw_allocation_placement added to tempest_scenario_cntt 84/71684/1
Cédric Ollivier [Tue, 8 Dec 2020 23:06:08 +0000 (00:06 +0100)]
Skip test_minbw_allocation_placement added to tempest_scenario_cntt

http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html

Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRather use rconfig.has_option() instead 78/71678/1
Cédric Ollivier [Tue, 8 Dec 2020 22:27:04 +0000 (23:27 +0100)]
Rather use rconfig.has_option() instead

It slightly increases py2 and py3 to ease next backports.

Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip create_and_update_routers if NO_TENANT_NETWORK 68/71668/1
Cédric Ollivier [Tue, 8 Dec 2020 17:11:06 +0000 (18:11 +0100)]
Skip create_and_update_routers if NO_TENANT_NETWORK

http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers

Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip Restack compute and platform if NO_TENANT_NETWORK 63/71663/1
Cédric Ollivier [Tue, 8 Dec 2020 17:00:42 +0000 (18:00 +0100)]
Skip Restack compute and platform if NO_TENANT_NETWORK

Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoConcat both dynamic and static roles in tempest.conf 51/71651/1
Cédric Ollivier [Tue, 8 Dec 2020 10:32:25 +0000 (11:32 +0100)]
Concat both dynamic and static roles in tempest.conf

It also moves all auth logic in a specific method.

Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove test_reset_network from Patrole test cases 43/71643/1
Cédric Ollivier [Mon, 7 Dec 2020 10:40:00 +0000 (11:40 +0100)]
Remove test_reset_network from Patrole test cases

Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html

Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate NovaServers.boot_server_associate_and_dissociate_floating_ip 39/71639/1
Cédric Ollivier [Mon, 7 Dec 2020 08:00:02 +0000 (09:00 +0100)]
Update NovaServers.boot_server_associate_and_dissociate_floating_ip

It conforms with "Fix nova scenarios for assiciating fips" [1]

http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html

[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460

Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test_count in tempest_full_cntt 35/71635/1
Cédric Ollivier [Sun, 6 Dec 2020 13:47:41 +0000 (14:47 +0100)]
Update test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html

Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove Rally Router testing if no tenant resources 25/71625/1
Cédric Ollivier [Fri, 4 Dec 2020 12:48:52 +0000 (13:48 +0100)]
Remove Rally Router testing if no tenant resources

It pleases airship which doesn't support neither routers and floating
ips.

Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop setting floating_ips in tempest_conf.yaml 19/71619/1
Cédric Ollivier [Fri, 4 Dec 2020 12:01:32 +0000 (13:01 +0100)]
Stop setting floating_ips in tempest_conf.yaml

It's now handled by tempest.py

Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove list_routers call if no tenant network 06/71606/1
Cédric Ollivier [Wed, 2 Dec 2020 16:34:06 +0000 (17:34 +0100)]
Remove list_routers call if no tenant network

Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate Shaker image as proposed in download.sh 04/71604/1
Cédric Ollivier [Wed, 2 Dec 2020 15:15:57 +0000 (16:15 +0100)]
Update Shaker image as proposed in download.sh

Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip a new upstream test in CNTT tempest_slow 76/71576/1
Cédric Ollivier [Tue, 1 Dec 2020 08:05:40 +0000 (09:05 +0100)]
Skip a new upstream test in CNTT tempest_slow

tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance

http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html

Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish CNTT/OPNFV CI assets 63/71563/1
Cédric Ollivier [Mon, 30 Nov 2020 15:43:54 +0000 (16:43 +0100)]
Publish CNTT/OPNFV CI assets

It will be introduced to ORAN.
It's also available in [1]

[1] http://testresults.opnfv.org/functest/oran

Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip the tests now marked as buggy 61/71561/1
Cédric Ollivier [Sun, 29 Nov 2020 18:24:34 +0000 (19:24 +0100)]
Skip the tests now marked as buggy

tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding
Skipped until bug: https://launchpad.net/bugs/1905432 is resolved.

http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html

Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoClean obsolete OPNFV contraints. 55/71555/1
Cédric Ollivier [Sun, 29 Nov 2020 11:19:48 +0000 (12:19 +0100)]
Clean obsolete OPNFV contraints.

Most of the projects are closed or at best no longer integrated in
Functest features.

Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop duplicating connect_method 48/71548/1
Cédric Ollivier [Sat, 28 Nov 2020 09:27:37 +0000 (10:27 +0100)]
Stop duplicating connect_method

This config is now managed dynamically by tempest.py

Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoReplace git.openstack.org by opendev.org 41/71541/2
Cédric Ollivier [Fri, 27 Nov 2020 16:21:08 +0000 (17:21 +0100)]
Replace git.openstack.org by opendev.org

https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console

Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoProtect vs false detected external networks if l2-only 31/71531/1
Cédric Ollivier [Fri, 27 Nov 2020 12:26:46 +0000 (13:26 +0100)]
Protect vs false detected external networks if l2-only

Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRe-enable xrally_kubernetes master 29/71529/1
Cédric Ollivier [Fri, 27 Nov 2020 07:56:13 +0000 (08:56 +0100)]
Re-enable xrally_kubernetes master

It mostly reverts the following changes as xrally_kubernetes supports 12.0.0
- xrally_kubernetes fails vs kubernetes 12.0
- patch xrally_kubernetes for kubernetes 12"

https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090

Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip dataplane benchmarkign if no tenant resources 23/71523/1
Cédric Ollivier [Thu, 26 Nov 2020 16:57:23 +0000 (17:57 +0100)]
Skip dataplane benchmarkign if no tenant resources

It asks for routers for instance.

Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove former allow_no_fip logic 17/71517/1
Cédric Ollivier [Thu, 26 Nov 2020 16:40:26 +0000 (17:40 +0100)]
Remove former allow_no_fip logic

Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAllow running cloudify without tenant network resources. 11/71511/1
Cédric Ollivier [Thu, 26 Nov 2020 16:31:58 +0000 (17:31 +0100)]
Allow running cloudify without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It skips all VNF test cases as they ask for tenant
resources.

Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAllow running tempest without tenant network resources. 05/71505/1
Cédric Ollivier [Thu, 26 Nov 2020 14:55:51 +0000 (15:55 +0100)]
Allow running tempest without tenant network resources.

It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)

Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove rtd-requirements.txt 79/71479/1
Cédric Ollivier [Tue, 24 Nov 2020 10:26:23 +0000 (11:26 +0100)]
Remove rtd-requirements.txt

It's now useless (snaps was removed).

Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSlightly update tempest_conf 72/71472/1
Cédric Ollivier [Mon, 23 Nov 2020 15:48:26 +0000 (16:48 +0100)]
Slightly update tempest_conf

It completes "Update CNTT regex according to latest tempest changes" [1]

[1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464

Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove snaps from rtd requirements 65/71465/1
Cédric Ollivier [Mon, 23 Nov 2020 14:43:44 +0000 (15:43 +0100)]
Remove snaps from rtd requirements

Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>