functest.git
2 months agoFix rally unit tests 10/74910/18 stable/xena
Cédric Ollivier [Thu, 3 Jul 2025 13:49:36 +0000 (15:49 +0200)]
Fix rally unit tests

Change-Id: I19a4f148a8c5e0a3fe4782f322e3e50deb22bf1c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 months agoFix tox.ini 08/74908/5
Cédric Ollivier [Thu, 3 Jul 2025 10:52:56 +0000 (12:52 +0200)]
Fix tox.ini

Change-Id: If7f67326a9fc72fc477f6c83957de3181d086a7b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 months agoRemove ODL and EPC api docs 09/74909/1
Cédric Ollivier [Thu, 3 Jul 2025 13:14:39 +0000 (15:14 +0200)]
Remove ODL and EPC api docs

Change-Id: Id8f18f3c8e0043885ab75f1f7504b44b149cbcb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 months agoRemoving juju_epc 07/74907/1
Cédric Ollivier [Thu, 3 Jul 2025 10:38:35 +0000 (12:38 +0200)]
Removing juju_epc

Change-Id: I492bbfe52b9094fcf2941955f2a4f6a987953304
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 months agoRemove ODL testing 06/74906/2
Cédric Ollivier [Thu, 3 Jul 2025 09:47:33 +0000 (11:47 +0200)]
Remove ODL testing

ODL removed the testcases as obsolete.

Change-Id: I1118979dc77a89e71ac7e827427c506e41bbc643
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 months agoSwitch to fork for opnfv-cloudify-clearwater 05/74905/1
Cédric Ollivier [Thu, 3 Jul 2025 08:03:09 +0000 (10:03 +0200)]
Switch to fork for opnfv-cloudify-clearwater

It allows removing diamond plugin which can't be downloaded.

Change-Id: I9ef1612c0da37c48c4d95d81714cc9fe05aa7693
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 months agoSkip 3 buggy Patrole tests 04/74904/8
Cédric Ollivier [Fri, 27 Jun 2025 15:15:45 +0000 (17:15 +0200)]
Skip 3 buggy Patrole tests

patrole_tempest_plugin.tests.api.volume.test_volume_actions_rbac.VolumesActionsV3RbacTest.test_attach_volume_to_instance
patrole_tempest_plugin.tests.api.volume.test_volume_actions_rbac.VolumesActionsV3RbacTest.test_detach_volume_from_instance
patrole_tempest_plugin.tests.api.volume.test_volume_actions_rbac.VolumesActionsV3RbacTest.test_force_detach_volume_from_instance

Change-Id: I91b4ddae60645a7701b78d10bc6d7471dd7b3657
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
20 months agoPrecise the right Functest version 49/74449/1
Cédric Ollivier [Tue, 9 Jan 2024 15:40:55 +0000 (16:40 +0100)]
Precise the right Functest version

Change-Id: Ia2bf3d3b5f5dcc03542f757acad9eb129a0801a2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7a1a8de00e68a0c0517e92c62a41b2da4ceee1c3)

20 months agoMake ansible/site.gate.yml up-to-date 43/74443/1
Cédric Ollivier [Tue, 9 Jan 2024 14:04:54 +0000 (15:04 +0100)]
Make ansible/site.gate.yml up-to-date

Change-Id: I453ba137bd7b57b716fa4692f18b1137b9d638c0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f469c4a7244dded492a03ebf4b4d31c873f1fd96)

20 months agoRemove tox pip_version 42/74442/1
Cédric Ollivier [Tue, 9 Jan 2024 14:04:35 +0000 (15:04 +0100)]
Remove tox pip_version

Change-Id: Ic98be7d50c38c6aa221743cc71fc348e56480dc4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 325baf2c7426b8e84bde31c3642a9fbfb05ea8da)

22 months agoPublish Functest Virtual Machines 16/74216/1
Cédric Ollivier [Thu, 19 Oct 2023 12:50:14 +0000 (14:50 +0200)]
Publish Functest Virtual Machines

Change-Id: I0c0b40df0fe1d72be07b950320f0e759156dd3b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 76be4ab4dae0348baff605dbc0e5dc12cbd4f92f)

2 years agoClean tabs and trailing blanks 29/73929/1
guillaume.lambert [Thu, 7 Jul 2022 17:57:48 +0000 (19:57 +0200)]
Clean tabs and trailing blanks

Signed-off-by: guillaume.lambert <guillaume.lambert@orange.com>
Change-Id: I82c3a2c26f02d9314fce8fa3f5b49c4a65ec8f75
(cherry picked from commit 7677c43363c22c7bfca60855058af503860c63b8)

2 years agotest_openstack_version14 -> test_openstack_version15 04/73904/1
Cédric Ollivier [Mon, 13 Mar 2023 15:45:36 +0000 (16:45 +0100)]
test_openstack_version14 -> test_openstack_version15

Change-Id: I155a00e46762b6710baf30f47bf19730e0be1238
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoChanlge all wiki links 01/73901/1
Cédric Ollivier [Mon, 13 Mar 2023 14:48:24 +0000 (15:48 +0100)]
Chanlge all wiki links

Change-Id: Ia1693aa55ee84c9529dd2aab55e23746b74ef3a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0914270da35fdd3db7d58ac250edd258a5d55c40)

2 years agoSwitch SNAPs link as it was removed from wiki 97/73897/1
Cédric Ollivier [Mon, 13 Mar 2023 14:10:03 +0000 (15:10 +0100)]
Switch SNAPs link as it was removed from wiki

Change-Id: Ib187246a5f6f3912d4ce607001f26ab6b21fb150
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoDetect OpenStack Xena 89/73889/1
Cédric Ollivier [Mon, 13 Mar 2023 09:59:26 +0000 (10:59 +0100)]
Detect OpenStack Xena

Change-Id: I3b0c9e030f2d31a6151d9ba44f2a06a627b3d913
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0e1b036ed4f4527c09cf1355a707875f640ee569)

2 years agoStop using docker install script 37/73637/1
Cédric Ollivier [Tue, 8 Nov 2022 16:14:06 +0000 (17:14 +0100)]
Stop using docker install script

As this script fails vs xenial, let's update ubuntu
and install the official package.

Change-Id: Iba4124429bcd80280f6c5d128758ca72f00bb8f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 587d560e6685ed7460d5f51dbaa1edde1fc27175)
(cherry picked from commit ed537f467b3dfabc7a6abb05a96f9b4d52c7a8eb)

2 years agoRemove neutron from constraints 31/73631/1
Cédric Ollivier [Mon, 7 Nov 2022 13:29:26 +0000 (14:29 +0100)]
Remove neutron from constraints

https://build.opnfv.org/ci/view/functest-docker/job/functest-xena-docker/1335/

Change-Id: Ifc6462b2854403f8891ac41ab6baa9c850c72d6d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix incorrect robotframework-sshlibrary version 08/73208/1
Cédric Ollivier [Mon, 7 Feb 2022 13:42:34 +0000 (14:42 +0100)]
Fix incorrect robotframework-sshlibrary version

It's silent in Functest but breaks ONAP integration gates.

Co-Authored-By: Michal Jagiello <michal.jagiello@t-mobile.pl>
Change-Id: Id8a6a96f3311dc53b107877fe6c9f53a7a83fc77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a628780776d12bb9461e38aa00cc54d93f5ffd84)

3 years agoUpdate rally-openstack to latest crucial changes 96/73196/1
Cédric Ollivier [Fri, 28 Jan 2022 09:54:00 +0000 (10:54 +0100)]
Update rally-openstack to latest crucial changes

It fixes cinder "update_volume_type() got an unexpected keyword and
the bugs detected by CI (here Cinder v3)
Then it also reverts:
 - Temporarily remove CinderVolumeTypes.create_and_update_volume_type
 - Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access

Change-Id: I3bdcc6891da25728453a80903aa18c113f81fd81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix new enchant package name 65/73165/1
Cédric Ollivier [Tue, 11 Jan 2022 12:27:44 +0000 (13:27 +0100)]
Fix new enchant package name

https://packages.debian.org/fr/bullseye/enchant-2

Change-Id: Idc5d856a8be90852c94ca213c62922e7ba6b2585
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3885a894aeb42b7856d159be8252a3bb4e3c2fe8)

3 years agoUpdate Xtesting to 0.94.0 45/73145/1
Cédric Ollivier [Wed, 5 Jan 2022 00:01:12 +0000 (01:01 +0100)]
Update Xtesting to 0.94.0

Change-Id: I34f816bedb7394034d3d149d496ab42fc18261bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dd46fa34caae1f535bcf6305fcb160530ac3c373)

3 years agoTemporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access 66/73066/1
Cédric Ollivier [Sat, 4 Dec 2021 16:30:52 +0000 (17:30 +0100)]
Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access

Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoTemporarily remove CinderVolumeTypes.create_and_update_volume_type 65/73065/1
Cédric Ollivier [Fri, 3 Dec 2021 16:50:10 +0000 (17:50 +0100)]
Temporarily remove CinderVolumeTypes.create_and_update_volume_type

A few tests are linked to Cinder v2 which was dropped in Xena

Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpgrade rally-openstack to 2.2.0 64/73064/1
Cédric Ollivier [Fri, 3 Dec 2021 16:49:49 +0000 (17:49 +0100)]
Upgrade rally-openstack to 2.2.0

Change-Id: I780c35db947d4293f5e7e2ff6d9d82dac10c9e8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoEnable RefStack back 59/73059/1
Cédric Ollivier [Fri, 26 Nov 2021 16:05:45 +0000 (17:05 +0100)]
Enable RefStack back

Change-Id: Ia87753bb12963c2da9515231b1241860546b7cfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFilter test_policy_minimum_bandwidth_rule_rbac in Patrole 57/73057/1
Cédric Ollivier [Thu, 25 Nov 2021 16:44:25 +0000 (17:44 +0100)]
Filter test_policy_minimum_bandwidth_rule_rbac in Patrole

https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html

Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c21b9453d34bac7be124b4133fb8a1501e92770b)

3 years agoReduce Patrole test case lists 55/73055/1
Cédric Ollivier [Thu, 25 Nov 2021 13:37:10 +0000 (14:37 +0100)]
Reduce Patrole test case lists

They seem related to Patrole obsolescence

patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action
Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service.

Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c7a5cf97160a6b980249da846cd8c40430d42073)

3 years agoIncreate test_count in tempest_slow_cntt 54/73054/1
Cédric Ollivier [Thu, 25 Nov 2021 13:24:22 +0000 (14:24 +0100)]
Increate test_count in tempest_slow_cntt

http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html

Change-Id: I88446714338e46188f61bcac8967196c421f0edd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 70b49c093c683170f38b6ef822053d82bc5f9486)

3 years agoIncreate test_count in tempest_full_cntt 53/73053/1
Cédric Ollivier [Thu, 25 Nov 2021 13:22:18 +0000 (14:22 +0100)]
Increate test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html

Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 00c6cecbb618183aaebfef85ca3fe83c9c291062)

3 years agoSkip new image import related tests in CNTT 29/73029/1
Cédric Ollivier [Sat, 20 Nov 2021 10:28:47 +0000 (11:28 +0100)]
Skip new image import related tests in CNTT

This feature is optional in CNTT.

Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2ec8656ca144af77462faaa80bc990255faf6488)

3 years agoTake hostname_fqdn_sanitization into account 28/73028/1
Cédric Ollivier [Sat, 20 Nov 2021 10:23:10 +0000 (11:23 +0100)]
Take hostname_fqdn_sanitization into account

It's skipped in CNTT as it's not enabled yet.

Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f3bfdf806216930da4da656684f8955503ba3538)

3 years agoUpdate linters and fix all new issues 20/73020/1
Cédric Ollivier [Wed, 10 Nov 2021 14:42:57 +0000 (15:42 +0100)]
Update linters and fix all new issues

It mostly add encoding in open calls and leverage f-strings.

Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4fdbdd34fb5fea55571a18b2438ececa953928ff)

3 years agoUpdate Xtesting to 0.93.0 14/73014/1
Cédric Ollivier [Tue, 9 Nov 2021 14:03:20 +0000 (15:03 +0100)]
Update Xtesting to 0.93.0

Change-Id: Idc5cc6d83d3f4f4786fae533bafeafc1ac9ea245
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e25e576af33547657c278e2dae49b033bf6a1fa1)

3 years agoSync requirements.txt 07/73007/1
Cédric Ollivier [Mon, 8 Nov 2021 16:02:01 +0000 (17:02 +0100)]
Sync requirements.txt

Change-Id: If20994285d09234f4bf696de5f8462e660b48b9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoAdd Xena tags in README.md 73/72973/1
Cédric Ollivier [Fri, 15 Oct 2021 12:50:59 +0000 (14:50 +0200)]
Add Xena tags in README.md

Change-Id: I89ec89a859869bcbf90d87d646809bc2ca553a8c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate RefStack test case descriptions 72/72972/1
Cédric Ollivier [Fri, 15 Oct 2021 12:50:24 +0000 (14:50 +0200)]
Update RefStack test case descriptions

RefStack now allows skip tests.

Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate tempest plugin test counts 68/72968/1
Cédric Ollivier [Tue, 12 Oct 2021 09:51:20 +0000 (11:51 +0200)]
Update tempest plugin test counts

http://artifacts.opnfv.org/functest/0V6VK1CX6MXV/functest-opnfv-functest-smoke-cntt-xena-tempest_neutron_cntt-run-1/tempest_neutron_cntt/tempest-report.html
http://artifacts.opnfv.org/functest/39VVHMHL4G7J/functest-opnfv-functest-smoke-cntt-xena-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html

Change-Id: I62c76e4d34f4bf840f0e6e0b4b201b16f3ab4d8e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate tags and branches to Xena 63/72963/1
Cédric Ollivier [Mon, 11 Oct 2021 11:24:17 +0000 (13:24 +0200)]
Update tags and branches to Xena

Change-Id: I14b36aee77848067aa45a2bfdba5fa224c230980
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPrepare all Functest stable/xena containers 61/72961/1
Cédric Ollivier [Mon, 11 Oct 2021 07:44:16 +0000 (09:44 +0200)]
Prepare all Functest stable/xena containers

Change-Id: Ic843ba12132bf25ad7c339bd483f0a211ac2d003
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate .gitreview to stable/xena 60/72960/1
Cédric Ollivier [Mon, 11 Oct 2021 07:07:03 +0000 (09:07 +0200)]
Update .gitreview to stable/xena

Change-Id: I2631d424b73b8074e0de7fcf6b14a9ff3ea4ed1c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks" 34/72834/1
Cédric Ollivier [Wed, 18 Aug 2021 12:09:22 +0000 (14:09 +0200)]
Fallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks"

Bootable volume support (bump) is breaking cinder changes removing Cinder v3 [1].

[1] https://opendev.org/x/vmtp/commit/5ac228a575153e059e3d683d5e125415dd32e89f

Change-Id: Id71332f537203d45ad62dae13745f505f46734b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate pylint to latest stable 33/72833/1
Cédric Ollivier [Wed, 18 Aug 2021 11:11:02 +0000 (13:11 +0200)]
Update pylint to latest stable

It also stops filtering py27 which dropped for a while.

Change-Id: Idf19d1d90e0c753b6c05bbe77f3748027c2e0af5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSwitch to provider_vlans public 32/72832/1
Cédric Ollivier [Wed, 18 Aug 2021 07:56:52 +0000 (09:56 +0200)]
Switch to provider_vlans public

It follows the new OpenStack gate configs.

Change-Id: I74ae08bf857f092012abab59e108128fc54ddea4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate to Alpine 3.14 26/72826/5
Cédric Ollivier [Thu, 12 Aug 2021 14:41:38 +0000 (16:41 +0200)]
Update to Alpine 3.14

It also fixes lots of new pylint warnings.

Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSelect Wallaby as CNTT baseline (Lakelse) 07/72807/1
Cédric Ollivier [Tue, 10 Aug 2021 10:06:14 +0000 (12:06 +0200)]
Select Wallaby as CNTT baseline (Lakelse)

Change-Id: I5637da29b3fa4c43e288ffb5f2306273a5bc2c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate README.md 25/72725/2
Cédric Ollivier [Wed, 30 Jun 2021 13:27:09 +0000 (15:27 +0200)]
Update README.md

It takes Wallaby into account

Change-Id: I529147fd2e80bcc4a19c786b46a0412b32f9ffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove distlib from constraints 60/72660/1
Cédric Ollivier [Thu, 10 Jun 2021 16:40:09 +0000 (18:40 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: Ibec464eed800f5b9e7d55bff6bb02f1c43b15aff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove six from Openstack requirements 87/72587/1
Cédric Ollivier [Wed, 26 May 2021 19:38:27 +0000 (21:38 +0200)]
Remove six from Openstack requirements

Attempting uninstall: six
  Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Id31393e9df11920ebebb13cfc4d9080c49a85e52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoAdd enchant in travis-ci 83/72583/3
Cédric Ollivier [Wed, 26 May 2021 14:43:29 +0000 (16:43 +0200)]
Add enchant in travis-ci

Change-Id: Ibbf0ecfc0b1e178a27a4981b10689f62fa103d62
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSwitch to focal in travis-ci gates 76/72576/3
Cédric Ollivier [Tue, 25 May 2021 14:13:05 +0000 (16:13 +0200)]
Switch to focal in travis-ci gates

Change-Id: Id6d1685762be5d81c5093c05f85c0cc36c234d76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 847a25ffe68aaa98e6101cd66e74144b6c25ea1e)

4 years agoSkip new Cinder rbac testing in CNTT 59/72559/1
Cédric Ollivier [Fri, 21 May 2021 16:36:05 +0000 (18:36 +0200)]
Skip new Cinder rbac testing in CNTT

Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip new Glance testing in CNTT 56/72556/1
Cédric Ollivier [Fri, 21 May 2021 13:05:19 +0000 (15:05 +0200)]
Skip new Glance testing in CNTT

They ask for features not mandatory in CNTT

Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip new Keystone RBAC testing in CNTT 52/72552/1
Cédric Ollivier [Fri, 21 May 2021 12:52:51 +0000 (14:52 +0200)]
Skip new Keystone RBAC testing in CNTT

Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)

4 years agoSkip test_get_network_ip_availabilities 51/72551/1
Cédric Ollivier [Fri, 21 May 2021 12:12:02 +0000 (14:12 +0200)]
Skip test_get_network_ip_availabilities

http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html

Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate test case counts 48/72548/1
Cédric Ollivier [Wed, 19 May 2021 21:45:18 +0000 (23:45 +0200)]
Update test case counts

Change-Id: I5a10da026a98218496de36beb0a92d668514e336
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoConfigure dashboard.dashboard_url if tempest_slow 43/72543/2
Cédric Ollivier [Tue, 18 May 2021 17:21:53 +0000 (19:21 +0200)]
Configure dashboard.dashboard_url if tempest_slow

Tempest Horizon is now also executed in tempest_slow.

Change-Id: I910adc68eeb067d089b705feb794911afd1747e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix mkfs.ext4 path if Cirros 0.5 40/72540/1
Cédric Ollivier [Tue, 18 May 2021 12:00:01 +0000 (14:00 +0200)]
Fix mkfs.ext4 path if Cirros 0.5

Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDetect OpenStack ussuri 34/72534/1
Cédric Ollivier [Mon, 17 May 2021 14:02:52 +0000 (16:02 +0200)]
Detect OpenStack ussuri

Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate test case counts in CNTT 33/72533/1
Cédric Ollivier [Mon, 17 May 2021 13:57:25 +0000 (15:57 +0200)]
Update test case counts in CNTT

Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)

4 years agoUpdate scenario img_file in tempest.conf 32/72532/1
Cédric Ollivier [Mon, 17 May 2021 11:13:18 +0000 (13:13 +0200)]
Update scenario img_file in tempest.conf

It's now an absolute filename [1].
It also updates the cirros version.

[1] https://github.com/openstack/barbican-tempest-plugin/commit/3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49

Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c068c042c8a9c02a7ba9c30257e897dab7705b2d)

4 years agoRefactor test_run_verifier_tests_default 23/72423/1
Cédric Ollivier [Tue, 20 Apr 2021 16:02:00 +0000 (18:02 +0200)]
Refactor test_run_verifier_tests_default

https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809

Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPin setuptools_scm===6.0.1 10/72410/1
Cédric Ollivier [Mon, 19 Apr 2021 16:39:31 +0000 (18:39 +0200)]
Pin setuptools_scm===6.0.1

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console

Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit ff8546b16057e6a053ea54de0eac1a2229a7ec75)

4 years agoMove Functest on Raspberry PI to md 94/72094/1
Cédric Ollivier [Wed, 17 Feb 2021 22:41:42 +0000 (23:41 +0100)]
Move Functest on Raspberry PI to md

https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoTypos 79/72079/1
Cédric Ollivier [Wed, 17 Feb 2021 20:37:39 +0000 (21:37 +0100)]
Typos

Change-Id: Ib6972a88644913621dc376367821148286123e9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate INFO.yml 78/72078/2
Cédric Ollivier [Wed, 17 Feb 2021 20:30:00 +0000 (21:30 +0100)]
Update INFO.yml

Functest has been promoted as Mature.
Badly lots of contributors dropped.

Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFix typo 76/72076/1
Cédric Ollivier [Wed, 17 Feb 2021 19:47:33 +0000 (20:47 +0100)]
Fix typo

Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPublish former wiki page as README.md 73/72073/1
Cédric Ollivier [Wed, 17 Feb 2021 18:51:09 +0000 (19:51 +0100)]
Publish former wiki page as README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751

Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpgrade system first 37/72037/1
Cédric Ollivier [Sat, 13 Feb 2021 19:29:02 +0000 (20:29 +0100)]
Upgrade system first

Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agotempest_horizon has been merged into openstack/tempest 87/71987/2
Cédric Ollivier [Thu, 11 Feb 2021 14:13:00 +0000 (15:13 +0100)]
tempest_horizon has been merged into openstack/tempest

https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035

Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoForce ansible-lint===4.2.0 71/71971/1
Cédric Ollivier [Wed, 10 Feb 2021 22:46:47 +0000 (23:46 +0100)]
Force ansible-lint===4.2.0

Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoFollow new pip name resolver 58/71958/13
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Follow new pip name resolver

Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate to alpine:3.13 91/71791/1
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Update to alpine:3.13

Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate tempest_neutron test_count to 529 43/71743/1
Cédric Ollivier [Thu, 10 Dec 2020 21:31:32 +0000 (22:31 +0100)]
Update tempest_neutron test_count to 529

artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html

Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUse pip==20.2.4 in tox venv 29/71729/1
Cédric Ollivier [Thu, 10 Dec 2020 17:44:20 +0000 (18:44 +0100)]
Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSet NEW_USER ROLE in tempest_heat classic user 16/71716/1
Cédric Ollivier [Thu, 10 Dec 2020 08:32:17 +0000 (09:32 +0100)]
Set NEW_USER ROLE in tempest_heat classic user

Else it fails when member is not the default role.

Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove all network data in Rally full tasks 01/71701/1
Cédric Ollivier [Wed, 9 Dec 2020 17:54:17 +0000 (18:54 +0100)]
Remove all network data in Rally full tasks

Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate Rally sanity tasks and blacklists for L2 only 00/71700/1
Cédric Ollivier [Wed, 9 Dec 2020 15:18:30 +0000 (16:18 +0100)]
Update Rally sanity tasks and blacklists for L2 only

This issues were hidden by Airship limitation (live-migration fails)

Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRally_jobs asks for Router in several tasks 89/71689/1
Cédric Ollivier [Wed, 9 Dec 2020 11:06:12 +0000 (12:06 +0100)]
Rally_jobs asks for Router in several tasks

NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).

As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]

[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports

Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoDon't filter vs NO_TENANT_NETWORK in CNTT testcases 88/71688/1
Cédric Ollivier [Wed, 9 Dec 2020 11:04:45 +0000 (12:04 +0100)]
Don't filter vs NO_TENANT_NETWORK in CNTT testcases

This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.

Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip test_minbw_allocation_placement added to tempest_scenario_cntt 84/71684/1
Cédric Ollivier [Tue, 8 Dec 2020 23:06:08 +0000 (00:06 +0100)]
Skip test_minbw_allocation_placement added to tempest_scenario_cntt

http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html

Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRather use rconfig.has_option() instead 78/71678/1
Cédric Ollivier [Tue, 8 Dec 2020 22:27:04 +0000 (23:27 +0100)]
Rather use rconfig.has_option() instead

It slightly increases py2 and py3 to ease next backports.

Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip create_and_update_routers if NO_TENANT_NETWORK 68/71668/1
Cédric Ollivier [Tue, 8 Dec 2020 17:11:06 +0000 (18:11 +0100)]
Skip create_and_update_routers if NO_TENANT_NETWORK

http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers

Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip Restack compute and platform if NO_TENANT_NETWORK 63/71663/1
Cédric Ollivier [Tue, 8 Dec 2020 17:00:42 +0000 (18:00 +0100)]
Skip Restack compute and platform if NO_TENANT_NETWORK

Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoConcat both dynamic and static roles in tempest.conf 51/71651/1
Cédric Ollivier [Tue, 8 Dec 2020 10:32:25 +0000 (11:32 +0100)]
Concat both dynamic and static roles in tempest.conf

It also moves all auth logic in a specific method.

Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove test_reset_network from Patrole test cases 43/71643/1
Cédric Ollivier [Mon, 7 Dec 2020 10:40:00 +0000 (11:40 +0100)]
Remove test_reset_network from Patrole test cases

Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html

Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate NovaServers.boot_server_associate_and_dissociate_floating_ip 39/71639/1
Cédric Ollivier [Mon, 7 Dec 2020 08:00:02 +0000 (09:00 +0100)]
Update NovaServers.boot_server_associate_and_dissociate_floating_ip

It conforms with "Fix nova scenarios for assiciating fips" [1]

http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html

[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460

Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate test_count in tempest_full_cntt 35/71635/1
Cédric Ollivier [Sun, 6 Dec 2020 13:47:41 +0000 (14:47 +0100)]
Update test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html

Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove Rally Router testing if no tenant resources 25/71625/1
Cédric Ollivier [Fri, 4 Dec 2020 12:48:52 +0000 (13:48 +0100)]
Remove Rally Router testing if no tenant resources

It pleases airship which doesn't support neither routers and floating
ips.

Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoStop setting floating_ips in tempest_conf.yaml 19/71619/1
Cédric Ollivier [Fri, 4 Dec 2020 12:01:32 +0000 (13:01 +0100)]
Stop setting floating_ips in tempest_conf.yaml

It's now handled by tempest.py

Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRemove list_routers call if no tenant network 06/71606/1
Cédric Ollivier [Wed, 2 Dec 2020 16:34:06 +0000 (17:34 +0100)]
Remove list_routers call if no tenant network

Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoUpdate Shaker image as proposed in download.sh 04/71604/1
Cédric Ollivier [Wed, 2 Dec 2020 15:15:57 +0000 (16:15 +0100)]
Update Shaker image as proposed in download.sh

Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip a new upstream test in CNTT tempest_slow 76/71576/1
Cédric Ollivier [Tue, 1 Dec 2020 08:05:40 +0000 (09:05 +0100)]
Skip a new upstream test in CNTT tempest_slow

tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance

http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html

Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoPublish CNTT/OPNFV CI assets 63/71563/1
Cédric Ollivier [Mon, 30 Nov 2020 15:43:54 +0000 (16:43 +0100)]
Publish CNTT/OPNFV CI assets

It will be introduced to ORAN.
It's also available in [1]

[1] http://testresults.opnfv.org/functest/oran

Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoSkip the tests now marked as buggy 61/71561/1
Cédric Ollivier [Sun, 29 Nov 2020 18:24:34 +0000 (19:24 +0100)]
Skip the tests now marked as buggy

tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding
Skipped until bug: https://launchpad.net/bugs/1905432 is resolved.

http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html

Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoClean obsolete OPNFV contraints. 55/71555/1
Cédric Ollivier [Sun, 29 Nov 2020 11:19:48 +0000 (12:19 +0100)]
Clean obsolete OPNFV contraints.

Most of the projects are closed or at best no longer integrated in
Functest features.

Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoStop duplicating connect_method 48/71548/1
Cédric Ollivier [Sat, 28 Nov 2020 09:27:37 +0000 (10:27 +0100)]
Stop duplicating connect_method

This config is now managed dynamically by tempest.py

Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoReplace git.openstack.org by opendev.org 41/71541/2
Cédric Ollivier [Fri, 27 Nov 2020 16:21:08 +0000 (17:21 +0100)]
Replace git.openstack.org by opendev.org

https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console

Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoProtect vs false detected external networks if l2-only 31/71531/1
Cédric Ollivier [Fri, 27 Nov 2020 12:26:46 +0000 (13:26 +0100)]
Protect vs false detected external networks if l2-only

Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
4 years agoRe-enable xrally_kubernetes master 29/71529/1
Cédric Ollivier [Fri, 27 Nov 2020 07:56:13 +0000 (08:56 +0100)]
Re-enable xrally_kubernetes master

It mostly reverts the following changes as xrally_kubernetes supports 12.0.0
- xrally_kubernetes fails vs kubernetes 12.0
- patch xrally_kubernetes for kubernetes 12"

https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090

Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>