functest.git
14 months agoDetect OpenStack Zed 07/73907/1
Cédric Ollivier [Mon, 13 Mar 2023 09:59:26 +0000 (10:59 +0100)]
Detect OpenStack Zed

Change-Id: I3b0c9e030f2d31a6151d9ba44f2a06a627b3d913
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoChanlge all wiki links 99/73899/1
Cédric Ollivier [Mon, 13 Mar 2023 14:48:24 +0000 (15:48 +0100)]
Chanlge all wiki links

Change-Id: Ia1693aa55ee84c9529dd2aab55e23746b74ef3a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoSwitch SNAPs link as it was removed from wiki 96/73896/1
Cédric Ollivier [Mon, 13 Mar 2023 14:10:03 +0000 (15:10 +0100)]
Switch SNAPs link as it was removed from wiki

Change-Id: Ib187246a5f6f3912d4ce607001f26ab6b21fb150
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoUpgrade to Alpine 3.17 82/73882/1
Cédric Ollivier [Mon, 6 Mar 2023 12:02:21 +0000 (13:02 +0100)]
Upgrade to Alpine 3.17

Change-Id: Ia9d64a094e787e0693fab3c59deb33e2404ccfc6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
14 months agoSet tempurl_digest_hashlib = sha1 in tempest_conf 75/73875/1
Cédric Ollivier [Mon, 6 Mar 2023 10:48:05 +0000 (11:48 +0100)]
Set tempurl_digest_hashlib = sha1 in tempest_conf

Functest uses Ceph in gate which doesn't support
sha256 as default.

Please see:
 - https://review.opendev.org/c/openstack/tempest/+/832771
 - https://tracker.ceph.com/issues/56564
 - https://github.com/ceph/ceph/pull/47723

Change-Id: I3e98301feca4b68b1f9ebb4a6b20feb505b2dd01
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoStop using docker install script 33/73633/1
Cédric Ollivier [Tue, 8 Nov 2022 16:14:06 +0000 (17:14 +0100)]
Stop using docker install script

As this script fails vs xenial, let's update ubuntu
and install the official package.

Change-Id: Iba4124429bcd80280f6c5d128758ca72f00bb8f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoSkip test_compute_unified_limits in tempest_scenario_cntt 28/73628/1
Cédric Ollivier [Mon, 7 Nov 2022 10:23:38 +0000 (11:23 +0100)]
Skip test_compute_unified_limits in tempest_scenario_cntt

All new features are skipped until RA1 put it as mandatory
https://artifacts.opnfv.org/functest/3LQT9SQ6HYCM/functest-opnfv-functest-smoke-cntt-yoga-tempest_scenario_cntt-run-1/tempest_scenario_cntt/tempest-report.html

Change-Id: I5f2deeee408703ff2d82e0ca26dc0cdd5ef765ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoDecrease test count in tempest_heat_cntt 25/73625/1
Cédric Ollivier [Mon, 7 Nov 2022 10:17:33 +0000 (11:17 +0100)]
Decrease test count in tempest_heat_cntt

https://artifacts.opnfv.org/functest/Z5NOKCLXQA25/functest-opnfv-functest-smoke-cntt-yoga-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html

Change-Id: I95be34b107bc6e731031abae304f3acc6f090244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoMerge "Filter local_ip testing"
Cedric Ollivier [Mon, 7 Nov 2022 10:14:21 +0000 (10:14 +0000)]
Merge "Filter local_ip testing"

18 months agoUpdate Cirros for testing 22/73622/1
Cédric Ollivier [Wed, 2 Nov 2022 13:48:41 +0000 (14:48 +0100)]
Update Cirros for testing

It avoids errors when reading ssh banneer.

Change-Id: I67ba57f56914359e488936873cd2ce639a839b52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoStop install distlib via packages 19/73619/1
Cédric Ollivier [Thu, 27 Oct 2022 13:22:47 +0000 (15:22 +0200)]
Stop install distlib via packages

Change-Id: I2a98204da9875186be648c120474834216fffe93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoRemove distlib from upper-constraints.txt 17/73617/1
Cédric Ollivier [Thu, 27 Oct 2022 13:04:17 +0000 (15:04 +0200)]
Remove distlib from upper-constraints.txt

https://build.opnfv.org/ci/job/functest-opnfv-functest-core-latest-build/53/console

Change-Id: I948c6f5913ba1984dba6f18ae5554c3bc2a3d99b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
18 months agoUpdate Alpine version to 3.16 03/73603/1
Cédric Ollivier [Tue, 25 Oct 2022 09:51:23 +0000 (11:51 +0200)]
Update Alpine version to 3.16

It's the latest stable version.
https://www.alpinelinux.org/posts/Alpine-3.16.0-released.html

Change-Id: I567bf68675e8de853aeb204c97994b08f3dda6c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 253e17d5b10965758465b08c7d13589c4ff7d0cf)

2 years agoFilter local_ip testing 30/73330/1
Cédric Ollivier [Mon, 2 May 2022 12:59:22 +0000 (14:59 +0200)]
Filter local_ip testing

It's a new feature which has not been set
as mandatory by Anuket

Change-Id: Ib5d4cdc266b9db6c798dc3a1f27dc6c99012d534
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix Alpine version in build.sh 24/73324/1
Cédric Ollivier [Mon, 25 Apr 2022 08:41:53 +0000 (10:41 +0200)]
Fix Alpine version in build.sh

Change-Id: Ia9959d58c3b2ae636197232211e47d3b9d7c6260
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoLeverage xtesting 0.96.0 54/73254/1
Cédric Ollivier [Fri, 4 Mar 2022 10:20:33 +0000 (11:20 +0100)]
Leverage xtesting 0.96.0

Change-Id: Ica7d7afb041d946dc25e37d736b07a3ad13c1ef7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix incorrect robotframework-sshlibrary version 07/73207/1
Cédric Ollivier [Mon, 7 Feb 2022 13:42:34 +0000 (14:42 +0100)]
Fix incorrect robotframework-sshlibrary version

It's silent in Functest but breaks ONAP integration gates.

Co-Authored-By: Michal Jagiello <michal.jagiello@t-mobile.pl>
Change-Id: Id8a6a96f3311dc53b107877fe6c9f53a7a83fc77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFix new enchant package name 64/73164/1
Cédric Ollivier [Tue, 11 Jan 2022 12:27:44 +0000 (13:27 +0100)]
Fix new enchant package name

https://packages.debian.org/fr/bullseye/enchant-2

Change-Id: Idc5d856a8be90852c94ca213c62922e7ba6b2585
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate Xtesting to 0.94.0 44/73144/1
Cédric Ollivier [Wed, 5 Jan 2022 00:01:12 +0000 (01:01 +0100)]
Update Xtesting to 0.94.0

Change-Id: I34f816bedb7394034d3d149d496ab42fc18261bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip test_volume_actions_rbac.VolumesActionsV310RbacTest 77/73077/1
Cédric Ollivier [Mon, 6 Dec 2021 16:36:37 +0000 (17:36 +0100)]
Skip test_volume_actions_rbac.VolumesActionsV310RbacTest

It completes the previous patch.
http://artifacts.opnfv.org/functest/2BTYC9OZVCC2/functest-opnfv-functest-smoke-latest-patrole_member-run-188/patrole_member/tempest-report.html

Change-Id: I03d3a21e72c5bc5335d77b8ce972601f8d2d273a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip ZaqarSignalTransportTest in tempest_heat_cntt 74/73074/1
Cédric Ollivier [Mon, 6 Dec 2021 13:57:13 +0000 (14:57 +0100)]
Skip ZaqarSignalTransportTest in tempest_heat_cntt

CNTT doesn't ask for messaging service.
http://artifacts.opnfv.org/functest/Y2DWN1R2YMHV/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-171/tempest_heat_cntt/tempest-report.html

Change-Id: Ia51a195fc937184932a6daabf670e4646f300f53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoExlude programming issues in Patrole test cases 73/73073/1
Cédric Ollivier [Mon, 6 Dec 2021 13:47:37 +0000 (14:47 +0100)]
Exlude programming issues in Patrole test cases

http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_admin-run-187/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_member-run-187/patrole_member/tempest-report.html
http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_reader-run-187/patrole_reader/tempest-report.html

Change-Id: Icd494ed69efaea37818d5b63a9772c4625aa8e08
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip test_network_qos_placement in tempest_scenario_cntt 72/73072/1
Cédric Ollivier [Mon, 6 Dec 2021 09:40:36 +0000 (10:40 +0100)]
Skip test_network_qos_placement in tempest_scenario_cntt

http://artifacts.opnfv.org/functest/RWGPS2N4S9AK/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-198/tempest_scenario_cntt/tempest-report.html

Change-Id: Ife673af908294d9aaff3fcb08ea7569ad3f43bce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoIncrease tempest_full_cntt test_count 71/73071/1
Cédric Ollivier [Mon, 6 Dec 2021 09:38:29 +0000 (10:38 +0100)]
Increase tempest_full_cntt test_count

http://artifacts.opnfv.org/functest/KZZNYVZ3KXTC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-201/tempest_full_cntt/tempest-report.html

Change-Id: I4be720dfca3af4961951f095f834a1453e4d92a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip tempest_heat tests asking for messaging service 70/73070/1
Cédric Ollivier [Mon, 6 Dec 2021 09:37:05 +0000 (10:37 +0100)]
Skip tempest_heat tests asking for messaging service

http://artifacts.opnfv.org/functest/JVAWH4X6HW5U/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-170/tempest_heat_cntt/tempest-report.html

Change-Id: I69b5c796490447f4d6a271190c7b02c561d3bd25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoIncrease tempest_neutron_cntt test_count 69/73069/1
Cédric Ollivier [Mon, 6 Dec 2021 09:11:19 +0000 (10:11 +0100)]
Increase tempest_neutron_cntt test_count

http://artifacts.opnfv.org/functest/3JQK2X84WTCX/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-165/tempest_neutron_cntt/tempest-report.html

Change-Id: I0b534e096f13c3096e4c04cecf463deb245d99e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoTemporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access 67/73067/1
Cédric Ollivier [Sat, 4 Dec 2021 16:30:52 +0000 (17:30 +0100)]
Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access

Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoTemporarily remove CinderVolumeTypes.create_and_update_volume_type 63/73063/1
Cédric Ollivier [Fri, 3 Dec 2021 16:50:10 +0000 (17:50 +0100)]
Temporarily remove CinderVolumeTypes.create_and_update_volume_type

A few tests are linked to Cinder v2 which was dropped in Xena

Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoEnable RefStack back 60/73060/1
Cédric Ollivier [Fri, 26 Nov 2021 16:05:45 +0000 (17:05 +0100)]
Enable RefStack back

Change-Id: Ia87753bb12963c2da9515231b1241860546b7cfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFilter test_policy_minimum_bandwidth_rule_rbac in Patrole 56/73056/1
Cédric Ollivier [Thu, 25 Nov 2021 16:44:25 +0000 (17:44 +0100)]
Filter test_policy_minimum_bandwidth_rule_rbac in Patrole

https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html

Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoReduce Patrole test case lists 52/73052/1
Cédric Ollivier [Thu, 25 Nov 2021 13:37:10 +0000 (14:37 +0100)]
Reduce Patrole test case lists

They seem related to Patrole obsolescence

patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action
Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service.

Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoIncreate test_count in tempest_slow_cntt 51/73051/1
Cédric Ollivier [Thu, 25 Nov 2021 13:24:22 +0000 (14:24 +0100)]
Increate test_count in tempest_slow_cntt

http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html

Change-Id: I88446714338e46188f61bcac8967196c421f0edd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoIncreate test_count in tempest_full_cntt 50/73050/1
Cédric Ollivier [Thu, 25 Nov 2021 13:22:18 +0000 (14:22 +0100)]
Increate test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html

Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new image import related tests in CNTT 27/73027/1
Cédric Ollivier [Sat, 20 Nov 2021 10:28:47 +0000 (11:28 +0100)]
Skip new image import related tests in CNTT

This feature is optional in CNTT.

Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoTake hostname_fqdn_sanitization into account 26/73026/1
Cédric Ollivier [Sat, 20 Nov 2021 10:23:10 +0000 (11:23 +0100)]
Take hostname_fqdn_sanitization into account

It's skipped in CNTT as it's not enabled yet.

Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate linters and fix all new issues 15/73015/4
Cédric Ollivier [Wed, 10 Nov 2021 14:42:57 +0000 (15:42 +0100)]
Update linters and fix all new issues

It mostly add encoding in open calls and leverage f-strings.

Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate Xtesting to 0.93.0 13/73013/1
Cédric Ollivier [Tue, 9 Nov 2021 14:03:20 +0000 (15:03 +0100)]
Update Xtesting to 0.93.0

Change-Id: Idc5cc6d83d3f4f4786fae533bafeafc1ac9ea245
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSync requirements 06/73006/1
Cédric Ollivier [Mon, 8 Nov 2021 16:00:56 +0000 (17:00 +0100)]
Sync requirements

Change-Id: Id52449163a894bfb5e52c6d4e8c986c246a88a84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate RefStack test case descriptions 71/72971/1
Cédric Ollivier [Fri, 15 Oct 2021 12:50:24 +0000 (14:50 +0200)]
Update RefStack test case descriptions

RefStack now allows skip tests.

Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoFallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks" 34/72834/1
Cédric Ollivier [Wed, 18 Aug 2021 12:09:22 +0000 (14:09 +0200)]
Fallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks"

Bootable volume support (bump) is breaking cinder changes removing Cinder v3 [1].

[1] https://opendev.org/x/vmtp/commit/5ac228a575153e059e3d683d5e125415dd32e89f

Change-Id: Id71332f537203d45ad62dae13745f505f46734b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate pylint to latest stable 33/72833/1
Cédric Ollivier [Wed, 18 Aug 2021 11:11:02 +0000 (13:11 +0200)]
Update pylint to latest stable

It also stops filtering py27 which dropped for a while.

Change-Id: Idf19d1d90e0c753b6c05bbe77f3748027c2e0af5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwitch to provider_vlans public 32/72832/1
Cédric Ollivier [Wed, 18 Aug 2021 07:56:52 +0000 (09:56 +0200)]
Switch to provider_vlans public

It follows the new OpenStack gate configs.

Change-Id: I74ae08bf857f092012abab59e108128fc54ddea4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate to Alpine 3.14 26/72826/5
Cédric Ollivier [Thu, 12 Aug 2021 14:41:38 +0000 (16:41 +0200)]
Update to Alpine 3.14

It also fixes lots of new pylint warnings.

Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSelect Wallaby as CNTT baseline (Lakelse) 07/72807/1
Cédric Ollivier [Tue, 10 Aug 2021 10:06:14 +0000 (12:06 +0200)]
Select Wallaby as CNTT baseline (Lakelse)

Change-Id: I5637da29b3fa4c43e288ffb5f2306273a5bc2c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoUpdate README.md 25/72725/2
Cédric Ollivier [Wed, 30 Jun 2021 13:27:09 +0000 (15:27 +0200)]
Update README.md

It takes Wallaby into account

Change-Id: I529147fd2e80bcc4a19c786b46a0412b32f9ffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove distlib from constraints 60/72660/1
Cédric Ollivier [Thu, 10 Jun 2021 16:40:09 +0000 (18:40 +0200)]
Remove distlib from constraints

Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console

Change-Id: Ibec464eed800f5b9e7d55bff6bb02f1c43b15aff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoRemove six from Openstack requirements 87/72587/1
Cédric Ollivier [Wed, 26 May 2021 19:38:27 +0000 (21:38 +0200)]
Remove six from Openstack requirements

Attempting uninstall: six
  Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445

Change-Id: Id31393e9df11920ebebb13cfc4d9080c49a85e52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoAdd enchant in travis-ci 83/72583/3
Cédric Ollivier [Wed, 26 May 2021 14:43:29 +0000 (16:43 +0200)]
Add enchant in travis-ci

Change-Id: Ibbf0ecfc0b1e178a27a4981b10689f62fa103d62
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSwitch to focal in travis-ci gates 76/72576/3
Cédric Ollivier [Tue, 25 May 2021 14:13:05 +0000 (16:13 +0200)]
Switch to focal in travis-ci gates

Change-Id: Id6d1685762be5d81c5093c05f85c0cc36c234d76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 847a25ffe68aaa98e6101cd66e74144b6c25ea1e)

2 years agoSkip new Cinder rbac testing in CNTT 59/72559/1
Cédric Ollivier [Fri, 21 May 2021 16:36:05 +0000 (18:36 +0200)]
Skip new Cinder rbac testing in CNTT

Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Glance testing in CNTT 56/72556/1
Cédric Ollivier [Fri, 21 May 2021 13:05:19 +0000 (15:05 +0200)]
Skip new Glance testing in CNTT

They ask for features not mandatory in CNTT

Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2 years agoSkip new Keystone RBAC testing in CNTT 52/72552/1
Cédric Ollivier [Fri, 21 May 2021 12:52:51 +0000 (14:52 +0200)]
Skip new Keystone RBAC testing in CNTT

Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)

2 years agoSkip test_get_network_ip_availabilities 51/72551/1
Cédric Ollivier [Fri, 21 May 2021 12:12:02 +0000 (14:12 +0200)]
Skip test_get_network_ip_availabilities

http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html

Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case counts 48/72548/1
Cédric Ollivier [Wed, 19 May 2021 21:45:18 +0000 (23:45 +0200)]
Update test case counts

Change-Id: I5a10da026a98218496de36beb0a92d668514e336
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoConfigure dashboard.dashboard_url if tempest_slow 43/72543/2
Cédric Ollivier [Tue, 18 May 2021 17:21:53 +0000 (19:21 +0200)]
Configure dashboard.dashboard_url if tempest_slow

Tempest Horizon is now also executed in tempest_slow.

Change-Id: I910adc68eeb067d089b705feb794911afd1747e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix mkfs.ext4 path if Cirros 0.5 40/72540/1
Cédric Ollivier [Tue, 18 May 2021 12:00:01 +0000 (14:00 +0200)]
Fix mkfs.ext4 path if Cirros 0.5

Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDetect OpenStack ussuri 34/72534/1
Cédric Ollivier [Mon, 17 May 2021 14:02:52 +0000 (16:02 +0200)]
Detect OpenStack ussuri

Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test case counts in CNTT 33/72533/1
Cédric Ollivier [Mon, 17 May 2021 13:57:25 +0000 (15:57 +0200)]
Update test case counts in CNTT

Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)

3 years agoUpdate scenario img_file in tempest.conf 32/72532/1
Cédric Ollivier [Mon, 17 May 2021 11:13:18 +0000 (13:13 +0200)]
Update scenario img_file in tempest.conf

It's now an absolute filename [1].
It also updates the cirros version.

[1] https://github.com/openstack/barbican-tempest-plugin/commit/3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49

Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c068c042c8a9c02a7ba9c30257e897dab7705b2d)

3 years agoRefactor test_run_verifier_tests_default 23/72423/1
Cédric Ollivier [Tue, 20 Apr 2021 16:02:00 +0000 (18:02 +0200)]
Refactor test_run_verifier_tests_default

https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809

Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPin setuptools_scm===6.0.1 10/72410/1
Cédric Ollivier [Mon, 19 Apr 2021 16:39:31 +0000 (18:39 +0200)]
Pin setuptools_scm===6.0.1

https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console

Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit ff8546b16057e6a053ea54de0eac1a2229a7ec75)

3 years agoMove Functest on Raspberry PI to md 94/72094/1
Cédric Ollivier [Wed, 17 Feb 2021 22:41:42 +0000 (23:41 +0100)]
Move Functest on Raspberry PI to md

https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI

Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoTypos 79/72079/1
Cédric Ollivier [Wed, 17 Feb 2021 20:37:39 +0000 (21:37 +0100)]
Typos

Change-Id: Ib6972a88644913621dc376367821148286123e9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate INFO.yml 78/72078/2
Cédric Ollivier [Wed, 17 Feb 2021 20:30:00 +0000 (21:30 +0100)]
Update INFO.yml

Functest has been promoted as Mature.
Badly lots of contributors dropped.

Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFix typo 76/72076/1
Cédric Ollivier [Wed, 17 Feb 2021 19:47:33 +0000 (20:47 +0100)]
Fix typo

Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish former wiki page as README.md 73/72073/1
Cédric Ollivier [Wed, 17 Feb 2021 18:51:09 +0000 (19:51 +0100)]
Publish former wiki page as README.md

https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751

Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpgrade system first 37/72037/1
Cédric Ollivier [Sat, 13 Feb 2021 19:29:02 +0000 (20:29 +0100)]
Upgrade system first

Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agotempest_horizon has been merged into openstack/tempest 87/71987/2
Cédric Ollivier [Thu, 11 Feb 2021 14:13:00 +0000 (15:13 +0100)]
tempest_horizon has been merged into openstack/tempest

https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035

Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoForce ansible-lint===4.2.0 71/71971/1
Cédric Ollivier [Wed, 10 Feb 2021 22:46:47 +0000 (23:46 +0100)]
Force ansible-lint===4.2.0

Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoFollow new pip name resolver 58/71958/13
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Follow new pip name resolver

Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate to alpine:3.13 91/71791/1
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Update to alpine:3.13

Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate tempest_neutron test_count to 529 43/71743/1
Cédric Ollivier [Thu, 10 Dec 2020 21:31:32 +0000 (22:31 +0100)]
Update tempest_neutron test_count to 529

artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html

Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUse pip==20.2.4 in tox venv 29/71729/1
Cédric Ollivier [Thu, 10 Dec 2020 17:44:20 +0000 (18:44 +0100)]
Use pip==20.2.4 in tox venv

pip 20.3 is disruptive and would lead to big changes in stable
branches.

Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSet NEW_USER ROLE in tempest_heat classic user 16/71716/1
Cédric Ollivier [Thu, 10 Dec 2020 08:32:17 +0000 (09:32 +0100)]
Set NEW_USER ROLE in tempest_heat classic user

Else it fails when member is not the default role.

Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove all network data in Rally full tasks 01/71701/1
Cédric Ollivier [Wed, 9 Dec 2020 17:54:17 +0000 (18:54 +0100)]
Remove all network data in Rally full tasks

Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate Rally sanity tasks and blacklists for L2 only 00/71700/1
Cédric Ollivier [Wed, 9 Dec 2020 15:18:30 +0000 (16:18 +0100)]
Update Rally sanity tasks and blacklists for L2 only

This issues were hidden by Airship limitation (live-migration fails)

Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRally_jobs asks for Router in several tasks 89/71689/1
Cédric Ollivier [Wed, 9 Dec 2020 11:06:12 +0000 (12:06 +0100)]
Rally_jobs asks for Router in several tasks

NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).

As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]

[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports

Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoDon't filter vs NO_TENANT_NETWORK in CNTT testcases 88/71688/1
Cédric Ollivier [Wed, 9 Dec 2020 11:04:45 +0000 (12:04 +0100)]
Don't filter vs NO_TENANT_NETWORK in CNTT testcases

This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.

Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip test_minbw_allocation_placement added to tempest_scenario_cntt 84/71684/1
Cédric Ollivier [Tue, 8 Dec 2020 23:06:08 +0000 (00:06 +0100)]
Skip test_minbw_allocation_placement added to tempest_scenario_cntt

http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html

Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRather use rconfig.has_option() instead 78/71678/1
Cédric Ollivier [Tue, 8 Dec 2020 22:27:04 +0000 (23:27 +0100)]
Rather use rconfig.has_option() instead

It slightly increases py2 and py3 to ease next backports.

Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip create_and_update_routers if NO_TENANT_NETWORK 68/71668/1
Cédric Ollivier [Tue, 8 Dec 2020 17:11:06 +0000 (18:11 +0100)]
Skip create_and_update_routers if NO_TENANT_NETWORK

http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers

Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip Restack compute and platform if NO_TENANT_NETWORK 63/71663/1
Cédric Ollivier [Tue, 8 Dec 2020 17:00:42 +0000 (18:00 +0100)]
Skip Restack compute and platform if NO_TENANT_NETWORK

Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoConcat both dynamic and static roles in tempest.conf 51/71651/1
Cédric Ollivier [Tue, 8 Dec 2020 10:32:25 +0000 (11:32 +0100)]
Concat both dynamic and static roles in tempest.conf

It also moves all auth logic in a specific method.

Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove test_reset_network from Patrole test cases 43/71643/1
Cédric Ollivier [Mon, 7 Dec 2020 10:40:00 +0000 (11:40 +0100)]
Remove test_reset_network from Patrole test cases

Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service.

http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html

Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate NovaServers.boot_server_associate_and_dissociate_floating_ip 39/71639/1
Cédric Ollivier [Mon, 7 Dec 2020 08:00:02 +0000 (09:00 +0100)]
Update NovaServers.boot_server_associate_and_dissociate_floating_ip

It conforms with "Fix nova scenarios for assiciating fips" [1]

http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html

[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460

Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate test_count in tempest_full_cntt 35/71635/1
Cédric Ollivier [Sun, 6 Dec 2020 13:47:41 +0000 (14:47 +0100)]
Update test_count in tempest_full_cntt

http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html

Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove Rally Router testing if no tenant resources 25/71625/1
Cédric Ollivier [Fri, 4 Dec 2020 12:48:52 +0000 (13:48 +0100)]
Remove Rally Router testing if no tenant resources

It pleases airship which doesn't support neither routers and floating
ips.

Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop setting floating_ips in tempest_conf.yaml 19/71619/1
Cédric Ollivier [Fri, 4 Dec 2020 12:01:32 +0000 (13:01 +0100)]
Stop setting floating_ips in tempest_conf.yaml

It's now handled by tempest.py

Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove list_routers call if no tenant network 06/71606/1
Cédric Ollivier [Wed, 2 Dec 2020 16:34:06 +0000 (17:34 +0100)]
Remove list_routers call if no tenant network

Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoUpdate Shaker image as proposed in download.sh 04/71604/1
Cédric Ollivier [Wed, 2 Dec 2020 15:15:57 +0000 (16:15 +0100)]
Update Shaker image as proposed in download.sh

Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip a new upstream test in CNTT tempest_slow 76/71576/1
Cédric Ollivier [Tue, 1 Dec 2020 08:05:40 +0000 (09:05 +0100)]
Skip a new upstream test in CNTT tempest_slow

tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance

http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html

Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoPublish CNTT/OPNFV CI assets 63/71563/1
Cédric Ollivier [Mon, 30 Nov 2020 15:43:54 +0000 (16:43 +0100)]
Publish CNTT/OPNFV CI assets

It will be introduced to ORAN.
It's also available in [1]

[1] http://testresults.opnfv.org/functest/oran

Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip the tests now marked as buggy 61/71561/1
Cédric Ollivier [Sun, 29 Nov 2020 18:24:34 +0000 (19:24 +0100)]
Skip the tests now marked as buggy

tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding
Skipped until bug: https://launchpad.net/bugs/1905432 is resolved.

http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html

Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoClean obsolete OPNFV contraints. 55/71555/1
Cédric Ollivier [Sun, 29 Nov 2020 11:19:48 +0000 (12:19 +0100)]
Clean obsolete OPNFV contraints.

Most of the projects are closed or at best no longer integrated in
Functest features.

Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoStop duplicating connect_method 48/71548/1
Cédric Ollivier [Sat, 28 Nov 2020 09:27:37 +0000 (10:27 +0100)]
Stop duplicating connect_method

This config is now managed dynamically by tempest.py

Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoReplace git.openstack.org by opendev.org 41/71541/2
Cédric Ollivier [Fri, 27 Nov 2020 16:21:08 +0000 (17:21 +0100)]
Replace git.openstack.org by opendev.org

https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console

Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoProtect vs false detected external networks if l2-only 31/71531/1
Cédric Ollivier [Fri, 27 Nov 2020 12:26:46 +0000 (13:26 +0100)]
Protect vs false detected external networks if l2-only

Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRe-enable xrally_kubernetes master 29/71529/1
Cédric Ollivier [Fri, 27 Nov 2020 07:56:13 +0000 (08:56 +0100)]
Re-enable xrally_kubernetes master

It mostly reverts the following changes as xrally_kubernetes supports 12.0.0
- xrally_kubernetes fails vs kubernetes 12.0
- patch xrally_kubernetes for kubernetes 12"

https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090

Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoSkip dataplane benchmarkign if no tenant resources 23/71523/1
Cédric Ollivier [Thu, 26 Nov 2020 16:57:23 +0000 (17:57 +0100)]
Skip dataplane benchmarkign if no tenant resources

It asks for routers for instance.

Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
3 years agoRemove former allow_no_fip logic 17/71517/1
Cédric Ollivier [Thu, 26 Nov 2020 16:40:26 +0000 (17:40 +0100)]
Remove former allow_no_fip logic

Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>