Cédric Ollivier [Mon, 7 Nov 2022 10:23:38 +0000 (11:23 +0100)]
Skip test_compute_unified_limits in tempest_scenario_cntt
All new features are skipped until RA1 put it as mandatory
https://artifacts.opnfv.org/functest/3LQT9SQ6HYCM/functest-opnfv-functest-smoke-cntt-yoga-tempest_scenario_cntt-run-1/tempest_scenario_cntt/tempest-report.html
Change-Id: I5f2deeee408703ff2d82e0ca26dc0cdd5ef765ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
b1a0e9cdb0777e628ce303639c10f422048d4ec0)
Cédric Ollivier [Mon, 7 Nov 2022 10:17:33 +0000 (11:17 +0100)]
Decrease test count in tempest_heat_cntt
https://artifacts.opnfv.org/functest/Z5NOKCLXQA25/functest-opnfv-functest-smoke-cntt-yoga-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html
Change-Id: I95be34b107bc6e731031abae304f3acc6f090244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
ae2795f4fedf8a9765edd2aeeb909957416e680d)
Cédric Ollivier [Mon, 2 May 2022 12:59:22 +0000 (14:59 +0200)]
Filter local_ip testing
It's a new feature which has not been set
as mandatory by Anuket
Change-Id: Ib5d4cdc266b9db6c798dc3a1f27dc6c99012d534
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
ce625fb8c3a484139c3810b1e745f896b11e6b0d)
Cédric Ollivier [Tue, 25 Oct 2022 16:43:04 +0000 (18:43 +0200)]
Fix tags in Functest smoke
Change-Id: I3ac85a0e29ab831e3900e3566fa7178d27b4f028
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 Oct 2022 09:51:23 +0000 (11:51 +0200)]
Update Alpine version to 3.16
It's the latest stable version.
https://www.alpinelinux.org/posts/Alpine-3.16.0-released.html
Change-Id: I567bf68675e8de853aeb204c97994b08f3dda6c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 25 Apr 2022 08:40:27 +0000 (10:40 +0200)]
Prepare docker builds for yoga
Change-Id: Ieecfc7a51f7440b2c6f576df38922144173062d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 25 Apr 2022 08:39:50 +0000 (10:39 +0200)]
Set defaultbranch=yoga in .gitreview
Change-Id: I559f8c85e1e6e48816aa5779e1705f1e25b32655
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 4 Mar 2022 10:20:33 +0000 (11:20 +0100)]
Leverage xtesting 0.96.0
Change-Id: Ica7d7afb041d946dc25e37d736b07a3ad13c1ef7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 7 Feb 2022 13:42:34 +0000 (14:42 +0100)]
Fix incorrect robotframework-sshlibrary version
It's silent in Functest but breaks ONAP integration gates.
Co-Authored-By: Michal Jagiello <michal.jagiello@t-mobile.pl>
Change-Id: Id8a6a96f3311dc53b107877fe6c9f53a7a83fc77
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 11 Jan 2022 12:27:44 +0000 (13:27 +0100)]
Fix new enchant package name
https://packages.debian.org/fr/bullseye/enchant-2
Change-Id: Idc5d856a8be90852c94ca213c62922e7ba6b2585
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 5 Jan 2022 00:01:12 +0000 (01:01 +0100)]
Update Xtesting to 0.94.0
Change-Id: I34f816bedb7394034d3d149d496ab42fc18261bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 16:36:37 +0000 (17:36 +0100)]
Skip test_volume_actions_rbac.VolumesActionsV310RbacTest
It completes the previous patch.
http://artifacts.opnfv.org/functest/2BTYC9OZVCC2/functest-opnfv-functest-smoke-latest-patrole_member-run-188/patrole_member/tempest-report.html
Change-Id: I03d3a21e72c5bc5335d77b8ce972601f8d2d273a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 13:57:13 +0000 (14:57 +0100)]
Skip ZaqarSignalTransportTest in tempest_heat_cntt
CNTT doesn't ask for messaging service.
http://artifacts.opnfv.org/functest/Y2DWN1R2YMHV/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-171/tempest_heat_cntt/tempest-report.html
Change-Id: Ia51a195fc937184932a6daabf670e4646f300f53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 13:47:37 +0000 (14:47 +0100)]
Exlude programming issues in Patrole test cases
http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_admin-run-187/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_member-run-187/patrole_member/tempest-report.html
http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_reader-run-187/patrole_reader/tempest-report.html
Change-Id: Icd494ed69efaea37818d5b63a9772c4625aa8e08
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 09:40:36 +0000 (10:40 +0100)]
Skip test_network_qos_placement in tempest_scenario_cntt
http://artifacts.opnfv.org/functest/RWGPS2N4S9AK/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-198/tempest_scenario_cntt/tempest-report.html
Change-Id: Ife673af908294d9aaff3fcb08ea7569ad3f43bce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 09:38:29 +0000 (10:38 +0100)]
Increase tempest_full_cntt test_count
http://artifacts.opnfv.org/functest/KZZNYVZ3KXTC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-201/tempest_full_cntt/tempest-report.html
Change-Id: I4be720dfca3af4961951f095f834a1453e4d92a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 09:37:05 +0000 (10:37 +0100)]
Skip tempest_heat tests asking for messaging service
http://artifacts.opnfv.org/functest/JVAWH4X6HW5U/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-170/tempest_heat_cntt/tempest-report.html
Change-Id: I69b5c796490447f4d6a271190c7b02c561d3bd25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 6 Dec 2021 09:11:19 +0000 (10:11 +0100)]
Increase tempest_neutron_cntt test_count
http://artifacts.opnfv.org/functest/3JQK2X84WTCX/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-165/tempest_neutron_cntt/tempest-report.html
Change-Id: I0b534e096f13c3096e4c04cecf463deb245d99e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 4 Dec 2021 16:30:52 +0000 (17:30 +0100)]
Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access
Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 3 Dec 2021 16:50:10 +0000 (17:50 +0100)]
Temporarily remove CinderVolumeTypes.create_and_update_volume_type
A few tests are linked to Cinder v2 which was dropped in Xena
Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 26 Nov 2021 16:05:45 +0000 (17:05 +0100)]
Enable RefStack back
Change-Id: Ia87753bb12963c2da9515231b1241860546b7cfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 16:44:25 +0000 (17:44 +0100)]
Filter test_policy_minimum_bandwidth_rule_rbac in Patrole
https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html
Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 13:37:10 +0000 (14:37 +0100)]
Reduce Patrole test case lists
They seem related to Patrole obsolescence
patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action
Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service.
Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 13:24:22 +0000 (14:24 +0100)]
Increate test_count in tempest_slow_cntt
http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html
Change-Id: I88446714338e46188f61bcac8967196c421f0edd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 25 Nov 2021 13:22:18 +0000 (14:22 +0100)]
Increate test_count in tempest_full_cntt
http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html
Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 20 Nov 2021 10:28:47 +0000 (11:28 +0100)]
Skip new image import related tests in CNTT
This feature is optional in CNTT.
Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 20 Nov 2021 10:23:10 +0000 (11:23 +0100)]
Take hostname_fqdn_sanitization into account
It's skipped in CNTT as it's not enabled yet.
Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 10 Nov 2021 14:42:57 +0000 (15:42 +0100)]
Update linters and fix all new issues
It mostly add encoding in open calls and leverage f-strings.
Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 9 Nov 2021 14:03:20 +0000 (15:03 +0100)]
Update Xtesting to 0.93.0
Change-Id: Idc5cc6d83d3f4f4786fae533bafeafc1ac9ea245
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 8 Nov 2021 16:00:56 +0000 (17:00 +0100)]
Sync requirements
Change-Id: Id52449163a894bfb5e52c6d4e8c986c246a88a84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 15 Oct 2021 12:50:24 +0000 (14:50 +0200)]
Update RefStack test case descriptions
RefStack now allows skip tests.
Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Aug 2021 12:09:22 +0000 (14:09 +0200)]
Fallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks"
Bootable volume support (bump) is breaking cinder changes removing Cinder v3 [1].
[1] https://opendev.org/x/vmtp/commit/
5ac228a575153e059e3d683d5e125415dd32e89f
Change-Id: Id71332f537203d45ad62dae13745f505f46734b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Aug 2021 11:11:02 +0000 (13:11 +0200)]
Update pylint to latest stable
It also stops filtering py27 which dropped for a while.
Change-Id: Idf19d1d90e0c753b6c05bbe77f3748027c2e0af5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 18 Aug 2021 07:56:52 +0000 (09:56 +0200)]
Switch to provider_vlans public
It follows the new OpenStack gate configs.
Change-Id: I74ae08bf857f092012abab59e108128fc54ddea4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 12 Aug 2021 14:41:38 +0000 (16:41 +0200)]
Update to Alpine 3.14
It also fixes lots of new pylint warnings.
Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 10 Aug 2021 10:06:14 +0000 (12:06 +0200)]
Select Wallaby as CNTT baseline (Lakelse)
Change-Id: I5637da29b3fa4c43e288ffb5f2306273a5bc2c9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 30 Jun 2021 13:27:09 +0000 (15:27 +0200)]
Update README.md
It takes Wallaby into account
Change-Id: I529147fd2e80bcc4a19c786b46a0412b32f9ffb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Jun 2021 16:40:09 +0000 (18:40 +0200)]
Remove distlib from constraints
Else it fails when uninstalling distlib.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console
Change-Id: Ibec464eed800f5b9e7d55bff6bb02f1c43b15aff
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 May 2021 19:38:27 +0000 (21:38 +0200)]
Remove six from Openstack requirements
Attempting uninstall: six
Found existing installation: six 1.15.0
[91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.
https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445
Change-Id: Id31393e9df11920ebebb13cfc4d9080c49a85e52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 26 May 2021 14:43:29 +0000 (16:43 +0200)]
Add enchant in travis-ci
Change-Id: Ibbf0ecfc0b1e178a27a4981b10689f62fa103d62
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 25 May 2021 14:13:05 +0000 (16:13 +0200)]
Switch to focal in travis-ci gates
Change-Id: Id6d1685762be5d81c5093c05f85c0cc36c234d76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
847a25ffe68aaa98e6101cd66e74144b6c25ea1e)
Cédric Ollivier [Fri, 21 May 2021 16:36:05 +0000 (18:36 +0200)]
Skip new Cinder rbac testing in CNTT
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 May 2021 13:05:19 +0000 (15:05 +0200)]
Skip new Glance testing in CNTT
They ask for features not mandatory in CNTT
Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 21 May 2021 12:52:51 +0000 (14:52 +0200)]
Skip new Keystone RBAC testing in CNTT
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
c2d68b7235efca6743350b362daf63cc9960775b)
Cédric Ollivier [Fri, 21 May 2021 12:12:02 +0000 (14:12 +0200)]
Skip test_get_network_ip_availabilities
http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html
http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html
Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 19 May 2021 21:45:18 +0000 (23:45 +0200)]
Update test case counts
Change-Id: I5a10da026a98218496de36beb0a92d668514e336
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 18 May 2021 17:21:53 +0000 (19:21 +0200)]
Configure dashboard.dashboard_url if tempest_slow
Tempest Horizon is now also executed in tempest_slow.
Change-Id: I910adc68eeb067d089b705feb794911afd1747e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 18 May 2021 12:00:01 +0000 (14:00 +0200)]
Fix mkfs.ext4 path if Cirros 0.5
Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 May 2021 14:02:52 +0000 (16:02 +0200)]
Detect OpenStack ussuri
Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 17 May 2021 13:57:25 +0000 (15:57 +0200)]
Update test case counts in CNTT
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
e0af292db068072a1b08879e32fd871237009fcf)
Cédric Ollivier [Mon, 17 May 2021 11:13:18 +0000 (13:13 +0200)]
Update scenario img_file in tempest.conf
It's now an absolute filename [1].
It also updates the cirros version.
[1] https://github.com/openstack/barbican-tempest-plugin/commit/
3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49
Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
c068c042c8a9c02a7ba9c30257e897dab7705b2d)
Cédric Ollivier [Tue, 20 Apr 2021 16:02:00 +0000 (18:02 +0200)]
Refactor test_run_verifier_tests_default
https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/
4e3262ab-3adf-4539-839c-
eddd49bcc2c1/jobs/809
Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 19 Apr 2021 16:39:31 +0000 (18:39 +0200)]
Pin setuptools_scm===6.0.1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console
Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit
21f5124676edb73f76cc819554f074d40d791eda)
(cherry picked from commit
ff8546b16057e6a053ea54de0eac1a2229a7ec75)
Cédric Ollivier [Wed, 17 Feb 2021 22:41:42 +0000 (23:41 +0100)]
Move Functest on Raspberry PI to md
https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI
Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 20:37:39 +0000 (21:37 +0100)]
Typos
Change-Id: Ib6972a88644913621dc376367821148286123e9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 20:30:00 +0000 (21:30 +0100)]
Update INFO.yml
Functest has been promoted as Mature.
Badly lots of contributors dropped.
Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 19:47:33 +0000 (20:47 +0100)]
Fix typo
Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 17 Feb 2021 18:51:09 +0000 (19:51 +0100)]
Publish former wiki page as README.md
https://wiki.opnfv.org/pages/viewpage.action?pageId=
13211751
Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 13 Feb 2021 19:29:02 +0000 (20:29 +0100)]
Upgrade system first
Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 11 Feb 2021 14:13:00 +0000 (15:13 +0100)]
tempest_horizon has been merged into openstack/tempest
https://github.com/openstack/tempest-horizon/commit/
6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035
Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 10 Feb 2021 22:46:47 +0000 (23:46 +0100)]
Force ansible-lint===4.2.0
Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Follow new pip name resolver
Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 21 Jan 2021 15:52:50 +0000 (16:52 +0100)]
Update to alpine:3.13
Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Dec 2020 21:31:32 +0000 (22:31 +0100)]
Update tempest_neutron test_count to 529
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html
Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Dec 2020 17:44:20 +0000 (18:44 +0100)]
Use pip==20.2.4 in tox venv
pip 20.3 is disruptive and would lead to big changes in stable
branches.
Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 10 Dec 2020 08:32:17 +0000 (09:32 +0100)]
Set NEW_USER ROLE in tempest_heat classic user
Else it fails when member is not the default role.
Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 17:54:17 +0000 (18:54 +0100)]
Remove all network data in Rally full tasks
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 15:18:30 +0000 (16:18 +0100)]
Update Rally sanity tasks and blacklists for L2 only
This issues were hidden by Airship limitation (live-migration fails)
Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 11:06:12 +0000 (12:06 +0100)]
Rally_jobs asks for Router in several tasks
NeutronNetworks.create_and_list_ports can be executed when no L3 if
the appropriate params are passed (see rally_sanity and rally_full).
As rally_jobs is an official task which shouldn't be changed, it
simply skips rally_jobs rather than
NeutronNetworks.create_and_list_ports [1]
[1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports
Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 9 Dec 2020 11:04:45 +0000 (12:04 +0100)]
Don't filter vs NO_TENANT_NETWORK in CNTT testcases
This param is incorrect from a CNTT point of view.
It only filters test cases in classical IaaS verification containers.
Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 23:06:08 +0000 (00:06 +0100)]
Skip test_minbw_allocation_placement added to tempest_scenario_cntt
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html
Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 22:27:04 +0000 (23:27 +0100)]
Rather use rconfig.has_option() instead
It slightly increases py2 and py3 to ease next backports.
Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 17:11:06 +0000 (18:11 +0100)]
Skip create_and_update_routers if NO_TENANT_NETWORK
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers
Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 17:00:42 +0000 (18:00 +0100)]
Skip Restack compute and platform if NO_TENANT_NETWORK
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 8 Dec 2020 10:32:25 +0000 (11:32 +0100)]
Concat both dynamic and static roles in tempest.conf
It also moves all auth logic in a specific method.
Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 7 Dec 2020 10:40:00 +0000 (11:40 +0100)]
Remove test_reset_network from Patrole test cases
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service.
http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html
Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 7 Dec 2020 08:00:02 +0000 (09:00 +0100)]
Update NovaServers.boot_server_associate_and_dissociate_floating_ip
It conforms with "Fix nova scenarios for assiciating fips" [1]
http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html
[1] https://github.com/openstack/rally-openstack/commit/
ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460
Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 6 Dec 2020 13:47:41 +0000 (14:47 +0100)]
Update test_count in tempest_full_cntt
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html
Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 4 Dec 2020 12:48:52 +0000 (13:48 +0100)]
Remove Rally Router testing if no tenant resources
It pleases airship which doesn't support neither routers and floating
ips.
Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 4 Dec 2020 12:01:32 +0000 (13:01 +0100)]
Stop setting floating_ips in tempest_conf.yaml
It's now handled by tempest.py
Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 2 Dec 2020 16:34:06 +0000 (17:34 +0100)]
Remove list_routers call if no tenant network
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Wed, 2 Dec 2020 15:15:57 +0000 (16:15 +0100)]
Update Shaker image as proposed in download.sh
Change-Id: I408a462274245e927b382e008ba146603d82b2e2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 1 Dec 2020 08:05:40 +0000 (09:05 +0100)]
Skip a new upstream test in CNTT tempest_slow
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance
http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html
Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 30 Nov 2020 15:43:54 +0000 (16:43 +0100)]
Publish CNTT/OPNFV CI assets
It will be introduced to ORAN.
It's also available in [1]
[1] http://testresults.opnfv.org/functest/oran
Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 29 Nov 2020 18:24:34 +0000 (19:24 +0100)]
Skip the tests now marked as buggy
tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding
Skipped until bug: https://launchpad.net/bugs/
1905432 is resolved.
http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html
Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 29 Nov 2020 11:19:48 +0000 (12:19 +0100)]
Clean obsolete OPNFV contraints.
Most of the projects are closed or at best no longer integrated in
Functest features.
Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sat, 28 Nov 2020 09:27:37 +0000 (10:27 +0100)]
Stop duplicating connect_method
This config is now managed dynamically by tempest.py
Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Nov 2020 16:21:08 +0000 (17:21 +0100)]
Replace git.openstack.org by opendev.org
https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console
Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Nov 2020 12:26:46 +0000 (13:26 +0100)]
Protect vs false detected external networks if l2-only
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Fri, 27 Nov 2020 07:56:13 +0000 (08:56 +0100)]
Re-enable xrally_kubernetes master
It mostly reverts the following changes as xrally_kubernetes supports 12.0.0
- xrally_kubernetes fails vs kubernetes 12.0
- patch xrally_kubernetes for kubernetes 12"
https://github.com/xrally/xrally-kubernetes/commit/
2ffa85af2bff3438b6b23034b6ec6ee1de481090
Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 16:57:23 +0000 (17:57 +0100)]
Skip dataplane benchmarkign if no tenant resources
It asks for routers for instance.
Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 16:40:26 +0000 (17:40 +0100)]
Remove former allow_no_fip logic
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 16:31:58 +0000 (17:31 +0100)]
Allow running cloudify without tenant network resources.
It fits the Airship deployment where there is neither tenant networks
nor floating ips. It skips all VNF test cases as they ask for tenant
resources.
Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Thu, 26 Nov 2020 14:55:51 +0000 (15:55 +0100)]
Allow running tempest without tenant network resources.
It fits the Airship deployment where there is neither tenant networks
nor floating ips. It only updates the scenarios and must be completed
by other changes for all the advanced testcases (Rally, Tempest, etc)
Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Tue, 24 Nov 2020 10:26:23 +0000 (11:26 +0100)]
Remove rtd-requirements.txt
It's now useless (snaps was removed).
Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Nov 2020 15:48:26 +0000 (16:48 +0100)]
Slightly update tempest_conf
It completes "Update CNTT regex according to latest tempest changes" [1]
[1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464
Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Nov 2020 14:43:44 +0000 (15:43 +0100)]
Remove snaps from rtd requirements
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Mon, 23 Nov 2020 09:11:15 +0000 (10:11 +0100)]
Update CNTT regex according to latest tempest changes
It skips all the new feature testing untill they are mandatory in CNTT
- [compute_feature_enabled] xenapi_apis [1]
- [identity_feature_enabled] access_rules [2]
- [image_feature_enabled] import_image [3]
- [volume_feature_enabled] extend_attached_encrypted_volume [4]
[1] https://review.opendev.org/c/openstack/tempest/+/749527
[2] https://review.opendev.org/c/openstack/tempest/+/699519
[3] https://review.opendev.org/c/openstack/tempest/+/742546
[4] https://review.opendev.org/c/openstack/tempest/+/706904
Change-Id: I161360f882138b46da56b78084a70b244cd1c53d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Nov 2020 21:31:01 +0000 (22:31 +0100)]
Update test count in tempest_heat_cntt
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html
Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Cédric Ollivier [Sun, 22 Nov 2020 16:34:04 +0000 (17:34 +0100)]
Disable refstack platform and compute
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1]
"Metadata is read-only on non-Xen-based deployments."
[1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html
Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Code Review / functest.git / log